2023-10-06T10:43:05.634 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T10:43:05.634 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371 --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371/orig.config.yaml 2023-10-06T10:43:05.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T10:43:05.757 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371 branch: wip-yuri3-testing-2023-10-05-0943-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} email: yweinste@redhat.com first_in_suite: false job_id: '7412371' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri3-testing-2023-10-05-0943-quincy ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-10-05-0943-quincy sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4002 sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri3-testing-2023-10-05-0943-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPmUNiI/du+DjhAlXQqDXZHtSBNrzErqwHdIF4I4HEoabQNYe2dN39WN6tRc+KGGK3RQYjnZAflyfpBIDOwwxvQ= smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOausg9QGYOUb+3nlDjpaqaYFRu/skUFfldx5MhhbcPoS5Loddu2QNq0FlmG+37CgvpmltbfDLC8l+xDYcsFi+E= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:54:57 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T10:43:05.758 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa; will attempt to use it 2023-10-06T10:43:05.758 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa/tasks 2023-10-06T10:43:05.758 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T10:43:05.760 INFO:teuthology.task.internal:Checking packages... 2023-10-06T10:43:05.780 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564' 2023-10-06T10:43:05.780 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T10:43:05.780 INFO:teuthology.packaging:ref: None 2023-10-06T10:43:05.780 INFO:teuthology.packaging:tag: None 2023-10-06T10:43:05.781 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T10:43:05.781 INFO:teuthology.packaging:sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T10:43:05.782 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T10:43:05.915 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1274.g68e53a4a 2023-10-06T10:43:05.916 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T10:43:05.922 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T10:43:05.922 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T10:43:05.955 INFO:teuthology.task.internal:Saving configuration 2023-10-06T10:43:05.969 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T10:43:05.988 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T10:43:06.019 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 10:38:15.585821', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPmUNiI/du+DjhAlXQqDXZHtSBNrzErqwHdIF4I4HEoabQNYe2dN39WN6tRc+KGGK3RQYjnZAflyfpBIDOwwxvQ='} 2023-10-06T10:43:06.041 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 10:38:15.587177', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOausg9QGYOUb+3nlDjpaqaYFRu/skUFfldx5MhhbcPoS5Loddu2QNq0FlmG+37CgvpmltbfDLC8l+xDYcsFi+E='} 2023-10-06T10:43:06.041 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T10:43:06.047 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T10:43:06.047 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T10:43:06.047 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T10:43:06.135 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f12cf8a2b80>, signals=[15]) 2023-10-06T10:43:06.135 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T10:43:06.140 INFO:teuthology.task.internal:Opening connections... 2023-10-06T10:43:06.141 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T10:43:06.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:43:06.211 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T10:43:06.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:43:06.280 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T10:43:06.286 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2023-10-06T10:43:06.309 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2023-10-06T10:43:06.310 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2023-10-06T10:43:06.371 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2023-10-06T10:43:06.372 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8" 2023-10-06T10:43:06.372 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2023-10-06T10:43:06.372 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2023-10-06T10:43:06.372 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8" 2023-10-06T10:43:06.372 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8" 2023-10-06T10:43:06.372 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-06T10:43:06.372 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2023-10-06T10:43:06.372 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-06T10:43:06.372 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2023-10-06T10:43:06.372 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T10:43:06.373 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T10:43:06.373 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-06T10:43:06.373 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-10-06T10:43:06.399 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-10-06T10:43:06.422 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-10-06T10:43:06.423 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-10-06T10:43:06.484 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2023-10-06T10:43:06.485 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8" 2023-10-06T10:43:06.485 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2023-10-06T10:43:06.485 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2023-10-06T10:43:06.485 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8" 2023-10-06T10:43:06.485 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2023-10-06T10:43:06.485 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-06T10:43:06.485 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-10-06T10:43:06.485 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-06T10:43:06.485 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2023-10-06T10:43:06.485 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T10:43:06.486 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T10:43:06.486 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-06T10:43:06.486 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-10-06T10:43:06.540 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T10:43:06.549 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T10:43:06.596 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T10:43:06.597 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2023-10-06T10:43:06.599 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2023-10-06T10:43:06.620 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T10:43:06.626 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T10:43:06.626 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2023-10-06T10:43:06.661 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2023-10-06T10:43:06.696 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T10:43:06.751 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T10:43:06.765 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-06T10:43:06.765 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-06T10:43:06.765 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T10:43:06.766 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T10:43:06.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T10:43:06.787 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2023-10-06T10:43:06.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T10:43:06.788 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-10-06T10:43:06.849 INFO:teuthology.orchestra.run.smithi007.stdout:4.18.0-489.el8.x86_64 2023-10-06T10:43:06.849 INFO:teuthology.task.kernel:Running kernel on smithi007: 4.18.0-489.el8.x86_64 2023-10-06T10:43:06.849 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum install -y kernel 2023-10-06T10:43:06.851 INFO:teuthology.orchestra.run.smithi050.stdout:4.18.0-489.el8.x86_64 2023-10-06T10:43:06.851 INFO:teuthology.task.kernel:Running kernel on smithi050: 4.18.0-489.el8.x86_64 2023-10-06T10:43:06.851 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum install -y kernel 2023-10-06T10:43:18.470 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 8 - AppStream 3.7 MB/s | 33 MB 00:09 2023-10-06T10:43:18.679 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 8 - AppStream 3.6 MB/s | 33 MB 00:09 2023-10-06T10:43:25.878 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 8 - BaseOS 54 MB/s | 48 MB 00:00 2023-10-06T10:43:26.021 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 8 - BaseOS 52 MB/s | 48 MB 00:00 2023-10-06T10:43:33.704 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 8 - Extras 43 kB/s | 18 kB 00:00 2023-10-06T10:43:33.803 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 8 - Extras 33 kB/s | 18 kB 00:00 2023-10-06T10:43:34.263 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 6.9 kB 00:00 2023-10-06T10:43:34.378 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2023-10-06T10:43:34.564 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-06T10:43:34.688 INFO:teuthology.orchestra.run.smithi007.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-06T10:43:35.724 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-10-06T10:43:36.306 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-06T10:43:39.757 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 559 kB/s | 24 kB 00:00 2023-10-06T10:43:40.372 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 450 kB/s | 24 kB 00:00 2023-10-06T10:43:43.598 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-06T10:43:43.598 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-06T10:43:43.871 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-06T10:43:43.872 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-06T10:43:43.872 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-10-06T10:43:43.872 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-06T10:43:43.872 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-06T10:43:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-06T10:43:43.873 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-06T10:43:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-06T10:43:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-06T10:43:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:43:43.873 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-06T10:43:43.873 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-06T10:43:43.873 INFO:teuthology.orchestra.run.smithi050.stdout:Install 3 Packages 2023-10-06T10:43:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:43:43.874 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 88 M 2023-10-06T10:43:43.874 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 96 M 2023-10-06T10:43:43.874 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-06T10:43:44.138 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-06T10:43:44.139 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-06T10:43:44.184 INFO:teuthology.orchestra.run.smithi050.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 37 MB/s | 10 MB 00:00 2023-10-06T10:43:44.406 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-10-06T10:43:44.407 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-10-06T10:43:44.407 INFO:teuthology.orchestra.run.smithi007.stdout: Package Architecture Version Repository Size 2023-10-06T10:43:44.407 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-10-06T10:43:44.408 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-10-06T10:43:44.408 INFO:teuthology.orchestra.run.smithi007.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-06T10:43:44.408 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-10-06T10:43:44.408 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-06T10:43:44.408 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-06T10:43:44.408 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:43:44.408 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-10-06T10:43:44.408 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-10-06T10:43:44.408 INFO:teuthology.orchestra.run.smithi007.stdout:Install 3 Packages 2023-10-06T10:43:44.408 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:43:44.409 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 88 M 2023-10-06T10:43:44.409 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 96 M 2023-10-06T10:43:44.409 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-10-06T10:43:44.601 INFO:teuthology.orchestra.run.smithi050.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 52 MB/s | 35 MB 00:00 2023-10-06T10:43:44.713 INFO:teuthology.orchestra.run.smithi007.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 38 MB/s | 10 MB 00:00 2023-10-06T10:43:45.034 INFO:teuthology.orchestra.run.smithi050.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 38 MB/s | 43 MB 00:01 2023-10-06T10:43:45.034 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-06T10:43:45.035 INFO:teuthology.orchestra.run.smithi050.stdout:Total 76 MB/s | 88 MB 00:01 2023-10-06T10:43:45.166 INFO:teuthology.orchestra.run.smithi007.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 49 MB/s | 35 MB 00:00 2023-10-06T10:43:45.599 INFO:teuthology.orchestra.run.smithi007.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 37 MB/s | 43 MB 00:01 2023-10-06T10:43:45.600 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-10-06T10:43:45.600 INFO:teuthology.orchestra.run.smithi007.stdout:Total 74 MB/s | 88 MB 00:01 2023-10-06T10:43:45.740 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-06T10:43:46.167 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-06T10:43:46.167 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-06T10:43:46.306 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-10-06T10:43:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-10-06T10:43:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-10-06T10:43:47.455 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-06T10:43:47.477 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-06T10:43:48.049 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-10-06T10:43:48.067 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-10-06T10:43:50.387 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-06T10:43:50.982 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-10-06T10:43:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-06T10:43:51.533 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-06T10:43:54.671 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-06T10:43:55.092 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-06T10:43:55.287 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-06T10:43:55.682 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-06T10:43:58.722 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-06T10:43:59.017 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-06T10:43:59.303 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-06T10:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-06T10:44:22.151 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-06T10:44:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-06T10:44:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-06T10:44:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-06T10:44:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-06T10:44:22.881 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-06T10:44:22.905 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-06T10:44:23.276 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-06T10:44:23.276 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:44:23.276 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-06T10:44:23.277 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-06T10:44:23.277 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-06T10:44:23.277 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:44:23.277 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-06T10:44:23.280 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-06T10:44:23.280 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-06T10:44:23.280 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-06T10:44:23.409 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T10:44:23.680 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-06T10:44:23.680 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-06T10:44:23.680 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-06T10:44:23.680 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T10:44:23.680 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T10:44:23.680 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-06T10:44:23.681 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T10:44:23.681 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T10:44:23.897 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-06T10:44:23.898 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-06T10:44:23.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2023-10-06T10:44:23.932 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2023-10-06T10:44:23.932 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2023-10-06T10:44:23.932 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.02 2023-10-06T10:44:23.932 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 129.el8 2023-10-06T10:44:23.933 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2023-10-06T10:44:23.933 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-06T10:44:23.933 INFO:teuthology.orchestra.run.smithi050.stdout:Group : System Environment/Base 2023-10-06T10:44:23.933 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 9265586 2023-10-06T10:44:23.933 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2023-10-06T10:44:23.933 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-06T10:44:23.933 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-06T10:44:23.933 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-06T10:44:23.933 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-06T10:44:23.933 INFO:teuthology.orchestra.run.smithi050.stdout:Relocations : (not relocatable) 2023-10-06T10:44:23.933 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : CentOS BuildSystem 2023-10-06T10:44:23.934 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : CentOS 2023-10-06T10:44:23.934 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T10:44:23.934 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2023-10-06T10:44:23.934 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2023-10-06T10:44:23.934 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:44:23.934 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T10:44:23.934 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T10:44:23.934 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T10:44:23.934 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2023-10-06T10:44:23.934 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:44:23.934 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T10:44:23.935 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T10:44:23.935 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 4.18.0-514.el8.x86_64 2023-10-06T10:44:23.936 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T10:44:23.993 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-06T10:44:23.993 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:44:23.993 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-10-06T10:44:23.993 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-06T10:44:23.993 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-06T10:44:23.993 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:44:23.993 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-10-06T10:44:24.969 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T10:44:25.196 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-06T10:44:25.197 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-06T10:44:25.197 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-06T10:44:25.197 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T10:44:25.197 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T10:44:25.197 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-06T10:44:25.197 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi007.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T10:44:25.197 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T10:44:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2023-10-06T10:44:25.415 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-06T10:44:25.415 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-06T10:44:25.415 DEBUG:teuthology.orchestra.run.smithi007:> sudo rpm -qi grub2-tools 2023-10-06T10:44:25.450 INFO:teuthology.orchestra.run.smithi007.stdout:Name : grub2-tools 2023-10-06T10:44:25.450 INFO:teuthology.orchestra.run.smithi007.stdout:Epoch : 1 2023-10-06T10:44:25.450 INFO:teuthology.orchestra.run.smithi007.stdout:Version : 2.02 2023-10-06T10:44:25.450 INFO:teuthology.orchestra.run.smithi007.stdout:Release : 129.el8 2023-10-06T10:44:25.450 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: x86_64 2023-10-06T10:44:25.450 INFO:teuthology.orchestra.run.smithi007.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-06T10:44:25.450 INFO:teuthology.orchestra.run.smithi007.stdout:Group : System Environment/Base 2023-10-06T10:44:25.451 INFO:teuthology.orchestra.run.smithi007.stdout:Size : 9265586 2023-10-06T10:44:25.451 INFO:teuthology.orchestra.run.smithi007.stdout:License : GPLv3+ 2023-10-06T10:44:25.451 INFO:teuthology.orchestra.run.smithi007.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-06T10:44:25.451 INFO:teuthology.orchestra.run.smithi007.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-06T10:44:25.451 INFO:teuthology.orchestra.run.smithi007.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-06T10:44:25.451 INFO:teuthology.orchestra.run.smithi007.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-06T10:44:25.451 INFO:teuthology.orchestra.run.smithi007.stdout:Relocations : (not relocatable) 2023-10-06T10:44:25.451 INFO:teuthology.orchestra.run.smithi007.stdout:Packager : CentOS BuildSystem 2023-10-06T10:44:25.451 INFO:teuthology.orchestra.run.smithi007.stdout:Vendor : CentOS 2023-10-06T10:44:25.451 INFO:teuthology.orchestra.run.smithi007.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T10:44:25.451 INFO:teuthology.orchestra.run.smithi007.stdout:Summary : Support tools for GRUB. 2023-10-06T10:44:25.451 INFO:teuthology.orchestra.run.smithi007.stdout:Description : 2023-10-06T10:44:25.452 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:44:25.452 INFO:teuthology.orchestra.run.smithi007.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T10:44:25.452 INFO:teuthology.orchestra.run.smithi007.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T10:44:25.452 INFO:teuthology.orchestra.run.smithi007.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T10:44:25.452 INFO:teuthology.orchestra.run.smithi007.stdout:hardware devices. 2023-10-06T10:44:25.452 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:44:25.452 INFO:teuthology.orchestra.run.smithi007.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T10:44:25.453 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T10:44:25.453 INFO:teuthology.task.kernel:Updating grub on smithi007 to boot 4.18.0-514.el8.x86_64 2023-10-06T10:44:25.453 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T10:44:26.607 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2023-10-06T10:44:27.515 INFO:teuthology.orchestra.run.smithi050.stderr:done 2023-10-06T10:44:27.517 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-10-06T10:44:27.538 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.k2g6TubHP6 2023-10-06T10:44:27.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.k2g6TubHP6 2023-10-06T10:44:27.611 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.k2g6TubHP6 2023-10-06T10:44:27.759 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.k2g6TubHP6 is 6KB 2023-10-06T10:44:27.808 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.k2g6TubHP6 2023-10-06T10:44:27.825 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T10:44:27.891 INFO:teuthology.orchestra.run.smithi050.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-06T10:44:27.892 INFO:teuthology.orchestra.run.smithi050.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-06T10:44:27.892 INFO:teuthology.orchestra.run.smithi050.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-06T10:44:27.892 INFO:teuthology.orchestra.run.smithi050.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-06T10:44:27.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-06T10:44:28.071 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2023-10-06T10:44:28.745 INFO:teuthology.orchestra.run.smithi007.stderr:done 2023-10-06T10:44:28.747 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2023-10-06T10:44:28.771 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.hwRSsATMCn 2023-10-06T10:44:28.771 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hwRSsATMCn 2023-10-06T10:44:28.844 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.hwRSsATMCn 2023-10-06T10:44:29.001 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.hwRSsATMCn is 6KB 2023-10-06T10:44:29.024 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.hwRSsATMCn 2023-10-06T10:44:29.042 DEBUG:teuthology.orchestra.run.smithi007:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T10:44:29.123 INFO:teuthology.orchestra.run.smithi007.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-06T10:44:29.123 INFO:teuthology.orchestra.run.smithi007.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-06T10:44:29.123 INFO:teuthology.orchestra.run.smithi007.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-06T10:44:29.123 INFO:teuthology.orchestra.run.smithi007.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-06T10:44:29.124 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-06T10:44:29.297 DEBUG:teuthology.orchestra.run.smithi007:> sudo shutdown -r now 2023-10-06T10:44:58.102 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-06T10:44:58.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-06T10:44:58.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:44:59.301 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-06T10:44:59.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-10-06T10:44:59.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:45:16.538 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-10-06T10:45:17.818 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-06T10:45:25.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-06T10:45:25.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:45:26.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-10-06T10:45:26.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:46:25.608 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T10:46:26.825 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T10:46:37.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-06T10:46:37.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:46:37.912 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-10-06T10:46:38.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-06T10:46:38.231 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-514.el8.x86_64"... 2023-10-06T10:46:38.231 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-10-06T10:46:38.254 INFO:teuthology.orchestra.run.smithi050.stdout:4.18.0-514.el8.x86_64 2023-10-06T10:46:38.254 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-06T10:46:38.254 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T10:46:38.254 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-06T10:46:38.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-10-06T10:46:38.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:46:39.201 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-10-06T10:46:39.255 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-06T10:46:39.255 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T10:46:39.338 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2023-10-06T10:46:39.349 DEBUG:teuthology.parallel:result is None 2023-10-06T10:46:39.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-10-06T10:46:39.513 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-514.el8.x86_64"... 2023-10-06T10:46:39.514 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2023-10-06T10:46:39.536 INFO:teuthology.orchestra.run.smithi007.stdout:4.18.0-514.el8.x86_64 2023-10-06T10:46:39.537 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-06T10:46:39.537 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T10:46:39.537 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-06T10:46:40.538 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-06T10:46:40.538 DEBUG:teuthology.orchestra.run.smithi007:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T10:46:40.617 INFO:teuthology.orchestra.run.smithi007.stdout:ttyS1 2023-10-06T10:46:40.630 DEBUG:teuthology.parallel:result is None 2023-10-06T10:46:40.630 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T10:46:40.638 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T10:46:40.638 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T10:46:40.640 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T10:46:40.663 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T10:46:40.672 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T10:46:40.713 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T10:46:40.713 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T10:46:40.716 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T10:46:40.757 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T10:46:40.768 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T10:46:40.768 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T10:46:40.794 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T10:46:40.834 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T10:46:40.841 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T10:46:40.847 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T10:46:40.854 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T10:46:40.855 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T10:46:40.864 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T10:46:40.864 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T10:46:40.892 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T10:46:40.930 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T10:46:40.943 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T10:46:40.943 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T10:46:40.968 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T10:46:40.992 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T10:46:41.076 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T10:46:41.146 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T10:46:41.193 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T10:46:41.246 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:46:41.246 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T10:46:41.321 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T10:46:41.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T10:46:41.429 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T10:46:41.522 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T10:46:41.571 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:46:41.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T10:46:41.647 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2023-10-06T10:46:41.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2023-10-06T10:46:41.710 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T10:46:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T10:46:42.036 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T10:46:42.046 INFO:teuthology.task.internal:Starting timer... 2023-10-06T10:46:42.046 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T10:46:42.105 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T10:46:42.152 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T10:46:42.152 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2023-10-06T10:46:42.238 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: 2023-10-06T10:46:42.240 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2023-10-06T10:46:42.335 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2023-10-06T10:46:42.337 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T10:46:42.337 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2023-10-06T10:46:42.388 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2023-10-06T10:46:42.389 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2023-10-06T10:46:42.434 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2023-10-06T10:46:42.434 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi050.front.sepia.ceph.com': 'permissive'} 2023-10-06T10:46:42.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T10:46:42.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T10:46:42.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T10:46:42.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T10:46:42.507 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T10:46:42.507 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2023-10-06T10:46:42.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2023-10-06T10:46:42.582 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T10:46:42.593 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-06T10:46:42.593 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T10:46:42.609 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T10:46:42.610 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi050.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T10:54:56.758 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi050.front.sepia.ceph.com')] 2023-10-06T10:54:56.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-10-06T10:54:56.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:54:56.832 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-10-06T10:54:56.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-10-06T10:54:56.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-06T10:54:56.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:54:56.979 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-10-06T10:54:57.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-06T10:54:57.054 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T10:54:57.066 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T10:54:57.066 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T10:54:57.066 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T10:54:57.069 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T10:54:57.069 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T10:54:57.108 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T10:54:57.125 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T10:54:57.135 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T10:54:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T10:54:57.201 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2023-10-06T10:54:57.215 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2023-10-06T10:54:57.223 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2023-10-06T10:54:57.231 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T10:54:57.236 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2023-10-06T10:54:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T10:54:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T10:54:57.268 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T10:54:57.316 INFO:teuthology.orchestra.run.smithi007.stderr:bash: ntpq: command not found 2023-10-06T10:54:57.320 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T10:54:57.320 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2023-10-06T10:54:57.321 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T10:54:57.321 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T10:54:57.321 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T10:54:57.321 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T10:54:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:bash: ntpq: command not found 2023-10-06T10:54:57.341 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T10:54:57.341 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-10-06T10:54:57.341 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T10:54:57.341 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T10:54:57.341 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T10:54:57.341 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T10:54:57.342 INFO:teuthology.run_tasks:Running task install... 2023-10-06T10:54:57.351 DEBUG:teuthology.task.install:project ceph 2023-10-06T10:54:57.351 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}} 2023-10-06T10:54:57.351 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'} 2023-10-06T10:54:57.351 INFO:teuthology.task.install:Using flavor: default 2023-10-06T10:54:57.357 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T10:54:57.357 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T10:54:57.357 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T10:54:57.358 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T10:54:57.360 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T10:54:57.360 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T10:54:57.507 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T10:54:57.507 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T10:54:57.575 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T10:54:57.575 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T10:54:57.942 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T10:54:57.942 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:54:57.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T10:54:57.979 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T10:54:57.979 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T10:54:57.990 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T10:54:57.990 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:54:57.990 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T10:54:58.026 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T10:54:58.026 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T10:54:58.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T10:54:58.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T10:54:58.143 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T10:54:58.176 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2023-10-06T10:54:58.178 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2023-10-06T10:54:58.192 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T10:54:58.224 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2023-10-06T10:54:58.226 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2023-10-06T10:54:58.497 INFO:teuthology.orchestra.run.smithi007.stdout:76 files removed 2023-10-06T10:54:58.530 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T10:54:58.549 INFO:teuthology.orchestra.run.smithi050.stdout:76 files removed 2023-10-06T10:54:58.585 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T10:54:59.750 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 104 kB/s | 78 kB 00:00 2023-10-06T10:54:59.783 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 108 kB/s | 78 kB 00:00 2023-10-06T10:55:00.408 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 16 kB/s | 9.2 kB 00:00 2023-10-06T10:55:00.525 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 13 kB/s | 9.2 kB 00:00 2023-10-06T10:55:01.125 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 2.1 kB/s | 1.4 kB 00:00 2023-10-06T10:55:01.334 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 1.9 kB/s | 1.4 kB 00:00 2023-10-06T10:55:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 8 - AppStream 4.9 MB/s | 33 MB 00:06 2023-10-06T10:55:09.034 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 8 - AppStream 4.2 MB/s | 33 MB 00:07 2023-10-06T10:55:15.893 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 8 - BaseOS 52 MB/s | 48 MB 00:00 2023-10-06T10:55:17.052 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 8 - BaseOS 41 MB/s | 48 MB 00:01 2023-10-06T10:55:23.710 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 8 - Extras 124 kB/s | 18 kB 00:00 2023-10-06T10:55:24.144 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 8 - Extras common packages 30 kB/s | 6.9 kB 00:00 2023-10-06T10:55:24.935 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 8 - Extras 59 kB/s | 18 kB 00:00 2023-10-06T10:55:25.494 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 6.9 kB 00:00 2023-10-06T10:55:25.528 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 8 - PowerTools 5.3 MB/s | 6.5 MB 00:01 2023-10-06T10:55:26.920 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 8 - PowerTools 5.2 MB/s | 6.5 MB 00:01 2023-10-06T10:55:27.138 INFO:teuthology.orchestra.run.smithi007.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-06T10:55:28.588 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-10-06T10:55:29.467 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 16 MB 00:02 2023-10-06T10:55:30.889 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 7.5 MB/s | 16 MB 00:02 2023-10-06T10:55:33.722 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 390 kB/s | 24 kB 00:00 2023-10-06T10:55:35.147 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 395 kB/s | 24 kB 00:00 2023-10-06T10:55:38.370 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T10:55:38.371 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T10:55:38.386 INFO:teuthology.orchestra.run.smithi007.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-06T10:55:38.386 INFO:teuthology.orchestra.run.smithi007.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-06T10:55:38.387 INFO:teuthology.orchestra.run.smithi007.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-06T10:55:38.388 INFO:teuthology.orchestra.run.smithi007.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-06T10:55:38.389 INFO:teuthology.orchestra.run.smithi007.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T10:55:38.391 INFO:teuthology.orchestra.run.smithi007.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T10:55:38.395 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-06T10:55:38.396 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-06T10:55:38.635 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-10-06T10:55:38.651 INFO:teuthology.orchestra.run.smithi007.stdout:==================================================================================================== 2023-10-06T10:55:38.651 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-10-06T10:55:38.651 INFO:teuthology.orchestra.run.smithi007.stdout:==================================================================================================== 2023-10-06T10:55:38.651 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-10-06T10:55:38.651 INFO:teuthology.orchestra.run.smithi007.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-06T10:55:38.652 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T10:55:38.652 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T10:55:38.652 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T10:55:38.652 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T10:55:38.652 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T10:55:38.652 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T10:55:38.652 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T10:55:38.652 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T10:55:38.652 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T10:55:38.652 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T10:55:38.652 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T10:55:38.653 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T10:55:38.653 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T10:55:38.653 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T10:55:38.653 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T10:55:38.653 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-06T10:55:38.653 INFO:teuthology.orchestra.run.smithi007.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-06T10:55:38.653 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-10-06T10:55:38.653 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T10:55:38.653 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T10:55:38.653 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T10:55:38.653 INFO:teuthology.orchestra.run.smithi007.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-10-06T10:55:38.654 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-10-06T10:55:38.654 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-06T10:55:38.654 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T10:55:38.654 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T10:55:38.654 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T10:55:38.654 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T10:55:38.654 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T10:55:38.654 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T10:55:38.654 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T10:55:38.654 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-10-06T10:55:38.654 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2023-10-06T10:55:38.655 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-06T10:55:38.655 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-06T10:55:38.655 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-06T10:55:38.655 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-06T10:55:38.655 INFO:teuthology.orchestra.run.smithi007.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-06T10:55:38.655 INFO:teuthology.orchestra.run.smithi007.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-06T10:55:38.655 INFO:teuthology.orchestra.run.smithi007.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-06T10:55:38.655 INFO:teuthology.orchestra.run.smithi007.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-06T10:55:38.655 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T10:55:38.655 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T10:55:38.655 INFO:teuthology.orchestra.run.smithi007.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-06T10:55:38.656 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-06T10:55:38.656 INFO:teuthology.orchestra.run.smithi007.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-06T10:55:38.656 INFO:teuthology.orchestra.run.smithi007.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-06T10:55:38.656 INFO:teuthology.orchestra.run.smithi007.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-10-06T10:55:38.656 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-10-06T10:55:38.656 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-10-06T10:55:38.656 INFO:teuthology.orchestra.run.smithi007.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-10-06T10:55:38.656 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T10:55:38.656 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T10:55:38.656 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T10:55:38.656 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T10:55:38.657 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T10:55:38.657 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T10:55:38.657 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T10:55:38.657 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T10:55:38.657 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-06T10:55:38.657 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T10:55:38.657 INFO:teuthology.orchestra.run.smithi007.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-06T10:55:38.657 INFO:teuthology.orchestra.run.smithi007.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-06T10:55:38.657 INFO:teuthology.orchestra.run.smithi007.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-06T10:55:38.657 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T10:55:38.657 INFO:teuthology.orchestra.run.smithi007.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-06T10:55:38.657 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-06T10:55:38.658 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T10:55:38.658 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-06T10:55:38.658 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-06T10:55:38.658 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T10:55:38.658 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-06T10:55:38.658 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T10:55:38.658 INFO:teuthology.orchestra.run.smithi007.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-06T10:55:38.658 INFO:teuthology.orchestra.run.smithi007.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-06T10:55:38.658 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T10:55:38.658 INFO:teuthology.orchestra.run.smithi007.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-06T10:55:38.658 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-06T10:55:38.659 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-06T10:55:38.659 INFO:teuthology.orchestra.run.smithi007.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-06T10:55:38.659 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-06T10:55:38.659 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-06T10:55:38.659 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-06T10:55:38.659 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-06T10:55:38.659 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-06T10:55:38.659 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T10:55:38.659 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-10-06T10:55:38.659 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T10:55:38.659 INFO:teuthology.orchestra.run.smithi007.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T10:55:38.660 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T10:55:38.660 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T10:55:38.660 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T10:55:38.660 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T10:55:38.660 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-06T10:55:38.660 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T10:55:38.660 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T10:55:38.660 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-06T10:55:38.660 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T10:55:38.660 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T10:55:38.660 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T10:55:38.661 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-10-06T10:55:38.661 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-06T10:55:38.661 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-06T10:55:38.661 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-06T10:55:38.661 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T10:55:38.661 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T10:55:38.661 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-06T10:55:38.661 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-06T10:55:38.661 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T10:55:38.661 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T10:55:38.661 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-06T10:55:38.661 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-06T10:55:38.662 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-06T10:55:38.662 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T10:55:38.662 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T10:55:38.662 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-06T10:55:38.662 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-06T10:55:38.662 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-06T10:55:38.662 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-06T10:55:38.662 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-06T10:55:38.662 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-06T10:55:38.662 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T10:55:38.662 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-06T10:55:38.662 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T10:55:38.663 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T10:55:38.663 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-06T10:55:38.663 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T10:55:38.663 INFO:teuthology.orchestra.run.smithi007.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T10:55:38.663 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T10:55:38.663 INFO:teuthology.orchestra.run.smithi007.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T10:55:38.663 INFO:teuthology.orchestra.run.smithi007.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T10:55:38.663 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T10:55:38.663 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T10:55:38.663 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T10:55:38.663 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-06T10:55:38.664 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T10:55:38.664 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-06T10:55:38.664 INFO:teuthology.orchestra.run.smithi007.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T10:55:38.664 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-06T10:55:38.664 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-06T10:55:38.664 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:55:38.664 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-10-06T10:55:38.664 INFO:teuthology.orchestra.run.smithi007.stdout:==================================================================================================== 2023-10-06T10:55:38.664 INFO:teuthology.orchestra.run.smithi007.stdout:Install 123 Packages 2023-10-06T10:55:38.664 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 16 Packages 2023-10-06T10:55:38.664 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:55:38.665 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 209 M 2023-10-06T10:55:38.665 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-10-06T10:55:39.582 INFO:teuthology.orchestra.run.smithi007.stdout:(1/139): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 16 kB/s | 6.4 kB 00:00 2023-10-06T10:55:39.841 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T10:55:39.842 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T10:55:39.857 INFO:teuthology.orchestra.run.smithi050.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-06T10:55:39.857 INFO:teuthology.orchestra.run.smithi050.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-06T10:55:39.858 INFO:teuthology.orchestra.run.smithi050.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-06T10:55:39.859 INFO:teuthology.orchestra.run.smithi050.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-06T10:55:39.860 INFO:teuthology.orchestra.run.smithi050.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T10:55:39.862 INFO:teuthology.orchestra.run.smithi050.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T10:55:39.865 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-06T10:55:39.866 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-06T10:55:40.106 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-06T10:55:40.121 INFO:teuthology.orchestra.run.smithi050.stdout:==================================================================================================== 2023-10-06T10:55:40.121 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-06T10:55:40.121 INFO:teuthology.orchestra.run.smithi050.stdout:==================================================================================================== 2023-10-06T10:55:40.121 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-06T10:55:40.121 INFO:teuthology.orchestra.run.smithi050.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-06T10:55:40.122 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T10:55:40.122 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T10:55:40.122 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T10:55:40.122 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T10:55:40.122 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T10:55:40.122 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T10:55:40.122 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T10:55:40.123 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T10:55:40.123 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T10:55:40.123 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T10:55:40.123 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T10:55:40.123 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T10:55:40.123 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T10:55:40.123 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T10:55:40.124 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T10:55:40.124 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-06T10:55:40.124 INFO:teuthology.orchestra.run.smithi050.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-06T10:55:40.124 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-10-06T10:55:40.124 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T10:55:40.124 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T10:55:40.125 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T10:55:40.125 INFO:teuthology.orchestra.run.smithi050.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-10-06T10:55:40.125 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-10-06T10:55:40.125 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-06T10:55:40.125 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T10:55:40.125 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T10:55:40.125 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T10:55:40.126 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T10:55:40.126 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T10:55:40.126 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T10:55:40.126 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T10:55:40.126 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-10-06T10:55:40.126 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2023-10-06T10:55:40.126 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-06T10:55:40.127 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-06T10:55:40.127 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-06T10:55:40.127 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-06T10:55:40.127 INFO:teuthology.orchestra.run.smithi050.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-06T10:55:40.127 INFO:teuthology.orchestra.run.smithi050.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-06T10:55:40.127 INFO:teuthology.orchestra.run.smithi050.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-06T10:55:40.127 INFO:teuthology.orchestra.run.smithi050.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-06T10:55:40.127 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T10:55:40.128 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T10:55:40.128 INFO:teuthology.orchestra.run.smithi050.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-06T10:55:40.128 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-06T10:55:40.128 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-06T10:55:40.128 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-06T10:55:40.128 INFO:teuthology.orchestra.run.smithi050.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-10-06T10:55:40.128 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-10-06T10:55:40.129 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-06T10:55:40.129 INFO:teuthology.orchestra.run.smithi050.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-10-06T10:55:40.129 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T10:55:40.129 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T10:55:40.129 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T10:55:40.129 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T10:55:40.129 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T10:55:40.130 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T10:55:40.130 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T10:55:40.130 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T10:55:40.130 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-06T10:55:40.130 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T10:55:40.130 INFO:teuthology.orchestra.run.smithi050.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-06T10:55:40.130 INFO:teuthology.orchestra.run.smithi050.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-06T10:55:40.130 INFO:teuthology.orchestra.run.smithi050.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-06T10:55:40.130 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T10:55:40.131 INFO:teuthology.orchestra.run.smithi050.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-06T10:55:40.131 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-06T10:55:40.131 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T10:55:40.131 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-06T10:55:40.131 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-06T10:55:40.131 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T10:55:40.131 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-06T10:55:40.131 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T10:55:40.131 INFO:teuthology.orchestra.run.smithi050.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-06T10:55:40.131 INFO:teuthology.orchestra.run.smithi050.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-06T10:55:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T10:55:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-06T10:55:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-06T10:55:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-06T10:55:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-06T10:55:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-06T10:55:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-06T10:55:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-06T10:55:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-06T10:55:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-06T10:55:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T10:55:40.133 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-10-06T10:55:40.133 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T10:55:40.133 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T10:55:40.133 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T10:55:40.133 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T10:55:40.133 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T10:55:40.133 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T10:55:40.133 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-06T10:55:40.133 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T10:55:40.133 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T10:55:40.133 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-06T10:55:40.134 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T10:55:40.134 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T10:55:40.134 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T10:55:40.134 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-10-06T10:55:40.134 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-06T10:55:40.134 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-06T10:55:40.134 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-06T10:55:40.134 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T10:55:40.134 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T10:55:40.134 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-06T10:55:40.135 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-06T10:55:40.135 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T10:55:40.135 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T10:55:40.135 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-06T10:55:40.135 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-06T10:55:40.135 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-06T10:55:40.135 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T10:55:40.135 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T10:55:40.135 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-06T10:55:40.135 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-06T10:55:40.135 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-06T10:55:40.136 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-06T10:55:40.136 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-06T10:55:40.136 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-06T10:55:40.136 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T10:55:40.136 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-06T10:55:40.136 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T10:55:40.136 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T10:55:40.136 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-06T10:55:40.136 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T10:55:40.136 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T10:55:40.136 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T10:55:40.136 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T10:55:40.137 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T10:55:40.137 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T10:55:40.137 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T10:55:40.137 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T10:55:40.137 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-06T10:55:40.137 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T10:55:40.137 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-06T10:55:40.137 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T10:55:40.137 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-06T10:55:40.137 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-06T10:55:40.137 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:55:40.137 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-06T10:55:40.138 INFO:teuthology.orchestra.run.smithi050.stdout:==================================================================================================== 2023-10-06T10:55:40.138 INFO:teuthology.orchestra.run.smithi050.stdout:Install 123 Packages 2023-10-06T10:55:40.138 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 16 Packages 2023-10-06T10:55:40.138 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:55:40.138 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 209 M 2023-10-06T10:55:40.138 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-06T10:55:40.607 INFO:teuthology.orchestra.run.smithi007.stdout:(2/139): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 856 kB/s | 877 kB 00:01 2023-10-06T10:55:40.815 INFO:teuthology.orchestra.run.smithi007.stdout:(3/139): ceph-immutable-object-cache-17.2.6-127 777 kB/s | 162 kB 00:00 2023-10-06T10:55:40.924 INFO:teuthology.orchestra.run.smithi050.stdout:(1/139): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 17 kB/s | 6.4 kB 00:00 2023-10-06T10:55:42.024 INFO:teuthology.orchestra.run.smithi050.stdout:(2/139): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 798 kB/s | 877 kB 00:01 2023-10-06T10:55:42.741 INFO:teuthology.orchestra.run.smithi050.stdout:(3/139): ceph-immutable-object-cache-17.2.6-127 225 kB/s | 162 kB 00:00 2023-10-06T10:55:42.849 INFO:teuthology.orchestra.run.smithi007.stdout:(4/139): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 1.4 MB/s | 5.2 MB 00:03 2023-10-06T10:55:43.149 INFO:teuthology.orchestra.run.smithi007.stdout:(5/139): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 1.0 MB/s | 2.3 MB 00:02 2023-10-06T10:55:43.866 INFO:teuthology.orchestra.run.smithi050.stdout:(4/139): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 1.6 MB/s | 5.2 MB 00:03 2023-10-06T10:55:44.183 INFO:teuthology.orchestra.run.smithi050.stdout:(5/139): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 1.6 MB/s | 2.3 MB 00:01 2023-10-06T10:55:44.241 INFO:teuthology.orchestra.run.smithi007.stdout:(6/139): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 1.1 MB/s | 1.6 MB 00:01 2023-10-06T10:55:44.725 INFO:teuthology.orchestra.run.smithi050.stdout:(6/139): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 1.8 MB/s | 1.6 MB 00:00 2023-10-06T10:55:45.500 INFO:teuthology.orchestra.run.smithi050.stdout:(7/139): ceph-common-17.2.6-1274.g68e53a4a.el8. 4.7 MB/s | 23 MB 00:04 2023-10-06T10:55:46.192 INFO:teuthology.orchestra.run.smithi050.stdout:(8/139): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 2.0 MB/s | 3.9 MB 00:02 2023-10-06T10:55:46.300 INFO:teuthology.orchestra.run.smithi050.stdout:(9/139): ceph-selinux-17.2.6-1274.g68e53a4a.el8 224 kB/s | 24 kB 00:00 2023-10-06T10:55:46.841 INFO:teuthology.orchestra.run.smithi007.stdout:(7/139): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 1.1 MB/s | 3.9 MB 00:03 2023-10-06T10:55:49.332 INFO:teuthology.orchestra.run.smithi050.stdout:(10/139): ceph-radosgw-17.2.6-1274.g68e53a4a.el 4.4 MB/s | 17 MB 00:03 2023-10-06T10:55:49.450 INFO:teuthology.orchestra.run.smithi050.stdout:(11/139): cephfs-mirror-17.2.6-1274.g68e53a4a.e 2.1 MB/s | 255 kB 00:00 2023-10-06T10:55:49.593 INFO:teuthology.orchestra.run.smithi050.stdout:(12/139): libcephfs-devel-17.2.6-1274.g68e53a4a 175 kB/s | 25 kB 00:00 2023-10-06T10:55:49.901 INFO:teuthology.orchestra.run.smithi050.stdout:(13/139): libcephfs2-17.2.6-1274.g68e53a4a.el8. 2.5 MB/s | 797 kB 00:00 2023-10-06T10:55:50.035 INFO:teuthology.orchestra.run.smithi050.stdout:(14/139): libcephsqlite-17.2.6-1274.g68e53a4a.e 1.3 MB/s | 175 kB 00:00 2023-10-06T10:55:50.041 INFO:teuthology.orchestra.run.smithi007.stdout:(8/139): ceph-common-17.2.6-1274.g68e53a4a.el8. 2.2 MB/s | 23 MB 00:10 2023-10-06T10:55:50.133 INFO:teuthology.orchestra.run.smithi007.stdout:(9/139): ceph-selinux-17.2.6-1274.g68e53a4a.el8 266 kB/s | 24 kB 00:00 2023-10-06T10:55:50.144 INFO:teuthology.orchestra.run.smithi050.stdout:(15/139): librados-devel-17.2.6-1274.g68e53a4a. 1.2 MB/s | 130 kB 00:00 2023-10-06T10:55:50.360 INFO:teuthology.orchestra.run.smithi050.stdout:(16/139): libradosstriper1-17.2.6-1274.g68e53a4 2.3 MB/s | 506 kB 00:00 2023-10-06T10:55:54.277 INFO:teuthology.orchestra.run.smithi050.stdout:(17/139): librgw2-17.2.6-1274.g68e53a4a.el8.x86 1.4 MB/s | 5.6 MB 00:03 2023-10-06T10:55:54.402 INFO:teuthology.orchestra.run.smithi050.stdout:(18/139): python3-ceph-argparse-17.2.6-1274.g68 357 kB/s | 45 kB 00:00 2023-10-06T10:55:54.511 INFO:teuthology.orchestra.run.smithi050.stdout:(19/139): python3-ceph-common-17.2.6-1274.g68e5 1.0 MB/s | 115 kB 00:00 2023-10-06T10:55:54.636 INFO:teuthology.orchestra.run.smithi050.stdout:(20/139): python3-cephfs-17.2.6-1274.g68e53a4a. 1.5 MB/s | 190 kB 00:00 2023-10-06T10:55:54.937 INFO:teuthology.orchestra.run.smithi050.stdout:(21/139): ceph-osd-17.2.6-1274.g68e53a4a.el8.x8 1.6 MB/s | 17 MB 00:10 2023-10-06T10:55:54.970 INFO:teuthology.orchestra.run.smithi050.stdout:(22/139): python3-rados-17.2.6-1274.g68e53a4a.e 1.1 MB/s | 371 kB 00:00 2023-10-06T10:55:55.163 INFO:teuthology.orchestra.run.smithi050.stdout:(23/139): python3-rbd-17.2.6-1274.g68e53a4a.el8 1.6 MB/s | 358 kB 00:00 2023-10-06T10:55:55.188 INFO:teuthology.orchestra.run.smithi050.stdout:(24/139): python3-rgw-17.2.6-1274.g68e53a4a.el8 491 kB/s | 107 kB 00:00 2023-10-06T10:55:55.271 INFO:teuthology.orchestra.run.smithi050.stdout:(25/139): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 836 kB/s | 91 kB 00:00 2023-10-06T10:55:55.380 INFO:teuthology.orchestra.run.smithi050.stdout:(26/139): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 1.6 MB/s | 173 kB 00:00 2023-10-06T10:55:55.480 INFO:teuthology.orchestra.run.smithi050.stdout:(27/139): ceph-grafana-dashboards-17.2.6-1274.g 230 kB/s | 23 kB 00:00 2023-10-06T10:55:55.739 INFO:teuthology.orchestra.run.smithi050.stdout:(28/139): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 469 kB/s | 121 kB 00:00 2023-10-06T10:55:56.631 INFO:teuthology.orchestra.run.smithi050.stdout:(29/139): ceph-mgr-dashboard-17.2.6-1274.g68e53 1.9 MB/s | 1.7 MB 00:00 2023-10-06T10:55:56.765 INFO:teuthology.orchestra.run.smithi050.stdout:(30/139): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 2.2 MB/s | 3.5 MB 00:01 2023-10-06T10:55:56.890 INFO:teuthology.orchestra.run.smithi050.stdout:(31/139): ceph-mgr-modules-core-17.2.6-1274.g68 1.9 MB/s | 238 kB 00:00 2023-10-06T10:55:56.990 INFO:teuthology.orchestra.run.smithi050.stdout:(32/139): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 473 kB/s | 47 kB 00:00 2023-10-06T10:55:57.091 INFO:teuthology.orchestra.run.smithi050.stdout:(33/139): ceph-prometheus-alerts-17.2.6-1274.g6 145 kB/s | 14 kB 00:00 2023-10-06T10:55:57.291 INFO:teuthology.orchestra.run.smithi050.stdout:(34/139): ceph-volume-17.2.6-1274.g68e53a4a.el8 1.3 MB/s | 267 kB 00:00 2023-10-06T10:55:57.399 INFO:teuthology.orchestra.run.smithi050.stdout:(35/139): cephadm-17.2.6-1274.g68e53a4a.el8.noa 742 kB/s | 80 kB 00:00 2023-10-06T10:55:57.517 INFO:teuthology.orchestra.run.smithi050.stdout:(36/139): cephfs-top-17.2.6-1274.g68e53a4a.el8. 153 kB/s | 18 kB 00:00 2023-10-06T10:55:57.650 INFO:teuthology.orchestra.run.smithi050.stdout:(37/139): automake-1.16.1-8.el8.noarch.rpm 5.4 MB/s | 740 kB 00:00 2023-10-06T10:55:57.734 INFO:teuthology.orchestra.run.smithi050.stdout:(38/139): bison-3.0.4-10.el8.x86_64.rpm 8.1 MB/s | 688 kB 00:00 2023-10-06T10:55:57.776 INFO:teuthology.orchestra.run.smithi050.stdout:(39/139): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-06T10:55:57.818 INFO:teuthology.orchestra.run.smithi050.stdout:(40/139): jq-1.6-7.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-06T10:55:57.860 INFO:teuthology.orchestra.run.smithi050.stdout:(41/139): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-06T10:55:57.952 INFO:teuthology.orchestra.run.smithi050.stdout:(42/139): libtool-2.4.6-25.el8.x86_64.rpm 7.5 MB/s | 709 kB 00:00 2023-10-06T10:55:58.002 INFO:teuthology.orchestra.run.smithi050.stdout:(43/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-10-06T10:55:58.036 INFO:teuthology.orchestra.run.smithi050.stdout:(44/139): oniguruma-6.8.2-2.el8.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2023-10-06T10:55:58.228 INFO:teuthology.orchestra.run.smithi050.stdout:(45/139): openblas-0.3.15-4.el8.x86_64.rpm 25 MB/s | 4.7 MB 00:00 2023-10-06T10:55:58.420 INFO:teuthology.orchestra.run.smithi050.stdout:(46/139): openblas-threads-0.3.15-4.el8.x86_64. 25 MB/s | 4.9 MB 00:00 2023-10-06T10:55:58.637 INFO:teuthology.orchestra.run.smithi050.stdout:(47/139): python3-babel-2.5.1-7.el8.noarch.rpm 22 MB/s | 4.8 MB 00:00 2023-10-06T10:55:58.687 INFO:teuthology.orchestra.run.smithi050.stdout:(48/139): python3-jinja2-2.10.1-3.el8.noarch.rp 11 MB/s | 538 kB 00:00 2023-10-06T10:55:58.721 INFO:teuthology.orchestra.run.smithi050.stdout:(49/139): python3-jsonpatch-1.21-2.el8.noarch.r 799 kB/s | 27 kB 00:00 2023-10-06T10:55:58.754 INFO:teuthology.orchestra.run.smithi050.stdout:(50/139): python3-jsonpointer-1.10-11.el8.noarc 601 kB/s | 20 kB 00:00 2023-10-06T10:55:58.797 INFO:teuthology.orchestra.run.smithi050.stdout:(51/139): python3-mako-1.0.6-14.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-10-06T10:55:58.838 INFO:teuthology.orchestra.run.smithi050.stdout:(52/139): python3-markupsafe-0.23-19.el8.x86_64 930 kB/s | 39 kB 00:00 2023-10-06T10:55:58.980 INFO:teuthology.orchestra.run.smithi050.stdout:(53/139): python3-numpy-1.14.3-10.el8.x86_64.rp 26 MB/s | 3.7 MB 00:00 2023-10-06T10:55:59.022 INFO:teuthology.orchestra.run.smithi050.stdout:(54/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-06T10:55:59.056 INFO:teuthology.orchestra.run.smithi050.stdout:(55/139): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-10-06T10:55:59.115 INFO:teuthology.orchestra.run.smithi050.stdout:(56/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2023-10-06T10:55:59.157 INFO:teuthology.orchestra.run.smithi050.stdout:(57/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.0 MB/s | 126 kB 00:00 2023-10-06T10:55:59.198 INFO:teuthology.orchestra.run.smithi050.stdout:(58/139): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-10-06T10:55:59.224 INFO:teuthology.orchestra.run.smithi050.stdout:(59/139): python3-pytz-2017.2-11.el8.noarch.rpm 2.2 MB/s | 57 kB 00:00 2023-10-06T10:55:59.733 INFO:teuthology.orchestra.run.smithi050.stdout:(60/139): python3-scipy-1.0.0-21.module_el8.5.0 27 MB/s | 14 MB 00:00 2023-10-06T10:55:59.817 INFO:teuthology.orchestra.run.smithi050.stdout:(61/139): python3-werkzeug-0.12.2-4.el8.noarch. 5.4 MB/s | 457 kB 00:00 2023-10-06T10:55:59.858 INFO:teuthology.orchestra.run.smithi050.stdout:(62/139): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-10-06T10:55:59.883 INFO:teuthology.orchestra.run.smithi050.stdout:(63/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 71 kB 00:00 2023-10-06T10:55:59.951 INFO:teuthology.orchestra.run.smithi050.stdout:(64/139): elfutils-libelf-devel-0.189-3.el8.x86 924 kB/s | 62 kB 00:00 2023-10-06T10:56:00.018 INFO:teuthology.orchestra.run.smithi050.stdout:(65/139): fuse-2.9.7-17.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2023-10-06T10:56:00.051 INFO:teuthology.orchestra.run.smithi050.stdout:(66/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.4 MB/s | 48 kB 00:00 2023-10-06T10:56:00.101 INFO:teuthology.orchestra.run.smithi050.stdout:(67/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 11 MB/s | 561 kB 00:00 2023-10-06T10:56:00.135 INFO:teuthology.orchestra.run.smithi050.stdout:(68/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 561 kB/s | 19 kB 00:00 2023-10-06T10:56:00.169 INFO:teuthology.orchestra.run.smithi050.stdout:(69/139): libcom_err-devel-1.45.6-5.el8.x86_64. 1.1 MB/s | 39 kB 00:00 2023-10-06T10:56:00.252 INFO:teuthology.orchestra.run.smithi050.stdout:(70/139): libgfortran-8.5.0-20.el8.x86_64.rpm 7.6 MB/s | 645 kB 00:00 2023-10-06T10:56:00.344 INFO:teuthology.orchestra.run.smithi050.stdout:(71/139): ceph-mgr-diskprediction-local-17.2.6- 2.0 MB/s | 7.4 MB 00:03 2023-10-06T10:56:00.369 INFO:teuthology.orchestra.run.smithi050.stdout:(72/139): libquadmath-8.5.0-20.el8.x86_64.rpm 1.4 MB/s | 172 kB 00:00 2023-10-06T10:56:00.403 INFO:teuthology.orchestra.run.smithi050.stdout:(73/139): libselinux-devel-2.9-8.el8.x86_64.rpm 5.9 MB/s | 200 kB 00:00 2023-10-06T10:56:00.462 INFO:teuthology.orchestra.run.smithi050.stdout:(74/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 399 kB/s | 47 kB 00:00 2023-10-06T10:56:00.495 INFO:teuthology.orchestra.run.smithi050.stdout:(75/139): libsepol-devel-2.9-3.el8.x86_64.rpm 945 kB/s | 87 kB 00:00 2023-10-06T10:56:00.521 INFO:teuthology.orchestra.run.smithi050.stdout:(76/139): libuuid-devel-2.32.1-43.el8.x86_64.rp 1.7 MB/s | 100 kB 00:00 2023-10-06T10:56:00.546 INFO:teuthology.orchestra.run.smithi050.stdout:(77/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 362 kB/s | 18 kB 00:00 2023-10-06T10:56:00.571 INFO:teuthology.orchestra.run.smithi050.stdout:(78/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 872 kB/s | 44 kB 00:00 2023-10-06T10:56:00.632 INFO:teuthology.orchestra.run.smithi007.stdout:(10/139): ceph-osd-17.2.6-1274.g68e53a4a.el8.x8 1.0 MB/s | 17 MB 00:16 2023-10-06T10:56:00.646 INFO:teuthology.orchestra.run.smithi050.stdout:(79/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 32 MB/s | 3.2 MB 00:00 2023-10-06T10:56:00.714 INFO:teuthology.orchestra.run.smithi050.stdout:(80/139): pcre2-devel-10.32-3.el8.x86_64.rpm 4.2 MB/s | 605 kB 00:00 2023-10-06T10:56:00.739 INFO:teuthology.orchestra.run.smithi050.stdout:(81/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.4 MB/s | 229 kB 00:00 2023-10-06T10:56:00.764 INFO:teuthology.orchestra.run.smithi050.stdout:(82/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-06T10:56:00.789 INFO:teuthology.orchestra.run.smithi050.stdout:(83/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.9 MB/s | 249 kB 00:00 2023-10-06T10:56:00.823 INFO:teuthology.orchestra.run.smithi050.stdout:(84/139): python3-cryptography-3.2.1-6.el8.x86_ 11 MB/s | 641 kB 00:00 2023-10-06T10:56:00.848 INFO:teuthology.orchestra.run.smithi050.stdout:(85/139): python3-jwt-1.6.1-2.el8.noarch.rpm 726 kB/s | 43 kB 00:00 2023-10-06T10:56:00.873 INFO:teuthology.orchestra.run.smithi050.stdout:(86/139): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-10-06T10:56:00.899 INFO:teuthology.orchestra.run.smithi007.stdout:(11/139): cephfs-mirror-17.2.6-1274.g68e53a4a.e 959 kB/s | 255 kB 00:00 2023-10-06T10:56:00.932 INFO:teuthology.orchestra.run.smithi050.stdout:(87/139): python3-pycparser-2.14-14.el8.noarch. 1.3 MB/s | 109 kB 00:00 2023-10-06T10:56:00.957 INFO:teuthology.orchestra.run.smithi050.stdout:(88/139): python3-requests-oauthlib-1.0.0-1.el8 510 kB/s | 43 kB 00:00 2023-10-06T10:56:00.983 INFO:teuthology.orchestra.run.smithi050.stdout:(89/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.5 MB/s | 74 kB 00:00 2023-10-06T10:56:01.008 INFO:teuthology.orchestra.run.smithi007.stdout:(12/139): libcephfs-devel-17.2.6-1274.g68e53a4a 229 kB/s | 25 kB 00:00 2023-10-06T10:56:01.008 INFO:teuthology.orchestra.run.smithi050.stdout:(90/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-10-06T10:56:01.250 INFO:teuthology.orchestra.run.smithi007.stdout:(13/139): ceph-radosgw-17.2.6-1274.g68e53a4a.el 1.2 MB/s | 17 MB 00:14 2023-10-06T10:56:01.392 INFO:teuthology.orchestra.run.smithi050.stdout:(91/139): liboath-2.6.2-3.el8.x86_64.rpm 153 kB/s | 59 kB 00:00 2023-10-06T10:56:01.475 INFO:teuthology.orchestra.run.smithi007.stdout:(14/139): libcephsqlite-17.2.6-1274.g68e53a4a.e 778 kB/s | 175 kB 00:00 2023-10-06T10:56:01.584 INFO:teuthology.orchestra.run.smithi007.stdout:(15/139): librados-devel-17.2.6-1274.g68e53a4a. 1.2 MB/s | 130 kB 00:00 2023-10-06T10:56:01.597 INFO:teuthology.orchestra.run.smithi050.stdout:(92/139): gperftools-libs-2.7-9.el8.x86_64.rpm 499 kB/s | 306 kB 00:00 2023-10-06T10:56:01.626 INFO:teuthology.orchestra.run.smithi050.stdout:(93/139): libunwind-1.3.1-3.el8.x86_64.rpm 321 kB/s | 75 kB 00:00 2023-10-06T10:56:01.659 INFO:teuthology.orchestra.run.smithi007.stdout:(16/139): libcephfs2-17.2.6-1274.g68e53a4a.el8. 1.2 MB/s | 797 kB 00:00 2023-10-06T10:56:01.751 INFO:teuthology.orchestra.run.smithi050.stdout:(94/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 349 kB/s | 44 kB 00:00 2023-10-06T10:56:01.842 INFO:teuthology.orchestra.run.smithi050.stdout:(95/139): python3-asyncssh-2.7.0-2.el8.noarch.r 1.9 MB/s | 476 kB 00:00 2023-10-06T10:56:01.943 INFO:teuthology.orchestra.run.smithi007.stdout:(17/139): libradosstriper1-17.2.6-1274.g68e53a4 1.4 MB/s | 506 kB 00:00 2023-10-06T10:56:01.951 INFO:teuthology.orchestra.run.smithi050.stdout:(96/139): python3-cachetools-3.1.1-4.el8.noarch 303 kB/s | 33 kB 00:00 2023-10-06T10:56:01.977 INFO:teuthology.orchestra.run.smithi050.stdout:(97/139): python3-beautifulsoup4-4.6.3-2.el8.1. 821 kB/s | 185 kB 00:00 2023-10-06T10:56:02.035 INFO:teuthology.orchestra.run.smithi007.stdout:(18/139): python3-ceph-argparse-17.2.6-1274.g68 487 kB/s | 45 kB 00:00 2023-10-06T10:56:02.079 INFO:teuthology.orchestra.run.smithi050.stdout:(98/139): python3-certifi-2018.10.15-7.el8.noar 128 kB/s | 16 kB 00:00 2023-10-06T10:56:02.119 INFO:teuthology.orchestra.run.smithi050.stdout:(99/139): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-10-06T10:56:02.160 INFO:teuthology.orchestra.run.smithi007.stdout:(19/139): python3-ceph-common-17.2.6-1274.g68e5 925 kB/s | 115 kB 00:00 2023-10-06T10:56:02.211 INFO:teuthology.orchestra.run.smithi050.stdout:(100/139): python3-cherrypy-18.4.0-1.el8.noarch 2.9 MB/s | 384 kB 00:00 2023-10-06T10:56:02.236 INFO:teuthology.orchestra.run.smithi050.stdout:(101/139): python3-google-auth-1.1.1-10.el8.noa 696 kB/s | 81 kB 00:00 2023-10-06T10:56:02.328 INFO:teuthology.orchestra.run.smithi050.stdout:(102/139): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-10-06T10:56:02.354 INFO:teuthology.orchestra.run.smithi050.stdout:(103/139): python3-jaraco-functools-2.0-4.el8.n 150 kB/s | 18 kB 00:00 2023-10-06T10:56:02.377 INFO:teuthology.orchestra.run.smithi007.stdout:(20/139): python3-cephfs-17.2.6-1274.g68e53a4a. 877 kB/s | 190 kB 00:00 2023-10-06T10:56:02.471 INFO:teuthology.orchestra.run.smithi050.stdout:(104/139): python3-logutils-0.3.5-11.el8.noarch 418 kB/s | 49 kB 00:00 2023-10-06T10:56:02.563 INFO:teuthology.orchestra.run.smithi050.stdout:(105/139): python3-kubernetes-11.0.0-6.el8.noar 5.0 MB/s | 1.2 MB 00:00 2023-10-06T10:56:02.596 INFO:teuthology.orchestra.run.smithi050.stdout:(106/139): python3-more-itertools-7.2.0-3.el8.n 468 kB/s | 59 kB 00:00 2023-10-06T10:56:02.680 INFO:teuthology.orchestra.run.smithi050.stdout:(107/139): python3-natsort-7.1.1-2.el8.noarch.r 515 kB/s | 60 kB 00:00 2023-10-06T10:56:02.780 INFO:teuthology.orchestra.run.smithi050.stdout:(108/139): python3-pecan-1.3.2-9.el8.noarch.rpm 1.5 MB/s | 283 kB 00:00 2023-10-06T10:56:02.785 INFO:teuthology.orchestra.run.smithi007.stdout:(21/139): python3-rados-17.2.6-1274.g68e53a4a.e 910 kB/s | 371 kB 00:00 2023-10-06T10:56:02.922 INFO:teuthology.orchestra.run.smithi050.stdout:(109/139): python3-portend-2.6-1.el8.noarch.rpm 64 kB/s | 16 kB 00:00 2023-10-06T10:56:02.967 INFO:teuthology.orchestra.run.smithi050.stdout:(110/139): python3-repoze-lru-0.7-6.el8.noarch. 180 kB/s | 34 kB 00:00 2023-10-06T10:56:03.089 INFO:teuthology.orchestra.run.smithi050.stdout:(111/139): python3-routes-2.4.1-12.el8.noarch.r 1.2 MB/s | 196 kB 00:00 2023-10-06T10:56:03.102 INFO:teuthology.orchestra.run.smithi007.stdout:(22/139): python3-rbd-17.2.6-1274.g68e53a4a.el8 1.1 MB/s | 358 kB 00:00 2023-10-06T10:56:03.114 INFO:teuthology.orchestra.run.smithi050.stdout:(112/139): python3-rsa-4.9-2.el8.noarch.rpm 437 kB/s | 64 kB 00:00 2023-10-06T10:56:03.223 INFO:teuthology.orchestra.run.smithi050.stdout:(113/139): python3-simplegeneric-0.8.1-17.el8.n 140 kB/s | 19 kB 00:00 2023-10-06T10:56:03.227 INFO:teuthology.orchestra.run.smithi007.stdout:(23/139): python3-rgw-17.2.6-1274.g68e53a4a.el8 854 kB/s | 107 kB 00:00 2023-10-06T10:56:03.248 INFO:teuthology.orchestra.run.smithi050.stdout:(114/139): python3-singledispatch-3.4.0.3-18.el 179 kB/s | 24 kB 00:00 2023-10-06T10:56:03.332 INFO:teuthology.orchestra.run.smithi050.stdout:(115/139): python3-tempora-1.14.1-5.el8.noarch. 269 kB/s | 29 kB 00:00 2023-10-06T10:56:03.357 INFO:teuthology.orchestra.run.smithi050.stdout:(116/139): python3-trustme-0.6.0-4.el8.noarch.r 253 kB/s | 27 kB 00:00 2023-10-06T10:56:03.436 INFO:teuthology.orchestra.run.smithi007.stdout:(24/139): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 436 kB/s | 91 kB 00:00 2023-10-06T10:56:03.474 INFO:teuthology.orchestra.run.smithi050.stdout:(117/139): python3-webob-1.8.5-1.el8.1.noarch.r 2.1 MB/s | 251 kB 00:00 2023-10-06T10:56:03.500 INFO:teuthology.orchestra.run.smithi050.stdout:(118/139): python3-waitress-1.4.3-1.el8.noarch. 1.5 MB/s | 255 kB 00:00 2023-10-06T10:56:03.575 INFO:teuthology.orchestra.run.smithi050.stdout:(119/139): python3-websocket-client-0.56.0-5.el 610 kB/s | 61 kB 00:00 2023-10-06T10:56:03.617 INFO:teuthology.orchestra.run.smithi050.stdout:(120/139): python3-webtest-2.0.33-1.el8.noarch. 729 kB/s | 85 kB 00:00 2023-10-06T10:56:03.675 INFO:teuthology.orchestra.run.smithi050.stdout:(121/139): python3-zc-lockfile-2.0-2.el8.noarch 229 kB/s | 23 kB 00:00 2023-10-06T10:56:04.109 INFO:teuthology.orchestra.run.smithi050.stdout:(122/139): thrift-0.13.0-2.el8.x86_64.rpm 3.5 MB/s | 1.7 MB 00:00 2023-10-06T10:56:05.726 INFO:teuthology.orchestra.run.smithi050.stdout:(123/139): librbd1-17.2.6-1274.g68e53a4a.el8.x8 2.2 MB/s | 3.5 MB 00:01 2023-10-06T10:56:05.793 INFO:teuthology.orchestra.run.smithi050.stdout:(124/139): NetworkManager-initscripts-updown-1. 2.1 MB/s | 143 kB 00:00 2023-10-06T10:56:05.826 INFO:teuthology.orchestra.run.smithi050.stdout:(125/139): elfutils-debuginfod-client-0.189-3.e 2.2 MB/s | 76 kB 00:00 2023-10-06T10:56:05.868 INFO:teuthology.orchestra.run.smithi050.stdout:(126/139): elfutils-libelf-0.189-3.el8.x86_64.r 5.5 MB/s | 232 kB 00:00 2023-10-06T10:56:05.902 INFO:teuthology.orchestra.run.smithi050.stdout:(127/139): elfutils-libs-0.189-3.el8.x86_64.rpm 8.9 MB/s | 303 kB 00:00 2023-10-06T10:56:05.969 INFO:teuthology.orchestra.run.smithi050.stdout:(128/139): iproute-6.2.0-5.el8.x86_64.rpm 13 MB/s | 854 kB 00:00 2023-10-06T10:56:06.003 INFO:teuthology.orchestra.run.smithi050.stdout:(129/139): libblkid-2.32.1-43.el8.x86_64.rpm 6.5 MB/s | 220 kB 00:00 2023-10-06T10:56:06.036 INFO:teuthology.orchestra.run.smithi050.stdout:(130/139): libfdisk-2.32.1-43.el8.x86_64.rpm 7.4 MB/s | 254 kB 00:00 2023-10-06T10:56:06.070 INFO:teuthology.orchestra.run.smithi050.stdout:(131/139): libmount-2.32.1-43.el8.x86_64.rpm 6.9 MB/s | 236 kB 00:00 2023-10-06T10:56:06.103 INFO:teuthology.orchestra.run.smithi007.stdout:(25/139): librgw2-17.2.6-1274.g68e53a4a.el8.x86 1.2 MB/s | 5.6 MB 00:04 2023-10-06T10:56:06.103 INFO:teuthology.orchestra.run.smithi050.stdout:(132/139): libsmartcols-2.32.1-43.el8.x86_64.rp 5.3 MB/s | 179 kB 00:00 2023-10-06T10:56:06.170 INFO:teuthology.orchestra.run.smithi050.stdout:(133/139): libuuid-2.32.1-43.el8.x86_64.rpm 1.5 MB/s | 99 kB 00:00 2023-10-06T10:56:06.238 INFO:teuthology.orchestra.run.smithi050.stdout:(134/139): util-linux-2.32.1-43.el8.x86_64.rpm 37 MB/s | 2.5 MB 00:00 2023-10-06T10:56:06.346 INFO:teuthology.orchestra.run.smithi050.stdout:(135/139): util-linux-user-2.32.1-43.el8.x86_64 948 kB/s | 103 kB 00:00 2023-10-06T10:56:06.522 INFO:teuthology.orchestra.run.smithi050.stdout:(136/139): xfsdump-3.1.8-6.el8.x86_64.rpm 1.9 MB/s | 334 kB 00:00 2023-10-06T10:56:06.570 INFO:teuthology.orchestra.run.smithi007.stdout:(26/139): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 370 kB/s | 173 kB 00:00 2023-10-06T10:56:06.572 INFO:teuthology.orchestra.run.smithi050.stdout:(137/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 22 MB/s | 1.1 MB 00:00 2023-10-06T10:56:06.678 INFO:teuthology.orchestra.run.smithi007.stdout:(27/139): ceph-grafana-dashboards-17.2.6-1274.g 213 kB/s | 23 kB 00:00 2023-10-06T10:56:06.887 INFO:teuthology.orchestra.run.smithi007.stdout:(28/139): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 582 kB/s | 121 kB 00:00 2023-10-06T10:56:06.997 INFO:teuthology.orchestra.run.smithi050.stdout:(138/139): librados2-17.2.6-1274.g68e53a4a.el8. 1.0 MB/s | 3.4 MB 00:03 2023-10-06T10:56:07.213 INFO:teuthology.orchestra.run.smithi007.stdout:(29/139): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 936 kB/s | 3.5 MB 00:03 2023-10-06T10:56:08.621 INFO:teuthology.orchestra.run.smithi007.stdout:(30/139): ceph-mgr-dashboard-17.2.6-1274.g68e53 1.0 MB/s | 1.7 MB 00:01 2023-10-06T10:56:08.863 INFO:teuthology.orchestra.run.smithi007.stdout:(31/139): ceph-mgr-modules-core-17.2.6-1274.g68 987 kB/s | 238 kB 00:00 2023-10-06T10:56:08.955 INFO:teuthology.orchestra.run.smithi007.stdout:(32/139): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 516 kB/s | 47 kB 00:00 2023-10-06T10:56:09.047 INFO:teuthology.orchestra.run.smithi007.stdout:(33/139): ceph-prometheus-alerts-17.2.6-1274.g6 158 kB/s | 14 kB 00:00 2023-10-06T10:56:09.297 INFO:teuthology.orchestra.run.smithi007.stdout:(34/139): ceph-volume-17.2.6-1274.g68e53a4a.el8 1.0 MB/s | 267 kB 00:00 2023-10-06T10:56:09.398 INFO:teuthology.orchestra.run.smithi007.stdout:(35/139): cephadm-17.2.6-1274.g68e53a4a.el8.noa 806 kB/s | 80 kB 00:00 2023-10-06T10:56:09.498 INFO:teuthology.orchestra.run.smithi007.stdout:(36/139): cephfs-top-17.2.6-1274.g68e53a4a.el8. 178 kB/s | 18 kB 00:00 2023-10-06T10:56:09.623 INFO:teuthology.orchestra.run.smithi007.stdout:(37/139): automake-1.16.1-8.el8.noarch.rpm 5.8 MB/s | 740 kB 00:00 2023-10-06T10:56:09.690 INFO:teuthology.orchestra.run.smithi007.stdout:(38/139): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-10-06T10:56:09.732 INFO:teuthology.orchestra.run.smithi007.stdout:(39/139): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-06T10:56:09.774 INFO:teuthology.orchestra.run.smithi007.stdout:(40/139): jq-1.6-7.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-06T10:56:09.816 INFO:teuthology.orchestra.run.smithi007.stdout:(41/139): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-06T10:56:09.867 INFO:teuthology.orchestra.run.smithi007.stdout:(42/139): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-10-06T10:56:09.909 INFO:teuthology.orchestra.run.smithi007.stdout:(43/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-10-06T10:56:09.951 INFO:teuthology.orchestra.run.smithi007.stdout:(44/139): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-10-06T10:56:10.084 INFO:teuthology.orchestra.run.smithi007.stdout:(45/139): openblas-0.3.15-4.el8.x86_64.rpm 35 MB/s | 4.7 MB 00:00 2023-10-06T10:56:10.218 INFO:teuthology.orchestra.run.smithi007.stdout:(46/139): openblas-threads-0.3.15-4.el8.x86_64. 36 MB/s | 4.9 MB 00:00 2023-10-06T10:56:10.343 INFO:teuthology.orchestra.run.smithi007.stdout:(47/139): python3-babel-2.5.1-7.el8.noarch.rpm 38 MB/s | 4.8 MB 00:00 2023-10-06T10:56:10.394 INFO:teuthology.orchestra.run.smithi007.stdout:(48/139): python3-jinja2-2.10.1-3.el8.noarch.rp 11 MB/s | 538 kB 00:00 2023-10-06T10:56:10.436 INFO:teuthology.orchestra.run.smithi007.stdout:(49/139): python3-jsonpatch-1.21-2.el8.noarch.r 639 kB/s | 27 kB 00:00 2023-10-06T10:56:10.478 INFO:teuthology.orchestra.run.smithi007.stdout:(50/139): python3-jsonpointer-1.10-11.el8.noarc 479 kB/s | 20 kB 00:00 2023-10-06T10:56:10.528 INFO:teuthology.orchestra.run.smithi007.stdout:(51/139): python3-mako-1.0.6-14.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-10-06T10:56:10.595 INFO:teuthology.orchestra.run.smithi007.stdout:(52/139): python3-markupsafe-0.23-19.el8.x86_64 583 kB/s | 39 kB 00:00 2023-10-06T10:56:10.712 INFO:teuthology.orchestra.run.smithi007.stdout:(53/139): python3-numpy-1.14.3-10.el8.x86_64.rp 32 MB/s | 3.7 MB 00:00 2023-10-06T10:56:10.762 INFO:teuthology.orchestra.run.smithi007.stdout:(54/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 4.4 MB/s | 225 kB 00:00 2023-10-06T10:56:10.796 INFO:teuthology.orchestra.run.smithi007.stdout:(55/139): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-10-06T10:56:10.838 INFO:teuthology.orchestra.run.smithi007.stdout:(56/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-10-06T10:56:10.880 INFO:teuthology.orchestra.run.smithi007.stdout:(57/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.0 MB/s | 126 kB 00:00 2023-10-06T10:56:10.922 INFO:teuthology.orchestra.run.smithi007.stdout:(58/139): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-10-06T10:56:11.054 INFO:teuthology.orchestra.run.smithi007.stdout:(59/139): python3-pytz-2017.2-11.el8.noarch.rpm 432 kB/s | 57 kB 00:00 2023-10-06T10:56:11.581 INFO:teuthology.orchestra.run.smithi007.stdout:(60/139): python3-scipy-1.0.0-21.module_el8.5.0 26 MB/s | 14 MB 00:00 2023-10-06T10:56:11.640 INFO:teuthology.orchestra.run.smithi007.stdout:(61/139): python3-werkzeug-0.12.2-4.el8.noarch. 7.7 MB/s | 457 kB 00:00 2023-10-06T10:56:11.699 INFO:teuthology.orchestra.run.smithi007.stdout:(62/139): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-10-06T10:56:11.741 INFO:teuthology.orchestra.run.smithi007.stdout:(63/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2023-10-06T10:56:11.799 INFO:teuthology.orchestra.run.smithi007.stdout:(64/139): elfutils-libelf-devel-0.189-3.el8.x86 1.0 MB/s | 62 kB 00:00 2023-10-06T10:56:11.841 INFO:teuthology.orchestra.run.smithi007.stdout:(65/139): fuse-2.9.7-17.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-10-06T10:56:11.875 INFO:teuthology.orchestra.run.smithi007.stdout:(66/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.4 MB/s | 48 kB 00:00 2023-10-06T10:56:11.926 INFO:teuthology.orchestra.run.smithi007.stdout:(67/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 11 MB/s | 561 kB 00:00 2023-10-06T10:56:11.959 INFO:teuthology.orchestra.run.smithi007.stdout:(68/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 564 kB/s | 19 kB 00:00 2023-10-06T10:56:12.018 INFO:teuthology.orchestra.run.smithi007.stdout:(69/139): libcom_err-devel-1.45.6-5.el8.x86_64. 665 kB/s | 39 kB 00:00 2023-10-06T10:56:12.068 INFO:teuthology.orchestra.run.smithi007.stdout:(70/139): libgfortran-8.5.0-20.el8.x86_64.rpm 13 MB/s | 645 kB 00:00 2023-10-06T10:56:12.101 INFO:teuthology.orchestra.run.smithi007.stdout:(71/139): libquadmath-8.5.0-20.el8.x86_64.rpm 5.1 MB/s | 172 kB 00:00 2023-10-06T10:56:12.135 INFO:teuthology.orchestra.run.smithi007.stdout:(72/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-10-06T10:56:12.169 INFO:teuthology.orchestra.run.smithi007.stdout:(73/139): libselinux-devel-2.9-8.el8.x86_64.rpm 5.9 MB/s | 200 kB 00:00 2023-10-06T10:56:12.202 INFO:teuthology.orchestra.run.smithi007.stdout:(74/139): libsepol-devel-2.9-3.el8.x86_64.rpm 2.5 MB/s | 87 kB 00:00 2023-10-06T10:56:12.236 INFO:teuthology.orchestra.run.smithi007.stdout:(75/139): libuuid-devel-2.32.1-43.el8.x86_64.rp 2.9 MB/s | 100 kB 00:00 2023-10-06T10:56:12.270 INFO:teuthology.orchestra.run.smithi007.stdout:(76/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 541 kB/s | 18 kB 00:00 2023-10-06T10:56:12.303 INFO:teuthology.orchestra.run.smithi007.stdout:(77/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-10-06T10:56:12.378 INFO:teuthology.orchestra.run.smithi007.stdout:(78/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 42 MB/s | 3.2 MB 00:00 2023-10-06T10:56:12.412 INFO:teuthology.orchestra.run.smithi007.stdout:(79/139): pcre2-devel-10.32-3.el8.x86_64.rpm 18 MB/s | 605 kB 00:00 2023-10-06T10:56:12.538 INFO:teuthology.orchestra.run.smithi007.stdout:(80/139): ceph-mgr-diskprediction-local-17.2.6- 1.4 MB/s | 7.4 MB 00:05 2023-10-06T10:56:12.563 INFO:teuthology.orchestra.run.smithi007.stdout:(81/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.5 MB/s | 229 kB 00:00 2023-10-06T10:56:12.596 INFO:teuthology.orchestra.run.smithi007.stdout:(82/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 7.3 MB/s | 249 kB 00:00 2023-10-06T10:56:12.638 INFO:teuthology.orchestra.run.smithi007.stdout:(83/139): python3-cryptography-3.2.1-6.el8.x86_ 15 MB/s | 641 kB 00:00 2023-10-06T10:56:12.664 INFO:teuthology.orchestra.run.smithi007.stdout:(84/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-10-06T10:56:12.689 INFO:teuthology.orchestra.run.smithi007.stdout:(85/139): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-10-06T10:56:12.723 INFO:teuthology.orchestra.run.smithi007.stdout:(86/139): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-10-06T10:56:12.748 INFO:teuthology.orchestra.run.smithi007.stdout:(87/139): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-10-06T10:56:12.765 INFO:teuthology.orchestra.run.smithi007.stdout:(88/139): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2023-10-06T10:56:12.790 INFO:teuthology.orchestra.run.smithi007.stdout:(89/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.7 MB/s | 74 kB 00:00 2023-10-06T10:56:12.807 INFO:teuthology.orchestra.run.smithi007.stdout:(90/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2023-10-06T10:56:13.324 INFO:teuthology.orchestra.run.smithi007.stdout:(91/139): liboath-2.6.2-3.el8.x86_64.rpm 114 kB/s | 59 kB 00:00 2023-10-06T10:56:13.508 INFO:teuthology.orchestra.run.smithi007.stdout:(92/139): libunwind-1.3.1-3.el8.x86_64.rpm 410 kB/s | 75 kB 00:00 2023-10-06T10:56:13.550 INFO:teuthology.orchestra.run.smithi007.stdout:(93/139): gperftools-libs-2.7-9.el8.x86_64.rpm 403 kB/s | 306 kB 00:00 2023-10-06T10:56:13.675 INFO:teuthology.orchestra.run.smithi007.stdout:(94/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 349 kB/s | 44 kB 00:00 2023-10-06T10:56:13.859 INFO:teuthology.orchestra.run.smithi007.stdout:(95/139): python3-beautifulsoup4-4.6.3-2.el8.1. 1.0 MB/s | 185 kB 00:00 2023-10-06T10:56:13.901 INFO:teuthology.orchestra.run.smithi007.stdout:(96/139): python3-asyncssh-2.7.0-2.el8.noarch.r 1.2 MB/s | 476 kB 00:00 2023-10-06T10:56:13.985 INFO:teuthology.orchestra.run.smithi007.stdout:(97/139): python3-cachetools-3.1.1-4.el8.noarch 263 kB/s | 33 kB 00:00 2023-10-06T10:56:14.027 INFO:teuthology.orchestra.run.smithi007.stdout:(98/139): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2023-10-06T10:56:14.143 INFO:teuthology.orchestra.run.smithi007.stdout:(99/139): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-10-06T10:56:14.202 INFO:teuthology.orchestra.run.smithi007.stdout:(100/139): python3-cherrypy-18.4.0-1.el8.noarch 2.1 MB/s | 384 kB 00:00 2023-10-06T10:56:14.277 INFO:teuthology.orchestra.run.smithi007.stdout:(101/139): python3-google-auth-1.1.1-10.el8.noa 608 kB/s | 81 kB 00:00 2023-10-06T10:56:14.336 INFO:teuthology.orchestra.run.smithi007.stdout:(102/139): python3-jaraco-6.2-6.el8.noarch.rpm 83 kB/s | 11 kB 00:00 2023-10-06T10:56:14.403 INFO:teuthology.orchestra.run.smithi007.stdout:(103/139): python3-jaraco-functools-2.0-4.el8.n 140 kB/s | 18 kB 00:00 2023-10-06T10:56:14.537 INFO:teuthology.orchestra.run.smithi007.stdout:(104/139): python3-logutils-0.3.5-11.el8.noarch 366 kB/s | 49 kB 00:00 2023-10-06T10:56:14.620 INFO:teuthology.orchestra.run.smithi007.stdout:(105/139): python3-kubernetes-11.0.0-6.el8.noar 4.1 MB/s | 1.2 MB 00:00 2023-10-06T10:56:14.670 INFO:teuthology.orchestra.run.smithi007.stdout:(106/139): python3-more-itertools-7.2.0-3.el8.n 439 kB/s | 59 kB 00:00 2023-10-06T10:56:14.788 INFO:teuthology.orchestra.run.smithi007.stdout:(107/139): python3-natsort-7.1.1-2.el8.noarch.r 361 kB/s | 60 kB 00:00 2023-10-06T10:56:14.855 INFO:teuthology.orchestra.run.smithi007.stdout:(108/139): python3-pecan-1.3.2-9.el8.noarch.rpm 1.5 MB/s | 283 kB 00:00 2023-10-06T10:56:14.905 INFO:teuthology.orchestra.run.smithi007.stdout:(109/139): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-10-06T10:56:14.980 INFO:teuthology.orchestra.run.smithi007.stdout:(110/139): python3-repoze-lru-0.7-6.el8.noarch. 269 kB/s | 34 kB 00:00 2023-10-06T10:56:15.031 INFO:teuthology.orchestra.run.smithi007.stdout:(111/139): python3-routes-2.4.1-12.el8.noarch.r 1.5 MB/s | 196 kB 00:00 2023-10-06T10:56:15.114 INFO:teuthology.orchestra.run.smithi007.stdout:(112/139): python3-rsa-4.9-2.el8.noarch.rpm 480 kB/s | 64 kB 00:00 2023-10-06T10:56:15.148 INFO:teuthology.orchestra.run.smithi007.stdout:(113/139): python3-simplegeneric-0.8.1-17.el8.n 160 kB/s | 19 kB 00:00 2023-10-06T10:56:15.240 INFO:teuthology.orchestra.run.smithi007.stdout:(114/139): python3-singledispatch-3.4.0.3-18.el 191 kB/s | 24 kB 00:00 2023-10-06T10:56:15.265 INFO:teuthology.orchestra.run.smithi007.stdout:(115/139): python3-tempora-1.14.1-5.el8.noarch. 249 kB/s | 29 kB 00:00 2023-10-06T10:56:15.366 INFO:teuthology.orchestra.run.smithi007.stdout:(116/139): python3-trustme-0.6.0-4.el8.noarch.r 219 kB/s | 27 kB 00:00 2023-10-06T10:56:15.399 INFO:teuthology.orchestra.run.smithi007.stdout:(117/139): python3-waitress-1.4.3-1.el8.noarch. 1.9 MB/s | 255 kB 00:00 2023-10-06T10:56:15.524 INFO:teuthology.orchestra.run.smithi007.stdout:(118/139): python3-websocket-client-0.56.0-5.el 490 kB/s | 61 kB 00:00 2023-10-06T10:56:15.550 INFO:teuthology.orchestra.run.smithi007.stdout:(119/139): python3-webob-1.8.5-1.el8.1.noarch.r 1.3 MB/s | 251 kB 00:00 2023-10-06T10:56:15.650 INFO:teuthology.orchestra.run.smithi007.stdout:(120/139): python3-webtest-2.0.33-1.el8.noarch. 682 kB/s | 85 kB 00:00 2023-10-06T10:56:15.700 INFO:teuthology.orchestra.run.smithi007.stdout:(121/139): python3-zc-lockfile-2.0-2.el8.noarch 153 kB/s | 23 kB 00:00 2023-10-06T10:56:15.867 INFO:teuthology.orchestra.run.smithi007.stdout:(122/139): thrift-0.13.0-2.el8.x86_64.rpm 8.0 MB/s | 1.7 MB 00:00 2023-10-06T10:56:19.126 INFO:teuthology.orchestra.run.smithi007.stdout:(123/139): librados2-17.2.6-1274.g68e53a4a.el8. 1.0 MB/s | 3.4 MB 00:03 2023-10-06T10:56:19.201 INFO:teuthology.orchestra.run.smithi007.stdout:(124/139): NetworkManager-initscripts-updown-1. 1.9 MB/s | 143 kB 00:00 2023-10-06T10:56:19.234 INFO:teuthology.orchestra.run.smithi007.stdout:(125/139): elfutils-debuginfod-client-0.189-3.e 2.2 MB/s | 76 kB 00:00 2023-10-06T10:56:19.276 INFO:teuthology.orchestra.run.smithi007.stdout:(126/139): elfutils-libelf-0.189-3.el8.x86_64.r 5.4 MB/s | 232 kB 00:00 2023-10-06T10:56:19.311 INFO:teuthology.orchestra.run.smithi007.stdout:(127/139): elfutils-libs-0.189-3.el8.x86_64.rpm 8.9 MB/s | 303 kB 00:00 2023-10-06T10:56:19.377 INFO:teuthology.orchestra.run.smithi007.stdout:(128/139): iproute-6.2.0-5.el8.x86_64.rpm 13 MB/s | 854 kB 00:00 2023-10-06T10:56:19.410 INFO:teuthology.orchestra.run.smithi007.stdout:(129/139): libblkid-2.32.1-43.el8.x86_64.rpm 6.5 MB/s | 220 kB 00:00 2023-10-06T10:56:19.444 INFO:teuthology.orchestra.run.smithi007.stdout:(130/139): libfdisk-2.32.1-43.el8.x86_64.rpm 7.4 MB/s | 254 kB 00:00 2023-10-06T10:56:19.478 INFO:teuthology.orchestra.run.smithi007.stdout:(131/139): libmount-2.32.1-43.el8.x86_64.rpm 7.0 MB/s | 236 kB 00:00 2023-10-06T10:56:19.513 INFO:teuthology.orchestra.run.smithi007.stdout:(132/139): libsmartcols-2.32.1-43.el8.x86_64.rp 5.3 MB/s | 179 kB 00:00 2023-10-06T10:56:19.545 INFO:teuthology.orchestra.run.smithi007.stdout:(133/139): libuuid-2.32.1-43.el8.x86_64.rpm 2.9 MB/s | 99 kB 00:00 2023-10-06T10:56:19.604 INFO:teuthology.orchestra.run.smithi007.stdout:(134/139): util-linux-2.32.1-43.el8.x86_64.rpm 43 MB/s | 2.5 MB 00:00 2023-10-06T10:56:19.637 INFO:teuthology.orchestra.run.smithi007.stdout:(135/139): util-linux-user-2.32.1-43.el8.x86_64 3.0 MB/s | 103 kB 00:00 2023-10-06T10:56:19.671 INFO:teuthology.orchestra.run.smithi007.stdout:(136/139): xfsdump-3.1.8-6.el8.x86_64.rpm 9.8 MB/s | 334 kB 00:00 2023-10-06T10:56:19.721 INFO:teuthology.orchestra.run.smithi007.stdout:(137/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 22 MB/s | 1.1 MB 00:00 2023-10-06T10:56:20.180 INFO:teuthology.orchestra.run.smithi007.stdout:(138/139): ceph-test-17.2.6-1274.g68e53a4a.el8. 1.7 MB/s | 52 MB 00:30 2023-10-06T10:56:20.238 INFO:teuthology.orchestra.run.smithi007.stdout:(139/139): librbd1-17.2.6-1274.g68e53a4a.el8.x8 832 kB/s | 3.5 MB 00:04 2023-10-06T10:56:20.242 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-10-06T10:56:20.242 INFO:teuthology.orchestra.run.smithi007.stdout:Total 5.0 MB/s | 209 MB 00:41 2023-10-06T10:56:21.149 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-10-06T10:56:21.629 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-10-06T10:56:21.629 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-10-06T10:56:23.174 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-10-06T10:56:23.178 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-10-06T10:56:28.563 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-10-06T10:56:28.614 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/1 2023-10-06T10:56:28.766 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 1/155 2023-10-06T10:56:28.841 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/155 2023-10-06T10:56:28.983 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 2/155 2023-10-06T10:56:29.075 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 2/155 2023-10-06T10:56:29.288 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-10-06T10:56:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 4/155 2023-10-06T10:56:29.896 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/155 2023-10-06T10:56:30.095 INFO:teuthology.orchestra.run.smithi050.stdout:(139/139): ceph-test-17.2.6-1274.g68e53a4a.el8. 1.2 MB/s | 52 MB 00:43 2023-10-06T10:56:30.098 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-06T10:56:30.099 INFO:teuthology.orchestra.run.smithi050.stdout:Total 4.2 MB/s | 209 MB 00:49 2023-10-06T10:56:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-10-06T10:56:30.282 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-10-06T10:56:30.695 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-10-06T10:56:30.890 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/155 2023-10-06T10:56:30.981 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-06T10:56:31.316 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/155 2023-10-06T10:56:31.462 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-06T10:56:31.462 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-06T10:56:31.507 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/155 2023-10-06T10:56:31.643 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/155 2023-10-06T10:56:31.857 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/155 2023-10-06T10:56:31.960 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/155 2023-10-06T10:56:32.184 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/155 2023-10-06T10:56:32.365 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-10-06T10:56:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-10-06T10:56:32.989 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-06T10:56:32.993 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-06T10:56:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/155 2023-10-06T10:56:33.398 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/155 2023-10-06T10:56:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-10-06T10:56:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-10-06T10:56:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-10-06T10:56:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-10-06T10:56:34.323 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 17/155 2023-10-06T10:56:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 17/155 2023-10-06T10:56:34.764 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/155 2023-10-06T10:56:34.900 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/155 2023-10-06T10:56:35.114 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-10-06T10:56:35.281 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-10-06T10:56:35.439 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-10-06T10:56:35.608 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-10-06T10:56:35.764 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-10-06T10:56:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-10-06T10:56:36.623 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-10-06T10:56:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-10-06T10:56:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-10-06T10:56:38.261 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-10-06T10:56:38.564 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-10-06T10:56:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-10-06T10:56:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-06T10:56:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/1 2023-10-06T10:56:39.063 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/155 2023-10-06T10:56:39.144 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 1/155 2023-10-06T10:56:39.257 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/155 2023-10-06T10:56:39.294 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-10-06T10:56:39.443 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 2/155 2023-10-06T10:56:39.506 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 29/155 2023-10-06T10:56:39.519 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 2/155 2023-10-06T10:56:39.727 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 30/155 2023-10-06T10:56:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-10-06T10:56:39.956 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 31/155 2023-10-06T10:56:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 4/155 2023-10-06T10:56:40.466 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/155 2023-10-06T10:56:40.711 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-10-06T10:56:40.910 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-10-06T10:56:41.071 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-10-06T10:56:41.320 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-10-06T10:56:41.426 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-10-06T10:56:41.560 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/155 2023-10-06T10:56:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-10-06T10:56:41.976 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/155 2023-10-06T10:56:42.152 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/155 2023-10-06T10:56:42.155 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-10-06T10:56:42.324 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/155 2023-10-06T10:56:42.544 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/155 2023-10-06T10:56:42.632 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/155 2023-10-06T10:56:42.863 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/155 2023-10-06T10:56:43.044 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-10-06T10:56:43.688 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-10-06T10:56:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/155 2023-10-06T10:56:44.097 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/155 2023-10-06T10:56:44.195 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-10-06T10:56:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-10-06T10:56:44.479 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-10-06T10:56:44.645 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-10-06T10:56:44.721 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-10-06T10:56:44.849 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-10-06T10:56:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-10-06T10:56:45.043 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-10-06T10:56:45.085 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 17/155 2023-10-06T10:56:45.230 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 17/155 2023-10-06T10:56:45.277 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/155 2023-10-06T10:56:45.437 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 40/155 2023-10-06T10:56:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/155 2023-10-06T10:56:45.653 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/155 2023-10-06T10:56:45.666 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 41/155 2023-10-06T10:56:45.839 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 42/155 2023-10-06T10:56:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-10-06T10:56:46.040 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-10-06T10:56:46.057 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 43/155 2023-10-06T10:56:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-10-06T10:56:46.304 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/155 2023-10-06T10:56:46.351 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-10-06T10:56:46.394 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/155 2023-10-06T10:56:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-10-06T10:56:46.638 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/155 2023-10-06T10:56:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/155 2023-10-06T10:56:46.851 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 46/155 2023-10-06T10:56:47.046 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-10-06T10:56:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-10-06T10:56:47.501 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-10-06T10:56:47.604 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-10-06T10:56:47.830 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/155 2023-10-06T10:56:47.850 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/155 2023-10-06T10:56:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-10-06T10:56:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-10-06T10:56:48.331 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-10-06T10:56:48.477 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-10-06T10:56:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-10-06T10:56:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-10-06T10:56:48.843 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-10-06T10:56:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-10-06T10:56:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-10-06T10:56:49.277 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-10-06T10:56:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/155 2023-10-06T10:56:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/155 2023-10-06T10:56:49.634 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-10-06T10:56:49.753 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/155 2023-10-06T10:56:49.886 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-10-06T10:56:49.943 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/155 2023-10-06T10:56:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/155 2023-10-06T10:56:50.094 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/155 2023-10-06T10:56:50.247 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/155 2023-10-06T10:56:50.271 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-10-06T10:56:50.453 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/155 2023-10-06T10:56:50.559 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 29/155 2023-10-06T10:56:50.678 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/155 2023-10-06T10:56:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 30/155 2023-10-06T10:56:50.942 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/155 2023-10-06T10:56:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 31/155 2023-10-06T10:56:51.145 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/155 2023-10-06T10:56:51.507 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/155 2023-10-06T10:56:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/155 2023-10-06T10:56:51.962 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/155 2023-10-06T10:56:52.064 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-10-06T10:56:52.217 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/155 2023-10-06T10:56:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/155 2023-10-06T10:56:52.480 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-10-06T10:56:52.928 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-10-06T10:56:52.992 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/155 2023-10-06T10:56:53.159 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-10-06T10:56:53.287 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/155 2023-10-06T10:56:53.495 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/155 2023-10-06T10:56:53.766 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/155 2023-10-06T10:56:54.124 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/155 2023-10-06T10:56:55.178 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-10-06T10:56:55.340 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/155 2023-10-06T10:56:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-10-06T10:56:55.729 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/155 2023-10-06T10:56:55.752 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-10-06T10:56:55.955 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-10-06T10:56:55.972 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/155 2023-10-06T10:56:56.181 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/155 2023-10-06T10:56:56.216 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/155 2023-10-06T10:56:56.399 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 40/155 2023-10-06T10:56:56.563 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/155 2023-10-06T10:56:56.661 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 41/155 2023-10-06T10:56:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/155 2023-10-06T10:56:56.867 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 42/155 2023-10-06T10:56:57.078 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 43/155 2023-10-06T10:56:57.100 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/155 2023-10-06T10:56:57.292 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/155 2023-10-06T10:56:57.342 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-10-06T10:56:57.405 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/155 2023-10-06T10:56:57.650 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/155 2023-10-06T10:56:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/155 2023-10-06T10:56:57.789 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/155 2023-10-06T10:56:57.867 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/155 2023-10-06T10:56:57.964 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 46/155 2023-10-06T10:56:58.022 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/155 2023-10-06T10:56:58.167 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-10-06T10:56:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/155 2023-10-06T10:56:58.533 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/155 2023-10-06T10:56:58.770 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-10-06T10:56:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/155 2023-10-06T10:56:58.944 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/155 2023-10-06T10:56:59.076 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/155 2023-10-06T10:56:59.095 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/155 2023-10-06T10:56:59.186 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/155 2023-10-06T10:56:59.284 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-10-06T10:56:59.397 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/155 2023-10-06T10:56:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-10-06T10:56:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/155 2023-10-06T10:56:59.759 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-10-06T10:56:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/155 2023-10-06T10:56:59.914 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-10-06T10:57:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/155 2023-10-06T10:57:00.096 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-10-06T10:57:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/155 2023-10-06T10:57:00.324 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-10-06T10:57:00.558 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-10-06T10:57:00.790 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/155 2023-10-06T10:57:00.987 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/155 2023-10-06T10:57:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/155 2023-10-06T10:57:01.373 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/155 2023-10-06T10:57:01.556 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/155 2023-10-06T10:57:01.751 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/155 2023-10-06T10:57:01.979 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/155 2023-10-06T10:57:02.240 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/155 2023-10-06T10:57:02.496 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/155 2023-10-06T10:57:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/155 2023-10-06T10:57:03.129 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/155 2023-10-06T10:57:03.215 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 97/155 2023-10-06T10:57:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/155 2023-10-06T10:57:03.452 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 97/155 2023-10-06T10:57:03.638 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/155 2023-10-06T10:57:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/155 2023-10-06T10:57:04.095 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 97/155 2023-10-06T10:57:04.204 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/155 2023-10-06T10:57:04.371 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 98/155 2023-10-06T10:57:04.499 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 98/155 2023-10-06T10:57:04.616 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/155 2023-10-06T10:57:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 99/155 2023-10-06T10:57:04.900 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/155 2023-10-06T10:57:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/155 2023-10-06T10:57:05.463 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/155 2023-10-06T10:57:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/155 2023-10-06T10:57:07.122 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/155 2023-10-06T10:57:07.525 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/155 2023-10-06T10:57:07.784 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/155 2023-10-06T10:57:08.067 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/155 2023-10-06T10:57:08.415 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/155 2023-10-06T10:57:08.686 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/155 2023-10-06T10:57:08.971 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/155 2023-10-06T10:57:09.221 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-10-06T10:57:09.587 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/155 2023-10-06T10:57:09.847 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/155 2023-10-06T10:57:09.985 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/155 2023-10-06T10:57:10.210 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/155 2023-10-06T10:57:10.600 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/155 2023-10-06T10:57:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/155 2023-10-06T10:57:11.098 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/155 2023-10-06T10:57:11.349 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/155 2023-10-06T10:57:11.585 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/155 2023-10-06T10:57:11.819 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/155 2023-10-06T10:57:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/155 2023-10-06T10:57:12.300 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/155 2023-10-06T10:57:12.482 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/155 2023-10-06T10:57:15.453 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 97/155 2023-10-06T10:57:15.732 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 97/155 2023-10-06T10:57:16.369 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 97/155 2023-10-06T10:57:16.707 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 98/155 2023-10-06T10:57:16.848 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 98/155 2023-10-06T10:57:17.073 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 99/155 2023-10-06T10:57:25.874 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 99/155 2023-10-06T10:57:25.877 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2023-10-06T10:57:25.877 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2023-10-06T10:57:25.877 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /dev 2023-10-06T10:57:25.877 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /run 2023-10-06T10:57:25.877 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2023-10-06T10:57:25.878 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2023-10-06T10:57:25.878 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2023-10-06T10:57:25.878 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2023-10-06T10:57:25.878 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /dev 2023-10-06T10:57:25.878 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:57:26.282 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 100/155 2023-10-06T10:57:27.923 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 100/155 2023-10-06T10:57:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/155 2023-10-06T10:57:28.403 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/155 2023-10-06T10:57:28.589 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 102/155 2023-10-06T10:57:29.021 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 102/155 2023-10-06T10:57:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/155 2023-10-06T10:57:29.226 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/155 2023-10-06T10:57:29.448 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-10-06T10:57:29.661 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-10-06T10:57:29.814 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-10-06T10:57:29.912 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-10-06T10:57:30.207 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-10-06T10:57:30.439 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : automake-1.16.1-8.el8.noarch 108/155 2023-10-06T10:57:30.975 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 109/155 2023-10-06T10:57:31.144 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 109/155 2023-10-06T10:57:31.280 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 110/155 2023-10-06T10:57:31.455 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 111/155 2023-10-06T10:57:31.646 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 112/155 2023-10-06T10:57:31.885 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 112/155 2023-10-06T10:57:32.082 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 113/155 2023-10-06T10:57:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 113/155 2023-10-06T10:57:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 114/155 2023-10-06T10:57:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 114/155 2023-10-06T10:57:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 115/155 2023-10-06T10:57:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/155 2023-10-06T10:57:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/155 2023-10-06T10:57:34.271 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 117/155 2023-10-06T10:57:34.285 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 117/155 2023-10-06T10:57:34.459 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 118/155 2023-10-06T10:57:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-10-06T10:57:38.735 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 99/155 2023-10-06T10:57:38.735 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2023-10-06T10:57:38.736 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2023-10-06T10:57:38.736 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2023-10-06T10:57:38.736 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /run 2023-10-06T10:57:38.736 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2023-10-06T10:57:38.736 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2023-10-06T10:57:38.736 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2023-10-06T10:57:38.736 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2023-10-06T10:57:38.736 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2023-10-06T10:57:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:57:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 100/155 2023-10-06T10:57:40.010 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-10-06T10:57:40.820 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 100/155 2023-10-06T10:57:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/155 2023-10-06T10:57:41.300 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/155 2023-10-06T10:57:41.536 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 102/155 2023-10-06T10:57:41.887 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 120/155 2023-10-06T10:57:41.967 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 102/155 2023-10-06T10:57:42.098 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/155 2023-10-06T10:57:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/155 2023-10-06T10:57:42.195 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/155 2023-10-06T10:57:42.224 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/155 2023-10-06T10:57:42.379 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 122/155 2023-10-06T10:57:42.428 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 122/155 2023-10-06T10:57:42.486 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-10-06T10:57:42.587 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 123/155 2023-10-06T10:57:42.741 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-10-06T10:57:42.927 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-10-06T10:57:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 123/155 2023-10-06T10:57:43.016 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-10-06T10:57:43.170 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 124/155 2023-10-06T10:57:43.277 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 124/155 2023-10-06T10:57:43.319 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-10-06T10:57:43.569 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : automake-1.16.1-8.el8.noarch 108/155 2023-10-06T10:57:44.145 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 109/155 2023-10-06T10:57:44.259 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 125/155 2023-10-06T10:57:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 109/155 2023-10-06T10:57:44.485 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 110/155 2023-10-06T10:57:44.585 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-10-06T10:57:44.711 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 111/155 2023-10-06T10:57:44.772 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/155 2023-10-06T10:57:44.975 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 112/155 2023-10-06T10:57:44.983 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 128/155 2023-10-06T10:57:45.149 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-10-06T10:57:45.211 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 112/155 2023-10-06T10:57:45.393 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 130/155 2023-10-06T10:57:45.461 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 113/155 2023-10-06T10:57:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-10-06T10:57:45.804 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 132/155 2023-10-06T10:57:46.054 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 133/155 2023-10-06T10:57:46.371 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 134/155 2023-10-06T10:57:46.537 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 113/155 2023-10-06T10:57:46.689 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 135/155 2023-10-06T10:57:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 114/155 2023-10-06T10:57:46.867 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 114/155 2023-10-06T10:57:46.903 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-10-06T10:57:46.915 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-10-06T10:57:47.090 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-10-06T10:57:47.280 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 115/155 2023-10-06T10:57:47.335 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-10-06T10:57:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-10-06T10:57:47.461 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/155 2023-10-06T10:57:47.504 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/155 2023-10-06T10:57:47.644 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-10-06T10:57:47.659 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-10-06T10:57:47.868 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 117/155 2023-10-06T10:57:47.871 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-10-06T10:57:47.883 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 117/155 2023-10-06T10:57:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-10-06T10:57:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 118/155 2023-10-06T10:57:48.207 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-10-06T10:57:48.207 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-10-06T10:57:48.318 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-10-06T10:57:48.439 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-10-06T10:57:48.439 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-10-06T10:57:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-10-06T10:57:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-10-06T10:57:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-10-06T10:57:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-10-06T10:57:49.101 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-10-06T10:57:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-10-06T10:57:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-10-06T10:57:49.696 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-10-06T10:57:49.696 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-10-06T10:57:49.922 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-10-06T10:57:49.922 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-10-06T10:57:50.163 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-10-06T10:57:50.164 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-10-06T10:57:50.372 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-10-06T10:57:50.372 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-10-06T10:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-10-06T10:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-10-06T10:57:50.797 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-10-06T10:57:51.012 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-10-06T10:57:51.647 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-10-06T10:57:51.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/155 2023-10-06T10:57:51.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/155 2023-10-06T10:57:51.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/155 2023-10-06T10:57:51.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/155 2023-10-06T10:57:51.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/155 2023-10-06T10:57:51.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/155 2023-10-06T10:57:51.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/155 2023-10-06T10:57:51.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/155 2023-10-06T10:57:51.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/155 2023-10-06T10:57:51.649 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/155 2023-10-06T10:57:51.649 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/155 2023-10-06T10:57:51.649 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/155 2023-10-06T10:57:51.649 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/155 2023-10-06T10:57:51.649 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/155 2023-10-06T10:57:51.649 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/155 2023-10-06T10:57:51.649 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/155 2023-10-06T10:57:51.649 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/155 2023-10-06T10:57:51.649 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/155 2023-10-06T10:57:51.649 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/155 2023-10-06T10:57:51.649 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/155 2023-10-06T10:57:51.650 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/155 2023-10-06T10:57:51.650 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/155 2023-10-06T10:57:51.650 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/155 2023-10-06T10:57:51.650 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/155 2023-10-06T10:57:51.650 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/155 2023-10-06T10:57:51.650 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/155 2023-10-06T10:57:51.650 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/155 2023-10-06T10:57:51.650 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/155 2023-10-06T10:57:51.650 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/155 2023-10-06T10:57:51.650 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/155 2023-10-06T10:57:51.661 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/155 2023-10-06T10:57:51.661 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/155 2023-10-06T10:57:51.662 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/155 2023-10-06T10:57:51.662 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/155 2023-10-06T10:57:51.662 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/155 2023-10-06T10:57:51.662 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/155 2023-10-06T10:57:51.662 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/155 2023-10-06T10:57:51.662 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/155 2023-10-06T10:57:51.662 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/155 2023-10-06T10:57:51.662 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/155 2023-10-06T10:57:51.662 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/155 2023-10-06T10:57:51.662 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : jq-1.6-7.el8.x86_64 42/155 2023-10-06T10:57:51.662 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 43/155 2023-10-06T10:57:51.663 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 44/155 2023-10-06T10:57:51.663 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 45/155 2023-10-06T10:57:51.663 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 46/155 2023-10-06T10:57:51.663 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 47/155 2023-10-06T10:57:51.663 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 48/155 2023-10-06T10:57:51.663 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 49/155 2023-10-06T10:57:51.663 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 50/155 2023-10-06T10:57:51.663 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 51/155 2023-10-06T10:57:51.663 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 52/155 2023-10-06T10:57:51.663 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 53/155 2023-10-06T10:57:51.663 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 54/155 2023-10-06T10:57:51.664 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 55/155 2023-10-06T10:57:51.664 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 56/155 2023-10-06T10:57:51.664 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 57/155 2023-10-06T10:57:51.664 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 58/155 2023-10-06T10:57:51.664 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 59/155 2023-10-06T10:57:51.664 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 60/155 2023-10-06T10:57:51.664 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 61/155 2023-10-06T10:57:51.664 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 62/155 2023-10-06T10:57:51.664 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 63/155 2023-10-06T10:57:51.664 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 64/155 2023-10-06T10:57:51.664 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 65/155 2023-10-06T10:57:51.664 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 66/155 2023-10-06T10:57:51.665 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 67/155 2023-10-06T10:57:51.665 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 68/155 2023-10-06T10:57:51.665 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 69/155 2023-10-06T10:57:51.665 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 70/155 2023-10-06T10:57:51.665 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 71/155 2023-10-06T10:57:51.665 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 72/155 2023-10-06T10:57:51.665 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 73/155 2023-10-06T10:57:51.665 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 74/155 2023-10-06T10:57:51.665 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 75/155 2023-10-06T10:57:51.665 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 76/155 2023-10-06T10:57:51.665 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 77/155 2023-10-06T10:57:51.666 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 78/155 2023-10-06T10:57:51.666 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/155 2023-10-06T10:57:51.666 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 80/155 2023-10-06T10:57:51.666 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 81/155 2023-10-06T10:57:51.666 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 82/155 2023-10-06T10:57:51.666 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-10-06T10:57:51.666 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 84/155 2023-10-06T10:57:51.666 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 85/155 2023-10-06T10:57:51.666 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 86/155 2023-10-06T10:57:51.666 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 87/155 2023-10-06T10:57:51.666 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/155 2023-10-06T10:57:51.667 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 89/155 2023-10-06T10:57:51.667 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 90/155 2023-10-06T10:57:51.667 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 91/155 2023-10-06T10:57:51.667 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 92/155 2023-10-06T10:57:51.667 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-10-06T10:57:51.667 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-10-06T10:57:51.667 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 95/155 2023-10-06T10:57:51.667 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-10-06T10:57:51.667 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-10-06T10:57:51.667 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-10-06T10:57:51.667 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-10-06T10:57:51.667 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-10-06T10:57:51.668 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-10-06T10:57:51.668 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 102/155 2023-10-06T10:57:51.668 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 103/155 2023-10-06T10:57:51.668 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 104/155 2023-10-06T10:57:51.669 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 105/155 2023-10-06T10:57:51.669 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 106/155 2023-10-06T10:57:51.669 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 107/155 2023-10-06T10:57:51.669 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 108/155 2023-10-06T10:57:51.669 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-10-06T10:57:51.669 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-10-06T10:57:51.669 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 111/155 2023-10-06T10:57:51.669 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 112/155 2023-10-06T10:57:51.669 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 113/155 2023-10-06T10:57:51.669 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 114/155 2023-10-06T10:57:51.670 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 115/155 2023-10-06T10:57:51.670 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 116/155 2023-10-06T10:57:51.670 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 117/155 2023-10-06T10:57:51.670 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 118/155 2023-10-06T10:57:51.670 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/155 2023-10-06T10:57:51.670 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/155 2023-10-06T10:57:51.670 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/155 2023-10-06T10:57:51.670 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 122/155 2023-10-06T10:57:51.670 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 123/155 2023-10-06T10:57:51.670 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 124/155 2023-10-06T10:57:51.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-10-06T10:57:51.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 126/155 2023-10-06T10:57:51.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-10-06T10:57:51.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 128/155 2023-10-06T10:57:51.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-10-06T10:57:51.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 130/155 2023-10-06T10:57:51.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-10-06T10:57:51.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 132/155 2023-10-06T10:57:51.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-10-06T10:57:51.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 134/155 2023-10-06T10:57:51.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-10-06T10:57:51.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 136/155 2023-10-06T10:57:51.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-10-06T10:57:51.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 138/155 2023-10-06T10:57:51.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-10-06T10:57:51.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 140/155 2023-10-06T10:57:51.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-10-06T10:57:51.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/155 2023-10-06T10:57:51.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-10-06T10:57:51.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/155 2023-10-06T10:57:51.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-10-06T10:57:51.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/155 2023-10-06T10:57:51.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-10-06T10:57:51.673 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/155 2023-10-06T10:57:51.673 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-10-06T10:57:51.673 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/155 2023-10-06T10:57:51.673 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-10-06T10:57:51.673 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-10-06T10:57:51.673 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-10-06T10:57:51.673 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-10-06T10:57:53.722 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-10-06T10:57:53.836 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-10-06T10:57:53.837 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:57:53.837 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2023-10-06T10:57:53.837 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-06T10:57:53.837 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-06T10:57:53.837 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-06T10:57:53.837 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-06T10:57:53.837 INFO:teuthology.orchestra.run.smithi007.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-06T10:57:53.837 INFO:teuthology.orchestra.run.smithi007.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-06T10:57:53.837 INFO:teuthology.orchestra.run.smithi007.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-06T10:57:53.837 INFO:teuthology.orchestra.run.smithi007.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-06T10:57:53.838 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.838 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.838 INFO:teuthology.orchestra.run.smithi007.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-06T10:57:53.838 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-06T10:57:53.838 INFO:teuthology.orchestra.run.smithi007.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-06T10:57:53.838 INFO:teuthology.orchestra.run.smithi007.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-06T10:57:53.838 INFO:teuthology.orchestra.run.smithi007.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-10-06T10:57:53.838 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-10-06T10:57:53.838 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-10-06T10:57:53.838 INFO:teuthology.orchestra.run.smithi007.stdout: automake-1.16.1-8.el8.noarch 2023-10-06T10:57:53.838 INFO:teuthology.orchestra.run.smithi007.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T10:57:53.839 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.839 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.839 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.839 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.839 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:57:53.839 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.839 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.839 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.839 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:57:53.839 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:57:53.839 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:57:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:57:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:57:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:57:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:57:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:57:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:57:53.841 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-06T10:57:53.841 INFO:teuthology.orchestra.run.smithi007.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T10:57:53.841 INFO:teuthology.orchestra.run.smithi007.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-06T10:57:53.841 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T10:57:53.841 INFO:teuthology.orchestra.run.smithi007.stdout: jq-1.6-7.el8.x86_64 2023-10-06T10:57:53.841 INFO:teuthology.orchestra.run.smithi007.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-06T10:57:53.841 INFO:teuthology.orchestra.run.smithi007.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-06T10:57:53.841 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T10:57:53.841 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.841 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.841 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.842 INFO:teuthology.orchestra.run.smithi007.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-06T10:57:53.842 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-06T10:57:53.842 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T10:57:53.842 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-06T10:57:53.842 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-06T10:57:53.842 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.842 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.842 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-06T10:57:53.842 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.842 INFO:teuthology.orchestra.run.smithi007.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-06T10:57:53.842 INFO:teuthology.orchestra.run.smithi007.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-06T10:57:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T10:57:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T10:57:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-10-06T10:57:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-06T10:57:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-06T10:57:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T10:57:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T10:57:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-06T10:57:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-06T10:57:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-06T10:57:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-06T10:57:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-06T10:57:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-06T10:57:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T10:57:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-06T10:57:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T10:57:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T10:57:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T10:57:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T10:57:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-06T10:57:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T10:57:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T10:57:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-06T10:57:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T10:57:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T10:57:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T10:57:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-06T10:57:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T10:57:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T10:57:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T10:57:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T10:57:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T10:57:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-06T10:57:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T10:57:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T10:57:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T10:57:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-06T10:57:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-06T10:57:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T10:57:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T10:57:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T10:57:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T10:57:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-06T10:57:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T10:57:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T10:57:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-06T10:57:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-06T10:57:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T10:57:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T10:57:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T10:57:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T10:57:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-06T10:57:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T10:57:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T10:57:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T10:57:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T10:57:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T10:57:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T10:57:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T10:57:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T10:57:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T10:57:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T10:57:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:57:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-06T10:57:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T10:57:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-10-06T10:57:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T10:57:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-06T10:57:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:57:53.849 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-10-06T10:57:54.046 DEBUG:teuthology.parallel:result is None 2023-10-06T10:57:55.635 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 120/155 2023-10-06T10:57:55.877 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/155 2023-10-06T10:57:56.001 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/155 2023-10-06T10:57:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 122/155 2023-10-06T10:57:56.268 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 122/155 2023-10-06T10:57:56.501 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 123/155 2023-10-06T10:57:56.887 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 123/155 2023-10-06T10:57:57.109 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 124/155 2023-10-06T10:57:57.217 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 124/155 2023-10-06T10:57:58.239 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 125/155 2023-10-06T10:57:58.548 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-10-06T10:57:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/155 2023-10-06T10:57:58.973 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 128/155 2023-10-06T10:57:59.179 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-10-06T10:57:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 130/155 2023-10-06T10:57:59.689 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-10-06T10:57:59.936 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 132/155 2023-10-06T10:58:00.211 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 133/155 2023-10-06T10:58:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 134/155 2023-10-06T10:58:00.903 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 135/155 2023-10-06T10:58:01.108 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-10-06T10:58:01.123 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-10-06T10:58:01.332 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-10-06T10:58:01.566 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-10-06T10:58:01.666 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-10-06T10:58:01.917 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-10-06T10:58:01.931 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-10-06T10:58:02.152 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-10-06T10:58:02.336 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-10-06T10:58:02.505 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-10-06T10:58:02.505 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-10-06T10:58:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-10-06T10:58:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-10-06T10:58:03.053 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-10-06T10:58:03.058 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-10-06T10:58:03.212 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-10-06T10:58:03.213 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-10-06T10:58:03.457 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-10-06T10:58:03.627 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-10-06T10:58:03.775 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-10-06T10:58:04.002 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-10-06T10:58:04.002 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-10-06T10:58:04.219 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-10-06T10:58:04.219 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-10-06T10:58:04.444 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-10-06T10:58:04.445 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-10-06T10:58:04.678 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-10-06T10:58:04.678 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-10-06T10:58:04.902 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-10-06T10:58:04.903 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-10-06T10:58:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-10-06T10:58:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-10-06T10:58:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-10-06T10:58:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/155 2023-10-06T10:58:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/155 2023-10-06T10:58:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/155 2023-10-06T10:58:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/155 2023-10-06T10:58:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/155 2023-10-06T10:58:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/155 2023-10-06T10:58:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/155 2023-10-06T10:58:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/155 2023-10-06T10:58:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/155 2023-10-06T10:58:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/155 2023-10-06T10:58:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/155 2023-10-06T10:58:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/155 2023-10-06T10:58:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/155 2023-10-06T10:58:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/155 2023-10-06T10:58:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/155 2023-10-06T10:58:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/155 2023-10-06T10:58:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/155 2023-10-06T10:58:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/155 2023-10-06T10:58:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/155 2023-10-06T10:58:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/155 2023-10-06T10:58:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/155 2023-10-06T10:58:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/155 2023-10-06T10:58:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/155 2023-10-06T10:58:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/155 2023-10-06T10:58:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/155 2023-10-06T10:58:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/155 2023-10-06T10:58:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/155 2023-10-06T10:58:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/155 2023-10-06T10:58:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/155 2023-10-06T10:58:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/155 2023-10-06T10:58:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/155 2023-10-06T10:58:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/155 2023-10-06T10:58:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/155 2023-10-06T10:58:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/155 2023-10-06T10:58:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/155 2023-10-06T10:58:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/155 2023-10-06T10:58:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/155 2023-10-06T10:58:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/155 2023-10-06T10:58:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/155 2023-10-06T10:58:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/155 2023-10-06T10:58:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/155 2023-10-06T10:58:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jq-1.6-7.el8.x86_64 42/155 2023-10-06T10:58:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 43/155 2023-10-06T10:58:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 44/155 2023-10-06T10:58:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 45/155 2023-10-06T10:58:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 46/155 2023-10-06T10:58:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 47/155 2023-10-06T10:58:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 48/155 2023-10-06T10:58:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 49/155 2023-10-06T10:58:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 50/155 2023-10-06T10:58:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 51/155 2023-10-06T10:58:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 52/155 2023-10-06T10:58:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 53/155 2023-10-06T10:58:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 54/155 2023-10-06T10:58:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 55/155 2023-10-06T10:58:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 56/155 2023-10-06T10:58:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 57/155 2023-10-06T10:58:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 58/155 2023-10-06T10:58:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 59/155 2023-10-06T10:58:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 60/155 2023-10-06T10:58:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 61/155 2023-10-06T10:58:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 62/155 2023-10-06T10:58:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 63/155 2023-10-06T10:58:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 64/155 2023-10-06T10:58:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 65/155 2023-10-06T10:58:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 66/155 2023-10-06T10:58:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 67/155 2023-10-06T10:58:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 68/155 2023-10-06T10:58:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 69/155 2023-10-06T10:58:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 70/155 2023-10-06T10:58:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 71/155 2023-10-06T10:58:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 72/155 2023-10-06T10:58:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 73/155 2023-10-06T10:58:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 74/155 2023-10-06T10:58:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 75/155 2023-10-06T10:58:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 76/155 2023-10-06T10:58:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 77/155 2023-10-06T10:58:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 78/155 2023-10-06T10:58:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/155 2023-10-06T10:58:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 80/155 2023-10-06T10:58:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 81/155 2023-10-06T10:58:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 82/155 2023-10-06T10:58:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-10-06T10:58:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 84/155 2023-10-06T10:58:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 85/155 2023-10-06T10:58:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 86/155 2023-10-06T10:58:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 87/155 2023-10-06T10:58:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/155 2023-10-06T10:58:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 89/155 2023-10-06T10:58:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 90/155 2023-10-06T10:58:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 91/155 2023-10-06T10:58:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 92/155 2023-10-06T10:58:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-10-06T10:58:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-10-06T10:58:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 95/155 2023-10-06T10:58:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-10-06T10:58:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-10-06T10:58:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-10-06T10:58:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-10-06T10:58:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-10-06T10:58:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-10-06T10:58:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 102/155 2023-10-06T10:58:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 103/155 2023-10-06T10:58:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 104/155 2023-10-06T10:58:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 105/155 2023-10-06T10:58:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 106/155 2023-10-06T10:58:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 107/155 2023-10-06T10:58:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 108/155 2023-10-06T10:58:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-10-06T10:58:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-10-06T10:58:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 111/155 2023-10-06T10:58:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 112/155 2023-10-06T10:58:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 113/155 2023-10-06T10:58:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 114/155 2023-10-06T10:58:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 115/155 2023-10-06T10:58:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 116/155 2023-10-06T10:58:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 117/155 2023-10-06T10:58:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 118/155 2023-10-06T10:58:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/155 2023-10-06T10:58:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/155 2023-10-06T10:58:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/155 2023-10-06T10:58:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 122/155 2023-10-06T10:58:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 123/155 2023-10-06T10:58:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 124/155 2023-10-06T10:58:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-10-06T10:58:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 126/155 2023-10-06T10:58:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-10-06T10:58:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 128/155 2023-10-06T10:58:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-10-06T10:58:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 130/155 2023-10-06T10:58:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-10-06T10:58:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 132/155 2023-10-06T10:58:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-10-06T10:58:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 134/155 2023-10-06T10:58:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-10-06T10:58:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 136/155 2023-10-06T10:58:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-10-06T10:58:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 138/155 2023-10-06T10:58:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-10-06T10:58:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 140/155 2023-10-06T10:58:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-10-06T10:58:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/155 2023-10-06T10:58:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-10-06T10:58:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/155 2023-10-06T10:58:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-10-06T10:58:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/155 2023-10-06T10:58:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-10-06T10:58:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/155 2023-10-06T10:58:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-10-06T10:58:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/155 2023-10-06T10:58:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-10-06T10:58:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-10-06T10:58:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-10-06T10:58:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-10-06T10:58:08.301 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-10-06T10:58:08.301 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:08.302 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2023-10-06T10:58:08.302 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-06T10:58:08.302 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-06T10:58:08.302 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-06T10:58:08.302 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-06T10:58:08.302 INFO:teuthology.orchestra.run.smithi050.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-06T10:58:08.302 INFO:teuthology.orchestra.run.smithi050.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-06T10:58:08.302 INFO:teuthology.orchestra.run.smithi050.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-06T10:58:08.302 INFO:teuthology.orchestra.run.smithi050.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-06T10:58:08.302 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.303 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.303 INFO:teuthology.orchestra.run.smithi050.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-06T10:58:08.303 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-06T10:58:08.303 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-06T10:58:08.303 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-06T10:58:08.303 INFO:teuthology.orchestra.run.smithi050.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-10-06T10:58:08.303 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-10-06T10:58:08.303 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-06T10:58:08.303 INFO:teuthology.orchestra.run.smithi050.stdout: automake-1.16.1-8.el8.noarch 2023-10-06T10:58:08.303 INFO:teuthology.orchestra.run.smithi050.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T10:58:08.303 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.303 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.304 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.304 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.304 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:58:08.304 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.304 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.304 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.304 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:58:08.304 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:58:08.304 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:58:08.304 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:58:08.304 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:58:08.304 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.305 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.305 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:58:08.305 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.305 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.305 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.305 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:58:08.305 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:58:08.305 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.305 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T10:58:08.305 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-06T10:58:08.305 INFO:teuthology.orchestra.run.smithi050.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T10:58:08.306 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-06T10:58:08.306 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T10:58:08.306 INFO:teuthology.orchestra.run.smithi050.stdout: jq-1.6-7.el8.x86_64 2023-10-06T10:58:08.306 INFO:teuthology.orchestra.run.smithi050.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-06T10:58:08.306 INFO:teuthology.orchestra.run.smithi050.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-06T10:58:08.306 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T10:58:08.306 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.306 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.306 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.306 INFO:teuthology.orchestra.run.smithi050.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-06T10:58:08.306 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-06T10:58:08.306 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T10:58:08.307 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-06T10:58:08.307 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-06T10:58:08.307 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.307 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.307 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-06T10:58:08.307 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.307 INFO:teuthology.orchestra.run.smithi050.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-06T10:58:08.307 INFO:teuthology.orchestra.run.smithi050.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-06T10:58:08.307 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T10:58:08.307 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T10:58:08.307 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-10-06T10:58:08.307 INFO:teuthology.orchestra.run.smithi050.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-06T10:58:08.308 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-06T10:58:08.308 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T10:58:08.308 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T10:58:08.308 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-06T10:58:08.308 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-06T10:58:08.308 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-06T10:58:08.308 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-06T10:58:08.308 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-06T10:58:08.308 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-06T10:58:08.308 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T10:58:08.308 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-06T10:58:08.308 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T10:58:08.309 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T10:58:08.309 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T10:58:08.309 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.309 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.309 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.309 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T10:58:08.309 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-06T10:58:08.309 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T10:58:08.309 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T10:58:08.309 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-06T10:58:08.309 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T10:58:08.310 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T10:58:08.310 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T10:58:08.310 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-06T10:58:08.310 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T10:58:08.310 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T10:58:08.310 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T10:58:08.310 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T10:58:08.310 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T10:58:08.310 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-06T10:58:08.310 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T10:58:08.310 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T10:58:08.310 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T10:58:08.311 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-06T10:58:08.311 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-06T10:58:08.311 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T10:58:08.311 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T10:58:08.311 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T10:58:08.311 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T10:58:08.311 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-06T10:58:08.311 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T10:58:08.311 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T10:58:08.311 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-06T10:58:08.311 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-06T10:58:08.312 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.312 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.312 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T10:58:08.312 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T10:58:08.312 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.312 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T10:58:08.312 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T10:58:08.312 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-06T10:58:08.312 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T10:58:08.312 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T10:58:08.312 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T10:58:08.312 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T10:58:08.313 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T10:58:08.313 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T10:58:08.313 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T10:58:08.313 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T10:58:08.313 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T10:58:08.313 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T10:58:08.313 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.313 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.313 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T10:58:08.313 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-06T10:58:08.313 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T10:58:08.313 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-10-06T10:58:08.313 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T10:58:08.314 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-06T10:58:08.314 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:08.314 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-06T10:58:08.556 DEBUG:teuthology.parallel:result is None 2023-10-06T10:58:08.557 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T10:58:08.703 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T10:58:08.734 INFO:teuthology.orchestra.run.smithi007.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T10:58:08.734 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T10:58:08.735 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T10:58:08.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T10:58:08.963 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T10:58:08.994 INFO:teuthology.orchestra.run.smithi050.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T10:58:08.994 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T10:58:08.994 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T10:58:08.994 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T10:58:08.995 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:08.995 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T10:58:09.034 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:09.034 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T10:58:09.073 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T10:58:09.074 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:09.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T10:58:09.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T10:58:09.185 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:09.185 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T10:58:09.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T10:58:09.294 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T10:58:09.294 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:09.295 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T10:58:09.330 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T10:58:09.405 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:09.406 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T10:58:09.439 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T10:58:09.514 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T10:58:09.515 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:09.515 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T10:58:09.549 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T10:58:09.624 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:09.625 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T10:58:09.658 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T10:58:09.733 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T10:58:09.797 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T10:58:09.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /var/log/ceph 2023-10-06T10:58:09.800 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2023-10-06T10:58:09.835 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T10:58:09.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T10:58:09.876 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T10:58:09.910 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T10:58:09.911 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T10:58:09.952 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T10:58:09.993 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T10:58:09.993 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T10:58:09.993 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T10:58:09.993 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:09.993 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T10:58:10.049 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T10:58:10.176 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T10:58:10.211 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:10.211 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T10:58:10.233 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T10:58:10.362 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T10:58:10.406 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T10:58:10.407 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T10:58:10.407 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371', 'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412371', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4002, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'targets': {'smithi007.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPmUNiI/du+DjhAlXQqDXZHtSBNrzErqwHdIF4I4HEoabQNYe2dN39WN6tRc+KGGK3RQYjnZAflyfpBIDOwwxvQ=', 'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOausg9QGYOUb+3nlDjpaqaYFRu/skUFfldx5MhhbcPoS5Loddu2QNq0FlmG+37CgvpmltbfDLC8l+xDYcsFi+E='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:54:57', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T10:58:10.408 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T10:58:10.411 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T10:58:10.457 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T10:58:10.474 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T10:58:10.531 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:10.531 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T10:58:10.570 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T10:58:10.571 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2023-10-06T10:58:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T10:58:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T10:58:10.635 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 395723 Links: 1 2023-10-06T10:58:10.635 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T10:58:10.635 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T10:58:10.635 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-10-06 10:57:51.249407141 +0000 2023-10-06T10:58:10.635 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-10-06 10:54:14.215860635 +0000 2023-10-06T10:58:10.635 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-10-06 10:54:14.215860635 +0000 2023-10-06T10:58:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-10-06T10:58:10.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T10:58:10.708 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-10-06T10:58:10.708 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-10-06T10:58:10.708 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.00012743 s, 4.0 MB/s 2023-10-06T10:58:10.709 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T10:58:10.775 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2023-10-06T10:58:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T10:58:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T10:58:10.840 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 394118 Links: 1 2023-10-06T10:58:10.840 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T10:58:10.840 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T10:58:10.840 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-10-06 10:57:51.249407141 +0000 2023-10-06T10:58:10.840 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-10-06 10:54:14.781852351 +0000 2023-10-06T10:58:10.841 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-10-06 10:54:14.781852351 +0000 2023-10-06T10:58:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-10-06T10:58:10.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T10:58:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-10-06T10:58:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-10-06T10:58:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000112771 s, 4.5 MB/s 2023-10-06T10:58:10.914 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T10:58:10.979 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2023-10-06T10:58:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T10:58:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T10:58:11.043 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 396036 Links: 1 2023-10-06T10:58:11.043 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T10:58:11.043 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T10:58:11.043 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-10-06 10:57:51.249407141 +0000 2023-10-06T10:58:11.043 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-10-06 10:54:15.340844171 +0000 2023-10-06T10:58:11.043 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-10-06 10:54:15.340844171 +0000 2023-10-06T10:58:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-10-06T10:58:11.044 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T10:58:11.116 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-10-06T10:58:11.116 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-10-06T10:58:11.116 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000126429 s, 4.0 MB/s 2023-10-06T10:58:11.117 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T10:58:11.182 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2023-10-06T10:58:11.245 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T10:58:11.245 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T10:58:11.245 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 390595 Links: 1 2023-10-06T10:58:11.246 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T10:58:11.246 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T10:58:11.246 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-10-06 10:57:51.249407141 +0000 2023-10-06T10:58:11.246 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-10-06 10:54:15.935835463 +0000 2023-10-06T10:58:11.246 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-10-06 10:54:15.935835463 +0000 2023-10-06T10:58:11.246 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-10-06T10:58:11.246 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T10:58:11.318 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-10-06T10:58:11.318 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-10-06T10:58:11.318 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000125586 s, 4.1 MB/s 2023-10-06T10:58:11.319 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T10:58:11.384 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T10:58:11.384 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:11.385 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T10:58:11.408 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T10:58:11.408 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2023-10-06T10:58:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T10:58:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T10:58:11.472 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 387613 Links: 1 2023-10-06T10:58:11.473 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T10:58:11.473 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T10:58:11.473 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-06 10:58:05.547554914 +0000 2023-10-06T10:58:11.473 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-06 10:54:14.685022121 +0000 2023-10-06T10:58:11.473 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-06 10:54:14.685022121 +0000 2023-10-06T10:58:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-10-06T10:58:11.473 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T10:58:11.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-06T10:58:11.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-06T10:58:11.551 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000142659 s, 3.6 MB/s 2023-10-06T10:58:11.552 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T10:58:11.616 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2023-10-06T10:58:11.679 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T10:58:11.679 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T10:58:11.680 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 395992 Links: 1 2023-10-06T10:58:11.680 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T10:58:11.680 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T10:58:11.680 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-06 10:58:05.547554914 +0000 2023-10-06T10:58:11.680 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-06 10:54:15.252008181 +0000 2023-10-06T10:58:11.680 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-06 10:54:15.252008181 +0000 2023-10-06T10:58:11.680 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-10-06T10:58:11.680 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T10:58:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-06T10:58:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-06T10:58:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000113465 s, 4.5 MB/s 2023-10-06T10:58:11.755 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T10:58:11.819 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2023-10-06T10:58:11.883 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T10:58:11.884 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T10:58:11.884 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 397633 Links: 1 2023-10-06T10:58:11.884 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T10:58:11.884 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T10:58:11.884 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-06 10:58:05.547554914 +0000 2023-10-06T10:58:11.884 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-06 10:54:15.829993970 +0000 2023-10-06T10:58:11.884 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-06 10:54:15.829993970 +0000 2023-10-06T10:58:11.884 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-10-06T10:58:11.885 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T10:58:11.956 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-06T10:58:11.956 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-06T10:58:11.957 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.00011534 s, 4.4 MB/s 2023-10-06T10:58:11.957 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T10:58:12.022 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2023-10-06T10:58:12.086 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T10:58:12.086 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T10:58:12.086 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 392826 Links: 1 2023-10-06T10:58:12.086 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T10:58:12.086 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T10:58:12.086 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-06 10:58:05.547554914 +0000 2023-10-06T10:58:12.086 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-06 10:54:16.392980128 +0000 2023-10-06T10:58:12.087 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-06 10:54:16.392980128 +0000 2023-10-06T10:58:12.087 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-10-06T10:58:12.087 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T10:58:12.159 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-06T10:58:12.159 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-06T10:58:12.159 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000127097 s, 4.0 MB/s 2023-10-06T10:58:12.160 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T10:58:12.225 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T10:58:12.225 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T10:58:12.225 INFO:tasks.ceph:Generating config... 2023-10-06T10:58:12.227 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T10:58:12.227 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T10:58:12.227 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T10:58:12.227 INFO:tasks.ceph:[client] pid file = 2023-10-06T10:58:12.227 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T10:58:12.227 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T10:58:12.227 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T10:58:12.227 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T10:58:12.228 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T10:58:12.228 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T10:58:12.228 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T10:58:12.228 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T10:58:12.228 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T10:58:12.228 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T10:58:12.228 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T10:58:12.228 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T10:58:12.228 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T10:58:12.229 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T10:58:12.229 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T10:58:12.229 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T10:58:12.229 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T10:58:12.229 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T10:58:12.229 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T10:58:12.229 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-06T10:58:12.229 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-06T10:58:12.229 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T10:58:12.229 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T10:58:12.229 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-06T10:58:12.229 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T10:58:12.230 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T10:58:12.230 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T10:58:12.230 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T10:58:12.230 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T10:58:12.230 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T10:58:12.230 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T10:58:12.230 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T10:58:12.296 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T10:58:12.299 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T10:58:12.351 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T10:58:12.383 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.7'), ('mon.b', '172.21.15.50'), ('mon.c', '[v2:172.21.15.50:3301,v1:172.21.15.50:6790]')] 2023-10-06T10:58:12.384 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.7,172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T10:58:12.384 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:12.384 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T10:58:12.447 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.7 --add b 172.21.15.50 --addv c '[v2:172.21.15.50:3301,v1:172.21.15.50:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T10:58:12.542 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T10:58:12.542 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: generated fsid ff7fc17b-4d49-4596-ba3b-1d865cad8f21 2023-10-06T10:58:12.542 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = octopus 2023-10-06T10:58:12.542 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 0 2023-10-06T10:58:12.542 INFO:teuthology.orchestra.run.smithi007.stdout:fsid ff7fc17b-4d49-4596-ba3b-1d865cad8f21 2023-10-06T10:58:12.542 INFO:teuthology.orchestra.run.smithi007.stdout:last_changed 2023-10-06T10:58:12.541425+0000 2023-10-06T10:58:12.543 INFO:teuthology.orchestra.run.smithi007.stdout:created 2023-10-06T10:58:12.541425+0000 2023-10-06T10:58:12.543 INFO:teuthology.orchestra.run.smithi007.stdout:min_mon_release 15 (octopus) 2023-10-06T10:58:12.543 INFO:teuthology.orchestra.run.smithi007.stdout:election_strategy: 1 2023-10-06T10:58:12.543 INFO:teuthology.orchestra.run.smithi007.stdout:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2023-10-06T10:58:12.543 INFO:teuthology.orchestra.run.smithi007.stdout:1: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2023-10-06T10:58:12.543 INFO:teuthology.orchestra.run.smithi007.stdout:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2023-10-06T10:58:12.543 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T10:58:12.544 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T10:58:12.565 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ff7fc17b-4d49-4596-ba3b-1d865cad8f21... 2023-10-06T10:58:12.566 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T10:58:12.608 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T10:58:12.663 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2023-10-06T10:58:12.663 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2023-10-06T10:58:12.663 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T10:58:12.663 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2023-10-06T10:58:12.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.663 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2023-10-06T10:58:12.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.663 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2023-10-06T10:58:12.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.663 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2023-10-06T10:58:12.664 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2023-10-06T10:58:12.664 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.664 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2023-10-06T10:58:12.664 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2023-10-06T10:58:12.664 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.664 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T10:58:12.664 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2023-10-06T10:58:12.664 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.664 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T10:58:12.664 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T10:58:12.665 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.665 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2023-10-06T10:58:12.665 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.665 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2023-10-06T10:58:12.665 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2023-10-06T10:58:12.665 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2023-10-06T10:58:12.665 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2023-10-06T10:58:12.665 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2023-10-06T10:58:12.665 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2023-10-06T10:58:12.665 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2023-10-06T10:58:12.665 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T10:58:12.666 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T10:58:12.666 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2023-10-06T10:58:12.666 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.666 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T10:58:12.666 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.666 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2023-10-06T10:58:12.666 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.666 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2023-10-06T10:58:12.666 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.666 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2023-10-06T10:58:12.667 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2023-10-06T10:58:12.667 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2023-10-06T10:58:12.667 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.7,172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790]" 2023-10-06T10:58:12.667 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = ff7fc17b-4d49-4596-ba3b-1d865cad8f21 2023-10-06T10:58:12.667 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.667 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2023-10-06T10:58:12.667 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2023-10-06T10:58:12.667 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.667 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2023-10-06T10:58:12.667 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2023-10-06T10:58:12.667 INFO:teuthology.orchestra.run.smithi007.stdout: osd mclock profile = high_recovery_ops 2023-10-06T10:58:12.668 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.668 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2023-10-06T10:58:12.668 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2023-10-06T10:58:12.668 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.668 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2023-10-06T10:58:12.668 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2023-10-06T10:58:12.668 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2023-10-06T10:58:12.668 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.668 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2023-10-06T10:58:12.668 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2023-10-06T10:58:12.668 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.669 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2023-10-06T10:58:12.669 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.669 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2023-10-06T10:58:12.669 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.669 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2023-10-06T10:58:12.669 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.669 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2023-10-06T10:58:12.669 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2023-10-06T10:58:12.669 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.669 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2023-10-06T10:58:12.669 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2023-10-06T10:58:12.670 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2023-10-06T10:58:12.670 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2023-10-06T10:58:12.670 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 20 2023-10-06T10:58:12.670 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 20 2023-10-06T10:58:12.670 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-10-06T10:58:12.670 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2023-10-06T10:58:12.670 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 10 2023-10-06T10:58:12.670 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T10:58:12.670 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2023-10-06T10:58:12.670 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2023-10-06T10:58:12.671 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2023-10-06T10:58:12.671 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2023-10-06T10:58:12.671 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2023-10-06T10:58:12.671 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.671 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2023-10-06T10:58:12.671 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-10-06T10:58:12.671 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2023-10-06T10:58:12.671 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2023-10-06T10:58:12.671 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2023-10-06T10:58:12.671 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2023-10-06T10:58:12.671 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2023-10-06T10:58:12.671 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2023-10-06T10:58:12.672 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.672 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2023-10-06T10:58:12.672 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-10-06T10:58:12.672 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2023-10-06T10:58:12.672 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2023-10-06T10:58:12.672 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2023-10-06T10:58:12.672 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2023-10-06T10:58:12.672 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2023-10-06T10:58:12.672 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2023-10-06T10:58:12.672 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2023-10-06T10:58:12.673 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2023-10-06T10:58:12.673 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2023-10-06T10:58:12.673 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.673 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T10:58:12.673 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T10:58:12.673 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T10:58:12.673 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.673 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T10:58:12.673 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T10:58:12.674 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T10:58:12.674 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.674 INFO:teuthology.orchestra.run.smithi007.stdout: # 1m isn't quite enough 2023-10-06T10:58:12.674 INFO:teuthology.orchestra.run.smithi007.stdout: mon_down_mkfs_grace = 2m 2023-10-06T10:58:12.674 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.674 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_filestore_osds = false 2023-10-06T10:58:12.674 INFO:teuthology.orchestra.run.smithi007.stdout: mon op complaint time = 120 2023-10-06T10:58:12.674 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:12.674 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2023-10-06T10:58:12.674 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2023-10-06T10:58:12.675 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2023-10-06T10:58:12.675 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2023-10-06T10:58:12.675 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T10:58:12.675 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T10:58:12.675 INFO:teuthology.orchestra.run.smithi007.stdout: client mount timeout = 600 2023-10-06T10:58:12.675 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2023-10-06T10:58:12.675 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-10-06T10:58:12.675 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = "" 2023-10-06T10:58:12.675 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2023-10-06T10:58:12.676 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2023-10-06T10:58:12.676 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2023-10-06T10:58:12.676 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2023-10-06T10:58:12.676 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2023-10-06T10:58:12.676 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2023-10-06T10:58:12.676 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2023-10-06T10:58:12.676 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2023-10-06T10:58:12.676 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d] 2023-10-06T10:58:12.676 INFO:teuthology.orchestra.run.smithi007.stdout:[mds] 2023-10-06T10:58:12.676 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds = 20 2023-10-06T10:58:12.676 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-10-06T10:58:12.677 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug frag = True 2023-10-06T10:58:12.677 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug scatterstat = True 2023-10-06T10:58:12.677 INFO:teuthology.orchestra.run.smithi007.stdout: mds op complaint time = 180 2023-10-06T10:58:12.677 INFO:teuthology.orchestra.run.smithi007.stdout: mds verify scatter = True 2023-10-06T10:58:12.677 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2023-10-06T10:58:12.677 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2023-10-06T10:58:12.677 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2023-10-06T10:58:12.677 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2023-10-06T10:58:12.678 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2023-10-06T10:58:12.678 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T10:58:12.678 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2023-10-06T10:58:12.678 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.678 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2023-10-06T10:58:12.678 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.678 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2023-10-06T10:58:12.678 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.678 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2023-10-06T10:58:12.678 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2023-10-06T10:58:12.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.679 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2023-10-06T10:58:12.679 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2023-10-06T10:58:12.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.679 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T10:58:12.679 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2023-10-06T10:58:12.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.679 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T10:58:12.679 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T10:58:12.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.679 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2023-10-06T10:58:12.680 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2023-10-06T10:58:12.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2023-10-06T10:58:12.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2023-10-06T10:58:12.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2023-10-06T10:58:12.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2023-10-06T10:58:12.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2023-10-06T10:58:12.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2023-10-06T10:58:12.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T10:58:12.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T10:58:12.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2023-10-06T10:58:12.681 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.681 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T10:58:12.681 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.681 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2023-10-06T10:58:12.681 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2023-10-06T10:58:12.681 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2023-10-06T10:58:12.681 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2023-10-06T10:58:12.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2023-10-06T10:58:12.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.7,172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790]" 2023-10-06T10:58:12.681 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = ff7fc17b-4d49-4596-ba3b-1d865cad8f21 2023-10-06T10:58:12.682 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.682 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2023-10-06T10:58:12.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2023-10-06T10:58:12.682 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2023-10-06T10:58:12.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2023-10-06T10:58:12.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2023-10-06T10:58:12.682 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2023-10-06T10:58:12.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2023-10-06T10:58:12.683 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2023-10-06T10:58:12.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2023-10-06T10:58:12.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2023-10-06T10:58:12.683 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2023-10-06T10:58:12.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2023-10-06T10:58:12.683 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2023-10-06T10:58:12.683 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2023-10-06T10:58:12.684 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.684 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2023-10-06T10:58:12.684 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.684 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2023-10-06T10:58:12.684 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2023-10-06T10:58:12.684 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.684 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2023-10-06T10:58:12.684 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2023-10-06T10:58:12.684 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2023-10-06T10:58:12.684 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2023-10-06T10:58:12.684 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2023-10-06T10:58:12.684 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2023-10-06T10:58:12.685 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-06T10:58:12.685 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2023-10-06T10:58:12.685 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2023-10-06T10:58:12.685 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T10:58:12.685 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2023-10-06T10:58:12.685 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2023-10-06T10:58:12.685 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2023-10-06T10:58:12.685 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2023-10-06T10:58:12.685 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2023-10-06T10:58:12.685 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.685 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2023-10-06T10:58:12.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-06T10:58:12.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2023-10-06T10:58:12.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-10-06T10:58:12.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-10-06T10:58:12.686 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-10-06T10:58:12.686 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-10-06T10:58:12.686 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2023-10-06T10:58:12.686 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.686 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2023-10-06T10:58:12.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-06T10:58:12.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-10-06T10:58:12.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2023-10-06T10:58:12.687 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-10-06T10:58:12.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2023-10-06T10:58:12.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2023-10-06T10:58:12.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-10-06T10:58:12.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2023-10-06T10:58:12.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2023-10-06T10:58:12.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-10-06T10:58:12.687 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.687 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T10:58:12.687 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T10:58:12.687 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T10:58:12.687 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.688 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T10:58:12.688 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T10:58:12.688 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T10:58:12.688 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.688 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2023-10-06T10:58:12.688 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2023-10-06T10:58:12.688 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.688 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2023-10-06T10:58:12.688 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2023-10-06T10:58:12.688 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T10:58:12.688 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2023-10-06T10:58:12.689 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2023-10-06T10:58:12.689 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2023-10-06T10:58:12.689 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2023-10-06T10:58:12.689 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T10:58:12.689 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T10:58:12.689 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2023-10-06T10:58:12.689 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2023-10-06T10:58:12.689 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-06T10:58:12.689 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = "" 2023-10-06T10:58:12.689 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2023-10-06T10:58:12.689 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2023-10-06T10:58:12.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2023-10-06T10:58:12.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2023-10-06T10:58:12.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2023-10-06T10:58:12.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2023-10-06T10:58:12.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2023-10-06T10:58:12.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2023-10-06T10:58:12.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2023-10-06T10:58:12.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2023-10-06T10:58:12.690 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2023-10-06T10:58:12.690 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-06T10:58:12.690 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2023-10-06T10:58:12.690 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2023-10-06T10:58:12.691 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2023-10-06T10:58:12.691 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2023-10-06T10:58:12.691 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2023-10-06T10:58:12.691 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2023-10-06T10:58:12.691 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2023-10-06T10:58:12.692 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T10:58:12.692 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T10:58:12.861 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T10:58:12.861 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:12.861 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T10:58:12.885 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:12.885 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T10:58:12.948 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T10:58:12.948 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:12.948 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T10:58:12.949 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T10:58:13.035 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:13.036 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T10:58:13.112 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T10:58:13.112 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:13.112 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T10:58:13.112 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T10:58:13.160 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:13.160 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T10:58:13.223 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T10:58:13.223 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T10:58:13.223 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T10:58:13.288 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T10:58:13.291 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T10:58:13.460 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T10:58:13.463 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T10:58:13.464 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T10:58:13.528 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T10:58:13.530 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T10:58:13.563 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T10:58:13.667 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T10:58:13.670 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T10:58:13.703 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T10:58:13.768 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T10:58:13.771 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T10:58:13.804 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T10:58:13.907 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T10:58:13.910 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T10:58:13.942 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T10:58:13.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T10:58:13.994 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T10:58:14.009 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T10:58:14.057 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T10:58:14.071 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T10:58:14.121 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T10:58:14.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T10:58:14.184 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T10:58:14.198 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T10:58:14.198 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T10:58:14.198 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T10:58:14.234 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T10:58:14.234 INFO:tasks.ceph:role: osd.0 2023-10-06T10:58:14.234 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T10:58:14.235 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T10:58:14.309 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T10:58:14.309 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T10:58:14.309 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T10:58:14.309 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T10:58:14.309 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T10:58:14.309 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-10-06T10:58:14.309 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T10:58:14.309 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T10:58:14.310 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T10:58:14.310 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T10:58:14.332 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-10-06T10:58:14.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-10-06T10:58:14.334 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T10:58:14.426 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T10:58:14.465 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T10:58:14.540 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T10:58:14.540 INFO:tasks.ceph:role: osd.1 2023-10-06T10:58:14.541 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T10:58:14.541 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T10:58:14.615 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T10:58:14.615 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T10:58:14.616 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T10:58:14.616 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T10:58:14.616 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T10:58:14.616 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-10-06T10:58:14.616 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T10:58:14.616 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T10:58:14.616 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T10:58:14.616 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T10:58:14.638 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-10-06T10:58:14.640 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-10-06T10:58:14.641 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T10:58:14.729 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T10:58:14.766 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T10:58:14.841 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T10:58:14.842 INFO:tasks.ceph:role: osd.2 2023-10-06T10:58:14.842 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T10:58:14.842 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T10:58:14.916 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T10:58:14.916 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T10:58:14.916 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T10:58:14.917 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T10:58:14.917 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T10:58:14.917 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-10-06T10:58:14.917 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T10:58:14.917 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T10:58:14.917 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T10:58:14.917 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T10:58:14.940 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-10-06T10:58:14.941 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-10-06T10:58:14.942 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T10:58:15.030 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T10:58:15.067 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T10:58:15.142 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T10:58:15.143 INFO:tasks.ceph:role: osd.3 2023-10-06T10:58:15.143 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T10:58:15.143 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T10:58:15.218 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T10:58:15.218 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T10:58:15.218 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T10:58:15.218 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T10:58:15.218 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T10:58:15.218 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-10-06T10:58:15.218 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T10:58:15.219 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T10:58:15.219 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T10:58:15.219 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T10:58:15.241 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-10-06T10:58:15.243 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-10-06T10:58:15.243 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T10:58:15.332 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T10:58:15.368 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T10:58:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:15.472+0000 7f2428971540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T10:58:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:15.472+0000 7f2428971540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T10:58:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:15.472+0000 7f2428971540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T10:58:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:15.472+0000 7f2428971540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T10:58:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:15.472+0000 7f2428971540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T10:58:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:15.473+0000 7f2428971540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T10:58:15.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:15.996+0000 7f2428971540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:16.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:16.761+0000 7f2428971540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:17.525+0000 7f2428971540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:18.324 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T10:58:18.359 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T10:58:18.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:18.453+0000 7f7a62eb5540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T10:58:18.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:18.453+0000 7f7a62eb5540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T10:58:18.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:18.454+0000 7f7a62eb5540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T10:58:18.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:18.454+0000 7f7a62eb5540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T10:58:18.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:18.454+0000 7f7a62eb5540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T10:58:18.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:18.454+0000 7f7a62eb5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T10:58:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:18.979+0000 7f7a62eb5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:19.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:19.739+0000 7f7a62eb5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:20.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:20.507+0000 7f7a62eb5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:21.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T10:58:21.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T10:58:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:21.433+0000 7fd640ec3540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T10:58:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:21.434+0000 7fd640ec3540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T10:58:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:21.434+0000 7fd640ec3540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T10:58:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:21.434+0000 7fd640ec3540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T10:58:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:21.434+0000 7fd640ec3540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T10:58:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:21.434+0000 7fd640ec3540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T10:58:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:21.959+0000 7fd640ec3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:22.720+0000 7fd640ec3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:23.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:23.484+0000 7fd640ec3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:24.280 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T10:58:24.315 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T10:58:24.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:24.408+0000 7fc18ba54540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T10:58:24.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:24.409+0000 7fc18ba54540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T10:58:24.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:24.409+0000 7fc18ba54540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T10:58:24.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:24.409+0000 7fc18ba54540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T10:58:24.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:24.409+0000 7fc18ba54540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T10:58:24.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:24.409+0000 7fc18ba54540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T10:58:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:24.934+0000 7fc18ba54540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:25.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:25.697+0000 7fc18ba54540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:26.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:26.458+0000 7fc18ba54540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:27.254 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T10:58:27.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T10:58:27.325 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T10:58:27.325 INFO:tasks.ceph:role: osd.4 2023-10-06T10:58:27.325 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T10:58:27.326 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T10:58:27.401 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T10:58:27.401 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T10:58:27.401 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T10:58:27.401 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T10:58:27.401 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T10:58:27.401 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-10-06T10:58:27.401 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T10:58:27.402 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T10:58:27.402 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T10:58:27.402 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T10:58:27.424 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-10-06T10:58:27.426 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-10-06T10:58:27.426 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T10:58:27.514 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T10:58:27.551 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T10:58:27.626 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T10:58:27.626 INFO:tasks.ceph:role: osd.5 2023-10-06T10:58:27.626 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T10:58:27.626 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T10:58:27.701 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T10:58:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T10:58:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T10:58:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T10:58:27.701 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T10:58:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-10-06T10:58:27.702 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T10:58:27.702 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T10:58:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T10:58:27.702 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T10:58:27.723 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-10-06T10:58:27.725 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-10-06T10:58:27.726 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T10:58:27.813 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T10:58:27.850 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T10:58:27.926 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T10:58:27.926 INFO:tasks.ceph:role: osd.6 2023-10-06T10:58:27.926 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T10:58:27.927 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T10:58:28.001 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T10:58:28.002 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T10:58:28.002 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T10:58:28.002 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T10:58:28.002 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T10:58:28.002 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-10-06T10:58:28.002 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T10:58:28.002 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T10:58:28.002 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T10:58:28.003 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T10:58:28.024 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-10-06T10:58:28.026 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-10-06T10:58:28.027 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T10:58:28.115 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T10:58:28.153 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T10:58:28.228 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T10:58:28.228 INFO:tasks.ceph:role: osd.7 2023-10-06T10:58:28.229 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T10:58:28.229 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T10:58:28.304 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T10:58:28.304 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T10:58:28.304 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T10:58:28.304 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T10:58:28.304 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T10:58:28.304 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-10-06T10:58:28.304 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T10:58:28.305 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T10:58:28.305 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T10:58:28.305 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T10:58:28.326 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-10-06T10:58:28.328 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-10-06T10:58:28.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T10:58:28.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T10:58:28.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T10:58:28.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:28.556+0000 7f9816797540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T10:58:28.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:28.556+0000 7f9816797540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T10:58:28.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:28.556+0000 7f9816797540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T10:58:28.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:28.556+0000 7f9816797540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T10:58:28.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:28.557+0000 7f9816797540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T10:58:28.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:28.557+0000 7f9816797540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T10:58:29.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:29.081+0000 7f9816797540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:29.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:29.846+0000 7f9816797540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:30.611+0000 7f9816797540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:31.407 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T10:58:31.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T10:58:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:31.535+0000 7f269d982540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T10:58:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:31.536+0000 7f269d982540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T10:58:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:31.536+0000 7f269d982540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T10:58:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:31.536+0000 7f269d982540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T10:58:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:31.536+0000 7f269d982540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T10:58:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:31.536+0000 7f269d982540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T10:58:32.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:32.061+0000 7f269d982540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:32.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:32.825+0000 7f269d982540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:33.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:33.588+0000 7f269d982540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:34.384 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T10:58:34.419 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T10:58:34.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:34.513+0000 7ff60939f540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T10:58:34.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:34.513+0000 7ff60939f540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T10:58:34.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:34.513+0000 7ff60939f540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T10:58:34.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:34.513+0000 7ff60939f540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T10:58:34.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:34.513+0000 7ff60939f540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T10:58:34.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:34.514+0000 7ff60939f540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T10:58:35.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:35.039+0000 7ff60939f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:35.803+0000 7ff60939f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:36.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:36.566+0000 7ff60939f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:37.364 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T10:58:37.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T10:58:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:37.494+0000 7fbe9853e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T10:58:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:37.495+0000 7fbe9853e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T10:58:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:37.495+0000 7fbe9853e540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T10:58:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:37.495+0000 7fbe9853e540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T10:58:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:37.495+0000 7fbe9853e540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T10:58:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:37.495+0000 7fbe9853e540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T10:58:38.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:38.023+0000 7fbe9853e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:38.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:38.788+0000 7fbe9853e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:39.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:39.554+0000 7fbe9853e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T10:58:40.349 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T10:58:40.384 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T10:58:40.384 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:40.384 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T10:58:40.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T10:58:40.412 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T10:58:40.423 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:40.423 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T10:58:40.497 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:40.498 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T10:58:40.572 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:40.572 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T10:58:40.647 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:40.648 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T10:58:40.723 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:40.723 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T10:58:40.797 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:40.798 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T10:58:40.873 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:40.873 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T10:58:40.909 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:40.909 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T10:58:40.984 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:40.984 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T10:58:41.059 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:41.060 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T10:58:41.134 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:41.135 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T10:58:41.209 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:41.210 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T10:58:41.285 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:41.285 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T10:58:41.361 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:41.361 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T10:58:41.384 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:41.384 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T10:58:41.447 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:41.447 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T10:58:41.470 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:41.470 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T10:58:41.532 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T10:58:41.532 DEBUG:teuthology.orchestra.run.smithi007:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T10:58:41.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T10:58:41.575 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.y] 2023-10-06T10:58:41.575 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBF6B9lf8gqERAA3eufSjBI2rAsqsjudLpE7g== 2023-10-06T10:58:41.575 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2023-10-06T10:58:41.575 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBF6B9lf5xzHxAAcz6DUCcDKY6kqw35Uk+wNA== 2023-10-06T10:58:41.575 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2023-10-06T10:58:41.576 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBF6B9ldTW9JxAAi47qjerSGEuRhjY8dyhP1g== 2023-10-06T10:58:41.576 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.0] 2023-10-06T10:58:41.576 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBH6B9lgM4tHBAAK3+2wwnrUqtSS6DfeIljpA== 2023-10-06T10:58:41.576 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.1] 2023-10-06T10:58:41.576 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBK6B9lK3gPGxAAs2vbC573ltq2FmhRYwRleg== 2023-10-06T10:58:41.576 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.2] 2023-10-06T10:58:41.576 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBN6B9lAyLxGRAA7C972ijYflialIb63Kh74Q== 2023-10-06T10:58:41.576 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.3] 2023-10-06T10:58:41.577 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBQ6B9lcKtyGBAAF05nCK/0waipy/gXdPtTig== 2023-10-06T10:58:41.577 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.x] 2023-10-06T10:58:41.577 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBF6B9lFqRxGxAAHsNDZAUE+we7WAUW6w0tYg== 2023-10-06T10:58:41.577 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2023-10-06T10:58:41.577 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBF6B9lr+TCLRAAS8X7U4CDijgiLkeY3N1k5A== 2023-10-06T10:58:41.577 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d] 2023-10-06T10:58:41.577 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBF6B9lwoERNhAAi2s7pUC6Zw8QUPImXW/Bkw== 2023-10-06T10:58:41.577 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.4] 2023-10-06T10:58:41.577 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBU6B9l8A1DIRAAiLVOvw89tvLJ/V4TAM8QUg== 2023-10-06T10:58:41.577 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.5] 2023-10-06T10:58:41.577 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBX6B9lPjwFIBAANzBcrS6icTB7itpK6dQOJA== 2023-10-06T10:58:41.578 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.6] 2023-10-06T10:58:41.578 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBa6B9lSwCtHhAAc9ckOLHeRYVEHIRVF2K0yw== 2023-10-06T10:58:41.578 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.7] 2023-10-06T10:58:41.578 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBd6B9l3ueTHRAAsF+CSsK+R8ZqoAYsIGb2dQ== 2023-10-06T10:58:41.578 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2023-10-06T10:58:41.578 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBF6B9lV+s+OxAA7FiireHQ6epyLCxHc9NRQA== 2023-10-06T10:58:41.578 INFO:teuthology.orchestra.run.smithi007.stdout:[client.2] 2023-10-06T10:58:41.578 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBG6B9ly+ZgAxAA9yXfZP3XEMbnUpSm/WDsgw== 2023-10-06T10:58:41.578 INFO:teuthology.orchestra.run.smithi007.stdout:[client.1] 2023-10-06T10:58:41.578 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBG6B9lJYM8BxAA0QUkFcKZNYlc9lNFaJlbKg== 2023-10-06T10:58:41.578 INFO:teuthology.orchestra.run.smithi007.stdout:[client.3] 2023-10-06T10:58:41.579 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBG6B9l/ijxChAAeSzF0/kDS6iEj++8bIK70Q== 2023-10-06T10:58:41.605 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2023-10-06T10:58:41.605 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBF6B9lf8gqERAA3eufSjBI2rAsqsjudLpE7g== 2023-10-06T10:58:41.606 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2023-10-06T10:58:41.606 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBF6B9lf5xzHxAAcz6DUCcDKY6kqw35Uk+wNA== 2023-10-06T10:58:41.606 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2023-10-06T10:58:41.606 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBF6B9ldTW9JxAAi47qjerSGEuRhjY8dyhP1g== 2023-10-06T10:58:41.606 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2023-10-06T10:58:41.606 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBH6B9lgM4tHBAAK3+2wwnrUqtSS6DfeIljpA== 2023-10-06T10:58:41.606 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2023-10-06T10:58:41.606 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBK6B9lK3gPGxAAs2vbC573ltq2FmhRYwRleg== 2023-10-06T10:58:41.606 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2023-10-06T10:58:41.607 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBN6B9lAyLxGRAA7C972ijYflialIb63Kh74Q== 2023-10-06T10:58:41.607 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2023-10-06T10:58:41.607 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBQ6B9lcKtyGBAAF05nCK/0waipy/gXdPtTig== 2023-10-06T10:58:41.607 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2023-10-06T10:58:41.607 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBF6B9lFqRxGxAAHsNDZAUE+we7WAUW6w0tYg== 2023-10-06T10:58:41.607 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2023-10-06T10:58:41.607 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBF6B9lr+TCLRAAS8X7U4CDijgiLkeY3N1k5A== 2023-10-06T10:58:41.607 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2023-10-06T10:58:41.607 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBF6B9lwoERNhAAi2s7pUC6Zw8QUPImXW/Bkw== 2023-10-06T10:58:41.608 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2023-10-06T10:58:41.608 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBU6B9l8A1DIRAAiLVOvw89tvLJ/V4TAM8QUg== 2023-10-06T10:58:41.608 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2023-10-06T10:58:41.608 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBX6B9lPjwFIBAANzBcrS6icTB7itpK6dQOJA== 2023-10-06T10:58:41.608 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2023-10-06T10:58:41.608 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBa6B9lSwCtHhAAc9ckOLHeRYVEHIRVF2K0yw== 2023-10-06T10:58:41.608 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2023-10-06T10:58:41.608 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBd6B9l3ueTHRAAsF+CSsK+R8ZqoAYsIGb2dQ== 2023-10-06T10:58:41.608 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-10-06T10:58:41.608 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBF6B9lV+s+OxAA7FiireHQ6epyLCxHc9NRQA== 2023-10-06T10:58:41.609 INFO:teuthology.orchestra.run.smithi050.stdout:[client.2] 2023-10-06T10:58:41.609 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBG6B9ly+ZgAxAA9yXfZP3XEMbnUpSm/WDsgw== 2023-10-06T10:58:41.609 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2023-10-06T10:58:41.609 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBG6B9lJYM8BxAA0QUkFcKZNYlc9lNFaJlbKg== 2023-10-06T10:58:41.609 INFO:teuthology.orchestra.run.smithi050.stdout:[client.3] 2023-10-06T10:58:41.609 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBG6B9l/ijxChAAeSzF0/kDS6iEj++8bIK70Q== 2023-10-06T10:58:41.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T10:58:41.622 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T10:58:41.713 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T10:58:41.716 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T10:58:41.779 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T10:58:41.781 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T10:58:41.842 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:41.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:41.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:41.904 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:41.960 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:41.962 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:42.018 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:42.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:42.076 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T10:58:42.079 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T10:58:42.135 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T10:58:42.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T10:58:42.195 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T10:58:42.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T10:58:42.256 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:42.259 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:42.315 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:42.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:42.372 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:42.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:42.431 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:42.433 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T10:58:42.489 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T10:58:42.492 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T10:58:42.551 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T10:58:42.553 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T10:58:42.613 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T10:58:42.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T10:58:42.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T10:58:42.678 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T10:58:42.738 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T10:58:42.739 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T10:58:42.770 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T10:58:42.873 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T10:58:42.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T10:58:42.940 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T10:58:43.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T10:58:43.082 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T10:58:43.158 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T10:58:43.266 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T10:58:43.299 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T10:58:43.302 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T10:58:43.363 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T10:58:43.363 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T10:58:43.363 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T10:58:43.365 INFO:tasks.ceph.mon.a:Started 2023-10-06T10:58:43.366 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T10:58:43.366 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T10:58:43.405 INFO:tasks.ceph.mon.b:Started 2023-10-06T10:58:43.405 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T10:58:43.405 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T10:58:43.407 INFO:tasks.ceph.mon.c:Started 2023-10-06T10:58:43.407 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T10:58:43.408 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T10:58:43.408 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T10:58:43.410 INFO:tasks.ceph.mgr.y:Started 2023-10-06T10:58:43.410 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T10:58:43.410 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T10:58:43.412 INFO:tasks.ceph.mgr.x:Started 2023-10-06T10:58:43.413 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T10:58:43.413 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T10:58:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.550+0000 7fb7c5a0d700 1 Processor -- start 2023-10-06T10:58:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.550+0000 7fb7c5a0d700 1 -- start start 2023-10-06T10:58:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.551+0000 7fb7c5a0d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7c01594c0 0x7fb7c00aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.551+0000 7fb7c5a0d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c00cf870 con 0x7fb7c00cb700 2023-10-06T10:58:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.551+0000 7fb7c5a0d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c00cecf0 con 0x7fb7c0159890 2023-10-06T10:58:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.551+0000 7fb7c5a0d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c00cef40 con 0x7fb7c01594c0 2023-10-06T10:58:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.551+0000 7fb7beffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7c01594c0 0x7fb7c00aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.551+0000 7fb7beffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7c01594c0 0x7fb7c00aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36676/0 (socket says 172.21.15.7:36676) 2023-10-06T10:58:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.551+0000 7fb7bf7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb7c00cb700 0x7fb7c00b0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55032/0 (socket says 172.21.15.7:55032) 2023-10-06T10:58:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.551+0000 7fb7beffd700 1 -- 172.21.15.7:0/3042570984 learned_addr learned my addr 172.21.15.7:0/3042570984 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.551+0000 7fb7beffd700 1 -- 172.21.15.7:0/3042570984 >> v2:172.21.15.7:3300/0 conn(0x7fb7c01594c0 msgr2=0x7fb7c00aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T10:58:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.551+0000 7fb7beffd700 1 -- 172.21.15.7:0/3042570984 >> v2:172.21.15.7:3300/0 conn(0x7fb7c01594c0 msgr2=0x7fb7c00aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T10:58:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.551+0000 7fb7beffd700 1 --2- 172.21.15.7:0/3042570984 >> v2:172.21.15.7:3300/0 conn(0x7fb7c01594c0 0x7fb7c00aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T10:58:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.551+0000 7fb7beffd700 1 --2- 172.21.15.7:0/3042570984 >> v2:172.21.15.7:3300/0 conn(0x7fb7c01594c0 0x7fb7c00aed30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T10:58:43.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.726+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316854101 0 0) 0x7fb7c00cecf0 con 0x7fb7c0159890 2023-10-06T10:58:43.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.726+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7ac003570 con 0x7fb7c0159890 2023-10-06T10:58:43.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.726+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109383074 0 0) 0x7fb7c00cf870 con 0x7fb7c00cb700 2023-10-06T10:58:43.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.726+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7c00cecf0 con 0x7fb7c00cb700 2023-10-06T10:58:43.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2478056860 0 0) 0x7fb7c00cecf0 con 0x7fb7c00cb700 2023-10-06T10:58:43.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 >> v2:172.21.15.7:3300/0 conn(0x7fb7c01594c0 msgr2=0x7fb7c00aed30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T10:58:43.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bdffb700 1 --2- 172.21.15.7:0/3042570984 >> v2:172.21.15.7:3300/0 conn(0x7fb7c01594c0 0x7fb7c00aed30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:43.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 >> v1:172.21.15.50:6789/0 conn(0x7fb7c0159890 legacy=0x7fb7c00caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:43.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c00cf220 con 0x7fb7c00cb700 2023-10-06T10:58:43.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7fb7b8001770 con 0x7fb7c00cb700 2023-10-06T10:58:43.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 >> v1:172.21.15.7:6789/0 conn(0x7fb7c00cb700 legacy=0x7fb7c00b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:43.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bdffb700 1 --2- 172.21.15.7:0/3042570984 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7ac004c50 0x7fb7ac005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:43.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bdffb700 1 --2- 172.21.15.7:0/3042570984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7ac0037b0 0x7fb7ac003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:43.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bdffb700 1 --2- 172.21.15.7:0/3042570984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac0041d0 0x7fb7ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:43.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c00cef40 con 0x7fb7ac0041d0 2023-10-06T10:58:43.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac00c160 con 0x7fb7ac0037b0 2023-10-06T10:58:43.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac00c320 con 0x7fb7ac004c50 2023-10-06T10:58:43.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bf7fe700 1 --2- 172.21.15.7:0/3042570984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac0041d0 0x7fb7ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:43.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7be7fc700 1 --2- 172.21.15.7:0/3042570984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7ac0037b0 0x7fb7ac003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:43.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7beffd700 1 --2- 172.21.15.7:0/3042570984 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7ac004c50 0x7fb7ac005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:43.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bf7fe700 1 -- 172.21.15.7:0/3042570984 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7ac004c50 msgr2=0x7fb7ac005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:43.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bf7fe700 1 --2- 172.21.15.7:0/3042570984 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7ac004c50 0x7fb7ac005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:43.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bf7fe700 1 -- 172.21.15.7:0/3042570984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7ac0037b0 msgr2=0x7fb7ac003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:43.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bf7fe700 1 --2- 172.21.15.7:0/3042570984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7ac0037b0 0x7fb7ac003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:43.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.727+0000 7fb7bf7fe700 1 -- 172.21.15.7:0/3042570984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c00cecf0 con 0x7fb7ac0041d0 2023-10-06T10:58:43.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.728+0000 7fb7bf7fe700 1 -- 172.21.15.7:0/3042570984 reap_dead start 2023-10-06T10:58:43.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.728+0000 7fb7bf7fe700 1 --2- 172.21.15.7:0/3042570984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac0041d0 0x7fb7ac00ba60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800a840 tx=0x7fb7b80020d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa90b001d7e6a2ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:43.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.729+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8005be0 con 0x7fb7ac0041d0 2023-10-06T10:58:43.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.729+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b8005d40 con 0x7fb7ac0041d0 2023-10-06T10:58:43.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.729+0000 7fb7bdffb700 1 -- 172.21.15.7:0/3042570984 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8007320 con 0x7fb7ac0041d0 2023-10-06T10:58:43.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.730+0000 7fb7c5a0d700 1 -- 172.21.15.7:0/3042570984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac0041d0 msgr2=0x7fb7ac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:43.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.730+0000 7fb7c5a0d700 1 --2- 172.21.15.7:0/3042570984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac0041d0 0x7fb7ac00ba60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800a840 tx=0x7fb7b80020d0 comp rx=0 tx=0).stop 2023-10-06T10:58:43.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.730+0000 7fb7c5a0d700 1 -- 172.21.15.7:0/3042570984 shutdown_connections 2023-10-06T10:58:43.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.730+0000 7fb7c5a0d700 1 --2- 172.21.15.7:0/3042570984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac0041d0 0x7fb7ac00ba60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:43.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.730+0000 7fb7c5a0d700 1 -- 172.21.15.7:0/3042570984 >> 172.21.15.7:0/3042570984 conn(0x7fb7c0067bc0 msgr2=0x7fb7c00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:43.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.730+0000 7fb7c5a0d700 1 -- 172.21.15.7:0/3042570984 shutdown_connections 2023-10-06T10:58:43.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.730+0000 7fb7c5a0d700 1 -- 172.21.15.7:0/3042570984 wait complete. 2023-10-06T10:58:43.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.732+0000 7fb7c5a0d700 1 Processor -- start 2023-10-06T10:58:43.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.732+0000 7fb7c5a0d700 1 -- start start 2023-10-06T10:58:43.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.733+0000 7fb7c5a0d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7ac0041d0 0x7fb7c015c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:43.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.733+0000 7fb7c5a0d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7c00b56c0 0x7fb7c00b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:43.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.733+0000 7fb7c5a0d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7c00b3570 0x7fb7c00b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:43.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.733+0000 7fb7c5a0d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c00b29f0 con 0x7fb7c00b3570 2023-10-06T10:58:43.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.733+0000 7fb7c5a0d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c00b3f00 con 0x7fb7ac0041d0 2023-10-06T10:58:43.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.733+0000 7fb7c5a0d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c00b1de0 con 0x7fb7c00b56c0 2023-10-06T10:58:43.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.733+0000 7fb7beffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7ac0041d0 0x7fb7c015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:43.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.733+0000 7fb7be7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7c00b56c0 0x7fb7c00b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:43.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.733+0000 7fb7beffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7ac0041d0 0x7fb7c015c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:49188/0 (socket says 172.21.15.7:49188) 2023-10-06T10:58:43.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.733+0000 7fb7be7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7c00b56c0 0x7fb7c00b5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:44100/0 (socket says 172.21.15.7:44100) 2023-10-06T10:58:43.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.733+0000 7fb7beffd700 1 -- 172.21.15.7:0/2384836564 learned_addr learned my addr 172.21.15.7:0/2384836564 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:43.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.733+0000 7fb7bf7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7c00b3570 0x7fb7c00b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:43.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.734+0000 7fb7bf7fe700 1 -- 172.21.15.7:0/2384836564 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7c00b56c0 msgr2=0x7fb7c00b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:43.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.734+0000 7fb7bf7fe700 1 --2- 172.21.15.7:0/2384836564 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7c00b56c0 0x7fb7c00b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:43.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.734+0000 7fb7bf7fe700 1 -- 172.21.15.7:0/2384836564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7ac0041d0 msgr2=0x7fb7c015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:43.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.734+0000 7fb7bf7fe700 1 --2- 172.21.15.7:0/2384836564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7ac0041d0 0x7fb7c015c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:43.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.734+0000 7fb7bf7fe700 1 -- 172.21.15.7:0/2384836564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c00b20c0 con 0x7fb7c00b3570 2023-10-06T10:58:43.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.734+0000 7fb7be7fc700 1 --2- 172.21.15.7:0/2384836564 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7c00b56c0 0x7fb7c00b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:43.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.734+0000 7fb7beffd700 1 --2- 172.21.15.7:0/2384836564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7ac0041d0 0x7fb7c015c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:43.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.734+0000 7fb7bf7fe700 1 --2- 172.21.15.7:0/2384836564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7c00b3570 0x7fb7c00b39c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00d1220 tx=0x7fb7b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:43.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.736+0000 7fb7b6ffd700 1 -- 172.21.15.7:0/2384836564 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b80020d0 con 0x7fb7c00b3570 2023-10-06T10:58:43.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.736+0000 7fb7b6ffd700 1 -- 172.21.15.7:0/2384836564 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b80078a0 con 0x7fb7c00b3570 2023-10-06T10:58:43.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.736+0000 7fb7c5a0d700 1 -- 172.21.15.7:0/2384836564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c00b23a0 con 0x7fb7c00b3570 2023-10-06T10:58:43.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.736+0000 7fb7b6ffd700 1 -- 172.21.15.7:0/2384836564 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b801e680 con 0x7fb7c00b3570 2023-10-06T10:58:43.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.736+0000 7fb7c5a0d700 1 -- 172.21.15.7:0/2384836564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c00b19b0 con 0x7fb7c00b3570 2023-10-06T10:58:43.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.737+0000 7fb7b6ffd700 1 -- 172.21.15.7:0/2384836564 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb7b801e9f0 con 0x7fb7c00b3570 2023-10-06T10:58:43.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.737+0000 7fb7b6ffd700 1 -- 172.21.15.7:0/2384836564 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb7b80297b0 con 0x7fb7c00b3570 2023-10-06T10:58:43.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.737+0000 7fb7c5a0d700 1 -- 172.21.15.7:0/2384836564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c00b1ba0 con 0x7fb7c00b3570 2023-10-06T10:58:43.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.741+0000 7fb7b6ffd700 1 -- 172.21.15.7:0/2384836564 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb7c00b1ba0 con 0x7fb7c00b3570 2023-10-06T10:58:43.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.823+0000 7fb7c5a0d700 1 -- 172.21.15.7:0/2384836564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb7c0070480 con 0x7fb7c00b3570 2023-10-06T10:58:43.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.826+0000 7fb7b6ffd700 1 -- 172.21.15.7:0/2384836564 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb7b80299c0 con 0x7fb7c00b3570 2023-10-06T10:58:43.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.827+0000 7fb7c5a0d700 1 -- 172.21.15.7:0/2384836564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7c00b3570 msgr2=0x7fb7c00b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:43.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.827+0000 7fb7c5a0d700 1 --2- 172.21.15.7:0/2384836564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7c00b3570 0x7fb7c00b39c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00d1220 tx=0x7fb7b8016000 comp rx=0 tx=0).stop 2023-10-06T10:58:43.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.827+0000 7fb7c5a0d700 1 -- 172.21.15.7:0/2384836564 shutdown_connections 2023-10-06T10:58:43.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.827+0000 7fb7c5a0d700 1 --2- 172.21.15.7:0/2384836564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7c00b3570 0x7fb7c00b39c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:43.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.827+0000 7fb7c5a0d700 1 --2- 172.21.15.7:0/2384836564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7ac0041d0 0x7fb7c015c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:43.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.827+0000 7fb7c5a0d700 1 --2- 172.21.15.7:0/2384836564 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7c00b56c0 0x7fb7c00b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:43.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.827+0000 7fb7c5a0d700 1 -- 172.21.15.7:0/2384836564 >> 172.21.15.7:0/2384836564 conn(0x7fb7c0067bc0 msgr2=0x7fb7c00c6390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:43.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.827+0000 7fb7c5a0d700 1 -- 172.21.15.7:0/2384836564 shutdown_connections 2023-10-06T10:58:43.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:43.827+0000 7fb7c5a0d700 1 -- 172.21.15.7:0/2384836564 wait complete. 2023-10-06T10:58:43.830 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2023-10-06T10:58:43.843 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T10:58:43.843 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:43.843 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T10:58:43.874 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:43.872+0000 7f1622b621c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T10:58:43.876 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:43.876 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T10:58:43.877 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:43.874+0000 7f6a14a4e1c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T10:58:43.947 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:43.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T10:58:44.047 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-06T10:58:44.048 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T10:58:44.065 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:44.063+0000 7f1622b621c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T10:58:44.073 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:44.071+0000 7f6a14a4e1c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T10:58:44.095 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:44.095 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T10:58:44.129 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:44.129 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T10:58:44.200 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:44.200 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T10:58:44.271 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T10:58:44.272 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T10:58:44.344 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 05b362f8-8ccf-47df-99fa-e183dcafe65f 0 2023-10-06T10:58:44.455 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:44.453+0000 7f1622b621c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T10:58:44.474 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:44.473+0000 7f6a14a4e1c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T10:58:44.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.515+0000 7f92959e7700 1 Processor -- start 2023-10-06T10:58:44.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.515+0000 7f92959e7700 1 -- start start 2023-10-06T10:58:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.515+0000 7f92959e7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f92901594c0 0x7f92900aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.515+0000 7f92959e7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9290159890 0x7f92900af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.515+0000 7f92959e7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92900caff0 0x7f92900cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.515+0000 7f92959e7700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92900cf870 con 0x7f92901594c0 2023-10-06T10:58:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f92959e7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92900cef40 con 0x7f92900caff0 2023-10-06T10:58:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f92959e7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92900cf220 con 0x7f9290159890 2023-10-06T10:58:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f928e7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9290159890 0x7f92900af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f928f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92900caff0 0x7f92900cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f928e7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9290159890 0x7f92900af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:43776/0 (socket says 172.21.15.50:43776) 2023-10-06T10:58:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f928f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92900caff0 0x7f92900cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50226/0 (socket says 172.21.15.50:50226) 2023-10-06T10:58:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f928e7fc700 1 -- 172.21.15.50:0/220533710 learned_addr learned my addr 172.21.15.50:0/220533710 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T10:58:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f928effd700 1 --2- 172.21.15.50:0/220533710 >> v2:172.21.15.7:3300/0 conn(0x7f92901594c0 0x7f92900aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f928f7fe700 1 -- 172.21.15.50:0/220533710 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9290159890 msgr2=0x7f92900af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f928f7fe700 1 --2- 172.21.15.50:0/220533710 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9290159890 0x7f92900af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f928f7fe700 1 -- 172.21.15.50:0/220533710 >> v2:172.21.15.7:3300/0 conn(0x7f92901594c0 msgr2=0x7f92900aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f928f7fe700 1 --2- 172.21.15.50:0/220533710 >> v2:172.21.15.7:3300/0 conn(0x7f92901594c0 0x7f92900aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f928f7fe700 1 -- 172.21.15.50:0/220533710 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92900cf500 con 0x7f92900caff0 2023-10-06T10:58:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f928e7fc700 1 --2- 172.21.15.50:0/220533710 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9290159890 0x7f92900af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f928f7fe700 1 --2- 172.21.15.50:0/220533710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92900caff0 0x7f92900cb470 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f92900ca9f0 tx=0x7f9288009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6b7e4a40b2b5fbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.516+0000 7f928dffb700 1 -- 172.21.15.50:0/220533710 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928800e070 con 0x7f92900caff0 2023-10-06T10:58:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.517+0000 7f928dffb700 1 -- 172.21.15.50:0/220533710 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928800bab0 con 0x7f92900caff0 2023-10-06T10:58:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.517+0000 7f928dffb700 1 -- 172.21.15.50:0/220533710 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928800be70 con 0x7f92900caff0 2023-10-06T10:58:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.517+0000 7f92959e7700 1 -- 172.21.15.50:0/220533710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92900caff0 msgr2=0x7f92900cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.517+0000 7f92959e7700 1 --2- 172.21.15.50:0/220533710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92900caff0 0x7f92900cb470 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f92900ca9f0 tx=0x7f9288009780 comp rx=0 tx=0).stop 2023-10-06T10:58:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.517+0000 7f92959e7700 1 -- 172.21.15.50:0/220533710 shutdown_connections 2023-10-06T10:58:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.517+0000 7f92959e7700 1 --2- 172.21.15.50:0/220533710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92900caff0 0x7f92900cb470 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.517+0000 7f92959e7700 1 --2- 172.21.15.50:0/220533710 >> v2:172.21.15.7:3300/0 conn(0x7f92901594c0 0x7f92900aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.517+0000 7f92959e7700 1 --2- 172.21.15.50:0/220533710 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9290159890 0x7f92900af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.517+0000 7f92959e7700 1 -- 172.21.15.50:0/220533710 >> 172.21.15.50:0/220533710 conn(0x7f9290067bc0 msgr2=0x7f92900d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:44.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.517+0000 7f92959e7700 1 -- 172.21.15.50:0/220533710 shutdown_connections 2023-10-06T10:58:44.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.517+0000 7f92959e7700 1 -- 172.21.15.50:0/220533710 wait complete. 2023-10-06T10:58:44.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.519+0000 7f92959e7700 1 Processor -- start 2023-10-06T10:58:44.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.519+0000 7f92959e7700 1 -- start start 2023-10-06T10:58:44.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.519+0000 7f92959e7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92900caff0 0x7f92900b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:44.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.519+0000 7f92959e7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92901594c0 0x7f92900c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:44.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.519+0000 7f92959e7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9290159890 0x7f92900c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:44.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.519+0000 7f92959e7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92900b55c0 con 0x7f92900caff0 2023-10-06T10:58:44.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.519+0000 7f92959e7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92900b49b0 con 0x7f92901594c0 2023-10-06T10:58:44.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.519+0000 7f92959e7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92900b4c90 con 0x7f9290159890 2023-10-06T10:58:44.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f928e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92901594c0 0x7f92900c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:44.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f928f7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9290159890 0x7f92900c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:44.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f928e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92901594c0 0x7f92900c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50242/0 (socket says 172.21.15.50:50242) 2023-10-06T10:58:44.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f928e7fc700 1 -- 172.21.15.50:0/2671063143 learned_addr learned my addr 172.21.15.50:0/2671063143 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T10:58:44.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f928effd700 1 --2- 172.21.15.50:0/2671063143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92900caff0 0x7f92900b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:44.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f928e7fc700 1 -- 172.21.15.50:0/2671063143 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9290159890 msgr2=0x7f92900c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:44.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f928e7fc700 1 --2- 172.21.15.50:0/2671063143 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9290159890 0x7f92900c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f928e7fc700 1 -- 172.21.15.50:0/2671063143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92900caff0 msgr2=0x7f92900b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f928e7fc700 1 --2- 172.21.15.50:0/2671063143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92900caff0 0x7f92900b5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f928e7fc700 1 -- 172.21.15.50:0/2671063143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92780094f0 con 0x7f92901594c0 2023-10-06T10:58:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f928f7fe700 1 --2- 172.21.15.50:0/2671063143 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9290159890 0x7f92900c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f928effd700 1 --2- 172.21.15.50:0/2671063143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92900caff0 0x7f92900b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f928e7fc700 1 --2- 172.21.15.50:0/2671063143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92901594c0 0x7f92900c71c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f927800ec50 tx=0x7f9278009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f9286ffd700 1 -- 172.21.15.50:0/2671063143 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927800c850 con 0x7f92901594c0 2023-10-06T10:58:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f9286ffd700 1 -- 172.21.15.50:0/2671063143 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927800c9b0 con 0x7f92901594c0 2023-10-06T10:58:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f92959e7700 1 -- 172.21.15.50:0/2671063143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9288009a20 con 0x7f92901594c0 2023-10-06T10:58:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.520+0000 7f9286ffd700 1 -- 172.21.15.50:0/2671063143 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927800cd30 con 0x7f92901594c0 2023-10-06T10:58:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.521+0000 7f92959e7700 1 -- 172.21.15.50:0/2671063143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92900b5250 con 0x7f92901594c0 2023-10-06T10:58:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.521+0000 7f9286ffd700 1 -- 172.21.15.50:0/2671063143 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9278005c80 con 0x7f92901594c0 2023-10-06T10:58:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.521+0000 7f9286ffd700 1 -- 172.21.15.50:0/2671063143 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9278006020 con 0x7f92901594c0 2023-10-06T10:58:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.521+0000 7f92959e7700 1 -- 172.21.15.50:0/2671063143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92900b5730 con 0x7f92901594c0 2023-10-06T10:58:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.524+0000 7f9286ffd700 1 -- 172.21.15.50:0/2671063143 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9278021060 con 0x7f92901594c0 2023-10-06T10:58:44.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.612+0000 7f92959e7700 1 -- 172.21.15.50:0/2671063143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "05b362f8-8ccf-47df-99fa-e183dcafe65f", "id": 0} v 0) v1 -- 0x7f9290068be0 con 0x7f92901594c0 2023-10-06T10:58:44.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.616+0000 7f9286ffd700 1 -- 172.21.15.50:0/2671063143 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "05b362f8-8ccf-47df-99fa-e183dcafe65f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9278017070 con 0x7f92901594c0 2023-10-06T10:58:44.618 INFO:teuthology.orchestra.run.smithi050.stdout:0 2023-10-06T10:58:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.617+0000 7f92959e7700 1 -- 172.21.15.50:0/2671063143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92901594c0 msgr2=0x7f92900c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.617+0000 7f92959e7700 1 --2- 172.21.15.50:0/2671063143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92901594c0 0x7f92900c71c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f927800ec50 tx=0x7f9278009250 comp rx=0 tx=0).stop 2023-10-06T10:58:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.617+0000 7f92959e7700 1 -- 172.21.15.50:0/2671063143 shutdown_connections 2023-10-06T10:58:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.617+0000 7f92959e7700 1 --2- 172.21.15.50:0/2671063143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92900caff0 0x7f92900b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.617+0000 7f92959e7700 1 --2- 172.21.15.50:0/2671063143 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9290159890 0x7f92900c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.617+0000 7f92959e7700 1 --2- 172.21.15.50:0/2671063143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92901594c0 0x7f92900c71c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.617+0000 7f92959e7700 1 -- 172.21.15.50:0/2671063143 >> 172.21.15.50:0/2671063143 conn(0x7f9290067bc0 msgr2=0x7f92900cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.617+0000 7f92959e7700 1 -- 172.21.15.50:0/2671063143 shutdown_connections 2023-10-06T10:58:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.617+0000 7f92959e7700 1 -- 172.21.15.50:0/2671063143 wait complete. 2023-10-06T10:58:44.631 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new b5501e71-257e-4247-9519-112bad21cb46 1 2023-10-06T10:58:44.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.761+0000 7f9dba8e0700 1 Processor -- start 2023-10-06T10:58:44.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.761+0000 7f9dba8e0700 1 -- start start 2023-10-06T10:58:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.762+0000 7f9dba8e0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9db40b2610 0x7f9db40cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.762+0000 7f9dba8e0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9db4140b60 0x7f9db40cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.762+0000 7f9dba8e0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db4067dc0 con 0x7f9db4140790 2023-10-06T10:58:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.762+0000 7f9dba8e0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db40cc500 con 0x7f9db4140b60 2023-10-06T10:58:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.762+0000 7f9dba8e0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40cc7e0 con 0x7f9db40b2610 2023-10-06T10:58:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.762+0000 7f9db37fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9db40b2610 0x7f9db40cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.762+0000 7f9db8e7d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9db4140b60 0x7f9db40cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.762+0000 7f9db8e7d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9db4140b60 0x7f9db40cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50258/0 (socket says 172.21.15.50:50258) 2023-10-06T10:58:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.762+0000 7f9db3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9db4140790 0x7f9db40b1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39278/0 (socket says 172.21.15.50:39278) 2023-10-06T10:58:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.762+0000 7f9db3fff700 1 -- 172.21.15.50:0/1640376277 learned_addr learned my addr 172.21.15.50:0/1640376277 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T10:58:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.762+0000 7f9db37fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9db40b2610 0x7f9db40cb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:43792/0 (socket says 172.21.15.50:43792) 2023-10-06T10:58:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.763+0000 7f9db37fe700 1 -- 172.21.15.50:0/1640376277 >> v2:172.21.15.50:3300/0 conn(0x7f9db4140b60 msgr2=0x7f9db40cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.763+0000 7f9db37fe700 1 --2- 172.21.15.50:0/1640376277 >> v2:172.21.15.50:3300/0 conn(0x7f9db4140b60 0x7f9db40cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.763+0000 7f9db37fe700 1 -- 172.21.15.50:0/1640376277 >> v1:172.21.15.50:6789/0 conn(0x7f9db4140790 legacy=0x7f9db40b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.763+0000 7f9db37fe700 1 -- 172.21.15.50:0/1640376277 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4068010 con 0x7f9db40b2610 2023-10-06T10:58:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.763+0000 7f9db8e7d700 1 --2- 172.21.15.50:0/1640376277 >> v2:172.21.15.50:3300/0 conn(0x7f9db4140b60 0x7f9db40cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.763+0000 7f9db37fe700 1 --2- 172.21.15.50:0/1640376277 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9db40b2610 0x7f9db40cb780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9da80098e0 tx=0x7f9da80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c5e3cc1ec563b6c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.763+0000 7f9db2ffd700 1 -- 172.21.15.50:0/1640376277 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da800b640 con 0x7f9db40b2610 2023-10-06T10:58:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.763+0000 7f9db2ffd700 1 -- 172.21.15.50:0/1640376277 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da800b7a0 con 0x7f9db40b2610 2023-10-06T10:58:44.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.763+0000 7f9db2ffd700 1 -- 172.21.15.50:0/1640376277 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da800bb40 con 0x7f9db40b2610 2023-10-06T10:58:44.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.764+0000 7f9dba8e0700 1 -- 172.21.15.50:0/1640376277 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9db40b2610 msgr2=0x7f9db40cb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:44.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.764+0000 7f9dba8e0700 1 --2- 172.21.15.50:0/1640376277 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9db40b2610 0x7f9db40cb780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9da80098e0 tx=0x7f9da80091a0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.764+0000 7f9dba8e0700 1 -- 172.21.15.50:0/1640376277 shutdown_connections 2023-10-06T10:58:44.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.764+0000 7f9dba8e0700 1 --2- 172.21.15.50:0/1640376277 >> v2:172.21.15.50:3300/0 conn(0x7f9db4140b60 0x7f9db40cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.764+0000 7f9dba8e0700 1 --2- 172.21.15.50:0/1640376277 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9db40b2610 0x7f9db40cb780 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.764+0000 7f9dba8e0700 1 -- 172.21.15.50:0/1640376277 >> 172.21.15.50:0/1640376277 conn(0x7f9db40cce30 msgr2=0x7f9db40cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:44.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.764+0000 7f9dba8e0700 1 -- 172.21.15.50:0/1640376277 shutdown_connections 2023-10-06T10:58:44.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.764+0000 7f9dba8e0700 1 -- 172.21.15.50:0/1640376277 wait complete. 2023-10-06T10:58:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.765+0000 7f9dba8e0700 1 Processor -- start 2023-10-06T10:58:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.765+0000 7f9dba8e0700 1 -- start start 2023-10-06T10:58:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.766+0000 7f9dba8e0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9db40b2610 0x7f9db4156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.766+0000 7f9dba8e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db4140790 0x7f9db41585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.766+0000 7f9dba8e0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9db4140b60 0x7f9db40ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.766+0000 7f9dba8e0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4159ce0 con 0x7f9db40b2610 2023-10-06T10:58:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.766+0000 7f9dba8e0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40ae370 con 0x7f9db4140790 2023-10-06T10:58:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.766+0000 7f9dba8e0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4158c40 con 0x7f9db4140b60 2023-10-06T10:58:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.766+0000 7f9db37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db4140790 0x7f9db41585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.766+0000 7f9db8e7d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9db4140b60 0x7f9db40ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.766+0000 7f9db37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db4140790 0x7f9db41585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50270/0 (socket says 172.21.15.50:50270) 2023-10-06T10:58:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.766+0000 7f9db8e7d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9db4140b60 0x7f9db40ade30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:43802/0 (socket says 172.21.15.50:43802) 2023-10-06T10:58:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.766+0000 7f9db37fe700 1 -- 172.21.15.50:0/4277820788 learned_addr learned my addr 172.21.15.50:0/4277820788 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T10:58:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.766+0000 7f9db3fff700 1 --2- 172.21.15.50:0/4277820788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9db40b2610 0x7f9db4156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.767+0000 7f9db37fe700 1 -- 172.21.15.50:0/4277820788 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9db4140b60 msgr2=0x7f9db40ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.767+0000 7f9db37fe700 1 --2- 172.21.15.50:0/4277820788 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9db4140b60 0x7f9db40ade30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.767+0000 7f9db37fe700 1 -- 172.21.15.50:0/4277820788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9db40b2610 msgr2=0x7f9db4156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.767+0000 7f9db37fe700 1 --2- 172.21.15.50:0/4277820788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9db40b2610 0x7f9db4156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.767+0000 7f9db37fe700 1 -- 172.21.15.50:0/4277820788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac00de30 con 0x7f9db4140790 2023-10-06T10:58:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.767+0000 7f9db37fe700 1 --2- 172.21.15.50:0/4277820788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db4140790 0x7f9db41585f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009f80 tx=0x7f9da8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.767+0000 7f9d9bfff700 1 -- 172.21.15.50:0/4277820788 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da801bb60 con 0x7f9db4140790 2023-10-06T10:58:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.767+0000 7f9d9bfff700 1 -- 172.21.15.50:0/4277820788 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da801bcc0 con 0x7f9db4140790 2023-10-06T10:58:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.767+0000 7f9dba8e0700 1 -- 172.21.15.50:0/4277820788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da8009420 con 0x7f9db4140790 2023-10-06T10:58:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.767+0000 7f9d9bfff700 1 -- 172.21.15.50:0/4277820788 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8011670 con 0x7f9db4140790 2023-10-06T10:58:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.767+0000 7f9dba8e0700 1 -- 172.21.15.50:0/4277820788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db4159200 con 0x7f9db4140790 2023-10-06T10:58:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.767+0000 7f9d9bfff700 1 -- 172.21.15.50:0/4277820788 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9da8011ca0 con 0x7f9db4140790 2023-10-06T10:58:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.768+0000 7f9d9bfff700 1 -- 172.21.15.50:0/4277820788 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f9da802c850 con 0x7f9db4140790 2023-10-06T10:58:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.768+0000 7f9dba8e0700 1 -- 172.21.15.50:0/4277820788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db4070480 con 0x7f9db4140790 2023-10-06T10:58:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.773+0000 7f9d9bfff700 1 -- 172.21.15.50:0/4277820788 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9da8015020 con 0x7f9db4140790 2023-10-06T10:58:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.861+0000 7f9dba8e0700 1 -- 172.21.15.50:0/4277820788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b5501e71-257e-4247-9519-112bad21cb46", "id": 1} v 0) v1 -- 0x7f9db40682f0 con 0x7f9db4140790 2023-10-06T10:58:44.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.865+0000 7f9d9bfff700 1 -- 172.21.15.50:0/4277820788 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b5501e71-257e-4247-9519-112bad21cb46", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9da801be30 con 0x7f9db4140790 2023-10-06T10:58:44.867 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-10-06T10:58:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.865+0000 7f9dba8e0700 1 -- 172.21.15.50:0/4277820788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db4140790 msgr2=0x7f9db41585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.865+0000 7f9dba8e0700 1 --2- 172.21.15.50:0/4277820788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db4140790 0x7f9db41585f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009f80 tx=0x7f9da8017000 comp rx=0 tx=0).stop 2023-10-06T10:58:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.866+0000 7f9dba8e0700 1 -- 172.21.15.50:0/4277820788 shutdown_connections 2023-10-06T10:58:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.866+0000 7f9dba8e0700 1 --2- 172.21.15.50:0/4277820788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9db40b2610 0x7f9db4156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.866+0000 7f9dba8e0700 1 --2- 172.21.15.50:0/4277820788 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9db4140b60 0x7f9db40ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.866+0000 7f9dba8e0700 1 --2- 172.21.15.50:0/4277820788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db4140790 0x7f9db41585f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.866+0000 7f9dba8e0700 1 -- 172.21.15.50:0/4277820788 >> 172.21.15.50:0/4277820788 conn(0x7f9db40cce30 msgr2=0x7f9db40b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.866+0000 7f9dba8e0700 1 -- 172.21.15.50:0/4277820788 shutdown_connections 2023-10-06T10:58:44.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:44.866+0000 7f9dba8e0700 1 -- 172.21.15.50:0/4277820788 wait complete. 2023-10-06T10:58:44.880 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new b6de38d9-1392-4690-85e2-7f85443247bb 2 2023-10-06T10:58:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.009+0000 7f203e33b700 1 Processor -- start 2023-10-06T10:58:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.009+0000 7f203e33b700 1 -- start start 2023-10-06T10:58:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.010+0000 7f203e33b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2038157390 0x7f2038161da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.010+0000 7f203e33b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20380c7fd0 con 0x7f20380c9a10 2023-10-06T10:58:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.010+0000 7f203e33b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20380c7400 con 0x7f20380c9de0 2023-10-06T10:58:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.010+0000 7f203e33b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20380c76a0 con 0x7f2038157390 2023-10-06T10:58:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.010+0000 7f20377fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f20380c9de0 0x7f2038156c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39294/0 (socket says 172.21.15.50:39294) 2023-10-06T10:58:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.010+0000 7f20377fe700 1 -- 172.21.15.50:0/1112969377 learned_addr learned my addr 172.21.15.50:0/1112969377 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T10:58:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.010+0000 7f203c8d8700 1 --2- 172.21.15.50:0/1112969377 >> v2:172.21.15.7:3300/0 conn(0x7f2038157390 0x7f2038161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.011+0000 7f2036ffd700 1 -- 172.21.15.50:0/1112969377 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245290146 0 0) 0x7f20380c7400 con 0x7f20380c9de0 2023-10-06T10:58:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.011+0000 7f2036ffd700 1 -- 172.21.15.50:0/1112969377 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2020003570 con 0x7f20380c9de0 2023-10-06T10:58:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.011+0000 7f2036ffd700 1 -- 172.21.15.50:0/1112969377 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2599280691 0 0) 0x7f20380c7fd0 con 0x7f20380c9a10 2023-10-06T10:58:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.011+0000 7f2036ffd700 1 -- 172.21.15.50:0/1112969377 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20380c7400 con 0x7f20380c9a10 2023-10-06T10:58:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.011+0000 7f203c8d8700 1 -- 172.21.15.50:0/1112969377 >> v1:172.21.15.50:6789/0 conn(0x7f20380c9de0 legacy=0x7f2038156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.011+0000 7f203c8d8700 1 -- 172.21.15.50:0/1112969377 >> v1:172.21.15.7:6789/0 conn(0x7f20380c9a10 legacy=0x7f2038069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.011+0000 7f203c8d8700 1 -- 172.21.15.50:0/1112969377 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20380c7980 con 0x7f2038157390 2023-10-06T10:58:45.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.011+0000 7f203c8d8700 1 --2- 172.21.15.50:0/1112969377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2038157390 0x7f2038161da0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2030009e60 tx=0x7f2030009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6235049184ab738a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:45.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.011+0000 7f2036ffd700 1 -- 172.21.15.50:0/1112969377 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203000e070 con 0x7f2038157390 2023-10-06T10:58:45.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.011+0000 7f2036ffd700 1 -- 172.21.15.50:0/1112969377 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203000bab0 con 0x7f2038157390 2023-10-06T10:58:45.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.011+0000 7f2036ffd700 1 -- 172.21.15.50:0/1112969377 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203000be70 con 0x7f2038157390 2023-10-06T10:58:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.012+0000 7f203e33b700 1 -- 172.21.15.50:0/1112969377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2038157390 msgr2=0x7f2038161da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.012+0000 7f203e33b700 1 --2- 172.21.15.50:0/1112969377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2038157390 0x7f2038161da0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2030009e60 tx=0x7f2030009780 comp rx=0 tx=0).stop 2023-10-06T10:58:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.012+0000 7f203e33b700 1 -- 172.21.15.50:0/1112969377 shutdown_connections 2023-10-06T10:58:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.012+0000 7f203e33b700 1 --2- 172.21.15.50:0/1112969377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2038157390 0x7f2038161da0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.012+0000 7f203e33b700 1 -- 172.21.15.50:0/1112969377 >> 172.21.15.50:0/1112969377 conn(0x7f20380afc90 msgr2=0x7f20380b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.012+0000 7f203e33b700 1 -- 172.21.15.50:0/1112969377 shutdown_connections 2023-10-06T10:58:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.012+0000 7f203e33b700 1 -- 172.21.15.50:0/1112969377 wait complete. 2023-10-06T10:58:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.013+0000 7f203e33b700 1 Processor -- start 2023-10-06T10:58:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.014+0000 7f203e33b700 1 -- start start 2023-10-06T10:58:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.014+0000 7f203e33b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20380c9a10 0x7f20380cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.014+0000 7f203e33b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20380c9de0 0x7f2038169b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.014+0000 7f203e33b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2038157390 0x7f20381664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.014+0000 7f203e33b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203816a040 con 0x7f20380c9de0 2023-10-06T10:58:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.014+0000 7f203e33b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380cc980 con 0x7f2038157390 2023-10-06T10:58:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.014+0000 7f203e33b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20380c2d50 con 0x7f20380c9a10 2023-10-06T10:58:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.014+0000 7f203c8d8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2038157390 0x7f20381664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f20377fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20380c9de0 0x7f2038169b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f203c8d8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2038157390 0x7f20381664e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50284/0 (socket says 172.21.15.50:50284) 2023-10-06T10:58:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f203c8d8700 1 -- 172.21.15.50:0/681019711 learned_addr learned my addr 172.21.15.50:0/681019711 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T10:58:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f2037fff700 1 --2- 172.21.15.50:0/681019711 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20380c9a10 0x7f20380cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f203c8d8700 1 -- 172.21.15.50:0/681019711 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20380c9a10 msgr2=0x7f20380cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f203c8d8700 1 --2- 172.21.15.50:0/681019711 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20380c9a10 0x7f20380cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f203c8d8700 1 -- 172.21.15.50:0/681019711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20380c9de0 msgr2=0x7f2038169b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f203c8d8700 1 --2- 172.21.15.50:0/681019711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20380c9de0 0x7f2038169b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f203c8d8700 1 -- 172.21.15.50:0/681019711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2030009a20 con 0x7f2038157390 2023-10-06T10:58:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f2037fff700 1 --2- 172.21.15.50:0/681019711 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20380c9a10 0x7f20380cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:45.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f20377fe700 1 --2- 172.21.15.50:0/681019711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20380c9de0 0x7f2038169b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:45.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f203c8d8700 1 --2- 172.21.15.50:0/681019711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2038157390 0x7f20381664e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f203806e0b0 tx=0x7f2030019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:45.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f201ffff700 1 -- 172.21.15.50:0/681019711 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030012dd0 con 0x7f2038157390 2023-10-06T10:58:45.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f201ffff700 1 -- 172.21.15.50:0/681019711 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2030026480 con 0x7f2038157390 2023-10-06T10:58:45.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f203e33b700 1 -- 172.21.15.50:0/681019711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20380c2a20 con 0x7f2038157390 2023-10-06T10:58:45.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f201ffff700 1 -- 172.21.15.50:0/681019711 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030026840 con 0x7f2038157390 2023-10-06T10:58:45.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.015+0000 7f203e33b700 1 -- 172.21.15.50:0/681019711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20380cc3a0 con 0x7f2038157390 2023-10-06T10:58:45.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.016+0000 7f201ffff700 1 -- 172.21.15.50:0/681019711 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2030026bb0 con 0x7f2038157390 2023-10-06T10:58:45.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.016+0000 7f201ffff700 1 -- 172.21.15.50:0/681019711 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f203001cbf0 con 0x7f2038157390 2023-10-06T10:58:45.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.016+0000 7f203e33b700 1 -- 172.21.15.50:0/681019711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20380c2880 con 0x7f2038157390 2023-10-06T10:58:45.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.019+0000 7f201ffff700 1 -- 172.21.15.50:0/681019711 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f20300456d0 con 0x7f2038157390 2023-10-06T10:58:45.040 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:45.039+0000 7f1622b621c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T10:58:45.060 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:45.058+0000 7f6a14a4e1c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T10:58:45.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.109+0000 7f203e33b700 1 -- 172.21.15.50:0/681019711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b6de38d9-1392-4690-85e2-7f85443247bb", "id": 2} v 0) v1 -- 0x7f2038070480 con 0x7f2038157390 2023-10-06T10:58:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.112+0000 7f201ffff700 1 -- 172.21.15.50:0/681019711 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b6de38d9-1392-4690-85e2-7f85443247bb", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2030034030 con 0x7f2038157390 2023-10-06T10:58:45.114 INFO:teuthology.orchestra.run.smithi050.stdout:2 2023-10-06T10:58:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.113+0000 7f203e33b700 1 -- 172.21.15.50:0/681019711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2038157390 msgr2=0x7f20381664e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.113+0000 7f203e33b700 1 --2- 172.21.15.50:0/681019711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2038157390 0x7f20381664e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f203806e0b0 tx=0x7f2030019000 comp rx=0 tx=0).stop 2023-10-06T10:58:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.113+0000 7f203e33b700 1 -- 172.21.15.50:0/681019711 shutdown_connections 2023-10-06T10:58:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.113+0000 7f203e33b700 1 --2- 172.21.15.50:0/681019711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2038157390 0x7f20381664e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.113+0000 7f203e33b700 1 --2- 172.21.15.50:0/681019711 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20380c9a10 0x7f20380cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.113+0000 7f203e33b700 1 --2- 172.21.15.50:0/681019711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20380c9de0 0x7f2038169b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.114+0000 7f203e33b700 1 -- 172.21.15.50:0/681019711 >> 172.21.15.50:0/681019711 conn(0x7f20380afc90 msgr2=0x7f203806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.114+0000 7f203e33b700 1 -- 172.21.15.50:0/681019711 shutdown_connections 2023-10-06T10:58:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.114+0000 7f203e33b700 1 -- 172.21.15.50:0/681019711 wait complete. 2023-10-06T10:58:45.128 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 768079ea-3de9-474a-b2f7-17b4ea3f849f 3 2023-10-06T10:58:45.195 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:45.193+0000 7f1622b621c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T10:58:45.219 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:45.217+0000 7f6a14a4e1c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T10:58:45.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.259+0000 7f3d611e2700 1 Processor -- start 2023-10-06T10:58:45.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.260+0000 7f3d611e2700 1 -- start start 2023-10-06T10:58:45.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.260+0000 7f3d611e2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3d5c0a6d30 0x7f3d5c0ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.260+0000 7f3d611e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d5c0aeb50 0x7f3d5c0ac590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.260+0000 7f3d611e2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d5c0a7100 0x7f3d5c0acad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.260+0000 7f3d611e2700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c06b1e0 con 0x7f3d5c0a6d30 2023-10-06T10:58:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.260+0000 7f3d611e2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c06b4c0 con 0x7f3d5c0aeb50 2023-10-06T10:58:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.260+0000 7f3d611e2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c06b7a0 con 0x7f3d5c0a7100 2023-10-06T10:58:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d5b59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d5c0a7100 0x7f3d5c0acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d5a59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d5c0aeb50 0x7f3d5c0ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d5a59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d5c0aeb50 0x7f3d5c0ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50296/0 (socket says 172.21.15.50:50296) 2023-10-06T10:58:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d5b59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d5c0a7100 0x7f3d5c0acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:43814/0 (socket says 172.21.15.50:43814) 2023-10-06T10:58:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d5a59c700 1 -- 172.21.15.50:0/1932427175 learned_addr learned my addr 172.21.15.50:0/1932427175 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T10:58:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d5ad9d700 1 --2- 172.21.15.50:0/1932427175 >> v2:172.21.15.7:3300/0 conn(0x7f3d5c0a6d30 0x7f3d5c0ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d5a59c700 1 -- 172.21.15.50:0/1932427175 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d5c0a7100 msgr2=0x7f3d5c0acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d5a59c700 1 --2- 172.21.15.50:0/1932427175 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d5c0a7100 0x7f3d5c0acad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d5a59c700 1 -- 172.21.15.50:0/1932427175 >> v2:172.21.15.7:3300/0 conn(0x7f3d5c0a6d30 msgr2=0x7f3d5c0ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d5a59c700 1 --2- 172.21.15.50:0/1932427175 >> v2:172.21.15.7:3300/0 conn(0x7f3d5c0a6d30 0x7f3d5c0ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d5a59c700 1 -- 172.21.15.50:0/1932427175 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c06ba80 con 0x7f3d5c0aeb50 2023-10-06T10:58:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d5b59e700 1 --2- 172.21.15.50:0/1932427175 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d5c0a7100 0x7f3d5c0acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d5a59c700 1 --2- 172.21.15.50:0/1932427175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0aeb50 0x7f3d5c0ac590 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c06df60 tx=0x7f3d50009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=306112fe28c82c58 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d59d9b700 1 -- 172.21.15.50:0/1932427175 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000b640 con 0x7f3d5c0aeb50 2023-10-06T10:58:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d59d9b700 1 -- 172.21.15.50:0/1932427175 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5000b7a0 con 0x7f3d5c0aeb50 2023-10-06T10:58:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.261+0000 7f3d59d9b700 1 -- 172.21.15.50:0/1932427175 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000bb60 con 0x7f3d5c0aeb50 2023-10-06T10:58:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.262+0000 7f3d611e2700 1 -- 172.21.15.50:0/1932427175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0aeb50 msgr2=0x7f3d5c0ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.262+0000 7f3d611e2700 1 --2- 172.21.15.50:0/1932427175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0aeb50 0x7f3d5c0ac590 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c06df60 tx=0x7f3d50009250 comp rx=0 tx=0).stop 2023-10-06T10:58:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.262+0000 7f3d611e2700 1 -- 172.21.15.50:0/1932427175 shutdown_connections 2023-10-06T10:58:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.262+0000 7f3d611e2700 1 --2- 172.21.15.50:0/1932427175 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d5c0a7100 0x7f3d5c0acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.262+0000 7f3d611e2700 1 --2- 172.21.15.50:0/1932427175 >> v2:172.21.15.7:3300/0 conn(0x7f3d5c0a6d30 0x7f3d5c0ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.262+0000 7f3d611e2700 1 --2- 172.21.15.50:0/1932427175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0aeb50 0x7f3d5c0ac590 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.262+0000 7f3d611e2700 1 -- 172.21.15.50:0/1932427175 >> 172.21.15.50:0/1932427175 conn(0x7f3d5c0cc560 msgr2=0x7f3d5c0cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.262+0000 7f3d611e2700 1 -- 172.21.15.50:0/1932427175 shutdown_connections 2023-10-06T10:58:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.262+0000 7f3d611e2700 1 -- 172.21.15.50:0/1932427175 wait complete. 2023-10-06T10:58:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.264+0000 7f3d611e2700 1 Processor -- start 2023-10-06T10:58:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.264+0000 7f3d611e2700 1 -- start start 2023-10-06T10:58:45.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d611e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0a6d30 0x7f3d5c16a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d611e2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d5c0a7100 0x7f3d5c0c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d611e2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d5c0aeb50 0x7f3d5c0c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d611e2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c32e0 con 0x7f3d5c0a7100 2023-10-06T10:58:45.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d611e2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c26d0 con 0x7f3d5c0a6d30 2023-10-06T10:58:45.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d611e2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c29b0 con 0x7f3d5c0aeb50 2023-10-06T10:58:45.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d5ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0a6d30 0x7f3d5c16a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d5ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0a6d30 0x7f3d5c16a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50312/0 (socket says 172.21.15.50:50312) 2023-10-06T10:58:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d5ad9d700 1 -- 172.21.15.50:0/3592959647 learned_addr learned my addr 172.21.15.50:0/3592959647 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T10:58:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d5a59c700 1 --2- 172.21.15.50:0/3592959647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d5c0a7100 0x7f3d5c0c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d5b59e700 1 --2- 172.21.15.50:0/3592959647 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d5c0aeb50 0x7f3d5c0c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d5ad9d700 1 -- 172.21.15.50:0/3592959647 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d5c0aeb50 msgr2=0x7f3d5c0c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d5ad9d700 1 --2- 172.21.15.50:0/3592959647 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d5c0aeb50 0x7f3d5c0c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d5ad9d700 1 -- 172.21.15.50:0/3592959647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d5c0a7100 msgr2=0x7f3d5c0c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d5ad9d700 1 --2- 172.21.15.50:0/3592959647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d5c0a7100 0x7f3d5c0c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d5ad9d700 1 -- 172.21.15.50:0/3592959647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d54009a20 con 0x7f3d5c0a6d30 2023-10-06T10:58:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d5b59e700 1 --2- 172.21.15.50:0/3592959647 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d5c0aeb50 0x7f3d5c0c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.265+0000 7f3d5ad9d700 1 --2- 172.21.15.50:0/3592959647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0a6d30 0x7f3d5c16a150 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00ec80 tx=0x7f3d4c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.266+0000 7f3d42ffd700 1 -- 172.21.15.50:0/3592959647 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00c850 con 0x7f3d5c0a6d30 2023-10-06T10:58:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.266+0000 7f3d42ffd700 1 -- 172.21.15.50:0/3592959647 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c00c9b0 con 0x7f3d5c0a6d30 2023-10-06T10:58:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.266+0000 7f3d611e2700 1 -- 172.21.15.50:0/3592959647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d500094f0 con 0x7f3d5c0a6d30 2023-10-06T10:58:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.266+0000 7f3d42ffd700 1 -- 172.21.15.50:0/3592959647 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00cd50 con 0x7f3d5c0a6d30 2023-10-06T10:58:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.266+0000 7f3d611e2700 1 -- 172.21.15.50:0/3592959647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c0c2f70 con 0x7f3d5c0a6d30 2023-10-06T10:58:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.266+0000 7f3d42ffd700 1 -- 172.21.15.50:0/3592959647 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3d4c013900 con 0x7f3d5c0a6d30 2023-10-06T10:58:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.266+0000 7f3d42ffd700 1 -- 172.21.15.50:0/3592959647 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f3d4c01ca80 con 0x7f3d5c0a6d30 2023-10-06T10:58:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.267+0000 7f3d611e2700 1 -- 172.21.15.50:0/3592959647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c070480 con 0x7f3d5c0a6d30 2023-10-06T10:58:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.270+0000 7f3d42ffd700 1 -- 172.21.15.50:0/3592959647 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3d4c021060 con 0x7f3d5c0a6d30 2023-10-06T10:58:45.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.359+0000 7f3d611e2700 1 -- 172.21.15.50:0/3592959647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "768079ea-3de9-474a-b2f7-17b4ea3f849f", "id": 3} v 0) v1 -- 0x7f3d5c06ad90 con 0x7f3d5c0a6d30 2023-10-06T10:58:45.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.362+0000 7f3d42ffd700 1 -- 172.21.15.50:0/3592959647 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "768079ea-3de9-474a-b2f7-17b4ea3f849f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3d4c017070 con 0x7f3d5c0a6d30 2023-10-06T10:58:45.364 INFO:teuthology.orchestra.run.smithi050.stdout:3 2023-10-06T10:58:45.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.363+0000 7f3d611e2700 1 -- 172.21.15.50:0/3592959647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0a6d30 msgr2=0x7f3d5c16a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.363+0000 7f3d611e2700 1 --2- 172.21.15.50:0/3592959647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0a6d30 0x7f3d5c16a150 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00ec80 tx=0x7f3d4c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.363+0000 7f3d611e2700 1 -- 172.21.15.50:0/3592959647 shutdown_connections 2023-10-06T10:58:45.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.363+0000 7f3d611e2700 1 --2- 172.21.15.50:0/3592959647 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d5c0aeb50 0x7f3d5c0c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.363+0000 7f3d611e2700 1 --2- 172.21.15.50:0/3592959647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0a6d30 0x7f3d5c16a150 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.363+0000 7f3d611e2700 1 --2- 172.21.15.50:0/3592959647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d5c0a7100 0x7f3d5c0c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.363+0000 7f3d611e2700 1 -- 172.21.15.50:0/3592959647 >> 172.21.15.50:0/3592959647 conn(0x7f3d5c0cc560 msgr2=0x7f3d5c0abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:45.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.363+0000 7f3d611e2700 1 -- 172.21.15.50:0/3592959647 shutdown_connections 2023-10-06T10:58:45.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.363+0000 7f3d611e2700 1 -- 172.21.15.50:0/3592959647 wait complete. 2023-10-06T10:58:45.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 368896ea-39d9-4ebb-be3b-3d45ef60ce45 4 2023-10-06T10:58:45.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.507+0000 7f3b18978700 1 Processor -- start 2023-10-06T10:58:45.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.507+0000 7f3b18978700 1 -- start start 2023-10-06T10:58:45.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.509+0000 7f3b18978700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3b140ae430 0x7f3b140b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.509+0000 7f3b18978700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3b140b0540 0x7f3b1406c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.509+0000 7f3b18978700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1406cb90 con 0x7f3b1406c770 2023-10-06T10:58:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.509+0000 7f3b18978700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b140af590 con 0x7f3b140b0540 2023-10-06T10:58:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.509+0000 7f3b18978700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1415bc60 con 0x7f3b140ae430 2023-10-06T10:58:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.509+0000 7f3b1259c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3b140ae430 0x7f3b140b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.509+0000 7f3b1259c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3b140ae430 0x7f3b140b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:43832/0 (socket says 172.21.15.50:43832) 2023-10-06T10:58:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.509+0000 7f3b1259c700 1 -- 172.21.15.50:0/595874646 learned_addr learned my addr 172.21.15.50:0/595874646 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T10:58:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.509+0000 7f3b11d9b700 1 --2- 172.21.15.50:0/595874646 >> v2:172.21.15.7:3300/0 conn(0x7f3b140b0540 0x7f3b1406c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.509+0000 7f3b1259c700 1 -- 172.21.15.50:0/595874646 >> v2:172.21.15.7:3300/0 conn(0x7f3b140b0540 msgr2=0x7f3b1406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.509+0000 7f3b1259c700 1 --2- 172.21.15.50:0/595874646 >> v2:172.21.15.7:3300/0 conn(0x7f3b140b0540 0x7f3b1406c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.509+0000 7f3b1259c700 1 -- 172.21.15.50:0/595874646 >> v1:172.21.15.7:6789/0 conn(0x7f3b1406c770 legacy=0x7f3b1406db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.509+0000 7f3b1259c700 1 -- 172.21.15.50:0/595874646 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1415b050 con 0x7f3b140ae430 2023-10-06T10:58:45.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.509+0000 7f3b1259c700 1 --2- 172.21.15.50:0/595874646 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3b140ae430 0x7f3b140b0000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3b040099b0 tx=0x7f3b04009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f2075343b5c30ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:45.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.510+0000 7f3b1159a700 1 -- 172.21.15.50:0/595874646 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04009ea0 con 0x7f3b140ae430 2023-10-06T10:58:45.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.510+0000 7f3b1159a700 1 -- 172.21.15.50:0/595874646 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0400b860 con 0x7f3b140ae430 2023-10-06T10:58:45.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.510+0000 7f3b1159a700 1 -- 172.21.15.50:0/595874646 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0400bc00 con 0x7f3b140ae430 2023-10-06T10:58:45.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.511+0000 7f3b18978700 1 -- 172.21.15.50:0/595874646 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3b140ae430 msgr2=0x7f3b140b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.511+0000 7f3b18978700 1 --2- 172.21.15.50:0/595874646 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3b140ae430 0x7f3b140b0000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3b040099b0 tx=0x7f3b04009250 comp rx=0 tx=0).stop 2023-10-06T10:58:45.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.511+0000 7f3b18978700 1 -- 172.21.15.50:0/595874646 shutdown_connections 2023-10-06T10:58:45.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.511+0000 7f3b18978700 1 --2- 172.21.15.50:0/595874646 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3b140ae430 0x7f3b140b0000 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.511+0000 7f3b18978700 1 --2- 172.21.15.50:0/595874646 >> v2:172.21.15.7:3300/0 conn(0x7f3b140b0540 0x7f3b1406c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.511+0000 7f3b18978700 1 -- 172.21.15.50:0/595874646 >> 172.21.15.50:0/595874646 conn(0x7f3b140cded0 msgr2=0x7f3b140ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:45.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.511+0000 7f3b18978700 1 -- 172.21.15.50:0/595874646 shutdown_connections 2023-10-06T10:58:45.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.511+0000 7f3b18978700 1 -- 172.21.15.50:0/595874646 wait complete. 2023-10-06T10:58:45.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.513+0000 7f3b18978700 1 Processor -- start 2023-10-06T10:58:45.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.513+0000 7f3b18978700 1 -- start start 2023-10-06T10:58:45.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.514+0000 7f3b18978700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3b1406c770 0x7f3b140c1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.514+0000 7f3b18978700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140ae430 0x7f3b1414f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.514+0000 7f3b18978700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b140b0540 0x7f3b140b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.514+0000 7f3b18978700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140b3280 con 0x7f3b140b0540 2023-10-06T10:58:45.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.514+0000 7f3b18978700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140c1d40 con 0x7f3b140ae430 2023-10-06T10:58:45.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.514+0000 7f3b18978700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140c2020 con 0x7f3b1406c770 2023-10-06T10:58:45.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.514+0000 7f3b1259c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3b1406c770 0x7f3b140c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.514+0000 7f3b11d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140ae430 0x7f3b1414f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.514+0000 7f3b1259c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3b1406c770 0x7f3b140c1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:43846/0 (socket says 172.21.15.50:43846) 2023-10-06T10:58:45.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.514+0000 7f3b11d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140ae430 0x7f3b1414f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50324/0 (socket says 172.21.15.50:50324) 2023-10-06T10:58:45.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.514+0000 7f3b1259c700 1 -- 172.21.15.50:0/740988026 learned_addr learned my addr 172.21.15.50:0/740988026 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T10:58:45.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.514+0000 7f3b12d9d700 1 --2- 172.21.15.50:0/740988026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b140b0540 0x7f3b140b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.515+0000 7f3b1259c700 1 -- 172.21.15.50:0/740988026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140ae430 msgr2=0x7f3b1414f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.515+0000 7f3b1259c700 1 --2- 172.21.15.50:0/740988026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140ae430 0x7f3b1414f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.515+0000 7f3b1259c700 1 -- 172.21.15.50:0/740988026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b140b0540 msgr2=0x7f3b140b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.515+0000 7f3b1259c700 1 --2- 172.21.15.50:0/740988026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b140b0540 0x7f3b140b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.515+0000 7f3b1259c700 1 -- 172.21.15.50:0/740988026 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b040094f0 con 0x7f3b1406c770 2023-10-06T10:58:45.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.515+0000 7f3b1259c700 1 --2- 172.21.15.50:0/740988026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3b1406c770 0x7f3b140c1760 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b1406ec50 tx=0x7f3b04017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:45.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.515+0000 7f3b027fc700 1 -- 172.21.15.50:0/740988026 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04000d10 con 0x7f3b1406c770 2023-10-06T10:58:45.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.515+0000 7f3b027fc700 1 -- 172.21.15.50:0/740988026 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0400bbe0 con 0x7f3b1406c770 2023-10-06T10:58:45.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.515+0000 7f3b18978700 1 -- 172.21.15.50:0/740988026 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b140c2300 con 0x7f3b1406c770 2023-10-06T10:58:45.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.515+0000 7f3b027fc700 1 -- 172.21.15.50:0/740988026 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04011670 con 0x7f3b1406c770 2023-10-06T10:58:45.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.515+0000 7f3b18978700 1 -- 172.21.15.50:0/740988026 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b140c28c0 con 0x7f3b1406c770 2023-10-06T10:58:45.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.516+0000 7f3b027fc700 1 -- 172.21.15.50:0/740988026 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3b04011d20 con 0x7f3b1406c770 2023-10-06T10:58:45.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.516+0000 7f3b027fc700 1 -- 172.21.15.50:0/740988026 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f3b0402ecc0 con 0x7f3b1406c770 2023-10-06T10:58:45.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.516+0000 7f3b18978700 1 -- 172.21.15.50:0/740988026 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b14070480 con 0x7f3b1406c770 2023-10-06T10:58:45.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.518+0000 7f3b027fc700 1 -- 172.21.15.50:0/740988026 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3b04033060 con 0x7f3b1406c770 2023-10-06T10:58:45.576 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:45.574+0000 7f1622b621c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T10:58:45.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.607+0000 7f3b18978700 1 -- 172.21.15.50:0/740988026 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "368896ea-39d9-4ebb-be3b-3d45ef60ce45", "id": 4} v 0) v1 -- 0x7f3b140c85e0 con 0x7f3b1406c770 2023-10-06T10:58:45.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.610+0000 7f3b027fc700 1 -- 172.21.15.50:0/740988026 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "368896ea-39d9-4ebb-be3b-3d45ef60ce45", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3b04015020 con 0x7f3b1406c770 2023-10-06T10:58:45.612 INFO:teuthology.orchestra.run.smithi050.stdout:4 2023-10-06T10:58:45.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.611+0000 7f3b18978700 1 -- 172.21.15.50:0/740988026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3b1406c770 msgr2=0x7f3b140c1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.611+0000 7f3b18978700 1 --2- 172.21.15.50:0/740988026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3b1406c770 0x7f3b140c1760 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b1406ec50 tx=0x7f3b04017000 comp rx=0 tx=0).stop 2023-10-06T10:58:45.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.611+0000 7f3b18978700 1 -- 172.21.15.50:0/740988026 shutdown_connections 2023-10-06T10:58:45.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.611+0000 7f3b18978700 1 --2- 172.21.15.50:0/740988026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b140b0540 0x7f3b140b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.611+0000 7f3b18978700 1 --2- 172.21.15.50:0/740988026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3b1406c770 0x7f3b140c1760 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.611+0000 7f3b18978700 1 --2- 172.21.15.50:0/740988026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140ae430 0x7f3b1414f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.611+0000 7f3b18978700 1 -- 172.21.15.50:0/740988026 >> 172.21.15.50:0/740988026 conn(0x7f3b140cded0 msgr2=0x7f3b1415a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:45.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.611+0000 7f3b18978700 1 -- 172.21.15.50:0/740988026 shutdown_connections 2023-10-06T10:58:45.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.611+0000 7f3b18978700 1 -- 172.21.15.50:0/740988026 wait complete. 2023-10-06T10:58:45.623 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:45.622+0000 7f6a14a4e1c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T10:58:45.625 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new f2b41a42-1560-44a6-8417-edde43b5fd52 5 2023-10-06T10:58:45.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.759+0000 7fd52cfc2700 1 Processor -- start 2023-10-06T10:58:45.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.759+0000 7fd52cfc2700 1 -- start start 2023-10-06T10:58:45.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd52cfc2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd52815a200 0x7fd52815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd52cfc2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd52806ad30 0x7fd5280670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd52cfc2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd5280ae130 0x7fd5280ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd52cfc2700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5280cb110 con 0x7fd5280ae130 2023-10-06T10:58:45.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd52cfc2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5280aeac0 con 0x7fd52806ad30 2023-10-06T10:58:45.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd52cfc2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52806c070 con 0x7fd52815a200 2023-10-06T10:58:45.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd525d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd52806ad30 0x7fd5280670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd52659c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd52815a200 0x7fd52815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd52659c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd52815a200 0x7fd52815a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:43854/0 (socket says 172.21.15.50:43854) 2023-10-06T10:58:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd525d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd52806ad30 0x7fd5280670f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50328/0 (socket says 172.21.15.50:50328) 2023-10-06T10:58:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd52659c700 1 -- 172.21.15.50:0/2927986515 learned_addr learned my addr 172.21.15.50:0/2927986515 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T10:58:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd526d9d700 1 --2- 172.21.15.50:0/2927986515 >> v2:172.21.15.7:3300/0 conn(0x7fd5280ae130 0x7fd5280ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd525d9b700 1 -- 172.21.15.50:0/2927986515 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd52815a200 msgr2=0x7fd52815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd525d9b700 1 --2- 172.21.15.50:0/2927986515 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd52815a200 0x7fd52815a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd525d9b700 1 -- 172.21.15.50:0/2927986515 >> v2:172.21.15.7:3300/0 conn(0x7fd5280ae130 msgr2=0x7fd5280ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd525d9b700 1 --2- 172.21.15.50:0/2927986515 >> v2:172.21.15.7:3300/0 conn(0x7fd5280ae130 0x7fd5280ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd525d9b700 1 -- 172.21.15.50:0/2927986515 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52815ab10 con 0x7fd52806ad30 2023-10-06T10:58:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd526d9d700 1 --2- 172.21.15.50:0/2927986515 >> v2:172.21.15.7:3300/0 conn(0x7fd5280ae130 0x7fd5280ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:58:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.760+0000 7fd52659c700 1 --2- 172.21.15.50:0/2927986515 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd52815a200 0x7fd52815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.761+0000 7fd525d9b700 1 --2- 172.21.15.50:0/2927986515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd52806ad30 0x7fd5280670f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd5280aedd0 tx=0x7fd51c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ee771835dff890d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:45.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.761+0000 7fd52559a700 1 -- 172.21.15.50:0/2927986515 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c011630 con 0x7fd52806ad30 2023-10-06T10:58:45.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.761+0000 7fd52559a700 1 -- 172.21.15.50:0/2927986515 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c011790 con 0x7fd52806ad30 2023-10-06T10:58:45.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.761+0000 7fd52559a700 1 -- 172.21.15.50:0/2927986515 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c011b30 con 0x7fd52806ad30 2023-10-06T10:58:45.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.762+0000 7fd52cfc2700 1 -- 172.21.15.50:0/2927986515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd52806ad30 msgr2=0x7fd5280670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.762+0000 7fd52cfc2700 1 --2- 172.21.15.50:0/2927986515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd52806ad30 0x7fd5280670f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd5280aedd0 tx=0x7fd51c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.762+0000 7fd52cfc2700 1 -- 172.21.15.50:0/2927986515 shutdown_connections 2023-10-06T10:58:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.762+0000 7fd52cfc2700 1 --2- 172.21.15.50:0/2927986515 >> v2:172.21.15.7:3300/0 conn(0x7fd5280ae130 0x7fd5280ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.762+0000 7fd52cfc2700 1 --2- 172.21.15.50:0/2927986515 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd52815a200 0x7fd52815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.762+0000 7fd52cfc2700 1 --2- 172.21.15.50:0/2927986515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd52806ad30 0x7fd5280670f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.762+0000 7fd52cfc2700 1 -- 172.21.15.50:0/2927986515 >> 172.21.15.50:0/2927986515 conn(0x7fd5280cc560 msgr2=0x7fd5280cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.762+0000 7fd52cfc2700 1 -- 172.21.15.50:0/2927986515 shutdown_connections 2023-10-06T10:58:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.762+0000 7fd52cfc2700 1 -- 172.21.15.50:0/2927986515 wait complete. 2023-10-06T10:58:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.763+0000 7fd52cfc2700 1 Processor -- start 2023-10-06T10:58:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.763+0000 7fd52cfc2700 1 -- start start 2023-10-06T10:58:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd52cfc2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd52806ad30 0x7fd528097490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd52cfc2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5280ae130 0x7fd528098d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd52cfc2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd52815a200 0x7fd52814a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd52cfc2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd528099f90 con 0x7fd52815a200 2023-10-06T10:58:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd52cfc2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd528099380 con 0x7fd5280ae130 2023-10-06T10:58:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd52cfc2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd528099660 con 0x7fd52806ad30 2023-10-06T10:58:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd52659c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd52806ad30 0x7fd528097490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd52659c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd52806ad30 0x7fd528097490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:43870/0 (socket says 172.21.15.50:43870) 2023-10-06T10:58:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd52659c700 1 -- 172.21.15.50:0/541937213 learned_addr learned my addr 172.21.15.50:0/541937213 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T10:58:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd525d9b700 1 --2- 172.21.15.50:0/541937213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5280ae130 0x7fd528098d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd526d9d700 1 --2- 172.21.15.50:0/541937213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd52815a200 0x7fd52814a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd52659c700 1 -- 172.21.15.50:0/541937213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5280ae130 msgr2=0x7fd528098d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd52659c700 1 --2- 172.21.15.50:0/541937213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5280ae130 0x7fd528098d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd52659c700 1 -- 172.21.15.50:0/541937213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd52815a200 msgr2=0x7fd52814a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd52659c700 1 --2- 172.21.15.50:0/541937213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd52815a200 0x7fd52814a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.764+0000 7fd52659c700 1 -- 172.21.15.50:0/541937213 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5180094f0 con 0x7fd52806ad30 2023-10-06T10:58:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.765+0000 7fd52659c700 1 --2- 172.21.15.50:0/541937213 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd52806ad30 0x7fd528097490 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd51800ec50 tx=0x7fd518009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.765+0000 7fd5167fc700 1 -- 172.21.15.50:0/541937213 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51800c850 con 0x7fd52806ad30 2023-10-06T10:58:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.765+0000 7fd5167fc700 1 -- 172.21.15.50:0/541937213 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51800c9b0 con 0x7fd52806ad30 2023-10-06T10:58:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.765+0000 7fd52cfc2700 1 -- 172.21.15.50:0/541937213 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51c009420 con 0x7fd52806ad30 2023-10-06T10:58:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.765+0000 7fd5167fc700 1 -- 172.21.15.50:0/541937213 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51800cd50 con 0x7fd52806ad30 2023-10-06T10:58:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.765+0000 7fd52cfc2700 1 -- 172.21.15.50:0/541937213 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd528099c20 con 0x7fd52806ad30 2023-10-06T10:58:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.765+0000 7fd5167fc700 1 -- 172.21.15.50:0/541937213 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd518005a00 con 0x7fd52806ad30 2023-10-06T10:58:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.765+0000 7fd5167fc700 1 -- 172.21.15.50:0/541937213 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fd5180123d0 con 0x7fd52806ad30 2023-10-06T10:58:45.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.766+0000 7fd52cfc2700 1 -- 172.21.15.50:0/541937213 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd528070480 con 0x7fd52806ad30 2023-10-06T10:58:45.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.769+0000 7fd5167fc700 1 -- 172.21.15.50:0/541937213 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd518021060 con 0x7fd52806ad30 2023-10-06T10:58:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.856+0000 7fd52cfc2700 1 -- 172.21.15.50:0/541937213 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f2b41a42-1560-44a6-8417-edde43b5fd52", "id": 5} v 0) v1 -- 0x7fd52806bbc0 con 0x7fd52806ad30 2023-10-06T10:58:45.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.859+0000 7fd5167fc700 1 -- 172.21.15.50:0/541937213 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f2b41a42-1560-44a6-8417-edde43b5fd52", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd518017070 con 0x7fd52806ad30 2023-10-06T10:58:45.861 INFO:teuthology.orchestra.run.smithi050.stdout:5 2023-10-06T10:58:45.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.860+0000 7fd52cfc2700 1 -- 172.21.15.50:0/541937213 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd52806ad30 msgr2=0x7fd528097490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.860+0000 7fd52cfc2700 1 --2- 172.21.15.50:0/541937213 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd52806ad30 0x7fd528097490 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd51800ec50 tx=0x7fd518009250 comp rx=0 tx=0).stop 2023-10-06T10:58:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.860+0000 7fd52cfc2700 1 -- 172.21.15.50:0/541937213 shutdown_connections 2023-10-06T10:58:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.860+0000 7fd52cfc2700 1 --2- 172.21.15.50:0/541937213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd52815a200 0x7fd52814a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.860+0000 7fd52cfc2700 1 --2- 172.21.15.50:0/541937213 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd52806ad30 0x7fd528097490 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.860+0000 7fd52cfc2700 1 --2- 172.21.15.50:0/541937213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5280ae130 0x7fd528098d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.860+0000 7fd52cfc2700 1 -- 172.21.15.50:0/541937213 >> 172.21.15.50:0/541937213 conn(0x7fd5280cc560 msgr2=0x7fd5280af300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.861+0000 7fd52cfc2700 1 -- 172.21.15.50:0/541937213 shutdown_connections 2023-10-06T10:58:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:45.861+0000 7fd52cfc2700 1 -- 172.21.15.50:0/541937213 wait complete. 2023-10-06T10:58:45.875 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 4070741e-bcef-4070-8c41-6731b75e1023 6 2023-10-06T10:58:46.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.005+0000 7f117fc27700 1 Processor -- start 2023-10-06T10:58:46.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.005+0000 7f117fc27700 1 -- start start 2023-10-06T10:58:46.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.006+0000 7f117fc27700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f11781590f0 0x7f1178068500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.006+0000 7f117fc27700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11781594c0 0x7f11780ab750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.006+0000 7f117fc27700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11780afbf0 0x7f117806c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.006+0000 7f117fc27700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11780abc90 con 0x7f11781590f0 2023-10-06T10:58:46.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.006+0000 7f117fc27700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11780abf30 con 0x7f11781594c0 2023-10-06T10:58:46.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.006+0000 7f117fc27700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11780ac210 con 0x7f11780afbf0 2023-10-06T10:58:46.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.007+0000 7f117d1c2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11781594c0 0x7f11780ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.007+0000 7f117e1c4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11780afbf0 0x7f117806c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.007+0000 7f117d1c2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11781594c0 0x7f11780ab750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50348/0 (socket says 172.21.15.50:50348) 2023-10-06T10:58:46.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.007+0000 7f117d1c2700 1 -- 172.21.15.50:0/3306577238 learned_addr learned my addr 172.21.15.50:0/3306577238 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T10:58:46.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.007+0000 7f117d9c3700 1 --2- 172.21.15.50:0/3306577238 >> v2:172.21.15.7:3300/0 conn(0x7f11781590f0 0x7f1178068500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.007+0000 7f117d1c2700 1 -- 172.21.15.50:0/3306577238 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11780afbf0 msgr2=0x7f117806c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:46.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.007+0000 7f117d1c2700 1 --2- 172.21.15.50:0/3306577238 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11780afbf0 0x7f117806c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.007+0000 7f117d1c2700 1 -- 172.21.15.50:0/3306577238 >> v2:172.21.15.7:3300/0 conn(0x7f11781590f0 msgr2=0x7f1178068500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:46.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.007+0000 7f117d1c2700 1 --2- 172.21.15.50:0/3306577238 >> v2:172.21.15.7:3300/0 conn(0x7f11781590f0 0x7f1178068500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.007+0000 7f117d1c2700 1 -- 172.21.15.50:0/3306577238 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1178067a20 con 0x7f11781594c0 2023-10-06T10:58:46.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.007+0000 7f117e1c4700 1 --2- 172.21.15.50:0/3306577238 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11780afbf0 0x7f117806c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:46.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.007+0000 7f117d1c2700 1 --2- 172.21.15.50:0/3306577238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11781594c0 0x7f11780ab750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f11780b2540 tx=0x7f1168009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac43e248886d4059 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:46.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.007+0000 7f117c9c1700 1 -- 172.21.15.50:0/3306577238 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116800b640 con 0x7f11781594c0 2023-10-06T10:58:46.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.008+0000 7f117c9c1700 1 -- 172.21.15.50:0/3306577238 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116800b7a0 con 0x7f11781594c0 2023-10-06T10:58:46.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.008+0000 7f117c9c1700 1 -- 172.21.15.50:0/3306577238 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116800bb60 con 0x7f11781594c0 2023-10-06T10:58:46.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.008+0000 7f117fc27700 1 -- 172.21.15.50:0/3306577238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11781594c0 msgr2=0x7f11780ab750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.008+0000 7f117fc27700 1 --2- 172.21.15.50:0/3306577238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11781594c0 0x7f11780ab750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f11780b2540 tx=0x7f1168009250 comp rx=0 tx=0).stop 2023-10-06T10:58:46.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.008+0000 7f117fc27700 1 -- 172.21.15.50:0/3306577238 shutdown_connections 2023-10-06T10:58:46.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.008+0000 7f117fc27700 1 --2- 172.21.15.50:0/3306577238 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11780afbf0 0x7f117806c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.008+0000 7f117fc27700 1 --2- 172.21.15.50:0/3306577238 >> v2:172.21.15.7:3300/0 conn(0x7f11781590f0 0x7f1178068500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.008+0000 7f117fc27700 1 --2- 172.21.15.50:0/3306577238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11781594c0 0x7f11780ab750 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.008+0000 7f117fc27700 1 -- 172.21.15.50:0/3306577238 >> 172.21.15.50:0/3306577238 conn(0x7f11780cce30 msgr2=0x7f11780cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:46.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.008+0000 7f117fc27700 1 -- 172.21.15.50:0/3306577238 shutdown_connections 2023-10-06T10:58:46.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.008+0000 7f117fc27700 1 -- 172.21.15.50:0/3306577238 wait complete. 2023-10-06T10:58:46.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.009+0000 7f117fc27700 1 Processor -- start 2023-10-06T10:58:46.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.010+0000 7f117fc27700 1 -- start start 2023-10-06T10:58:46.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.010+0000 7f117fc27700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11780afbf0 0x7f1178069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.010+0000 7f117fc27700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11781590f0 0x7f1178153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.010+0000 7f117fc27700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11781594c0 0x7f11780b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.010+0000 7f117fc27700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117815b640 con 0x7f11780afbf0 2023-10-06T10:58:46.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.010+0000 7f117fc27700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1178069ad0 con 0x7f11781594c0 2023-10-06T10:58:46.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.010+0000 7f117fc27700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117815aa30 con 0x7f11781590f0 2023-10-06T10:58:46.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.010+0000 7f117d1c2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11781590f0 0x7f1178153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.010+0000 7f117e1c4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11781594c0 0x7f11780b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.010+0000 7f117d1c2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11781590f0 0x7f1178153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:43884/0 (socket says 172.21.15.50:43884) 2023-10-06T10:58:46.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.010+0000 7f117d1c2700 1 -- 172.21.15.50:0/2990481998 learned_addr learned my addr 172.21.15.50:0/2990481998 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T10:58:46.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.010+0000 7f117d9c3700 1 --2- 172.21.15.50:0/2990481998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11780afbf0 0x7f1178069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.011+0000 7f117d1c2700 1 -- 172.21.15.50:0/2990481998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11781594c0 msgr2=0x7f11780b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.011+0000 7f117d1c2700 1 --2- 172.21.15.50:0/2990481998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11781594c0 0x7f11780b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.011+0000 7f117d1c2700 1 -- 172.21.15.50:0/2990481998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11780afbf0 msgr2=0x7f1178069590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.011+0000 7f117d1c2700 1 --2- 172.21.15.50:0/2990481998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11780afbf0 0x7f1178069590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.011+0000 7f117d1c2700 1 -- 172.21.15.50:0/2990481998 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1170009a20 con 0x7f11781590f0 2023-10-06T10:58:46.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.011+0000 7f117e1c4700 1 --2- 172.21.15.50:0/2990481998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11781594c0 0x7f11780b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:46.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.011+0000 7f117d1c2700 1 --2- 172.21.15.50:0/2990481998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11781590f0 0x7f1178153d80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f11780ac070 tx=0x7f1168017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:46.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.011+0000 7f116dffb700 1 -- 172.21.15.50:0/2990481998 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168000d10 con 0x7f11781590f0 2023-10-06T10:58:46.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.011+0000 7f116dffb700 1 -- 172.21.15.50:0/2990481998 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116800bb20 con 0x7f11781590f0 2023-10-06T10:58:46.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.011+0000 7f117fc27700 1 -- 172.21.15.50:0/2990481998 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11680094f0 con 0x7f11781590f0 2023-10-06T10:58:46.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.011+0000 7f116dffb700 1 -- 172.21.15.50:0/2990481998 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168011670 con 0x7f11781590f0 2023-10-06T10:58:46.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.011+0000 7f117fc27700 1 -- 172.21.15.50:0/2990481998 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117815aff0 con 0x7f11781590f0 2023-10-06T10:58:46.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.012+0000 7f116dffb700 1 -- 172.21.15.50:0/2990481998 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1168011c60 con 0x7f11781590f0 2023-10-06T10:58:46.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.012+0000 7f116dffb700 1 -- 172.21.15.50:0/2990481998 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f11680253f0 con 0x7f11781590f0 2023-10-06T10:58:46.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.012+0000 7f117fc27700 1 -- 172.21.15.50:0/2990481998 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1178070480 con 0x7f11781590f0 2023-10-06T10:58:46.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.015+0000 7f116dffb700 1 -- 172.21.15.50:0/2990481998 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1168033060 con 0x7f11781590f0 2023-10-06T10:58:46.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.103+0000 7f117fc27700 1 -- 172.21.15.50:0/2990481998 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4070741e-bcef-4070-8c41-6731b75e1023", "id": 6} v 0) v1 -- 0x7f11780ad090 con 0x7f11781590f0 2023-10-06T10:58:46.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.106+0000 7f116dffb700 1 -- 172.21.15.50:0/2990481998 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4070741e-bcef-4070-8c41-6731b75e1023", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1168015020 con 0x7f11781590f0 2023-10-06T10:58:46.108 INFO:teuthology.orchestra.run.smithi050.stdout:6 2023-10-06T10:58:46.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.107+0000 7f117fc27700 1 -- 172.21.15.50:0/2990481998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11781590f0 msgr2=0x7f1178153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.107+0000 7f117fc27700 1 --2- 172.21.15.50:0/2990481998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11781590f0 0x7f1178153d80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f11780ac070 tx=0x7f1168017000 comp rx=0 tx=0).stop 2023-10-06T10:58:46.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.107+0000 7f117fc27700 1 -- 172.21.15.50:0/2990481998 shutdown_connections 2023-10-06T10:58:46.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.107+0000 7f117fc27700 1 --2- 172.21.15.50:0/2990481998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11780afbf0 0x7f1178069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.107+0000 7f117fc27700 1 --2- 172.21.15.50:0/2990481998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11781594c0 0x7f11780b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.107+0000 7f117fc27700 1 --2- 172.21.15.50:0/2990481998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11781590f0 0x7f1178153d80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.107+0000 7f117fc27700 1 -- 172.21.15.50:0/2990481998 >> 172.21.15.50:0/2990481998 conn(0x7f11780cce30 msgr2=0x7f11780cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:46.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.107+0000 7f117fc27700 1 -- 172.21.15.50:0/2990481998 shutdown_connections 2023-10-06T10:58:46.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.107+0000 7f117fc27700 1 -- 172.21.15.50:0/2990481998 wait complete. 2023-10-06T10:58:46.122 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new f562162d-d284-4631-9697-1b07ff86072e 7 2023-10-06T10:58:46.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.251+0000 7fba5ff71700 1 Processor -- start 2023-10-06T10:58:46.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.251+0000 7fba5ff71700 1 -- start start 2023-10-06T10:58:46.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.253+0000 7fba5ff71700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba580c8e50 0x7fba5815a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.253+0000 7fba5ff71700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba58069dd0 con 0x7fba580cab40 2023-10-06T10:58:46.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.253+0000 7fba5ff71700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5806a070 con 0x7fba580caf10 2023-10-06T10:58:46.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.253+0000 7fba5ff71700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5806a350 con 0x7fba580c8e50 2023-10-06T10:58:46.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.253+0000 7fba5e50e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba580c8e50 0x7fba5815a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.253+0000 7fba5e50e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba580c8e50 0x7fba5815a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50376/0 (socket says 172.21.15.50:50376) 2023-10-06T10:58:46.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.253+0000 7fba5e50e700 1 -- 172.21.15.50:0/1621323314 learned_addr learned my addr 172.21.15.50:0/1621323314 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T10:58:46.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.253+0000 7fba5d50c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fba580caf10 0x7fba58159dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39304/0 (socket says 172.21.15.50:39304) 2023-10-06T10:58:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.254+0000 7fba5e50e700 1 -- 172.21.15.50:0/1621323314 >> v1:172.21.15.50:6789/0 conn(0x7fba580caf10 legacy=0x7fba58159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.254+0000 7fba5e50e700 1 -- 172.21.15.50:0/1621323314 >> v1:172.21.15.7:6789/0 conn(0x7fba580cab40 legacy=0x7fba580694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.254+0000 7fba5cd0b700 1 -- 172.21.15.50:0/1621323314 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028811521 0 0) 0x7fba58069dd0 con 0x7fba580cab40 2023-10-06T10:58:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.254+0000 7fba5e50e700 1 -- 172.21.15.50:0/1621323314 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba580c7360 con 0x7fba580c8e50 2023-10-06T10:58:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.254+0000 7fba5e50e700 1 --2- 172.21.15.50:0/1621323314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba580c8e50 0x7fba5815a4d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba50009930 tx=0x7fba50009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a559afeab1009d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.254+0000 7fba5cd0b700 1 -- 172.21.15.50:0/1621323314 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5000b7e0 con 0x7fba580c8e50 2023-10-06T10:58:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.254+0000 7fba5cd0b700 1 -- 172.21.15.50:0/1621323314 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5000b940 con 0x7fba580c8e50 2023-10-06T10:58:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.254+0000 7fba5cd0b700 1 -- 172.21.15.50:0/1621323314 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5000bce0 con 0x7fba580c8e50 2023-10-06T10:58:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.255+0000 7fba5ff71700 1 -- 172.21.15.50:0/1621323314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba580c8e50 msgr2=0x7fba5815a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.255+0000 7fba5ff71700 1 --2- 172.21.15.50:0/1621323314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba580c8e50 0x7fba5815a4d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba50009930 tx=0x7fba50009250 comp rx=0 tx=0).stop 2023-10-06T10:58:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.255+0000 7fba5ff71700 1 -- 172.21.15.50:0/1621323314 shutdown_connections 2023-10-06T10:58:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.255+0000 7fba5ff71700 1 --2- 172.21.15.50:0/1621323314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba580c8e50 0x7fba5815a4d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.255+0000 7fba5ff71700 1 -- 172.21.15.50:0/1621323314 >> 172.21.15.50:0/1621323314 conn(0x7fba580afc90 msgr2=0x7fba580b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:46.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.255+0000 7fba5ff71700 1 -- 172.21.15.50:0/1621323314 shutdown_connections 2023-10-06T10:58:46.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.255+0000 7fba5ff71700 1 -- 172.21.15.50:0/1621323314 wait complete. 2023-10-06T10:58:46.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.257+0000 7fba5ff71700 1 Processor -- start 2023-10-06T10:58:46.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.257+0000 7fba5ff71700 1 -- start start 2023-10-06T10:58:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.258+0000 7fba5ff71700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba580c8e50 0x7fba5816cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.258+0000 7fba5ff71700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba580cab40 0x7fba5816a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.258+0000 7fba5ff71700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba580caf10 0x7fba58145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.258+0000 7fba5ff71700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5814e830 con 0x7fba580c8e50 2023-10-06T10:58:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.258+0000 7fba5ff71700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5816a8a0 con 0x7fba580caf10 2023-10-06T10:58:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.258+0000 7fba5ff71700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5816d500 con 0x7fba580cab40 2023-10-06T10:58:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba5e50e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba580caf10 0x7fba58145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba5d50c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba580cab40 0x7fba5816a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba5e50e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba580caf10 0x7fba58145ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50386/0 (socket says 172.21.15.50:50386) 2023-10-06T10:58:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba5e50e700 1 -- 172.21.15.50:0/1172694404 learned_addr learned my addr 172.21.15.50:0/1172694404 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T10:58:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba5dd0d700 1 --2- 172.21.15.50:0/1172694404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba580c8e50 0x7fba5816cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba5e50e700 1 -- 172.21.15.50:0/1172694404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba580cab40 msgr2=0x7fba5816a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba5e50e700 1 --2- 172.21.15.50:0/1172694404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba580cab40 0x7fba5816a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba5e50e700 1 -- 172.21.15.50:0/1172694404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba580c8e50 msgr2=0x7fba5816cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba5e50e700 1 --2- 172.21.15.50:0/1172694404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba580c8e50 0x7fba5816cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba5e50e700 1 -- 172.21.15.50:0/1172694404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba500094f0 con 0x7fba580caf10 2023-10-06T10:58:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba5e50e700 1 --2- 172.21.15.50:0/1172694404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba580caf10 0x7fba58145ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fba50009290 tx=0x7fba50016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba55ffb700 1 -- 172.21.15.50:0/1172694404 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5001c690 con 0x7fba580caf10 2023-10-06T10:58:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba55ffb700 1 -- 172.21.15.50:0/1172694404 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5001c7f0 con 0x7fba580caf10 2023-10-06T10:58:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba55ffb700 1 -- 172.21.15.50:0/1172694404 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5001cb70 con 0x7fba580caf10 2023-10-06T10:58:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.259+0000 7fba5ff71700 1 -- 172.21.15.50:0/1172694404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5816d7e0 con 0x7fba580caf10 2023-10-06T10:58:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.260+0000 7fba5ff71700 1 -- 172.21.15.50:0/1172694404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5816dda0 con 0x7fba580caf10 2023-10-06T10:58:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.260+0000 7fba55ffb700 1 -- 172.21.15.50:0/1172694404 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fba500256b0 con 0x7fba580caf10 2023-10-06T10:58:46.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.260+0000 7fba55ffb700 1 -- 172.21.15.50:0/1172694404 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fba50019a60 con 0x7fba580caf10 2023-10-06T10:58:46.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.261+0000 7fba5ff71700 1 -- 172.21.15.50:0/1172694404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5814e9e0 con 0x7fba580caf10 2023-10-06T10:58:46.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.265+0000 7fba55ffb700 1 -- 172.21.15.50:0/1172694404 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fba500446d0 con 0x7fba580caf10 2023-10-06T10:58:46.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.354+0000 7fba5ff71700 1 -- 172.21.15.50:0/1172694404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f562162d-d284-4631-9697-1b07ff86072e", "id": 7} v 0) v1 -- 0x7fba5814e620 con 0x7fba580caf10 2023-10-06T10:58:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.358+0000 7fba55ffb700 1 -- 172.21.15.50:0/1172694404 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f562162d-d284-4631-9697-1b07ff86072e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fba50033030 con 0x7fba580caf10 2023-10-06T10:58:46.359 INFO:teuthology.orchestra.run.smithi050.stdout:7 2023-10-06T10:58:46.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.359+0000 7fba5ff71700 1 -- 172.21.15.50:0/1172694404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba580caf10 msgr2=0x7fba58145ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.359+0000 7fba5ff71700 1 --2- 172.21.15.50:0/1172694404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba580caf10 0x7fba58145ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fba50009290 tx=0x7fba50016000 comp rx=0 tx=0).stop 2023-10-06T10:58:46.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.359+0000 7fba5ff71700 1 -- 172.21.15.50:0/1172694404 shutdown_connections 2023-10-06T10:58:46.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.359+0000 7fba5ff71700 1 --2- 172.21.15.50:0/1172694404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba580c8e50 0x7fba5816cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.359+0000 7fba5ff71700 1 --2- 172.21.15.50:0/1172694404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba580caf10 0x7fba58145ea0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.359+0000 7fba5ff71700 1 --2- 172.21.15.50:0/1172694404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba580cab40 0x7fba5816a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.359+0000 7fba5ff71700 1 -- 172.21.15.50:0/1172694404 >> 172.21.15.50:0/1172694404 conn(0x7fba580afc90 msgr2=0x7fba5806c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:46.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.359+0000 7fba5ff71700 1 -- 172.21.15.50:0/1172694404 shutdown_connections 2023-10-06T10:58:46.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T10:58:46.359+0000 7fba5ff71700 1 -- 172.21.15.50:0/1172694404 wait complete. 2023-10-06T10:58:46.374 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T10:58:46.374 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T10:58:46.376 INFO:tasks.ceph.osd.0:Started 2023-10-06T10:58:46.376 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T10:58:46.376 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T10:58:46.378 INFO:tasks.ceph.osd.1:Started 2023-10-06T10:58:46.379 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T10:58:46.379 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T10:58:46.381 INFO:tasks.ceph.osd.2:Started 2023-10-06T10:58:46.381 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T10:58:46.381 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T10:58:46.383 INFO:tasks.ceph.osd.3:Started 2023-10-06T10:58:46.383 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T10:58:46.383 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T10:58:46.385 INFO:tasks.ceph.osd.4:Started 2023-10-06T10:58:46.385 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T10:58:46.386 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T10:58:46.387 INFO:tasks.ceph.osd.5:Started 2023-10-06T10:58:46.388 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T10:58:46.388 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T10:58:46.390 INFO:tasks.ceph.osd.6:Started 2023-10-06T10:58:46.390 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T10:58:46.390 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T10:58:46.392 INFO:tasks.ceph.osd.7:Started 2023-10-06T10:58:46.393 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:58:46.408 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:46.406+0000 7f1622b621c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T10:58:46.496 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:46.494+0000 7f6a14a4e1c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T10:58:46.512 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:46.511+0000 7f1622b621c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T10:58:46.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.548+0000 7f2fd144a700 1 Processor -- start 2023-10-06T10:58:46.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.548+0000 7f2fd144a700 1 -- start start 2023-10-06T10:58:46.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fd144a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2fcc0cfb50 0x7f2fcc068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fd144a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2fcc069420 0x7f2fcc0afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fd144a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fcc0cf6c0 con 0x7f2fcc0af320 2023-10-06T10:58:46.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fd144a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fcc159c00 con 0x7f2fcc069420 2023-10-06T10:58:46.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fd144a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0698a0 con 0x7f2fcc0cfb50 2023-10-06T10:58:46.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fcb7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2fcc069420 0x7f2fcc0afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fca7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2fcc0cfb50 0x7f2fcc068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fcb7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2fcc069420 0x7f2fcc0afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36756/0 (socket says 172.21.15.7:36756) 2023-10-06T10:58:46.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fcb7fe700 1 -- 172.21.15.7:0/3356154561 learned_addr learned my addr 172.21.15.7:0/3356154561 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:46.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fcaffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2fcc0af320 0x7f2fcc0cb040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:56974/0 (socket says 172.21.15.7:56974) 2023-10-06T10:58:46.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fcb7fe700 1 -- 172.21.15.7:0/3356154561 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2fcc0cfb50 msgr2=0x7f2fcc068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:46.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fcb7fe700 1 --2- 172.21.15.7:0/3356154561 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2fcc0cfb50 0x7f2fcc068ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fcb7fe700 1 -- 172.21.15.7:0/3356154561 >> v1:172.21.15.50:6789/0 conn(0x7f2fcc0af320 legacy=0x7f2fcc0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fc9ffb700 1 -- 172.21.15.7:0/3356154561 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029310892 0 0) 0x7f2fcc0cf6c0 con 0x7f2fcc0af320 2023-10-06T10:58:46.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fcb7fe700 1 -- 172.21.15.7:0/3356154561 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc0cb750 con 0x7f2fcc069420 2023-10-06T10:58:46.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fcb7fe700 1 --2- 172.21.15.7:0/3356154561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fcc069420 0x7f2fcc0afc90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009f50 tx=0x7f2fc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc91d01d9fa957e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:46.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.549+0000 7f2fc9ffb700 1 -- 172.21.15.7:0/3356154561 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc400e070 con 0x7f2fcc069420 2023-10-06T10:58:46.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.550+0000 7f2fc9ffb700 1 -- 172.21.15.7:0/3356154561 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc400ba50 con 0x7f2fcc069420 2023-10-06T10:58:46.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.550+0000 7f2fc9ffb700 1 -- 172.21.15.7:0/3356154561 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc40092e0 con 0x7f2fcc069420 2023-10-06T10:58:46.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.550+0000 7f2fd144a700 1 -- 172.21.15.7:0/3356154561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fcc069420 msgr2=0x7f2fcc0afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.550+0000 7f2fd144a700 1 --2- 172.21.15.7:0/3356154561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fcc069420 0x7f2fcc0afc90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009f50 tx=0x7f2fc4009840 comp rx=0 tx=0).stop 2023-10-06T10:58:46.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.550+0000 7f2fd144a700 1 -- 172.21.15.7:0/3356154561 shutdown_connections 2023-10-06T10:58:46.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.550+0000 7f2fd144a700 1 --2- 172.21.15.7:0/3356154561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fcc069420 0x7f2fcc0afc90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.550+0000 7f2fd144a700 1 --2- 172.21.15.7:0/3356154561 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2fcc0cfb50 0x7f2fcc068ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.550+0000 7f2fd144a700 1 -- 172.21.15.7:0/3356154561 >> 172.21.15.7:0/3356154561 conn(0x7f2fcc067b80 msgr2=0x7f2fcc0d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:46.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.550+0000 7f2fd144a700 1 -- 172.21.15.7:0/3356154561 shutdown_connections 2023-10-06T10:58:46.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.550+0000 7f2fd144a700 1 -- 172.21.15.7:0/3356154561 wait complete. 2023-10-06T10:58:46.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.552+0000 7f2fd144a700 1 Processor -- start 2023-10-06T10:58:46.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.552+0000 7f2fd144a700 1 -- start start 2023-10-06T10:58:46.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fd144a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fcc069420 0x7f2fcc0b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fd144a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2fcc0af320 0x7f2fcc169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fd144a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fcc0cfb50 0x7f2fcc0cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fd144a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0b43e0 con 0x7f2fcc069420 2023-10-06T10:58:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fd144a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0b4cb0 con 0x7f2fcc0cfb50 2023-10-06T10:58:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fd144a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0b4f00 con 0x7f2fcc0af320 2023-10-06T10:58:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fca7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2fcc0af320 0x7f2fcc169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fcaffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fcc069420 0x7f2fcc0b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fcb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fcc0cfb50 0x7f2fcc0cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fca7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2fcc0af320 0x7f2fcc169bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:44150/0 (socket says 172.21.15.7:44150) 2023-10-06T10:58:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fca7fc700 1 -- 172.21.15.7:0/1910239660 learned_addr learned my addr 172.21.15.7:0/1910239660 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fca7fc700 1 -- 172.21.15.7:0/1910239660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fcc0cfb50 msgr2=0x7f2fcc0cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fca7fc700 1 --2- 172.21.15.7:0/1910239660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fcc0cfb50 0x7f2fcc0cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fca7fc700 1 -- 172.21.15.7:0/1910239660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fcc069420 msgr2=0x7f2fcc0b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fca7fc700 1 --2- 172.21.15.7:0/1910239660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fcc069420 0x7f2fcc0b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fca7fc700 1 -- 172.21.15.7:0/1910239660 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc4009ae0 con 0x7f2fcc0af320 2023-10-06T10:58:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fcaffd700 1 --2- 172.21.15.7:0/1910239660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fcc069420 0x7f2fcc0b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fca7fc700 1 --2- 172.21.15.7:0/1910239660 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2fcc0af320 0x7f2fcc169bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000e930 tx=0x7f2fc00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.553+0000 7f2fb2ffd700 1 -- 172.21.15.7:0/1910239660 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0013680 con 0x7f2fcc0af320 2023-10-06T10:58:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.554+0000 7f2fb2ffd700 1 -- 172.21.15.7:0/1910239660 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc00137e0 con 0x7f2fcc0af320 2023-10-06T10:58:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.554+0000 7f2fd144a700 1 -- 172.21.15.7:0/1910239660 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fcc0b51e0 con 0x7f2fcc0af320 2023-10-06T10:58:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.554+0000 7f2fb2ffd700 1 -- 172.21.15.7:0/1910239660 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0013ba0 con 0x7f2fcc0af320 2023-10-06T10:58:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.554+0000 7f2fd144a700 1 -- 172.21.15.7:0/1910239660 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fcc0b57a0 con 0x7f2fcc0af320 2023-10-06T10:58:46.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.554+0000 7f2fb2ffd700 1 -- 172.21.15.7:0/1910239660 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2fc0005c80 con 0x7f2fcc0af320 2023-10-06T10:58:46.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.554+0000 7f2fb2ffd700 1 -- 172.21.15.7:0/1910239660 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f2fc0006020 con 0x7f2fcc0af320 2023-10-06T10:58:46.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.555+0000 7f2fd144a700 1 -- 172.21.15.7:0/1910239660 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fcc070480 con 0x7f2fcc0af320 2023-10-06T10:58:46.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.557+0000 7f2fb2ffd700 1 -- 172.21.15.7:0/1910239660 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2fc0021060 con 0x7f2fcc0af320 2023-10-06T10:58:46.579 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:46.577+0000 7f6a14a4e1c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T10:58:46.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.631+0000 7f2fd144a700 1 -- 172.21.15.7:0/1910239660 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fcc0ceab0 con 0x7f2fcc0af320 2023-10-06T10:58:46.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.632+0000 7f2fb2ffd700 1 -- 172.21.15.7:0/1910239660 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f2fc0029020 con 0x7f2fcc0af320 2023-10-06T10:58:46.634 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:46.634 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":10,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:58:46.356557+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:58:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.633+0000 7f2fd144a700 1 -- 172.21.15.7:0/1910239660 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2fcc0af320 msgr2=0x7f2fcc169bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.633+0000 7f2fd144a700 1 --2- 172.21.15.7:0/1910239660 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2fcc0af320 0x7f2fcc169bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000e930 tx=0x7f2fc00091a0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.633+0000 7f2fd144a700 1 -- 172.21.15.7:0/1910239660 shutdown_connections 2023-10-06T10:58:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.633+0000 7f2fd144a700 1 --2- 172.21.15.7:0/1910239660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fcc069420 0x7f2fcc0b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.633+0000 7f2fd144a700 1 --2- 172.21.15.7:0/1910239660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fcc0cfb50 0x7f2fcc0cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.633+0000 7f2fd144a700 1 --2- 172.21.15.7:0/1910239660 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2fcc0af320 0x7f2fcc169bf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.633+0000 7f2fd144a700 1 -- 172.21.15.7:0/1910239660 >> 172.21.15.7:0/1910239660 conn(0x7f2fcc067b80 msgr2=0x7f2fcc0afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.633+0000 7f2fd144a700 1 -- 172.21.15.7:0/1910239660 shutdown_connections 2023-10-06T10:58:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:46.633+0000 7f2fd144a700 1 -- 172.21.15.7:0/1910239660 wait complete. 2023-10-06T10:58:46.648 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T10:58:46.649 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T10:58:46.668 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:46.666+0000 7f1622b621c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T10:58:46.731 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:46.730+0000 7f6a14a4e1c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T10:58:46.746 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:46.744+0000 7f1622b621c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T10:58:46.772 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-10-06T10:58:46.771+0000 7fda3bc82540 -1 Falling back to public interface 2023-10-06T10:58:46.809 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:46.807+0000 7f6a14a4e1c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T10:58:46.952 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:46.950+0000 7f1622b621c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T10:58:46.999 INFO:tasks.ceph.osd.4.smithi050.stderr:2023-10-06T10:58:46.997+0000 7f1b34407540 -1 Falling back to public interface 2023-10-06T10:58:47.004 INFO:tasks.ceph.osd.5.smithi050.stderr:2023-10-06T10:58:47.002+0000 7fdc635b7540 -1 Falling back to public interface 2023-10-06T10:58:47.020 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:47.018+0000 7f6a14a4e1c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T10:58:47.022 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-10-06T10:58:47.020+0000 7ff5f5deb540 -1 Falling back to public interface 2023-10-06T10:58:47.025 INFO:tasks.ceph.osd.6.smithi050.stderr:2023-10-06T10:58:47.023+0000 7f395296d540 -1 Falling back to public interface 2023-10-06T10:58:47.029 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-10-06T10:58:47.027+0000 7fad6304e540 -1 Falling back to public interface 2023-10-06T10:58:47.029 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-10-06T10:58:47.027+0000 7f98be517540 -1 Falling back to public interface 2023-10-06T10:58:47.030 INFO:tasks.ceph.osd.7.smithi050.stderr:2023-10-06T10:58:47.028+0000 7fc2a3e94540 -1 Falling back to public interface 2023-10-06T10:58:47.041 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:47.039+0000 7f1622b621c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T10:58:47.107 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:47.106+0000 7f6a14a4e1c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T10:58:47.127 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:47.126+0000 7f1622b621c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T10:58:47.194 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:47.192+0000 7f6a14a4e1c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T10:58:47.225 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:47.224+0000 7f1622b621c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T10:58:47.283 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:47.281+0000 7f6a14a4e1c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T10:58:47.424 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:47.422+0000 7f1622b621c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T10:58:47.456 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T10:58:47.483 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:47.481+0000 7f6a14a4e1c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T10:58:47.517 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:47.516+0000 7f1622b621c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T10:58:47.573 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:47.571+0000 7f6a14a4e1c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T10:58:47.579 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.578+0000 7f5da94c0700 1 Processor -- start 2023-10-06T10:58:47.579 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.578+0000 7f5da94c0700 1 -- start start 2023-10-06T10:58:47.581 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.579+0000 7f5da94c0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5da40ae970 0x7f5da40ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:47.582 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.579+0000 7f5da94c0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da40aedd0 con 0x7f5da40a6dc0 2023-10-06T10:58:47.582 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.579+0000 7f5da94c0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da4068500 con 0x7f5da40a7190 2023-10-06T10:58:47.582 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.579+0000 7f5da94c0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da406ab80 con 0x7f5da40ae970 2023-10-06T10:58:47.582 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.579+0000 7f5da2ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5da40a6dc0 0x7f5da4067d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55038/0 (socket says 172.21.15.7:55038) 2023-10-06T10:58:47.582 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.579+0000 7f5da2ffd700 1 -- 172.21.15.7:0/169224846 learned_addr learned my addr 172.21.15.7:0/169224846 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:58:47.582 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.579+0000 7f5da37fe700 1 --2- 172.21.15.7:0/169224846 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5da40ae970 0x7f5da40ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:47.582 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.579+0000 7f5da1ffb700 1 -- 172.21.15.7:0/169224846 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095609543 0 0) 0x7f5da4068500 con 0x7f5da40a7190 2023-10-06T10:58:47.582 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.579+0000 7f5da1ffb700 1 -- 172.21.15.7:0/169224846 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d8c003570 con 0x7f5da40a7190 2023-10-06T10:58:47.582 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.579+0000 7f5da1ffb700 1 -- 172.21.15.7:0/169224846 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520172212 0 0) 0x7f5d94001290 con 0x7f5da40a6dc0 2023-10-06T10:58:47.583 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.579+0000 7f5da37fe700 1 -- 172.21.15.7:0/169224846 >> v1:172.21.15.50:6789/0 conn(0x7f5da40a7190 legacy=0x7f5da4159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:47.583 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.579+0000 7f5da37fe700 1 -- 172.21.15.7:0/169224846 >> v1:172.21.15.7:6789/0 conn(0x7f5da40a6dc0 legacy=0x7f5da4067d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:47.583 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.579+0000 7f5da37fe700 1 -- 172.21.15.7:0/169224846 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da406ae60 con 0x7f5da40ae970 2023-10-06T10:58:47.583 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.579+0000 7f5da37fe700 1 --2- 172.21.15.7:0/169224846 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5da40ae970 0x7f5da40ac5f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009e90 tx=0x7f5d9c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a5b9404db39b1e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:47.583 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.580+0000 7f5da1ffb700 1 -- 172.21.15.7:0/169224846 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00e070 con 0x7f5da40ae970 2023-10-06T10:58:47.583 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.580+0000 7f5da1ffb700 1 -- 172.21.15.7:0/169224846 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c00bc30 con 0x7f5da40ae970 2023-10-06T10:58:47.583 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.580+0000 7f5da1ffb700 1 -- 172.21.15.7:0/169224846 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c012430 con 0x7f5da40ae970 2023-10-06T10:58:47.586 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.580+0000 7f5da94c0700 1 -- 172.21.15.7:0/169224846 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5da40ae970 msgr2=0x7f5da40ac5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:47.586 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.580+0000 7f5da94c0700 1 --2- 172.21.15.7:0/169224846 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5da40ae970 0x7f5da40ac5f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009e90 tx=0x7f5d9c009780 comp rx=0 tx=0).stop 2023-10-06T10:58:47.586 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.580+0000 7f5da94c0700 1 -- 172.21.15.7:0/169224846 shutdown_connections 2023-10-06T10:58:47.586 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.580+0000 7f5da94c0700 1 --2- 172.21.15.7:0/169224846 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5da40ae970 0x7f5da40ac5f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:47.586 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.580+0000 7f5da94c0700 1 -- 172.21.15.7:0/169224846 >> 172.21.15.7:0/169224846 conn(0x7f5da40cc550 msgr2=0x7f5da40cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:47.587 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.580+0000 7f5da94c0700 1 -- 172.21.15.7:0/169224846 shutdown_connections 2023-10-06T10:58:47.587 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.580+0000 7f5da94c0700 1 -- 172.21.15.7:0/169224846 wait complete. 2023-10-06T10:58:47.587 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.582+0000 7f5da94c0700 1 Processor -- start 2023-10-06T10:58:47.587 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.582+0000 7f5da94c0700 1 -- start start 2023-10-06T10:58:47.587 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da94c0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5da40a6dc0 0x7f5da4095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:47.587 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da94c0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5da40a7190 0x7f5da41545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:47.587 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da94c0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5da40ae970 0x7f5da415f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:47.588 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da94c0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da4169320 con 0x7f5da40a6dc0 2023-10-06T10:58:47.588 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da94c0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da4097760 con 0x7f5da40a7190 2023-10-06T10:58:47.588 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da94c0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da4097a40 con 0x7f5da40ae970 2023-10-06T10:58:47.588 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da2ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5da40a6dc0 0x7f5da4095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:47.588 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da2ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5da40a6dc0 0x7f5da4095a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36776/0 (socket says 172.21.15.7:36776) 2023-10-06T10:58:47.588 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da2ffd700 1 -- 172.21.15.7:0/3713389340 learned_addr learned my addr 172.21.15.7:0/3713389340 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:47.588 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da37fe700 1 --2- 172.21.15.7:0/3713389340 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5da40ae970 0x7f5da415f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:47.589 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da27fc700 1 --2- 172.21.15.7:0/3713389340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5da40a7190 0x7f5da41545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:47.589 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da2ffd700 1 -- 172.21.15.7:0/3713389340 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5da40ae970 msgr2=0x7f5da415f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:47.589 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da2ffd700 1 --2- 172.21.15.7:0/3713389340 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5da40ae970 0x7f5da415f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:47.589 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da2ffd700 1 -- 172.21.15.7:0/3713389340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5da40a7190 msgr2=0x7f5da41545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:47.589 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da2ffd700 1 --2- 172.21.15.7:0/3713389340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5da40a7190 0x7f5da41545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:47.589 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da2ffd700 1 -- 172.21.15.7:0/3713389340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c009a20 con 0x7f5da40a6dc0 2023-10-06T10:58:47.589 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.583+0000 7f5da37fe700 1 --2- 172.21.15.7:0/3713389340 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5da40ae970 0x7f5da415f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:47.589 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.584+0000 7f5da2ffd700 1 --2- 172.21.15.7:0/3713389340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5da40a6dc0 0x7f5da4095a70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400c790 tx=0x7f5d94007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:47.590 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.584+0000 7f5d8affd700 1 -- 172.21.15.7:0/3713389340 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d940073b0 con 0x7f5da40a6dc0 2023-10-06T10:58:47.590 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.584+0000 7f5d8affd700 1 -- 172.21.15.7:0/3713389340 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d94007530 con 0x7f5da40a6dc0 2023-10-06T10:58:47.590 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.584+0000 7f5da94c0700 1 -- 172.21.15.7:0/3713389340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da4097d20 con 0x7f5da40a6dc0 2023-10-06T10:58:47.590 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.584+0000 7f5d8affd700 1 -- 172.21.15.7:0/3713389340 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94005a40 con 0x7f5da40a6dc0 2023-10-06T10:58:47.590 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.584+0000 7f5da94c0700 1 -- 172.21.15.7:0/3713389340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da4154af0 con 0x7f5da40a6dc0 2023-10-06T10:58:47.590 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.584+0000 7f5d8affd700 1 -- 172.21.15.7:0/3713389340 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5d9401c6c0 con 0x7f5da40a6dc0 2023-10-06T10:58:47.591 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.584+0000 7f5d8affd700 1 -- 172.21.15.7:0/3713389340 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f5d94005e30 con 0x7f5da40a6dc0 2023-10-06T10:58:47.591 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.585+0000 7f5da94c0700 1 -- 172.21.15.7:0/3713389340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da404c380 con 0x7f5da40a6dc0 2023-10-06T10:58:47.591 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.587+0000 7f5d8affd700 1 -- 172.21.15.7:0/3713389340 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5d94017070 con 0x7f5da40a6dc0 2023-10-06T10:58:47.663 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.661+0000 7f5da94c0700 1 -- 172.21.15.7:0/3713389340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5da406b140 con 0x7f5da40a6dc0 2023-10-06T10:58:47.664 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.662+0000 7f5d8affd700 1 -- 172.21.15.7:0/3713389340 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f5da40aedd0 con 0x7f5da40a6dc0 2023-10-06T10:58:47.664 INFO:teuthology.misc.health.smithi007.stdout: 2023-10-06T10:58:47.664 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":10,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:58:46.356557+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:58:47.666 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.663+0000 7f5da94c0700 1 -- 172.21.15.7:0/3713389340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5da40a6dc0 msgr2=0x7f5da4095a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:47.666 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.663+0000 7f5da94c0700 1 --2- 172.21.15.7:0/3713389340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5da40a6dc0 0x7f5da4095a70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400c790 tx=0x7f5d94007b00 comp rx=0 tx=0).stop 2023-10-06T10:58:47.666 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.663+0000 7f5da94c0700 1 -- 172.21.15.7:0/3713389340 shutdown_connections 2023-10-06T10:58:47.666 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.663+0000 7f5da94c0700 1 --2- 172.21.15.7:0/3713389340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5da40a6dc0 0x7f5da4095a70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:47.666 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.663+0000 7f5da94c0700 1 --2- 172.21.15.7:0/3713389340 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5da40ae970 0x7f5da415f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:47.666 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.663+0000 7f5da94c0700 1 --2- 172.21.15.7:0/3713389340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5da40a7190 0x7f5da41545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:47.667 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.663+0000 7f5da94c0700 1 -- 172.21.15.7:0/3713389340 >> 172.21.15.7:0/3713389340 conn(0x7f5da40cc550 msgr2=0x7f5da40b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:47.667 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.663+0000 7f5da94c0700 1 -- 172.21.15.7:0/3713389340 shutdown_connections 2023-10-06T10:58:47.667 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:47.663+0000 7f5da94c0700 1 -- 172.21.15.7:0/3713389340 wait complete. 2023-10-06T10:58:47.677 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T10:58:47.847 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:47.846+0000 7f1622b621c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T10:58:47.902 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:47.900+0000 7f6a14a4e1c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T10:58:47.926 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:47.924+0000 7f1622b621c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T10:58:47.982 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:47.980+0000 7f6a14a4e1c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T10:58:48.501 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:48.499+0000 7f1622b621c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T10:58:48.555 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:48.553+0000 7f6a14a4e1c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T10:58:48.859 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:48.858+0000 7f1622b621c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T10:58:48.915 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:48.913+0000 7f6a14a4e1c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T10:58:49.016 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:49.015+0000 7f1622b621c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T10:58:49.072 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:49.071+0000 7f6a14a4e1c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T10:58:49.421 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:49.419+0000 7f1622b621c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T10:58:49.479 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:49.478+0000 7f6a14a4e1c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T10:58:49.597 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:49.595+0000 7f1622b621c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T10:58:49.646 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:49.644+0000 7f6a14a4e1c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T10:58:49.808 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:49.806+0000 7f1622b621c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T10:58:49.855 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:49.853+0000 7f6a14a4e1c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T10:58:49.951 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:49.950+0000 7f1622b621c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T10:58:49.990 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-06T10:58:49.988+0000 7f6a14a4e1c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T10:58:50.265 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-10-06T10:58:50.264+0000 7fda3bc82540 -1 osd.2 0 log_to_monitors true 2023-10-06T10:58:50.502 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-10-06T10:58:50.501+0000 7ff5f5deb540 -1 osd.1 0 log_to_monitors true 2023-10-06T10:58:50.514 INFO:tasks.ceph.osd.4.smithi050.stderr:2023-10-06T10:58:50.513+0000 7f1b34407540 -1 osd.4 0 log_to_monitors true 2023-10-06T10:58:50.518 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-10-06T10:58:50.516+0000 7fad6304e540 -1 osd.3 0 log_to_monitors true 2023-10-06T10:58:50.520 INFO:tasks.ceph.osd.5.smithi050.stderr:2023-10-06T10:58:50.518+0000 7fdc635b7540 -1 osd.5 0 log_to_monitors true 2023-10-06T10:58:50.526 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-10-06T10:58:50.524+0000 7f98be517540 -1 osd.0 0 log_to_monitors true 2023-10-06T10:58:50.545 INFO:tasks.ceph.osd.7.smithi050.stderr:2023-10-06T10:58:50.544+0000 7fc2a3e94540 -1 osd.7 0 log_to_monitors true 2023-10-06T10:58:50.555 INFO:tasks.ceph.osd.6.smithi050.stderr:2023-10-06T10:58:50.553+0000 7f395296d540 -1 osd.6 0 log_to_monitors true 2023-10-06T10:58:50.977 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:50.976+0000 7f15e7242700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T10:58:50.978 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-06T10:58:50.976+0000 7f15e7242700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T10:58:53.303 INFO:tasks.ceph.osd.6.smithi050.stderr:2023-10-06T10:58:53.301+0000 7f3949572700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T10:58:53.311 INFO:tasks.ceph.osd.6.smithi050.stderr:2023-10-06T10:58:53.309+0000 7f3942369700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T10:58:53.344 INFO:tasks.ceph.osd.5.smithi050.stderr:2023-10-06T10:58:53.342+0000 7fdc5a1bc700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T10:58:53.357 INFO:tasks.ceph.osd.5.smithi050.stderr:2023-10-06T10:58:53.356+0000 7fdc52fb3700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T10:58:53.407 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-10-06T10:58:53.405+0000 7f98b511c700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T10:58:53.421 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-10-06T10:58:53.419+0000 7f98adf13700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T10:58:53.447 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-10-06T10:58:53.446+0000 7ff5ee1f3700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T10:58:53.451 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-10-06T10:58:53.449+0000 7fda32887700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T10:58:53.453 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-10-06T10:58:53.449+0000 7fad59c53700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T10:58:53.454 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-10-06T10:58:53.452+0000 7ff5e57e7700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T10:58:53.457 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-10-06T10:58:53.455+0000 7fda2b67e700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T10:58:53.460 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-10-06T10:58:53.458+0000 7fad52a4a700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T10:58:53.476 INFO:tasks.ceph.osd.7.smithi050.stderr:2023-10-06T10:58:53.475+0000 7fc29aa99700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T10:58:53.481 INFO:tasks.ceph.osd.7.smithi050.stderr:2023-10-06T10:58:53.479+0000 7fc293890700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T10:58:53.784 INFO:tasks.ceph.osd.4.smithi050.stderr:2023-10-06T10:58:53.782+0000 7f1b2b00c700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T10:58:53.789 INFO:tasks.ceph.osd.4.smithi050.stderr:2023-10-06T10:58:53.787+0000 7f1b23e03700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T10:58:54.485 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T10:58:54.616 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.615+0000 7f68fe74b700 1 Processor -- start 2023-10-06T10:58:54.617 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.615+0000 7f68fe74b700 1 -- start start 2023-10-06T10:58:54.619 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.615+0000 7f68fe74b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68f8156260 0x7f68f815a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:54.619 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.615+0000 7f68fe74b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f68f80ac7c0 0x7f68f80acc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:54.619 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.615+0000 7f68fe74b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f80aa3e0 con 0x7f68f8155e90 2023-10-06T10:58:54.620 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.616+0000 7f68fe74b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f80b0bb0 con 0x7f68f80ac7c0 2023-10-06T10:58:54.620 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.616+0000 7f68fe74b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f80a9ab0 con 0x7f68f8156260 2023-10-06T10:58:54.620 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.616+0000 7f68f7fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f68f8155e90 0x7f68f80b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50290/0 (socket says 172.21.15.7:50290) 2023-10-06T10:58:54.620 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.616+0000 7f68f7fff700 1 -- 172.21.15.7:0/437454344 learned_addr learned my addr 172.21.15.7:0/437454344 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:58:54.620 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.616+0000 7f68fcce8700 1 --2- 172.21.15.7:0/437454344 >> v2:172.21.15.50:3300/0 conn(0x7f68f80ac7c0 0x7f68f80acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:54.620 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.616+0000 7f68f77fe700 1 --2- 172.21.15.7:0/437454344 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68f8156260 0x7f68f815a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:54.620 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.616+0000 7f68f6ffd700 1 -- 172.21.15.7:0/437454344 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824307883 0 0) 0x7f68f80aa3e0 con 0x7f68f8155e90 2023-10-06T10:58:54.620 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.616+0000 7f68f6ffd700 1 -- 172.21.15.7:0/437454344 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68e0003570 con 0x7f68f8155e90 2023-10-06T10:58:54.620 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.616+0000 7f68fcce8700 1 -- 172.21.15.7:0/437454344 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68f8156260 msgr2=0x7f68f815a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:54.620 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.616+0000 7f68fcce8700 1 --2- 172.21.15.7:0/437454344 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68f8156260 0x7f68f815a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:54.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.616+0000 7f68fcce8700 1 -- 172.21.15.7:0/437454344 >> v1:172.21.15.7:6789/0 conn(0x7f68f8155e90 legacy=0x7f68f80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:54.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.616+0000 7f68fcce8700 1 -- 172.21.15.7:0/437454344 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f80a9d90 con 0x7f68f80ac7c0 2023-10-06T10:58:54.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.616+0000 7f68f77fe700 1 --2- 172.21.15.7:0/437454344 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68f8156260 0x7f68f815a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:54.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.616+0000 7f68fcce8700 1 --2- 172.21.15.7:0/437454344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f80ac7c0 0x7f68f80acc40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009e60 tx=0x7f68f0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2e07fa8963ae4e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:54.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.617+0000 7f68f6ffd700 1 -- 172.21.15.7:0/437454344 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f000e070 con 0x7f68f80ac7c0 2023-10-06T10:58:54.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.617+0000 7f68f6ffd700 1 -- 172.21.15.7:0/437454344 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f000bab0 con 0x7f68f80ac7c0 2023-10-06T10:58:54.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.617+0000 7f68f6ffd700 1 -- 172.21.15.7:0/437454344 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f000be30 con 0x7f68f80ac7c0 2023-10-06T10:58:54.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.617+0000 7f68fe74b700 1 -- 172.21.15.7:0/437454344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f80ac7c0 msgr2=0x7f68f80acc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:54.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.617+0000 7f68fe74b700 1 --2- 172.21.15.7:0/437454344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f80ac7c0 0x7f68f80acc40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009e60 tx=0x7f68f0009780 comp rx=0 tx=0).stop 2023-10-06T10:58:54.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.617+0000 7f68fe74b700 1 -- 172.21.15.7:0/437454344 shutdown_connections 2023-10-06T10:58:54.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.617+0000 7f68fe74b700 1 --2- 172.21.15.7:0/437454344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f80ac7c0 0x7f68f80acc40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:54.622 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.617+0000 7f68fe74b700 1 --2- 172.21.15.7:0/437454344 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68f8156260 0x7f68f815a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:54.622 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.617+0000 7f68fe74b700 1 -- 172.21.15.7:0/437454344 >> 172.21.15.7:0/437454344 conn(0x7f68f80962a0 msgr2=0x7f68f80afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:54.622 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.617+0000 7f68fe74b700 1 -- 172.21.15.7:0/437454344 shutdown_connections 2023-10-06T10:58:54.622 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.617+0000 7f68fe74b700 1 -- 172.21.15.7:0/437454344 wait complete. 2023-10-06T10:58:54.624 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.618+0000 7f68fe74b700 1 Processor -- start 2023-10-06T10:58:54.624 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.619+0000 7f68fe74b700 1 -- start start 2023-10-06T10:58:54.625 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.619+0000 7f68fe74b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f80ac7c0 0x7f68f8154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:54.625 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.619+0000 7f68fe74b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68f8155e90 0x7f68f8097b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:54.625 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.619+0000 7f68fe74b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68f8156260 0x7f68f80998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:54.625 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.619+0000 7f68fe74b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8166480 con 0x7f68f8155e90 2023-10-06T10:58:54.625 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.619+0000 7f68fe74b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8166140 con 0x7f68f80ac7c0 2023-10-06T10:58:54.625 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.619+0000 7f68fe74b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8098570 con 0x7f68f8156260 2023-10-06T10:58:54.625 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68f77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68f8155e90 0x7f68f8097b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:54.625 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68f77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68f8155e90 0x7f68f8097b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56466/0 (socket says 172.21.15.7:56466) 2023-10-06T10:58:54.625 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68f77fe700 1 -- 172.21.15.7:0/3743684628 learned_addr learned my addr 172.21.15.7:0/3743684628 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:54.626 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68f7fff700 1 --2- 172.21.15.7:0/3743684628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f80ac7c0 0x7f68f8154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:54.626 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68fcce8700 1 --2- 172.21.15.7:0/3743684628 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68f8156260 0x7f68f80998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:54.626 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68f77fe700 1 -- 172.21.15.7:0/3743684628 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68f8156260 msgr2=0x7f68f80998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:54.626 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68f77fe700 1 --2- 172.21.15.7:0/3743684628 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68f8156260 0x7f68f80998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:54.626 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68f77fe700 1 -- 172.21.15.7:0/3743684628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f80ac7c0 msgr2=0x7f68f8154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:54.626 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68f77fe700 1 --2- 172.21.15.7:0/3743684628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f80ac7c0 0x7f68f8154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:54.626 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68f77fe700 1 -- 172.21.15.7:0/3743684628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec009420 con 0x7f68f8155e90 2023-10-06T10:58:54.626 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68f77fe700 1 --2- 172.21.15.7:0/3743684628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68f8155e90 0x7f68f8097b80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00ec80 tx=0x7f68ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:54.626 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68dffff700 1 -- 172.21.15.7:0/3743684628 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00c9d0 con 0x7f68f8155e90 2023-10-06T10:58:54.626 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68dffff700 1 -- 172.21.15.7:0/3743684628 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec00cb30 con 0x7f68f8155e90 2023-10-06T10:58:54.627 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68fe74b700 1 -- 172.21.15.7:0/3743684628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f0009a20 con 0x7f68f8155e90 2023-10-06T10:58:54.627 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68dffff700 1 -- 172.21.15.7:0/3743684628 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00ceb0 con 0x7f68f8155e90 2023-10-06T10:58:54.627 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.620+0000 7f68fe74b700 1 -- 172.21.15.7:0/3743684628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f8098b30 con 0x7f68f8155e90 2023-10-06T10:58:54.627 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.621+0000 7f68fe74b700 1 -- 172.21.15.7:0/3743684628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f81665f0 con 0x7f68f8155e90 2023-10-06T10:58:54.627 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.622+0000 7f68dffff700 1 -- 172.21.15.7:0/3743684628 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f68ec013680 con 0x7f68f8155e90 2023-10-06T10:58:54.627 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.622+0000 7f68dffff700 1 --2- 172.21.15.7:0/3743684628 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f68e4066ea0 0x7f68e4069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:54.627 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.622+0000 7f68dffff700 1 -- 172.21.15.7:0/3743684628 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f68ec0842e0 con 0x7f68f8155e90 2023-10-06T10:58:54.627 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.622+0000 7f68f7fff700 1 --2- 172.21.15.7:0/3743684628 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f68e4066ea0 0x7f68e4069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:54.627 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.623+0000 7f68f7fff700 1 --2- 172.21.15.7:0/3743684628 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f68e4066ea0 0x7f68e4069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f68e80058d0 tx=0x7f68e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:54.629 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.627+0000 7f68dffff700 1 -- 172.21.15.7:0/3743684628 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68ec051b00 con 0x7f68f8155e90 2023-10-06T10:58:54.831 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.829+0000 7f68fe74b700 1 -- 172.21.15.7:0/3743684628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68f804c380 con 0x7f68f8155e90 2023-10-06T10:58:54.832 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.830+0000 7f68dffff700 1 -- 172.21.15.7:0/3743684628 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10396 (secure 0 0 0) 0x7f68ec055120 con 0x7f68f8155e90 2023-10-06T10:58:54.832 INFO:teuthology.misc.health.smithi007.stdout: 2023-10-06T10:58:54.832 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":13,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:58:54.307083+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:58:54.834 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.832+0000 7f68fe74b700 1 -- 172.21.15.7:0/3743684628 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f68e4066ea0 msgr2=0x7f68e4069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:54.834 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.832+0000 7f68fe74b700 1 --2- 172.21.15.7:0/3743684628 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f68e4066ea0 0x7f68e4069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f68e80058d0 tx=0x7f68e8009040 comp rx=0 tx=0).stop 2023-10-06T10:58:54.835 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.832+0000 7f68fe74b700 1 -- 172.21.15.7:0/3743684628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68f8155e90 msgr2=0x7f68f8097b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:54.835 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.832+0000 7f68fe74b700 1 --2- 172.21.15.7:0/3743684628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68f8155e90 0x7f68f8097b80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00ec80 tx=0x7f68ec0091a0 comp rx=0 tx=0).stop 2023-10-06T10:58:54.835 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.832+0000 7f68fe74b700 1 -- 172.21.15.7:0/3743684628 shutdown_connections 2023-10-06T10:58:54.835 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.832+0000 7f68fe74b700 1 --2- 172.21.15.7:0/3743684628 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f68e4066ea0 0x7f68e4069350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:54.835 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.832+0000 7f68fe74b700 1 --2- 172.21.15.7:0/3743684628 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68f8156260 0x7f68f80998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:54.835 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.832+0000 7f68fe74b700 1 --2- 172.21.15.7:0/3743684628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f80ac7c0 0x7f68f8154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:54.835 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.832+0000 7f68fe74b700 1 --2- 172.21.15.7:0/3743684628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68f8155e90 0x7f68f8097b80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:54.835 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.832+0000 7f68fe74b700 1 -- 172.21.15.7:0/3743684628 >> 172.21.15.7:0/3743684628 conn(0x7f68f80962a0 msgr2=0x7f68f8159bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:54.835 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.833+0000 7f68fe74b700 1 -- 172.21.15.7:0/3743684628 shutdown_connections 2023-10-06T10:58:54.835 INFO:teuthology.misc.health.smithi007.stderr:2023-10-06T10:58:54.833+0000 7f68fe74b700 1 -- 172.21.15.7:0/3743684628 wait complete. 2023-10-06T10:58:54.846 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T10:58:54.847 INFO:tasks.ceph:Creating RBD pool 2023-10-06T10:58:54.847 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T10:58:54.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.976+0000 7f309b38e700 1 Processor -- start 2023-10-06T10:58:54.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.976+0000 7f309b38e700 1 -- start start 2023-10-06T10:58:54.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.977+0000 7f309b38e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30941595b0 0x7f30940c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:54.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.977+0000 7f309b38e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30940c8fe0 con 0x7f30940cbf20 2023-10-06T10:58:54.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.977+0000 7f309b38e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30940c92c0 con 0x7f30940cc2f0 2023-10-06T10:58:54.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.977+0000 7f309b38e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30940ca790 con 0x7f30941595b0 2023-10-06T10:58:54.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.977+0000 7f309992b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30941595b0 0x7f30940c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:54.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.977+0000 7f309912a700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f30940cbf20 0x7f30940ca080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50300/0 (socket says 172.21.15.7:50300) 2023-10-06T10:58:54.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.977+0000 7f309912a700 1 -- 172.21.15.7:0/3299137968 learned_addr learned my addr 172.21.15.7:0/3299137968 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:58:54.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.978+0000 7f3087fff700 1 -- 172.21.15.7:0/3299137968 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439919836 0 0) 0x7f30940c8fe0 con 0x7f30940cbf20 2023-10-06T10:58:54.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.978+0000 7f3087fff700 1 -- 172.21.15.7:0/3299137968 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3080003570 con 0x7f30940cbf20 2023-10-06T10:58:54.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.978+0000 7f309992b700 1 -- 172.21.15.7:0/3299137968 >> v1:172.21.15.50:6789/0 conn(0x7f30940cc2f0 legacy=0x7f3094158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:54.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.978+0000 7f3087fff700 1 -- 172.21.15.7:0/3299137968 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964661098 0 0) 0x7f30940c92c0 con 0x7f30940cc2f0 2023-10-06T10:58:54.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.978+0000 7f309992b700 1 -- 172.21.15.7:0/3299137968 >> v1:172.21.15.7:6789/0 conn(0x7f30940cbf20 legacy=0x7f30940ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:54.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.978+0000 7f309992b700 1 -- 172.21.15.7:0/3299137968 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30940c95a0 con 0x7f30941595b0 2023-10-06T10:58:54.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.978+0000 7f309992b700 1 --2- 172.21.15.7:0/3299137968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30941595b0 0x7f30940c8920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f308c009e60 tx=0x7f308c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b1672ecb16f6b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:54.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.978+0000 7f3087fff700 1 -- 172.21.15.7:0/3299137968 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c00e070 con 0x7f30941595b0 2023-10-06T10:58:54.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.978+0000 7f3087fff700 1 -- 172.21.15.7:0/3299137968 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308c00bb60 con 0x7f30941595b0 2023-10-06T10:58:54.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.978+0000 7f3087fff700 1 -- 172.21.15.7:0/3299137968 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c012430 con 0x7f30941595b0 2023-10-06T10:58:54.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.979+0000 7f309b38e700 1 -- 172.21.15.7:0/3299137968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30941595b0 msgr2=0x7f30940c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:54.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.979+0000 7f309b38e700 1 --2- 172.21.15.7:0/3299137968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30941595b0 0x7f30940c8920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f308c009e60 tx=0x7f308c009780 comp rx=0 tx=0).stop 2023-10-06T10:58:54.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.979+0000 7f309b38e700 1 -- 172.21.15.7:0/3299137968 shutdown_connections 2023-10-06T10:58:54.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.979+0000 7f309b38e700 1 --2- 172.21.15.7:0/3299137968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30941595b0 0x7f30940c8920 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:54.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.979+0000 7f309b38e700 1 -- 172.21.15.7:0/3299137968 >> 172.21.15.7:0/3299137968 conn(0x7f30940afc90 msgr2=0x7f30940b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:54.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.979+0000 7f309b38e700 1 -- 172.21.15.7:0/3299137968 shutdown_connections 2023-10-06T10:58:54.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.979+0000 7f309b38e700 1 -- 172.21.15.7:0/3299137968 wait complete. 2023-10-06T10:58:54.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.980+0000 7f309b38e700 1 Processor -- start 2023-10-06T10:58:54.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.980+0000 7f309b38e700 1 -- start start 2023-10-06T10:58:54.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309b38e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30940cbf20 0x7f309415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:54.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309b38e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30940cc2f0 0x7f309414a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:54.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309b38e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30941595b0 0x7f309415b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:54.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309b38e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30940c66b0 con 0x7f30940cbf20 2023-10-06T10:58:54.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309b38e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30940c5aa0 con 0x7f30940cc2f0 2023-10-06T10:58:54.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309b38e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30940c5d80 con 0x7f30941595b0 2023-10-06T10:58:54.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309912a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30940cbf20 0x7f309415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:54.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309912a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30940cbf20 0x7f309415c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56494/0 (socket says 172.21.15.7:56494) 2023-10-06T10:58:54.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309912a700 1 -- 172.21.15.7:0/2168295463 learned_addr learned my addr 172.21.15.7:0/2168295463 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:54.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f3098929700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30940cc2f0 0x7f309414a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:54.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309992b700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30941595b0 0x7f309415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:54.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309912a700 1 -- 172.21.15.7:0/2168295463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30941595b0 msgr2=0x7f309415b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:54.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309912a700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30941595b0 0x7f309415b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:54.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309912a700 1 -- 172.21.15.7:0/2168295463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30940cc2f0 msgr2=0x7f309414a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:54.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309912a700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30940cc2f0 0x7f309414a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:54.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f309912a700 1 -- 172.21.15.7:0/2168295463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c009a20 con 0x7f30940cbf20 2023-10-06T10:58:54.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.981+0000 7f3098929700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30940cc2f0 0x7f309414a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:58:54.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.982+0000 7f309912a700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30940cbf20 0x7f309415c9e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30900011e0 tx=0x7f3090007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:54.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.982+0000 7f30857fa700 1 -- 172.21.15.7:0/2168295463 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090005b30 con 0x7f30940cbf20 2023-10-06T10:58:54.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.982+0000 7f30857fa700 1 -- 172.21.15.7:0/2168295463 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3090005c90 con 0x7f30940cbf20 2023-10-06T10:58:54.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.982+0000 7f309b38e700 1 -- 172.21.15.7:0/2168295463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30940c6060 con 0x7f30940cbf20 2023-10-06T10:58:54.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.982+0000 7f30857fa700 1 -- 172.21.15.7:0/2168295463 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30900072e0 con 0x7f30940cbf20 2023-10-06T10:58:54.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.982+0000 7f309b38e700 1 -- 172.21.15.7:0/2168295463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30940c5770 con 0x7f30940cbf20 2023-10-06T10:58:54.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.983+0000 7f309b38e700 1 -- 172.21.15.7:0/2168295463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30940c6500 con 0x7f30940cbf20 2023-10-06T10:58:54.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.983+0000 7f30857fa700 1 -- 172.21.15.7:0/2168295463 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f3090007650 con 0x7f30940cbf20 2023-10-06T10:58:54.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.983+0000 7f30857fa700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3078066ea0 0x7f3078069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:54.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.984+0000 7f30857fa700 1 -- 172.21.15.7:0/2168295463 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f3090083350 con 0x7f30940cbf20 2023-10-06T10:58:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.984+0000 7f3098929700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3078066ea0 0x7f3078069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.984+0000 7f3098929700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3078066ea0 0x7f3078069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30940c8a50 tx=0x7f3088009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:54.988+0000 7f30857fa700 1 -- 172.21.15.7:0/2168295463 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f309004b5a0 con 0x7f30940cbf20 2023-10-06T10:58:55.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.192+0000 7f309b38e700 1 -- 172.21.15.7:0/2168295463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f309409a9e0 con 0x7f30940cbf20 2023-10-06T10:58:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.315+0000 7f30857fa700 1 -- 172.21.15.7:0/2168295463 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f30900170a0 con 0x7f30940cbf20 2023-10-06T10:58:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.318+0000 7f309b38e700 1 -- 172.21.15.7:0/2168295463 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3078066ea0 msgr2=0x7f3078069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.318+0000 7f309b38e700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3078066ea0 0x7f3078069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30940c8a50 tx=0x7f3088009040 comp rx=0 tx=0).stop 2023-10-06T10:58:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.318+0000 7f309b38e700 1 -- 172.21.15.7:0/2168295463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30940cbf20 msgr2=0x7f309415c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.318+0000 7f309b38e700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30940cbf20 0x7f309415c9e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30900011e0 tx=0x7f3090007df0 comp rx=0 tx=0).stop 2023-10-06T10:58:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.318+0000 7f309b38e700 1 -- 172.21.15.7:0/2168295463 shutdown_connections 2023-10-06T10:58:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.318+0000 7f309b38e700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3078066ea0 0x7f3078069350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.318+0000 7f309b38e700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30940cbf20 0x7f309415c9e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.318+0000 7f309b38e700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30941595b0 0x7f309415b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.318+0000 7f309b38e700 1 --2- 172.21.15.7:0/2168295463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30940cc2f0 0x7f309414a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.318+0000 7f309b38e700 1 -- 172.21.15.7:0/2168295463 >> 172.21.15.7:0/2168295463 conn(0x7f30940afc90 msgr2=0x7f3094069950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.318+0000 7f309b38e700 1 -- 172.21.15.7:0/2168295463 shutdown_connections 2023-10-06T10:58:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.318+0000 7f309b38e700 1 -- 172.21.15.7:0/2168295463 wait complete. 2023-10-06T10:58:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'rbd' created 2023-10-06T10:58:55.335 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T10:58:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.470+0000 7fc55a540700 1 Processor -- start 2023-10-06T10:58:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.470+0000 7fc55a540700 1 -- start start 2023-10-06T10:58:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.471+0000 7fc55a540700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5540692b0 0x7fc554069880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.471+0000 7fc55a540700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc554069dc0 0x7fc5540ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.471+0000 7fc55a540700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5540cd720 con 0x7fc5541570b0 2023-10-06T10:58:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.471+0000 7fc55a540700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5540ccb50 con 0x7fc5540692b0 2023-10-06T10:58:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.471+0000 7fc55a540700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5540cdbb0 con 0x7fc554069dc0 2023-10-06T10:58:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.471+0000 7fc5537fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5540692b0 0x7fc554069880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.471+0000 7fc553fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc5541570b0 0x7fc554068ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50314/0 (socket says 172.21.15.7:50314) 2023-10-06T10:58:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.471+0000 7fc553fff700 1 -- 172.21.15.7:0/304097523 learned_addr learned my addr 172.21.15.7:0/304097523 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:58:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.471+0000 7fc558add700 1 --2- 172.21.15.7:0/304097523 >> v2:172.21.15.50:3300/0 conn(0x7fc554069dc0 0x7fc5540ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.472+0000 7fc5537fe700 1 -- 172.21.15.7:0/304097523 >> v2:172.21.15.50:3300/0 conn(0x7fc554069dc0 msgr2=0x7fc5540ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.472+0000 7fc5537fe700 1 --2- 172.21.15.7:0/304097523 >> v2:172.21.15.50:3300/0 conn(0x7fc554069dc0 0x7fc5540ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.472+0000 7fc5537fe700 1 -- 172.21.15.7:0/304097523 >> v1:172.21.15.7:6789/0 conn(0x7fc5541570b0 legacy=0x7fc554068ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.472+0000 7fc5537fe700 1 -- 172.21.15.7:0/304097523 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5540ccdf0 con 0x7fc5540692b0 2023-10-06T10:58:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.472+0000 7fc552ffd700 1 -- 172.21.15.7:0/304097523 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615340603 0 0) 0x7fc5540cd720 con 0x7fc5541570b0 2023-10-06T10:58:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.472+0000 7fc5537fe700 1 --2- 172.21.15.7:0/304097523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5540692b0 0x7fc554069880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc55406a680 tx=0x7fc53c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebf4596e3e715e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.472+0000 7fc552ffd700 1 -- 172.21.15.7:0/304097523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c00b6b0 con 0x7fc5540692b0 2023-10-06T10:58:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.472+0000 7fc552ffd700 1 -- 172.21.15.7:0/304097523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c00b810 con 0x7fc5540692b0 2023-10-06T10:58:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.472+0000 7fc552ffd700 1 -- 172.21.15.7:0/304097523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c00bbb0 con 0x7fc5540692b0 2023-10-06T10:58:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.473+0000 7fc55a540700 1 -- 172.21.15.7:0/304097523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5540692b0 msgr2=0x7fc554069880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.473+0000 7fc55a540700 1 --2- 172.21.15.7:0/304097523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5540692b0 0x7fc554069880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc55406a680 tx=0x7fc53c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:58:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.473+0000 7fc55a540700 1 -- 172.21.15.7:0/304097523 shutdown_connections 2023-10-06T10:58:55.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.473+0000 7fc55a540700 1 --2- 172.21.15.7:0/304097523 >> v2:172.21.15.50:3300/0 conn(0x7fc554069dc0 0x7fc5540ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:55.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.473+0000 7fc55a540700 1 --2- 172.21.15.7:0/304097523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5540692b0 0x7fc554069880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:55.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.473+0000 7fc55a540700 1 -- 172.21.15.7:0/304097523 >> 172.21.15.7:0/304097523 conn(0x7fc554096160 msgr2=0x7fc5540afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:55.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.473+0000 7fc55a540700 1 -- 172.21.15.7:0/304097523 shutdown_connections 2023-10-06T10:58:55.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.473+0000 7fc55a540700 1 -- 172.21.15.7:0/304097523 wait complete. 2023-10-06T10:58:55.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.474+0000 7fc55a540700 1 Processor -- start 2023-10-06T10:58:55.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.474+0000 7fc55a540700 1 -- start start 2023-10-06T10:58:55.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc55a540700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5540692b0 0x7fc5540c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:55.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc55a540700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554069dc0 0x7fc5540aa410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:55.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc55a540700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5541570b0 0x7fc554151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:55.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc55a540700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5540c71e0 con 0x7fc554069dc0 2023-10-06T10:58:55.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc55a540700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc554158b00 con 0x7fc5541570b0 2023-10-06T10:58:55.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc55a540700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5540c65d0 con 0x7fc5540692b0 2023-10-06T10:58:55.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc5537fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554069dc0 0x7fc5540aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:55.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc5537fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554069dc0 0x7fc5540aa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56516/0 (socket says 172.21.15.7:56516) 2023-10-06T10:58:55.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc5537fe700 1 -- 172.21.15.7:0/2195280924 learned_addr learned my addr 172.21.15.7:0/2195280924 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:55.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc558add700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5541570b0 0x7fc554151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:55.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc553fff700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5540692b0 0x7fc5540c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc5537fe700 1 -- 172.21.15.7:0/2195280924 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5540692b0 msgr2=0x7fc5540c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc5537fe700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5540692b0 0x7fc5540c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc5537fe700 1 -- 172.21.15.7:0/2195280924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5541570b0 msgr2=0x7fc554151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc5537fe700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5541570b0 0x7fc554151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc5537fe700 1 -- 172.21.15.7:0/2195280924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c009420 con 0x7fc554069dc0 2023-10-06T10:58:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc558add700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5541570b0 0x7fc554151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:58:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.475+0000 7fc553fff700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5540692b0 0x7fc5540c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:58:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.476+0000 7fc5537fe700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554069dc0 0x7fc5540aa410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc5540b2e50 tx=0x7fc53c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.476+0000 7fc54bfff700 1 -- 172.21.15.7:0/2195280924 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c011420 con 0x7fc554069dc0 2023-10-06T10:58:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.476+0000 7fc54bfff700 1 -- 172.21.15.7:0/2195280924 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c011580 con 0x7fc554069dc0 2023-10-06T10:58:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.476+0000 7fc54bfff700 1 -- 172.21.15.7:0/2195280924 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c011940 con 0x7fc554069dc0 2023-10-06T10:58:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.476+0000 7fc55a540700 1 -- 172.21.15.7:0/2195280924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5540c68b0 con 0x7fc554069dc0 2023-10-06T10:58:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.476+0000 7fc55a540700 1 -- 172.21.15.7:0/2195280924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5540c6e70 con 0x7fc554069dc0 2023-10-06T10:58:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.477+0000 7fc55a540700 1 -- 172.21.15.7:0/2195280924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc554070480 con 0x7fc554069dc0 2023-10-06T10:58:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.477+0000 7fc54bfff700 1 -- 172.21.15.7:0/2195280924 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fc53c011d30 con 0x7fc554069dc0 2023-10-06T10:58:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.478+0000 7fc54bfff700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc534066ea0 0x7fc534069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.478+0000 7fc54bfff700 1 -- 172.21.15.7:0/2195280924 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4809+0+0 (secure 0 0 0) 0x7fc53c085a50 con 0x7fc554069dc0 2023-10-06T10:58:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.478+0000 7fc553fff700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc534066ea0 0x7fc534069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.478+0000 7fc553fff700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc534066ea0 0x7fc534069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc5440011e0 tx=0x7fc544009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.483+0000 7fc54bfff700 1 -- 172.21.15.7:0/2195280924 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc53c053120 con 0x7fc554069dc0 2023-10-06T10:58:55.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:55.687+0000 7fc55a540700 1 -- 172.21.15.7:0/2195280924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc5540af740 con 0x7fc554069dc0 2023-10-06T10:58:56.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.320+0000 7fc54bfff700 1 -- 172.21.15.7:0/2195280924 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc53c0150c0 con 0x7fc554069dc0 2023-10-06T10:58:56.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.325+0000 7fc55a540700 1 -- 172.21.15.7:0/2195280924 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc534066ea0 msgr2=0x7fc534069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:56.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.325+0000 7fc55a540700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc534066ea0 0x7fc534069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc5440011e0 tx=0x7fc544009040 comp rx=0 tx=0).stop 2023-10-06T10:58:56.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.325+0000 7fc55a540700 1 -- 172.21.15.7:0/2195280924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554069dc0 msgr2=0x7fc5540aa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:56.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.325+0000 7fc55a540700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554069dc0 0x7fc5540aa410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc5540b2e50 tx=0x7fc53c017000 comp rx=0 tx=0).stop 2023-10-06T10:58:56.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.325+0000 7fc55a540700 1 -- 172.21.15.7:0/2195280924 shutdown_connections 2023-10-06T10:58:56.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.325+0000 7fc55a540700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc534066ea0 0x7fc534069350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.325+0000 7fc55a540700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5541570b0 0x7fc554151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.325+0000 7fc55a540700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5540692b0 0x7fc5540c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.325+0000 7fc55a540700 1 --2- 172.21.15.7:0/2195280924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554069dc0 0x7fc5540aa410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.325+0000 7fc55a540700 1 -- 172.21.15.7:0/2195280924 >> 172.21.15.7:0/2195280924 conn(0x7fc554096160 msgr2=0x7fc5540ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:56.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.326+0000 7fc55a540700 1 -- 172.21.15.7:0/2195280924 shutdown_connections 2023-10-06T10:58:56.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.326+0000 7fc55a540700 1 -- 172.21.15.7:0/2195280924 wait complete. 2023-10-06T10:58:56.331 INFO:teuthology.orchestra.run.smithi007.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T10:58:56.344 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T10:58:56.344 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T10:58:56.345 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T10:58:56.347 INFO:tasks.ceph.mds.a:Started 2023-10-06T10:58:56.347 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T10:58:56.347 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T10:58:56.349 INFO:tasks.ceph.mds.c:Started 2023-10-06T10:58:56.349 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T10:58:56.349 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T10:58:56.352 INFO:tasks.ceph.mds.b:Started 2023-10-06T10:58:56.352 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T10:58:56.353 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T10:58:56.354 INFO:tasks.ceph.mds.d:Started 2023-10-06T10:58:56.355 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T10:58:56.355 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:58:56.444 INFO:tasks.ceph.mds.d.smithi050.stdout:starting mds.d at 2023-10-06T10:58:56.445 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2023-10-06T10:58:56.493 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-06T10:58:56.493 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-06T10:58:56.494 INFO:tasks.ceph.mds.c.smithi007.stderr:2023-10-06T10:58:56.492+0000 7f36a6b75700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T10:58:56.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.498+0000 7f0e6ed24700 1 Processor -- start 2023-10-06T10:58:56.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.498+0000 7f0e6ed24700 1 -- start start 2023-10-06T10:58:56.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.499+0000 7f0e6ed24700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e68159360 0x7f0e680afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:56.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.499+0000 7f0e6ed24700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e68068100 0x7f0e68162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:56.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.499+0000 7f0e6ed24700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e680aeba0 con 0x7f0e680ac7f0 2023-10-06T10:58:56.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.499+0000 7f0e6ed24700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e68159730 con 0x7f0e68068100 2023-10-06T10:58:56.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.499+0000 7f0e6ed24700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680ae270 con 0x7f0e68159360 2023-10-06T10:58:56.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.499+0000 7f0e67fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0e680ac7f0 0x7f0e680a6980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50330/0 (socket says 172.21.15.7:50330) 2023-10-06T10:58:56.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.499+0000 7f0e67fff700 1 -- 172.21.15.7:0/1482959102 learned_addr learned my addr 172.21.15.7:0/1482959102 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:58:56.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.500+0000 7f0e6cac0700 1 --2- 172.21.15.7:0/1482959102 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e68159360 0x7f0e680afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:56.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.500+0000 7f0e6d2c1700 1 --2- 172.21.15.7:0/1482959102 >> v2:172.21.15.50:3300/0 conn(0x7f0e68068100 0x7f0e68162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:56.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.500+0000 7f0e677fe700 1 -- 172.21.15.7:0/1482959102 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044790950 0 0) 0x7f0e680aeba0 con 0x7f0e680ac7f0 2023-10-06T10:58:56.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.500+0000 7f0e677fe700 1 -- 172.21.15.7:0/1482959102 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e58003570 con 0x7f0e680ac7f0 2023-10-06T10:58:56.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.500+0000 7f0e6d2c1700 1 -- 172.21.15.7:0/1482959102 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e68159360 msgr2=0x7f0e680afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:56.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.500+0000 7f0e6d2c1700 1 --2- 172.21.15.7:0/1482959102 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e68159360 0x7f0e680afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.500+0000 7f0e6d2c1700 1 -- 172.21.15.7:0/1482959102 >> v1:172.21.15.7:6789/0 conn(0x7f0e680ac7f0 legacy=0x7f0e680a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:56.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.500+0000 7f0e6d2c1700 1 -- 172.21.15.7:0/1482959102 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e680ae550 con 0x7f0e68068100 2023-10-06T10:58:56.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.500+0000 7f0e6d2c1700 1 --2- 172.21.15.7:0/1482959102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e68068100 0x7f0e68162ea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009e60 tx=0x7f0e60009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=babef7c433fff90c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:56.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.500+0000 7f0e677fe700 1 -- 172.21.15.7:0/1482959102 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000e070 con 0x7f0e68068100 2023-10-06T10:58:56.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.500+0000 7f0e677fe700 1 -- 172.21.15.7:0/1482959102 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6000bab0 con 0x7f0e68068100 2023-10-06T10:58:56.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.500+0000 7f0e677fe700 1 -- 172.21.15.7:0/1482959102 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000be70 con 0x7f0e68068100 2023-10-06T10:58:56.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.501+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1482959102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e68068100 msgr2=0x7f0e68162ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:56.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.501+0000 7f0e6ed24700 1 --2- 172.21.15.7:0/1482959102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e68068100 0x7f0e68162ea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009e60 tx=0x7f0e60009780 comp rx=0 tx=0).stop 2023-10-06T10:58:56.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.501+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1482959102 shutdown_connections 2023-10-06T10:58:56.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.501+0000 7f0e6ed24700 1 --2- 172.21.15.7:0/1482959102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e68068100 0x7f0e68162ea0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.501+0000 7f0e6ed24700 1 --2- 172.21.15.7:0/1482959102 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e68159360 0x7f0e680afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.501+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1482959102 >> 172.21.15.7:0/1482959102 conn(0x7f0e68095a70 msgr2=0x7f0e680af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:56.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.501+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1482959102 shutdown_connections 2023-10-06T10:58:56.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.501+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1482959102 wait complete. 2023-10-06T10:58:56.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.502+0000 7f0e6ed24700 1 Processor -- start 2023-10-06T10:58:56.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.502+0000 7f0e6ed24700 1 -- start start 2023-10-06T10:58:56.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.503+0000 7f0e6ed24700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e68068100 0x7f0e68148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:56.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.503+0000 7f0e6ed24700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e680ac7f0 0x7f0e68155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:56.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.503+0000 7f0e6ed24700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e68159360 0x7f0e68155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:56.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.503+0000 7f0e6ed24700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e68153aa0 con 0x7f0e68159360 2023-10-06T10:58:56.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.503+0000 7f0e6ed24700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e681522c0 con 0x7f0e68068100 2023-10-06T10:58:56.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.503+0000 7f0e6ed24700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6815aa60 con 0x7f0e680ac7f0 2023-10-06T10:58:56.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.503+0000 7f0e6d2c1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e68159360 0x7f0e68155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:56.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.503+0000 7f0e6d2c1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e68159360 0x7f0e68155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56566/0 (socket says 172.21.15.7:56566) 2023-10-06T10:58:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.503+0000 7f0e6d2c1700 1 -- 172.21.15.7:0/1374601928 learned_addr learned my addr 172.21.15.7:0/1374601928 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.503+0000 7f0e67fff700 1 --2- 172.21.15.7:0/1374601928 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e680ac7f0 0x7f0e68155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.503+0000 7f0e6cac0700 1 --2- 172.21.15.7:0/1374601928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e68068100 0x7f0e68148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.504+0000 7f0e6d2c1700 1 -- 172.21.15.7:0/1374601928 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e680ac7f0 msgr2=0x7f0e68155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.504+0000 7f0e6d2c1700 1 --2- 172.21.15.7:0/1374601928 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e680ac7f0 0x7f0e68155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.504+0000 7f0e6d2c1700 1 -- 172.21.15.7:0/1374601928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e68068100 msgr2=0x7f0e68148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.504+0000 7f0e6d2c1700 1 --2- 172.21.15.7:0/1374601928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e68068100 0x7f0e68148d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.504+0000 7f0e6d2c1700 1 -- 172.21.15.7:0/1374601928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60009a20 con 0x7f0e68159360 2023-10-06T10:58:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.504+0000 7f0e6d2c1700 1 --2- 172.21.15.7:0/1374601928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e68159360 0x7f0e68155cc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e60013000 tx=0x7f0e60019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.504+0000 7f0e64ff9700 1 -- 172.21.15.7:0/1374601928 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60012e10 con 0x7f0e68159360 2023-10-06T10:58:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.504+0000 7f0e64ff9700 1 -- 172.21.15.7:0/1374601928 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e60027470 con 0x7f0e68159360 2023-10-06T10:58:56.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.504+0000 7f0e64ff9700 1 -- 172.21.15.7:0/1374601928 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60027830 con 0x7f0e68159360 2023-10-06T10:58:56.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.504+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1374601928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6815ad40 con 0x7f0e68159360 2023-10-06T10:58:56.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.504+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1374601928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6815b300 con 0x7f0e68159360 2023-10-06T10:58:56.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.505+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1374601928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e68070480 con 0x7f0e68159360 2023-10-06T10:58:56.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.505+0000 7f0e64ff9700 1 -- 172.21.15.7:0/1374601928 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f0e60024070 con 0x7f0e68159360 2023-10-06T10:58:56.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.506+0000 7f0e64ff9700 1 --2- 172.21.15.7:0/1374601928 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0e4c066ea0 0x7f0e4c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:56.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.506+0000 7f0e64ff9700 1 -- 172.21.15.7:0/1374601928 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f0e60086ae0 con 0x7f0e68159360 2023-10-06T10:58:56.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.506+0000 7f0e6cac0700 1 --2- 172.21.15.7:0/1374601928 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0e4c066ea0 0x7f0e4c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:56.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.506+0000 7f0e6cac0700 1 --2- 172.21.15.7:0/1374601928 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0e4c066ea0 0x7f0e4c069350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009d10 tx=0x7f0e5c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:56.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.511+0000 7f0e64ff9700 1 -- 172.21.15.7:0/1374601928 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e60054030 con 0x7f0e68159360 2023-10-06T10:58:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.718+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1374601928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e680ae830 con 0x7f0e68159360 2023-10-06T10:58:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.718+0000 7f0e64ff9700 1 -- 172.21.15.7:0/1374601928 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13666 (secure 0 0 0) 0x7f0e60057650 con 0x7f0e68159360 2023-10-06T10:58:56.720 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:56.720 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":15,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:58:56.314996+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:58:56.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.721+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1374601928 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0e4c066ea0 msgr2=0x7f0e4c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:56.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.721+0000 7f0e6ed24700 1 --2- 172.21.15.7:0/1374601928 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0e4c066ea0 0x7f0e4c069350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009d10 tx=0x7f0e5c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.721+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1374601928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e68159360 msgr2=0x7f0e68155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:56.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.721+0000 7f0e6ed24700 1 --2- 172.21.15.7:0/1374601928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e68159360 0x7f0e68155cc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e60013000 tx=0x7f0e60019000 comp rx=0 tx=0).stop 2023-10-06T10:58:56.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.721+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1374601928 shutdown_connections 2023-10-06T10:58:56.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.721+0000 7f0e6ed24700 1 --2- 172.21.15.7:0/1374601928 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0e4c066ea0 0x7f0e4c069350 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.721+0000 7f0e6ed24700 1 --2- 172.21.15.7:0/1374601928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e68159360 0x7f0e68155cc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.721+0000 7f0e6ed24700 1 --2- 172.21.15.7:0/1374601928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e68068100 0x7f0e68148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.721+0000 7f0e6ed24700 1 --2- 172.21.15.7:0/1374601928 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e680ac7f0 0x7f0e68155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.721+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1374601928 >> 172.21.15.7:0/1374601928 conn(0x7f0e68095a70 msgr2=0x7f0e68159960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:56.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.721+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1374601928 shutdown_connections 2023-10-06T10:58:56.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.721+0000 7f0e6ed24700 1 -- 172.21.15.7:0/1374601928 wait complete. 2023-10-06T10:58:56.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T10:58:55.224661+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T10:58:56.032929+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}}] 2023-10-06T10:58:56.737 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T10:58:56.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.869+0000 7f385ec1c700 1 Processor -- start 2023-10-06T10:58:56.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.869+0000 7f385ec1c700 1 -- start start 2023-10-06T10:58:56.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.870+0000 7f385ec1c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f38580af440 0x7f38580caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:56.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.870+0000 7f385ec1c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3858159890 0x7f38580cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:56.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.870+0000 7f385ec1c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580cf870 con 0x7f38581594c0 2023-10-06T10:58:56.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.870+0000 7f385ec1c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38580cecf0 con 0x7f3858159890 2023-10-06T10:58:56.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.870+0000 7f385ec1c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38580cba70 con 0x7f38580af440 2023-10-06T10:58:56.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.870+0000 7f385d1b9700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3858159890 0x7f38580cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:56.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.870+0000 7f385c9b8700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f38581594c0 0x7f38580aed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50334/0 (socket says 172.21.15.7:50334) 2023-10-06T10:58:56.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.870+0000 7f385c9b8700 1 -- 172.21.15.7:0/3686551379 learned_addr learned my addr 172.21.15.7:0/3686551379 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:58:56.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.870+0000 7f3857fff700 1 --2- 172.21.15.7:0/3686551379 >> v2:172.21.15.50:3300/0 conn(0x7f38580af440 0x7f38580caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:56.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.871+0000 7f385d1b9700 1 -- 172.21.15.7:0/3686551379 >> v2:172.21.15.50:3300/0 conn(0x7f38580af440 msgr2=0x7f38580caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:56.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.871+0000 7f385d1b9700 1 --2- 172.21.15.7:0/3686551379 >> v2:172.21.15.50:3300/0 conn(0x7f38580af440 0x7f38580caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.871+0000 7f385d1b9700 1 -- 172.21.15.7:0/3686551379 >> v1:172.21.15.7:6789/0 conn(0x7f38581594c0 legacy=0x7f38580aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:56.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.871+0000 7f385d1b9700 1 -- 172.21.15.7:0/3686551379 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580b1030 con 0x7f3858159890 2023-10-06T10:58:56.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.871+0000 7f38577fe700 1 -- 172.21.15.7:0/3686551379 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510270529 0 0) 0x7f38580cf870 con 0x7f38581594c0 2023-10-06T10:58:56.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.871+0000 7f385d1b9700 1 --2- 172.21.15.7:0/3686551379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3858159890 0x7f38580cb530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f38580680d0 tx=0x7f3850009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f960c4789a9dddf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:56.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.871+0000 7f38577fe700 1 -- 172.21.15.7:0/3686551379 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385000e070 con 0x7f3858159890 2023-10-06T10:58:56.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.871+0000 7f38577fe700 1 -- 172.21.15.7:0/3686551379 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385000bb60 con 0x7f3858159890 2023-10-06T10:58:56.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.871+0000 7f38577fe700 1 -- 172.21.15.7:0/3686551379 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850012430 con 0x7f3858159890 2023-10-06T10:58:56.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.872+0000 7f385ec1c700 1 -- 172.21.15.7:0/3686551379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3858159890 msgr2=0x7f38580cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:56.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.872+0000 7f385ec1c700 1 --2- 172.21.15.7:0/3686551379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3858159890 0x7f38580cb530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f38580680d0 tx=0x7f3850009780 comp rx=0 tx=0).stop 2023-10-06T10:58:56.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.872+0000 7f385ec1c700 1 -- 172.21.15.7:0/3686551379 shutdown_connections 2023-10-06T10:58:56.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.872+0000 7f385ec1c700 1 --2- 172.21.15.7:0/3686551379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3858159890 0x7f38580cb530 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.872+0000 7f385ec1c700 1 --2- 172.21.15.7:0/3686551379 >> v2:172.21.15.50:3300/0 conn(0x7f38580af440 0x7f38580caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.872+0000 7f385ec1c700 1 -- 172.21.15.7:0/3686551379 >> 172.21.15.7:0/3686551379 conn(0x7f3858067bc0 msgr2=0x7f38580d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:56.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.872+0000 7f385ec1c700 1 -- 172.21.15.7:0/3686551379 shutdown_connections 2023-10-06T10:58:56.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.872+0000 7f385ec1c700 1 -- 172.21.15.7:0/3686551379 wait complete. 2023-10-06T10:58:56.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.873+0000 7f385ec1c700 1 Processor -- start 2023-10-06T10:58:56.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.873+0000 7f385ec1c700 1 -- start start 2023-10-06T10:58:56.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385ec1c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38580af440 0x7f3858159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:56.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385ec1c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38581594c0 0x7f385816c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:56.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385ec1c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3858159890 0x7f385815c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:56.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385ec1c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385815b630 con 0x7f3858159890 2023-10-06T10:58:56.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385ec1c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385815a590 con 0x7f38581594c0 2023-10-06T10:58:56.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385ec1c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385815a870 con 0x7f38580af440 2023-10-06T10:58:56.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385d1b9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3858159890 0x7f385815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:56.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385d1b9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3858159890 0x7f385815c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56584/0 (socket says 172.21.15.7:56584) 2023-10-06T10:58:56.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385d1b9700 1 -- 172.21.15.7:0/1226748763 learned_addr learned my addr 172.21.15.7:0/1226748763 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:56.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385c9b8700 1 --2- 172.21.15.7:0/1226748763 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38580af440 0x7f3858159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:56.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f3857fff700 1 --2- 172.21.15.7:0/1226748763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38581594c0 0x7f385816c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:56.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385d1b9700 1 -- 172.21.15.7:0/1226748763 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38580af440 msgr2=0x7f3858159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:56.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385d1b9700 1 --2- 172.21.15.7:0/1226748763 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38580af440 0x7f3858159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385d1b9700 1 -- 172.21.15.7:0/1226748763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38581594c0 msgr2=0x7f385816c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:56.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385d1b9700 1 --2- 172.21.15.7:0/1226748763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38581594c0 0x7f385816c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:56.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.874+0000 7f385d1b9700 1 -- 172.21.15.7:0/1226748763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3850009a20 con 0x7f3858159890 2023-10-06T10:58:56.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.875+0000 7f385d1b9700 1 --2- 172.21.15.7:0/1226748763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3858159890 0x7f385815c230 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f38500099f0 tx=0x7f3850019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:56.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.875+0000 7f3854ff9700 1 -- 172.21.15.7:0/1226748763 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850027470 con 0x7f3858159890 2023-10-06T10:58:56.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.875+0000 7f3854ff9700 1 -- 172.21.15.7:0/1226748763 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3850027610 con 0x7f3858159890 2023-10-06T10:58:56.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.875+0000 7f385ec1c700 1 -- 172.21.15.7:0/1226748763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385815ab50 con 0x7f3858159890 2023-10-06T10:58:56.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.875+0000 7f3854ff9700 1 -- 172.21.15.7:0/1226748763 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38500279d0 con 0x7f3858159890 2023-10-06T10:58:56.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.875+0000 7f385ec1c700 1 -- 172.21.15.7:0/1226748763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385815b110 con 0x7f3858159890 2023-10-06T10:58:56.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.876+0000 7f385ec1c700 1 -- 172.21.15.7:0/1226748763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385815b330 con 0x7f3858159890 2023-10-06T10:58:56.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.877+0000 7f3854ff9700 1 -- 172.21.15.7:0/1226748763 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f3850024070 con 0x7f3858159890 2023-10-06T10:58:56.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.877+0000 7f3854ff9700 1 --2- 172.21.15.7:0/1226748763 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f383c066ea0 0x7f383c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:56.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.877+0000 7f3854ff9700 1 -- 172.21.15.7:0/1226748763 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f3850086950 con 0x7f3858159890 2023-10-06T10:58:56.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.877+0000 7f385c9b8700 1 --2- 172.21.15.7:0/1226748763 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f383c066ea0 0x7f383c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:56.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.878+0000 7f385c9b8700 1 --2- 172.21.15.7:0/1226748763 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f383c066ea0 0x7f383c069350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f384c007fd0 tx=0x7f384c007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:56.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:56.882+0000 7f3854ff9700 1 -- 172.21.15.7:0/1226748763 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3850053ea0 con 0x7f3858159890 2023-10-06T10:58:57.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.085+0000 7f385ec1c700 1 -- 172.21.15.7:0/1226748763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3858070480 con 0x7f3858159890 2023-10-06T10:58:57.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.086+0000 7f3854ff9700 1 -- 172.21.15.7:0/1226748763 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f38500574c0 con 0x7f3858159890 2023-10-06T10:58:57.088 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-10-06T10:58:57.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.088+0000 7f385ec1c700 1 -- 172.21.15.7:0/1226748763 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f383c066ea0 msgr2=0x7f383c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:57.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.088+0000 7f385ec1c700 1 --2- 172.21.15.7:0/1226748763 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f383c066ea0 0x7f383c069350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f384c007fd0 tx=0x7f384c007d30 comp rx=0 tx=0).stop 2023-10-06T10:58:57.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.088+0000 7f385ec1c700 1 -- 172.21.15.7:0/1226748763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3858159890 msgr2=0x7f385815c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.088+0000 7f385ec1c700 1 --2- 172.21.15.7:0/1226748763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3858159890 0x7f385815c230 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f38500099f0 tx=0x7f3850019000 comp rx=0 tx=0).stop 2023-10-06T10:58:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.088+0000 7f385ec1c700 1 -- 172.21.15.7:0/1226748763 shutdown_connections 2023-10-06T10:58:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.088+0000 7f385ec1c700 1 --2- 172.21.15.7:0/1226748763 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f383c066ea0 0x7f383c069350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.088+0000 7f385ec1c700 1 --2- 172.21.15.7:0/1226748763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3858159890 0x7f385815c230 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.088+0000 7f385ec1c700 1 --2- 172.21.15.7:0/1226748763 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38580af440 0x7f3858159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.088+0000 7f385ec1c700 1 --2- 172.21.15.7:0/1226748763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38581594c0 0x7f385816c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.088+0000 7f385ec1c700 1 -- 172.21.15.7:0/1226748763 >> 172.21.15.7:0/1226748763 conn(0x7f3858067bc0 msgr2=0x7f38580cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.088+0000 7f385ec1c700 1 -- 172.21.15.7:0/1226748763 shutdown_connections 2023-10-06T10:58:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.088+0000 7f385ec1c700 1 -- 172.21.15.7:0/1226748763 wait complete. 2023-10-06T10:58:57.103 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T10:58:57.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.236+0000 7f09b65c8700 1 Processor -- start 2023-10-06T10:58:57.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.236+0000 7f09b65c8700 1 -- start start 2023-10-06T10:58:57.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.237+0000 7f09b65c8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09b00c9de0 0x7f09b0156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:57.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.237+0000 7f09b65c8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f09b01571c0 0x7f09b00c8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:57.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.237+0000 7f09b65c8700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b00c7fd0 con 0x7f09b00c9a10 2023-10-06T10:58:57.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.237+0000 7f09b65c8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b00c7400 con 0x7f09b01571c0 2023-10-06T10:58:57.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.237+0000 7f09b65c8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00c76a0 con 0x7f09b00c9de0 2023-10-06T10:58:57.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.237+0000 7f09b4b65700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f09b01571c0 0x7f09b00c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:57.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.237+0000 7f09b4b65700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f09b01571c0 0x7f09b00c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56594/0 (socket says 172.21.15.7:56594) 2023-10-06T10:58:57.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.237+0000 7f09affff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f09b00c9a10 0x7f09b0069d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50350/0 (socket says 172.21.15.7:50350) 2023-10-06T10:58:57.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.237+0000 7f09b4b65700 1 -- 172.21.15.7:0/3335930964 learned_addr learned my addr 172.21.15.7:0/3335930964 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:57.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.238+0000 7f09af7fe700 1 --2- 172.21.15.7:0/3335930964 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09b00c9de0 0x7f09b0156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:57.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.238+0000 7f09b4b65700 1 -- 172.21.15.7:0/3335930964 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09b00c9de0 msgr2=0x7f09b0156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:57.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.238+0000 7f09b4b65700 1 --2- 172.21.15.7:0/3335930964 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09b00c9de0 0x7f09b0156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.238+0000 7f09b4b65700 1 -- 172.21.15.7:0/3335930964 >> v1:172.21.15.7:6789/0 conn(0x7f09b00c9a10 legacy=0x7f09b0069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:57.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.238+0000 7f09b4b65700 1 -- 172.21.15.7:0/3335930964 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b00c7980 con 0x7f09b01571c0 2023-10-06T10:58:57.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.238+0000 7f09aeffd700 1 -- 172.21.15.7:0/3335930964 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450528127 0 0) 0x7f09b00c7fd0 con 0x7f09b00c9a10 2023-10-06T10:58:57.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.238+0000 7f09b4b65700 1 --2- 172.21.15.7:0/3335930964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09b01571c0 0x7f09b00c8460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009f50 tx=0x7f09a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9556c9ec146c86f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:57.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.238+0000 7f09aeffd700 1 -- 172.21.15.7:0/3335930964 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a800e070 con 0x7f09b01571c0 2023-10-06T10:58:57.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.238+0000 7f09aeffd700 1 -- 172.21.15.7:0/3335930964 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a800b9c0 con 0x7f09b01571c0 2023-10-06T10:58:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.238+0000 7f09aeffd700 1 -- 172.21.15.7:0/3335930964 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a80092e0 con 0x7f09b01571c0 2023-10-06T10:58:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.239+0000 7f09b65c8700 1 -- 172.21.15.7:0/3335930964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09b01571c0 msgr2=0x7f09b00c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.239+0000 7f09b65c8700 1 --2- 172.21.15.7:0/3335930964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09b01571c0 0x7f09b00c8460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009f50 tx=0x7f09a8009840 comp rx=0 tx=0).stop 2023-10-06T10:58:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.239+0000 7f09b65c8700 1 -- 172.21.15.7:0/3335930964 shutdown_connections 2023-10-06T10:58:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.239+0000 7f09b65c8700 1 --2- 172.21.15.7:0/3335930964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09b01571c0 0x7f09b00c8460 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.239+0000 7f09b65c8700 1 --2- 172.21.15.7:0/3335930964 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09b00c9de0 0x7f09b0156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.239+0000 7f09b65c8700 1 -- 172.21.15.7:0/3335930964 >> 172.21.15.7:0/3335930964 conn(0x7f09b00afc90 msgr2=0x7f09b00b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.239+0000 7f09b65c8700 1 -- 172.21.15.7:0/3335930964 shutdown_connections 2023-10-06T10:58:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.239+0000 7f09b65c8700 1 -- 172.21.15.7:0/3335930964 wait complete. 2023-10-06T10:58:57.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.240+0000 7f09b65c8700 1 Processor -- start 2023-10-06T10:58:57.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.240+0000 7f09b65c8700 1 -- start start 2023-10-06T10:58:57.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.241+0000 7f09b65c8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09b00c9a10 0x7f09b01507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:57.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.241+0000 7f09b65c8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09b00c9de0 0x7f09b00cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:57.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.241+0000 7f09b65c8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09b01571c0 0x7f09b00cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:57.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.241+0000 7f09b65c8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00c5520 con 0x7f09b01571c0 2023-10-06T10:58:57.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.241+0000 7f09b65c8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00add60 con 0x7f09b00c9a10 2023-10-06T10:58:57.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.241+0000 7f09b65c8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00c5770 con 0x7f09b00c9de0 2023-10-06T10:58:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.241+0000 7f09b4b65700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09b01571c0 0x7f09b00cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.241+0000 7f09b4b65700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09b01571c0 0x7f09b00cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56608/0 (socket says 172.21.15.7:56608) 2023-10-06T10:58:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.241+0000 7f09b4b65700 1 -- 172.21.15.7:0/3927243403 learned_addr learned my addr 172.21.15.7:0/3927243403 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.241+0000 7f09af7fe700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09b00c9de0 0x7f09b00cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.241+0000 7f09affff700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09b00c9a10 0x7f09b01507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.242+0000 7f09b4b65700 1 -- 172.21.15.7:0/3927243403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09b00c9de0 msgr2=0x7f09b00cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.242+0000 7f09b4b65700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09b00c9de0 0x7f09b00cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.242+0000 7f09b4b65700 1 -- 172.21.15.7:0/3927243403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09b00c9a10 msgr2=0x7f09b01507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.242+0000 7f09b4b65700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09b00c9a10 0x7f09b01507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.242+0000 7f09b4b65700 1 -- 172.21.15.7:0/3927243403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a8009ae0 con 0x7f09b01571c0 2023-10-06T10:58:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.242+0000 7f09af7fe700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09b00c9de0 0x7f09b00cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:58:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.242+0000 7f09b4b65700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09b01571c0 0x7f09b00cc400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009430 tx=0x7f09a8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.242+0000 7f09a7fff700 1 -- 172.21.15.7:0/3927243403 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8008c60 con 0x7f09b01571c0 2023-10-06T10:58:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.242+0000 7f09a7fff700 1 -- 172.21.15.7:0/3927243403 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a8008dc0 con 0x7f09b01571c0 2023-10-06T10:58:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.242+0000 7f09b65c8700 1 -- 172.21.15.7:0/3927243403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b00c5a50 con 0x7f09b01571c0 2023-10-06T10:58:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.242+0000 7f09a7fff700 1 -- 172.21.15.7:0/3927243403 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8025690 con 0x7f09b01571c0 2023-10-06T10:58:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.242+0000 7f09b65c8700 1 -- 172.21.15.7:0/3927243403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b0150d10 con 0x7f09b01571c0 2023-10-06T10:58:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.243+0000 7f09b65c8700 1 -- 172.21.15.7:0/3927243403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b0070480 con 0x7f09b01571c0 2023-10-06T10:58:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.243+0000 7f09a7fff700 1 -- 172.21.15.7:0/3927243403 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f09a8003040 con 0x7f09b01571c0 2023-10-06T10:58:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.244+0000 7f09a7fff700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0990066ed0 0x7f0990069380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.244+0000 7f09a7fff700 1 -- 172.21.15.7:0/3927243403 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f09a80857e0 con 0x7f09b01571c0 2023-10-06T10:58:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.244+0000 7f09affff700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0990066ed0 0x7f0990069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:57.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.244+0000 7f09affff700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0990066ed0 0x7f0990069380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f09b006c120 tx=0x7f09a0007bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:57.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.248+0000 7f09a7fff700 1 -- 172.21.15.7:0/3927243403 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09a8052d30 con 0x7f09b01571c0 2023-10-06T10:58:57.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.470+0000 7f09b65c8700 1 -- 172.21.15.7:0/3927243403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09b00c7c60 con 0x7f09b01571c0 2023-10-06T10:58:57.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.471+0000 7f09a7fff700 1 -- 172.21.15.7:0/3927243403 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f09a8008f30 con 0x7f09b01571c0 2023-10-06T10:58:57.473 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-06T10:58:57.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.473+0000 7f09b65c8700 1 -- 172.21.15.7:0/3927243403 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0990066ed0 msgr2=0x7f0990069380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:57.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.473+0000 7f09b65c8700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0990066ed0 0x7f0990069380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f09b006c120 tx=0x7f09a0007bf0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.473+0000 7f09b65c8700 1 -- 172.21.15.7:0/3927243403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09b01571c0 msgr2=0x7f09b00cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:57.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.473+0000 7f09b65c8700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09b01571c0 0x7f09b00cc400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009430 tx=0x7f09a8018000 comp rx=0 tx=0).stop 2023-10-06T10:58:57.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.473+0000 7f09b65c8700 1 -- 172.21.15.7:0/3927243403 shutdown_connections 2023-10-06T10:58:57.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.473+0000 7f09b65c8700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0990066ed0 0x7f0990069380 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.473+0000 7f09b65c8700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09b01571c0 0x7f09b00cc400 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.473+0000 7f09b65c8700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09b00c9a10 0x7f09b01507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.473+0000 7f09b65c8700 1 --2- 172.21.15.7:0/3927243403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09b00c9de0 0x7f09b00cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.473+0000 7f09b65c8700 1 -- 172.21.15.7:0/3927243403 >> 172.21.15.7:0/3927243403 conn(0x7f09b00afc90 msgr2=0x7f09b0153640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:57.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.473+0000 7f09b65c8700 1 -- 172.21.15.7:0/3927243403 shutdown_connections 2023-10-06T10:58:57.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.473+0000 7f09b65c8700 1 -- 172.21.15.7:0/3927243403 wait complete. 2023-10-06T10:58:57.489 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T10:58:57.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.623+0000 7f8131df8700 1 Processor -- start 2023-10-06T10:58:57.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.623+0000 7f8131df8700 1 -- start start 2023-10-06T10:58:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.624+0000 7f8131df8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c159220 0x7f812c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.624+0000 7f8131df8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f812c0ce7a0 0x7f812c0af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.624+0000 7f8131df8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812c0cf820 con 0x7f812c1595f0 2023-10-06T10:58:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.624+0000 7f8131df8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812c0cec10 con 0x7f812c0ce7a0 2023-10-06T10:58:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.624+0000 7f8131df8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c0ceef0 con 0x7f812c159220 2023-10-06T10:58:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.624+0000 7f812b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c159220 0x7f812c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.624+0000 7f812affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f812c0ce7a0 0x7f812c0af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.624+0000 7f812b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c159220 0x7f812c0aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:40864/0 (socket says 172.21.15.7:40864) 2023-10-06T10:58:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.624+0000 7f812b7fe700 1 -- 172.21.15.7:0/1430796197 learned_addr learned my addr 172.21.15.7:0/1430796197 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.624+0000 7f812b7fe700 1 -- 172.21.15.7:0/1430796197 >> v2:172.21.15.50:3300/0 conn(0x7f812c0ce7a0 msgr2=0x7f812c0af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.624+0000 7f812b7fe700 1 --2- 172.21.15.7:0/1430796197 >> v2:172.21.15.50:3300/0 conn(0x7f812c0ce7a0 0x7f812c0af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.624+0000 7f812b7fe700 1 -- 172.21.15.7:0/1430796197 >> v1:172.21.15.50:6789/0 conn(0x7f812c1595f0 legacy=0x7f812c0cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.624+0000 7f812b7fe700 1 -- 172.21.15.7:0/1430796197 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c0cf1d0 con 0x7f812c159220 2023-10-06T10:58:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.625+0000 7f812b7fe700 1 --2- 172.21.15.7:0/1430796197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c159220 0x7f812c0aedb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f811c0099b0 tx=0x7f811c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba31e2ed598ded55 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.625+0000 7f812a7fc700 1 -- 172.21.15.7:0/1430796197 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c009ea0 con 0x7f812c159220 2023-10-06T10:58:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.625+0000 7f812a7fc700 1 -- 172.21.15.7:0/1430796197 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c00b860 con 0x7f812c159220 2023-10-06T10:58:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.625+0000 7f812a7fc700 1 -- 172.21.15.7:0/1430796197 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c00bc00 con 0x7f812c159220 2023-10-06T10:58:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.625+0000 7f8131df8700 1 -- 172.21.15.7:0/1430796197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c159220 msgr2=0x7f812c0aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.625+0000 7f8131df8700 1 --2- 172.21.15.7:0/1430796197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c159220 0x7f812c0aedb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f811c0099b0 tx=0x7f811c009250 comp rx=0 tx=0).stop 2023-10-06T10:58:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.625+0000 7f8131df8700 1 -- 172.21.15.7:0/1430796197 shutdown_connections 2023-10-06T10:58:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.625+0000 7f8131df8700 1 --2- 172.21.15.7:0/1430796197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c159220 0x7f812c0aedb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.625+0000 7f8131df8700 1 --2- 172.21.15.7:0/1430796197 >> v2:172.21.15.50:3300/0 conn(0x7f812c0ce7a0 0x7f812c0af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.625+0000 7f8131df8700 1 -- 172.21.15.7:0/1430796197 >> 172.21.15.7:0/1430796197 conn(0x7f812c069f60 msgr2=0x7f812c0670f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.625+0000 7f8131df8700 1 -- 172.21.15.7:0/1430796197 shutdown_connections 2023-10-06T10:58:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.625+0000 7f8131df8700 1 -- 172.21.15.7:0/1430796197 wait complete. 2023-10-06T10:58:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.627+0000 7f8131df8700 1 Processor -- start 2023-10-06T10:58:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.627+0000 7f8131df8700 1 -- start start 2023-10-06T10:58:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f8131df8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f812c0ce7a0 0x7f812c16a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f8131df8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c159220 0x7f812c0c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f8131df8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f812c0c6a30 0x7f812c0c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f8131df8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c0c7ab0 con 0x7f812c0ce7a0 2023-10-06T10:58:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f8131df8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c169ab0 con 0x7f812c0c6a30 2023-10-06T10:58:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f8131df8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c0c6ea0 con 0x7f812c159220 2023-10-06T10:58:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f812b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f812c0ce7a0 0x7f812c16a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f812b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f812c0ce7a0 0x7f812c16a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56634/0 (socket says 172.21.15.7:56634) 2023-10-06T10:58:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f812b7fe700 1 -- 172.21.15.7:0/3975290147 learned_addr learned my addr 172.21.15.7:0/3975290147 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f812affd700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c159220 0x7f812c0c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f812bfff700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f812c0c6a30 0x7f812c0c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f812b7fe700 1 -- 172.21.15.7:0/3975290147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c159220 msgr2=0x7f812c0c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f812b7fe700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c159220 0x7f812c0c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f812b7fe700 1 -- 172.21.15.7:0/3975290147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f812c0c6a30 msgr2=0x7f812c0c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f812b7fe700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f812c0c6a30 0x7f812c0c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f812b7fe700 1 -- 172.21.15.7:0/3975290147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c0094f0 con 0x7f812c0ce7a0 2023-10-06T10:58:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f812bfff700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f812c0c6a30 0x7f812c0c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:58:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.628+0000 7f812b7fe700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f812c0ce7a0 0x7f812c16a730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f812c068d60 tx=0x7f811c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.629+0000 7f81137fe700 1 -- 172.21.15.7:0/3975290147 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c00bbe0 con 0x7f812c0ce7a0 2023-10-06T10:58:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.629+0000 7f81137fe700 1 -- 172.21.15.7:0/3975290147 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c011420 con 0x7f812c0ce7a0 2023-10-06T10:58:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.629+0000 7f8131df8700 1 -- 172.21.15.7:0/3975290147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812c0c7180 con 0x7f812c0ce7a0 2023-10-06T10:58:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.629+0000 7f81137fe700 1 -- 172.21.15.7:0/3975290147 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0117c0 con 0x7f812c0ce7a0 2023-10-06T10:58:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.629+0000 7f8131df8700 1 -- 172.21.15.7:0/3975290147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812c0c7740 con 0x7f812c0ce7a0 2023-10-06T10:58:57.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.630+0000 7f8131df8700 1 -- 172.21.15.7:0/3975290147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812c070480 con 0x7f812c0ce7a0 2023-10-06T10:58:57.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.631+0000 7f81137fe700 1 -- 172.21.15.7:0/3975290147 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f811c011bf0 con 0x7f812c0ce7a0 2023-10-06T10:58:57.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.631+0000 7f81137fe700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8118066ea0 0x7f8118069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:57.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.631+0000 7f81137fe700 1 -- 172.21.15.7:0/3975290147 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f811c0863f0 con 0x7f812c0ce7a0 2023-10-06T10:58:57.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.631+0000 7f812affd700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8118066ea0 0x7f8118069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:57.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.632+0000 7f812affd700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8118066ea0 0x7f8118069350 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f812c15ec20 tx=0x7f81200091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.638+0000 7f81137fe700 1 -- 172.21.15.7:0/3975290147 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f811c0539d0 con 0x7f812c0ce7a0 2023-10-06T10:58:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.889+0000 7f8131df8700 1 -- 172.21.15.7:0/3975290147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f812c0cf4b0 con 0x7f812c0ce7a0 2023-10-06T10:58:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.890+0000 7f81137fe700 1 -- 172.21.15.7:0/3975290147 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3512 (secure 0 0 0) 0x7f811c015dd0 con 0x7f812c0ce7a0 2023-10-06T10:58:57.892 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:57.892 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/941534596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":941534596},{"type":"v1","addr":"172.21.15.50:6835","nonce":941534596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3152699387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3152699387},{"type":"v1","addr":"172.21.15.50:6834","nonce":3152699387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/271704556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":271704556},{"type":"v1","addr":"172.21.15.7:6837","nonce":271704556}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3123178887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3123178887},{"type":"v1","addr":"172.21.15.7:6836","nonce":3123178887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T10:58:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.892+0000 7f8131df8700 1 -- 172.21.15.7:0/3975290147 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8118066ea0 msgr2=0x7f8118069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.892+0000 7f8131df8700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8118066ea0 0x7f8118069350 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f812c15ec20 tx=0x7f81200091a0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.892+0000 7f8131df8700 1 -- 172.21.15.7:0/3975290147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f812c0ce7a0 msgr2=0x7f812c16a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.892+0000 7f8131df8700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f812c0ce7a0 0x7f812c16a730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f812c068d60 tx=0x7f811c017000 comp rx=0 tx=0).stop 2023-10-06T10:58:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.892+0000 7f8131df8700 1 -- 172.21.15.7:0/3975290147 shutdown_connections 2023-10-06T10:58:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.892+0000 7f8131df8700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8118066ea0 0x7f8118069350 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.892+0000 7f8131df8700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f812c0ce7a0 0x7f812c16a730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.892+0000 7f8131df8700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f812c0c6a30 0x7f812c0c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.892+0000 7f8131df8700 1 --2- 172.21.15.7:0/3975290147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c159220 0x7f812c0c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.892+0000 7f8131df8700 1 -- 172.21.15.7:0/3975290147 >> 172.21.15.7:0/3975290147 conn(0x7f812c069f60 msgr2=0x7f812c1545c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.892+0000 7f8131df8700 1 -- 172.21.15.7:0/3975290147 shutdown_connections 2023-10-06T10:58:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:57.892+0000 7f8131df8700 1 -- 172.21.15.7:0/3975290147 wait complete. 2023-10-06T10:58:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 3 2023-10-06T10:58:57.907 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:58:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.042+0000 7faa6f565700 1 Processor -- start 2023-10-06T10:58:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.042+0000 7faa6f565700 1 -- start start 2023-10-06T10:58:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.043+0000 7faa6f565700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa68068100 0x7faa680a6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.043+0000 7faa6f565700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa680ac7f0 0x7faa680a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.043+0000 7faa6f565700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa680b0250 con 0x7faa68159360 2023-10-06T10:58:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.043+0000 7faa6f565700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa680aeba0 con 0x7faa68068100 2023-10-06T10:58:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.043+0000 7faa6f565700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa68159730 con 0x7faa680ac7f0 2023-10-06T10:58:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.044+0000 7faa6db02700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa680ac7f0 0x7faa680a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.044+0000 7faa6cb00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa68068100 0x7faa680a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.044+0000 7faa6d301700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faa68159360 0x7faa680afb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:50432/0 (socket says 172.21.15.7:50432) 2023-10-06T10:58:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.044+0000 7faa6cb00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa68068100 0x7faa680a6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:36944/0 (socket says 172.21.15.7:36944) 2023-10-06T10:58:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.044+0000 7faa6d301700 1 -- 172.21.15.7:0/4206221723 learned_addr learned my addr 172.21.15.7:0/4206221723 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:58:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.044+0000 7faa6cb00700 1 -- 172.21.15.7:0/4206221723 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa680ac7f0 msgr2=0x7faa680a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.044+0000 7faa6cb00700 1 --2- 172.21.15.7:0/4206221723 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa680ac7f0 0x7faa680a6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.044+0000 7faa6cb00700 1 -- 172.21.15.7:0/4206221723 >> v1:172.21.15.50:6789/0 conn(0x7faa68159360 legacy=0x7faa680afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.044+0000 7faa6cb00700 1 -- 172.21.15.7:0/4206221723 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa680ae270 con 0x7faa68068100 2023-10-06T10:58:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.044+0000 7faa6cb00700 1 --2- 172.21.15.7:0/4206221723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa68068100 0x7faa680a6980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faa580098e0 tx=0x7faa580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24ec492395baf7ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.044+0000 7faa5ffff700 1 -- 172.21.15.7:0/4206221723 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800b640 con 0x7faa68068100 2023-10-06T10:58:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.044+0000 7faa5ffff700 1 -- 172.21.15.7:0/4206221723 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5800b7a0 con 0x7faa68068100 2023-10-06T10:58:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.044+0000 7faa5ffff700 1 -- 172.21.15.7:0/4206221723 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800bb40 con 0x7faa68068100 2023-10-06T10:58:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.045+0000 7faa6f565700 1 -- 172.21.15.7:0/4206221723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa68068100 msgr2=0x7faa680a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.045+0000 7faa6f565700 1 --2- 172.21.15.7:0/4206221723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa68068100 0x7faa680a6980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faa580098e0 tx=0x7faa580091a0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.045+0000 7faa6f565700 1 -- 172.21.15.7:0/4206221723 shutdown_connections 2023-10-06T10:58:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.045+0000 7faa6f565700 1 --2- 172.21.15.7:0/4206221723 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa680ac7f0 0x7faa680a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.045+0000 7faa6f565700 1 --2- 172.21.15.7:0/4206221723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa68068100 0x7faa680a6980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.045+0000 7faa6f565700 1 -- 172.21.15.7:0/4206221723 >> 172.21.15.7:0/4206221723 conn(0x7faa68095a70 msgr2=0x7faa680af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.045+0000 7faa6f565700 1 -- 172.21.15.7:0/4206221723 shutdown_connections 2023-10-06T10:58:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.045+0000 7faa6f565700 1 -- 172.21.15.7:0/4206221723 wait complete. 2023-10-06T10:58:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.046+0000 7faa6f565700 1 Processor -- start 2023-10-06T10:58:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.046+0000 7faa6f565700 1 -- start start 2023-10-06T10:58:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.047+0000 7faa6f565700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa68068100 0x7faa68099b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.047+0000 7faa6f565700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa680ac7f0 0x7faa6816d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.047+0000 7faa6f565700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa68159360 0x7faa6816d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.047+0000 7faa6f565700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa68157d10 con 0x7faa680ac7f0 2023-10-06T10:58:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.047+0000 7faa6f565700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa68157a30 con 0x7faa68159360 2023-10-06T10:58:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.047+0000 7faa6f565700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6816ad40 con 0x7faa68068100 2023-10-06T10:58:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.047+0000 7faa6cb00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa680ac7f0 0x7faa6816d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.047+0000 7faa6d301700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa68068100 0x7faa68099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.047+0000 7faa6cb00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa680ac7f0 0x7faa6816d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56642/0 (socket says 172.21.15.7:56642) 2023-10-06T10:58:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.047+0000 7faa6cb00700 1 -- 172.21.15.7:0/1926471010 learned_addr learned my addr 172.21.15.7:0/1926471010 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.047+0000 7faa6db02700 1 --2- 172.21.15.7:0/1926471010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa68159360 0x7faa6816d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.048+0000 7faa6d301700 1 -- 172.21.15.7:0/1926471010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa68159360 msgr2=0x7faa6816d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.048+0000 7faa6d301700 1 --2- 172.21.15.7:0/1926471010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa68159360 0x7faa6816d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.048+0000 7faa6d301700 1 -- 172.21.15.7:0/1926471010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa680ac7f0 msgr2=0x7faa6816d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.048+0000 7faa6d301700 1 --2- 172.21.15.7:0/1926471010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa680ac7f0 0x7faa6816d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.048+0000 7faa6d301700 1 -- 172.21.15.7:0/1926471010 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa58009420 con 0x7faa68068100 2023-10-06T10:58:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.048+0000 7faa6db02700 1 --2- 172.21.15.7:0/1926471010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa68159360 0x7faa6816d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.048+0000 7faa6d301700 1 --2- 172.21.15.7:0/1926471010 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa68068100 0x7faa68099b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c4a0 tx=0x7faa64007f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.048+0000 7faa5d7fa700 1 -- 172.21.15.7:0/1926471010 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6400ce50 con 0x7faa68068100 2023-10-06T10:58:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.048+0000 7faa5d7fa700 1 -- 172.21.15.7:0/1926471010 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa64005b30 con 0x7faa68068100 2023-10-06T10:58:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.048+0000 7faa6f565700 1 -- 172.21.15.7:0/1926471010 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6816b020 con 0x7faa68068100 2023-10-06T10:58:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.048+0000 7faa5d7fa700 1 -- 172.21.15.7:0/1926471010 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa640070d0 con 0x7faa68068100 2023-10-06T10:58:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.048+0000 7faa6f565700 1 -- 172.21.15.7:0/1926471010 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa68156c60 con 0x7faa68068100 2023-10-06T10:58:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.049+0000 7faa6f565700 1 -- 172.21.15.7:0/1926471010 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa680b1be0 con 0x7faa68068100 2023-10-06T10:58:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.050+0000 7faa5d7fa700 1 -- 172.21.15.7:0/1926471010 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7faa640074c0 con 0x7faa68068100 2023-10-06T10:58:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.050+0000 7faa5d7fa700 1 --2- 172.21.15.7:0/1926471010 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faa4c066ea0 0x7faa4c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.050+0000 7faa5d7fa700 1 -- 172.21.15.7:0/1926471010 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7faa64083410 con 0x7faa68068100 2023-10-06T10:58:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.050+0000 7faa6cb00700 1 --2- 172.21.15.7:0/1926471010 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faa4c066ea0 0x7faa4c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.051+0000 7faa6cb00700 1 --2- 172.21.15.7:0/1926471010 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faa4c066ea0 0x7faa4c069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faa681589d0 tx=0x7faa58017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.055+0000 7faa5d7fa700 1 -- 172.21.15.7:0/1926471010 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa64050950 con 0x7faa68068100 2023-10-06T10:58:58.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.261+0000 7faa6f565700 1 -- 172.21.15.7:0/1926471010 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa680b0250 con 0x7faa68068100 2023-10-06T10:58:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.262+0000 7faa5d7fa700 1 -- 172.21.15.7:0/1926471010 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13661 (secure 0 0 0) 0x7faa680b0250 con 0x7faa68068100 2023-10-06T10:58:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:58.265 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":16,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:58:57.319232+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:58:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.265+0000 7faa6f565700 1 -- 172.21.15.7:0/1926471010 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faa4c066ea0 msgr2=0x7faa4c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.265+0000 7faa6f565700 1 --2- 172.21.15.7:0/1926471010 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faa4c066ea0 0x7faa4c069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faa681589d0 tx=0x7faa58017000 comp rx=0 tx=0).stop 2023-10-06T10:58:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.265+0000 7faa6f565700 1 -- 172.21.15.7:0/1926471010 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa68068100 msgr2=0x7faa68099b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.265+0000 7faa6f565700 1 --2- 172.21.15.7:0/1926471010 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa68068100 0x7faa68099b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c4a0 tx=0x7faa64007f10 comp rx=0 tx=0).stop 2023-10-06T10:58:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.265+0000 7faa6f565700 1 -- 172.21.15.7:0/1926471010 shutdown_connections 2023-10-06T10:58:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.265+0000 7faa6f565700 1 --2- 172.21.15.7:0/1926471010 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faa4c066ea0 0x7faa4c069350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.265+0000 7faa6f565700 1 --2- 172.21.15.7:0/1926471010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa68159360 0x7faa6816d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.265+0000 7faa6f565700 1 --2- 172.21.15.7:0/1926471010 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa68068100 0x7faa68099b90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.265+0000 7faa6f565700 1 --2- 172.21.15.7:0/1926471010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa680ac7f0 0x7faa6816d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.265+0000 7faa6f565700 1 -- 172.21.15.7:0/1926471010 >> 172.21.15.7:0/1926471010 conn(0x7faa68095a70 msgr2=0x7faa6806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.265+0000 7faa6f565700 1 -- 172.21.15.7:0/1926471010 shutdown_connections 2023-10-06T10:58:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.265+0000 7faa6f565700 1 -- 172.21.15.7:0/1926471010 wait complete. 2023-10-06T10:58:58.280 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T10:58:55.224661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T10:58:56.032929+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T10:58:58.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T10:58:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.416+0000 7f753b558700 1 Processor -- start 2023-10-06T10:58:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.416+0000 7f753b558700 1 -- start start 2023-10-06T10:58:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.417+0000 7f753b558700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f75340cbdd0 0x7f75340c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.417+0000 7f753b558700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f753406b8e0 0x7f753406bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.417+0000 7f753b558700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7534068070 con 0x7f75340acab0 2023-10-06T10:58:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.417+0000 7f753b558700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753406c260 con 0x7f75340cbdd0 2023-10-06T10:58:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.417+0000 7f753b558700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75340adb60 con 0x7f753406b8e0 2023-10-06T10:58:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.417+0000 7f75392f4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f75340cbdd0 0x7f75340c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.417+0000 7f75392f4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f75340cbdd0 0x7f75340c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56662/0 (socket says 172.21.15.7:56662) 2023-10-06T10:58:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.417+0000 7f7538af3700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f75340acab0 0x7f75340acfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50356/0 (socket says 172.21.15.7:50356) 2023-10-06T10:58:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.417+0000 7f75392f4700 1 -- 172.21.15.7:0/2104254990 learned_addr learned my addr 172.21.15.7:0/2104254990 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.417+0000 7f7539af5700 1 --2- 172.21.15.7:0/2104254990 >> v2:172.21.15.50:3300/0 conn(0x7f753406b8e0 0x7f753406bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.418+0000 7f75392f4700 1 -- 172.21.15.7:0/2104254990 >> v2:172.21.15.50:3300/0 conn(0x7f753406b8e0 msgr2=0x7f753406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.418+0000 7f75392f4700 1 --2- 172.21.15.7:0/2104254990 >> v2:172.21.15.50:3300/0 conn(0x7f753406b8e0 0x7f753406bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.418+0000 7f75392f4700 1 -- 172.21.15.7:0/2104254990 >> v1:172.21.15.7:6789/0 conn(0x7f75340acab0 legacy=0x7f75340acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.418+0000 7f75392f4700 1 -- 172.21.15.7:0/2104254990 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75340ad880 con 0x7f75340cbdd0 2023-10-06T10:58:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.418+0000 7f752bfff700 1 -- 172.21.15.7:0/2104254990 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200460730 0 0) 0x7f7534068070 con 0x7f75340acab0 2023-10-06T10:58:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.418+0000 7f75392f4700 1 --2- 172.21.15.7:0/2104254990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75340cbdd0 0x7f75340c9080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f75340cd5d0 tx=0x7f7530009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd743e683f8d59d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.418+0000 7f752bfff700 1 -- 172.21.15.7:0/2104254990 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000b8f0 con 0x7f75340cbdd0 2023-10-06T10:58:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.418+0000 7f752bfff700 1 -- 172.21.15.7:0/2104254990 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753000ba50 con 0x7f75340cbdd0 2023-10-06T10:58:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.418+0000 7f752bfff700 1 -- 172.21.15.7:0/2104254990 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000bdf0 con 0x7f75340cbdd0 2023-10-06T10:58:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.418+0000 7f753b558700 1 -- 172.21.15.7:0/2104254990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75340cbdd0 msgr2=0x7f75340c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.418+0000 7f753b558700 1 --2- 172.21.15.7:0/2104254990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75340cbdd0 0x7f75340c9080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f75340cd5d0 tx=0x7f7530009250 comp rx=0 tx=0).stop 2023-10-06T10:58:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.419+0000 7f753b558700 1 -- 172.21.15.7:0/2104254990 shutdown_connections 2023-10-06T10:58:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.419+0000 7f753b558700 1 --2- 172.21.15.7:0/2104254990 >> v2:172.21.15.50:3300/0 conn(0x7f753406b8e0 0x7f753406bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.419+0000 7f753b558700 1 --2- 172.21.15.7:0/2104254990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75340cbdd0 0x7f75340c9080 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.419+0000 7f753b558700 1 -- 172.21.15.7:0/2104254990 >> 172.21.15.7:0/2104254990 conn(0x7f75340cc560 msgr2=0x7f75340cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.419+0000 7f753b558700 1 -- 172.21.15.7:0/2104254990 shutdown_connections 2023-10-06T10:58:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.419+0000 7f753b558700 1 -- 172.21.15.7:0/2104254990 wait complete. 2023-10-06T10:58:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.420+0000 7f753b558700 1 Processor -- start 2023-10-06T10:58:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.420+0000 7f753b558700 1 -- start start 2023-10-06T10:58:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f753b558700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f753406b8e0 0x7f7534159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f753b558700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75340acab0 0x7f75340c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f753b558700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75340cbdd0 0x7f75340b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f753b558700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340cb150 con 0x7f753406b8e0 2023-10-06T10:58:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f753b558700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753415a120 con 0x7f75340cbdd0 2023-10-06T10:58:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f753b558700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75340ca580 con 0x7f75340acab0 2023-10-06T10:58:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f75392f4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f753406b8e0 0x7f7534159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f75392f4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f753406b8e0 0x7f7534159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56674/0 (socket says 172.21.15.7:56674) 2023-10-06T10:58:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f75392f4700 1 -- 172.21.15.7:0/2980273261 learned_addr learned my addr 172.21.15.7:0/2980273261 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f7539af5700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75340cbdd0 0x7f75340b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f7538af3700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75340acab0 0x7f75340c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f75392f4700 1 -- 172.21.15.7:0/2980273261 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75340acab0 msgr2=0x7f75340c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f75392f4700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75340acab0 0x7f75340c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f75392f4700 1 -- 172.21.15.7:0/2980273261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75340cbdd0 msgr2=0x7f75340b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f75392f4700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75340cbdd0 0x7f75340b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f75392f4700 1 -- 172.21.15.7:0/2980273261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75300094f0 con 0x7f753406b8e0 2023-10-06T10:58:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f7538af3700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75340acab0 0x7f75340c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:58:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f75392f4700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f753406b8e0 0x7f7534159be0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7530006f50 tx=0x7f7530017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f75297fa700 1 -- 172.21.15.7:0/2980273261 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530024440 con 0x7f753406b8e0 2023-10-06T10:58:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f75297fa700 1 -- 172.21.15.7:0/2980273261 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75300245e0 con 0x7f753406b8e0 2023-10-06T10:58:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f753b558700 1 -- 172.21.15.7:0/2980273261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75340ca820 con 0x7f753406b8e0 2023-10-06T10:58:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f75297fa700 1 -- 172.21.15.7:0/2980273261 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75300249a0 con 0x7f753406b8e0 2023-10-06T10:58:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.422+0000 7f753b558700 1 -- 172.21.15.7:0/2980273261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75340cade0 con 0x7f753406b8e0 2023-10-06T10:58:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.423+0000 7f753b558700 1 -- 172.21.15.7:0/2980273261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7534070480 con 0x7f753406b8e0 2023-10-06T10:58:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.424+0000 7f75297fa700 1 -- 172.21.15.7:0/2980273261 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f7530024d50 con 0x7f753406b8e0 2023-10-06T10:58:58.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.424+0000 7f75297fa700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7518066ea0 0x7f7518069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.424+0000 7f75297fa700 1 -- 172.21.15.7:0/2980273261 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7530086030 con 0x7f753406b8e0 2023-10-06T10:58:58.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.424+0000 7f7538af3700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7518066ea0 0x7f7518069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.425+0000 7f7538af3700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7518066ea0 0x7f7518069350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7524007fd0 tx=0x7f7524007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.429+0000 7f75297fa700 1 -- 172.21.15.7:0/2980273261 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7530053570 con 0x7f753406b8e0 2023-10-06T10:58:58.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.635+0000 7f753b558700 1 -- 172.21.15.7:0/2980273261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f753406af60 con 0x7f753406b8e0 2023-10-06T10:58:58.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.636+0000 7f75297fa700 1 -- 172.21.15.7:0/2980273261 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f75300150a0 con 0x7f753406b8e0 2023-10-06T10:58:58.638 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-10-06T10:58:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.638+0000 7f753b558700 1 -- 172.21.15.7:0/2980273261 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7518066ea0 msgr2=0x7f7518069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.638+0000 7f753b558700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7518066ea0 0x7f7518069350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7524007fd0 tx=0x7f7524007e30 comp rx=0 tx=0).stop 2023-10-06T10:58:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.638+0000 7f753b558700 1 -- 172.21.15.7:0/2980273261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f753406b8e0 msgr2=0x7f7534159be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.638+0000 7f753b558700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f753406b8e0 0x7f7534159be0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7530006f50 tx=0x7f7530017000 comp rx=0 tx=0).stop 2023-10-06T10:58:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.638+0000 7f753b558700 1 -- 172.21.15.7:0/2980273261 shutdown_connections 2023-10-06T10:58:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.638+0000 7f753b558700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7518066ea0 0x7f7518069350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.638+0000 7f753b558700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f753406b8e0 0x7f7534159be0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.638+0000 7f753b558700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75340cbdd0 0x7f75340b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.638+0000 7f753b558700 1 --2- 172.21.15.7:0/2980273261 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75340acab0 0x7f75340c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.638+0000 7f753b558700 1 -- 172.21.15.7:0/2980273261 >> 172.21.15.7:0/2980273261 conn(0x7f75340cc560 msgr2=0x7f75340af790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:58.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.638+0000 7f753b558700 1 -- 172.21.15.7:0/2980273261 shutdown_connections 2023-10-06T10:58:58.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.638+0000 7f753b558700 1 -- 172.21.15.7:0/2980273261 wait complete. 2023-10-06T10:58:58.653 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T10:58:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.786+0000 7fc2130d5700 1 Processor -- start 2023-10-06T10:58:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.786+0000 7fc2130d5700 1 -- start start 2023-10-06T10:58:58.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.787+0000 7fc2130d5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc20c0c9de0 0x7fc20c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.787+0000 7fc2130d5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc20c1571c0 0x7fc20c0c8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.787+0000 7fc2130d5700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c0c7fd0 con 0x7fc20c0c9a10 2023-10-06T10:58:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.787+0000 7fc2130d5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c0c7400 con 0x7fc20c1571c0 2023-10-06T10:58:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.787+0000 7fc2130d5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0c76a0 con 0x7fc20c0c9de0 2023-10-06T10:58:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.787+0000 7fc210e71700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc20c0c9a10 0x7fc20c069d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50368/0 (socket says 172.21.15.7:50368) 2023-10-06T10:58:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.787+0000 7fc210e71700 1 -- 172.21.15.7:0/851291999 learned_addr learned my addr 172.21.15.7:0/851291999 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:58:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.787+0000 7fc211672700 1 --2- 172.21.15.7:0/851291999 >> v2:172.21.15.50:3300/0 conn(0x7fc20c1571c0 0x7fc20c0c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.787+0000 7fc20bfff700 1 --2- 172.21.15.7:0/851291999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc20c0c9de0 0x7fc20c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.787+0000 7fc20b7fe700 1 -- 172.21.15.7:0/851291999 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468980768 0 0) 0x7fc20c0c7fd0 con 0x7fc20c0c9a10 2023-10-06T10:58:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.787+0000 7fc20b7fe700 1 -- 172.21.15.7:0/851291999 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1f4003570 con 0x7fc20c0c9a10 2023-10-06T10:58:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20b7fe700 1 -- 172.21.15.7:0/851291999 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1624867998 0 0) 0x7fc1f4003570 con 0x7fc20c0c9a10 2023-10-06T10:58:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20b7fe700 1 -- 172.21.15.7:0/851291999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc20c0c9de0 msgr2=0x7fc20c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20b7fe700 1 --2- 172.21.15.7:0/851291999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc20c0c9de0 0x7fc20c156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20b7fe700 1 -- 172.21.15.7:0/851291999 >> v2:172.21.15.50:3300/0 conn(0x7fc20c1571c0 msgr2=0x7fc20c0c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20b7fe700 1 --2- 172.21.15.7:0/851291999 >> v2:172.21.15.50:3300/0 conn(0x7fc20c1571c0 0x7fc20c0c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20b7fe700 1 -- 172.21.15.7:0/851291999 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c0c7980 con 0x7fc20c0c9a10 2023-10-06T10:58:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20b7fe700 1 -- 172.21.15.7:0/851291999 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7fc1fc001470 con 0x7fc20c0c9a10 2023-10-06T10:58:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20bfff700 1 --2- 172.21.15.7:0/851291999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc20c0c9de0 0x7fc20c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc211672700 1 --2- 172.21.15.7:0/851291999 >> v2:172.21.15.50:3300/0 conn(0x7fc20c1571c0 0x7fc20c0c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:58:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20b7fe700 1 -- 172.21.15.7:0/851291999 >> v1:172.21.15.7:6789/0 conn(0x7fc20c0c9a10 legacy=0x7fc20c069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20b7fe700 1 --2- 172.21.15.7:0/851291999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f4003a60 0x7fc1f4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20b7fe700 1 --2- 172.21.15.7:0/851291999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1f4004810 0x7fc1f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20b7fe700 1 --2- 172.21.15.7:0/851291999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc20c0c9de0 0x7fc1f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20b7fe700 1 -- 172.21.15.7:0/851291999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0c7400 con 0x7fc1f4004810 2023-10-06T10:58:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20b7fe700 1 -- 172.21.15.7:0/851291999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0c76a0 con 0x7fc1f4003a60 2023-10-06T10:58:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20b7fe700 1 -- 172.21.15.7:0/851291999 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f400ba60 con 0x7fc20c0c9de0 2023-10-06T10:58:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20bfff700 1 --2- 172.21.15.7:0/851291999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1f4004810 0x7fc1f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc210e71700 1 --2- 172.21.15.7:0/851291999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f4003a60 0x7fc1f4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc211672700 1 --2- 172.21.15.7:0/851291999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc20c0c9de0 0x7fc1f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20bfff700 1 -- 172.21.15.7:0/851291999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc20c0c9de0 msgr2=0x7fc1f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20bfff700 1 --2- 172.21.15.7:0/851291999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc20c0c9de0 0x7fc1f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20bfff700 1 -- 172.21.15.7:0/851291999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f4003a60 msgr2=0x7fc1f4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20bfff700 1 --2- 172.21.15.7:0/851291999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f4003a60 0x7fc1f4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20bfff700 1 -- 172.21.15.7:0/851291999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc200009420 con 0x7fc1f4004810 2023-10-06T10:58:58.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.788+0000 7fc20bfff700 1 --2- 172.21.15.7:0/851291999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1f4004810 0x7fc1f4004c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc200009df0 tx=0x7fc2000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd430a5d43bb44b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:58.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.789+0000 7fc20b7fe700 1 -- 172.21.15.7:0/851291999 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc200009740 con 0x7fc1f4004810 2023-10-06T10:58:58.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.789+0000 7fc20b7fe700 1 -- 172.21.15.7:0/851291999 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20000e920 con 0x7fc1f4004810 2023-10-06T10:58:58.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.789+0000 7fc20b7fe700 1 -- 172.21.15.7:0/851291999 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20000ece0 con 0x7fc1f4004810 2023-10-06T10:58:58.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.789+0000 7fc2130d5700 1 -- 172.21.15.7:0/851291999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1f4004810 msgr2=0x7fc1f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.789+0000 7fc2130d5700 1 --2- 172.21.15.7:0/851291999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1f4004810 0x7fc1f4004c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc200009df0 tx=0x7fc2000091a0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.789+0000 7fc211672700 1 -- 172.21.15.7:0/851291999 reap_dead start 2023-10-06T10:58:58.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.789+0000 7fc2130d5700 1 -- 172.21.15.7:0/851291999 shutdown_connections 2023-10-06T10:58:58.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.789+0000 7fc2130d5700 1 -- 172.21.15.7:0/851291999 >> 172.21.15.7:0/851291999 conn(0x7fc20c0afc90 msgr2=0x7fc20c0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:58.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.789+0000 7fc2130d5700 1 -- 172.21.15.7:0/851291999 shutdown_connections 2023-10-06T10:58:58.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.789+0000 7fc2130d5700 1 -- 172.21.15.7:0/851291999 wait complete. 2023-10-06T10:58:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.790+0000 7fc2130d5700 1 Processor -- start 2023-10-06T10:58:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.791+0000 7fc2130d5700 1 -- start start 2023-10-06T10:58:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.791+0000 7fc2130d5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1f4004810 0x7fc20c0af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.791+0000 7fc2130d5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc20c1575c0 0x7fc20c0ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc2130d5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc20c0cc550 0x7fc20c0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc2130d5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0af730 con 0x7fc20c0cc550 2023-10-06T10:58:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc2130d5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c169b20 con 0x7fc20c1575c0 2023-10-06T10:58:58.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc2130d5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c16a8a0 con 0x7fc1f4004810 2023-10-06T10:58:58.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc211672700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc20c0cc550 0x7fc20c0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc211672700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc20c0cc550 0x7fc20c0cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56700/0 (socket says 172.21.15.7:56700) 2023-10-06T10:58:58.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc211672700 1 -- 172.21.15.7:0/1450063130 learned_addr learned my addr 172.21.15.7:0/1450063130 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:58.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc210e71700 1 --2- 172.21.15.7:0/1450063130 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1f4004810 0x7fc20c0af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc20bfff700 1 --2- 172.21.15.7:0/1450063130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc20c1575c0 0x7fc20c0ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc211672700 1 -- 172.21.15.7:0/1450063130 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1f4004810 msgr2=0x7fc20c0af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc211672700 1 --2- 172.21.15.7:0/1450063130 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1f4004810 0x7fc20c0af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc211672700 1 -- 172.21.15.7:0/1450063130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc20c1575c0 msgr2=0x7fc20c0ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:58.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc211672700 1 --2- 172.21.15.7:0/1450063130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc20c1575c0 0x7fc20c0ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:58.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc211672700 1 -- 172.21.15.7:0/1450063130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c169dc0 con 0x7fc20c0cc550 2023-10-06T10:58:58.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc211672700 1 --2- 172.21.15.7:0/1450063130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc20c0cc550 0x7fc20c0cae30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc20c06aa50 tx=0x7fc20400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:58.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc208ff9700 1 -- 172.21.15.7:0/1450063130 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20400e040 con 0x7fc20c0cc550 2023-10-06T10:58:58.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc208ff9700 1 -- 172.21.15.7:0/1450063130 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20400f040 con 0x7fc20c0cc550 2023-10-06T10:58:58.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc2130d5700 1 -- 172.21.15.7:0/1450063130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20c16a0a0 con 0x7fc20c0cc550 2023-10-06T10:58:58.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc208ff9700 1 -- 172.21.15.7:0/1450063130 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20400fdb0 con 0x7fc20c0cc550 2023-10-06T10:58:58.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.792+0000 7fc2130d5700 1 -- 172.21.15.7:0/1450063130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20c157b30 con 0x7fc20c0cc550 2023-10-06T10:58:58.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.793+0000 7fc2130d5700 1 -- 172.21.15.7:0/1450063130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20c070480 con 0x7fc20c0cc550 2023-10-06T10:58:58.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.794+0000 7fc208ff9700 1 -- 172.21.15.7:0/1450063130 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fc204015640 con 0x7fc20c0cc550 2023-10-06T10:58:58.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.794+0000 7fc208ff9700 1 --2- 172.21.15.7:0/1450063130 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc1f8066ea0 0x7fc1f8069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:58.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.795+0000 7fc208ff9700 1 -- 172.21.15.7:0/1450063130 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc204084d00 con 0x7fc20c0cc550 2023-10-06T10:58:58.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.795+0000 7fc210e71700 1 --2- 172.21.15.7:0/1450063130 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc1f8066ea0 0x7fc1f8069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:58.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.795+0000 7fc210e71700 1 --2- 172.21.15.7:0/1450063130 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc1f8066ea0 0x7fc1f8069350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc001050 tx=0x7fc1fc001e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:58.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.799+0000 7fc208ff9700 1 -- 172.21.15.7:0/1450063130 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2040521a0 con 0x7fc20c0cc550 2023-10-06T10:58:58.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:58.981+0000 7fc208ff9700 1 -- 172.21.15.7:0/1450063130 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc204052570 con 0x7fc20c0cc550 2023-10-06T10:58:59.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.005+0000 7fc2130d5700 1 -- 172.21.15.7:0/1450063130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc20c0c7c60 con 0x7fc20c0cc550 2023-10-06T10:58:59.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.005+0000 7fc208ff9700 1 -- 172.21.15.7:0/1450063130 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc204055c30 con 0x7fc20c0cc550 2023-10-06T10:58:59.007 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-06T10:58:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.008+0000 7fc2130d5700 1 -- 172.21.15.7:0/1450063130 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc1f8066ea0 msgr2=0x7fc1f8069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.008+0000 7fc2130d5700 1 --2- 172.21.15.7:0/1450063130 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc1f8066ea0 0x7fc1f8069350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc001050 tx=0x7fc1fc001e50 comp rx=0 tx=0).stop 2023-10-06T10:58:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.008+0000 7fc2130d5700 1 -- 172.21.15.7:0/1450063130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc20c0cc550 msgr2=0x7fc20c0cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.008+0000 7fc2130d5700 1 --2- 172.21.15.7:0/1450063130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc20c0cc550 0x7fc20c0cae30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc20c06aa50 tx=0x7fc20400b040 comp rx=0 tx=0).stop 2023-10-06T10:58:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.008+0000 7fc2130d5700 1 -- 172.21.15.7:0/1450063130 shutdown_connections 2023-10-06T10:58:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.008+0000 7fc2130d5700 1 --2- 172.21.15.7:0/1450063130 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc1f8066ea0 0x7fc1f8069350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.008+0000 7fc2130d5700 1 --2- 172.21.15.7:0/1450063130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc20c0cc550 0x7fc20c0cae30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.008+0000 7fc2130d5700 1 --2- 172.21.15.7:0/1450063130 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1f4004810 0x7fc20c0af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.008+0000 7fc2130d5700 1 --2- 172.21.15.7:0/1450063130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc20c1575c0 0x7fc20c0ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.008+0000 7fc2130d5700 1 -- 172.21.15.7:0/1450063130 >> 172.21.15.7:0/1450063130 conn(0x7fc20c0afc90 msgr2=0x7fc20c15c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:59.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.008+0000 7fc2130d5700 1 -- 172.21.15.7:0/1450063130 shutdown_connections 2023-10-06T10:58:59.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.008+0000 7fc2130d5700 1 -- 172.21.15.7:0/1450063130 wait complete. 2023-10-06T10:58:59.023 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T10:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.155+0000 7f8bdffff700 1 Processor -- start 2023-10-06T10:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.155+0000 7f8bdffff700 1 -- start start 2023-10-06T10:58:59.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bdffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8be015c3a0 0x7f8be00c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:59.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bdffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8be00b1b90 0x7f8be00b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:59.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bdffff700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be00b2520 con 0x7f8be015c770 2023-10-06T10:58:59.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bdffff700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be0067ab0 con 0x7f8be00b1b90 2023-10-06T10:58:59.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bdffff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be0067d90 con 0x7f8be015c3a0 2023-10-06T10:58:59.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bdf7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8be00b1b90 0x7f8be00b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:59.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bde7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8be015c770 0x7f8be00a9810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50384/0 (socket says 172.21.15.7:50384) 2023-10-06T10:58:59.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bde7fc700 1 -- 172.21.15.7:0/4292055177 learned_addr learned my addr 172.21.15.7:0/4292055177 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:58:59.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bdeffd700 1 --2- 172.21.15.7:0/4292055177 >> v2:172.21.15.50:3300/0 conn(0x7f8be015c3a0 0x7f8be00c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:59.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bdf7fe700 1 -- 172.21.15.7:0/4292055177 >> v2:172.21.15.50:3300/0 conn(0x7f8be015c3a0 msgr2=0x7f8be00c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:58:59.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bdf7fe700 1 --2- 172.21.15.7:0/4292055177 >> v2:172.21.15.50:3300/0 conn(0x7f8be015c3a0 0x7f8be00c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bdf7fe700 1 -- 172.21.15.7:0/4292055177 >> v1:172.21.15.7:6789/0 conn(0x7f8be015c770 legacy=0x7f8be00a9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:59.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bdf7fe700 1 -- 172.21.15.7:0/4292055177 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be0068070 con 0x7f8be00b1b90 2023-10-06T10:58:59.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bddffb700 1 -- 172.21.15.7:0/4292055177 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393506230 0 0) 0x7f8be00b2520 con 0x7f8be015c770 2023-10-06T10:58:59.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.156+0000 7f8bdf7fe700 1 --2- 172.21.15.7:0/4292055177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be00b1b90 0x7f8be00b1fe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009e60 tx=0x7f8bd8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebb836376719f17 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:59.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.157+0000 7f8bddffb700 1 -- 172.21.15.7:0/4292055177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd800e070 con 0x7f8be00b1b90 2023-10-06T10:58:59.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.157+0000 7f8bddffb700 1 -- 172.21.15.7:0/4292055177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd800bb20 con 0x7f8be00b1b90 2023-10-06T10:58:59.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.157+0000 7f8bddffb700 1 -- 172.21.15.7:0/4292055177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8012430 con 0x7f8be00b1b90 2023-10-06T10:58:59.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.157+0000 7f8bdffff700 1 -- 172.21.15.7:0/4292055177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be00b1b90 msgr2=0x7f8be00b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:59.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.157+0000 7f8bdffff700 1 --2- 172.21.15.7:0/4292055177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be00b1b90 0x7f8be00b1fe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009e60 tx=0x7f8bd8009780 comp rx=0 tx=0).stop 2023-10-06T10:58:59.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.157+0000 7f8bdffff700 1 -- 172.21.15.7:0/4292055177 shutdown_connections 2023-10-06T10:58:59.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.157+0000 7f8bdffff700 1 --2- 172.21.15.7:0/4292055177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be00b1b90 0x7f8be00b1fe0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.157+0000 7f8bdffff700 1 --2- 172.21.15.7:0/4292055177 >> v2:172.21.15.50:3300/0 conn(0x7f8be015c3a0 0x7f8be00c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.157+0000 7f8bdffff700 1 -- 172.21.15.7:0/4292055177 >> 172.21.15.7:0/4292055177 conn(0x7f8be0095e80 msgr2=0x7f8be00afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:59.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.157+0000 7f8bdffff700 1 -- 172.21.15.7:0/4292055177 shutdown_connections 2023-10-06T10:58:59.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.157+0000 7f8bdffff700 1 -- 172.21.15.7:0/4292055177 wait complete. 2023-10-06T10:58:59.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.159+0000 7f8bdffff700 1 Processor -- start 2023-10-06T10:58:59.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.159+0000 7f8bdffff700 1 -- start start 2023-10-06T10:58:59.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.159+0000 7f8bdffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be00b1b90 0x7f8be00acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:59.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.159+0000 7f8bdffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be015c3a0 0x7f8be01596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:59.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.159+0000 7f8bdffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8be015c770 0x7f8be00ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:59.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.159+0000 7f8bdffff700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be00ca3c0 con 0x7f8be015c3a0 2023-10-06T10:58:59.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.159+0000 7f8bdffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be00ac670 con 0x7f8be00b1b90 2023-10-06T10:58:59.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.159+0000 7f8bdffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be00ad040 con 0x7f8be015c770 2023-10-06T10:58:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bde7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be015c3a0 0x7f8be01596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bde7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be015c3a0 0x7f8be01596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56718/0 (socket says 172.21.15.7:56718) 2023-10-06T10:58:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bde7fc700 1 -- 172.21.15.7:0/3975212972 learned_addr learned my addr 172.21.15.7:0/3975212972 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bdeffd700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be00b1b90 0x7f8be00acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bdf7fe700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8be015c770 0x7f8be00ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bde7fc700 1 -- 172.21.15.7:0/3975212972 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8be015c770 msgr2=0x7f8be00ade60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bde7fc700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8be015c770 0x7f8be00ade60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bde7fc700 1 -- 172.21.15.7:0/3975212972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be00b1b90 msgr2=0x7f8be00acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bde7fc700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be00b1b90 0x7f8be00acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bde7fc700 1 -- 172.21.15.7:0/3975212972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd8009a20 con 0x7f8be015c3a0 2023-10-06T10:58:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bdeffd700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be00b1b90 0x7f8be00acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:58:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bde7fc700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be015c3a0 0x7f8be01596b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c810 tx=0x7f8bd4007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bc6ffd700 1 -- 172.21.15.7:0/3975212972 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4005c00 con 0x7f8be015c3a0 2023-10-06T10:58:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bc6ffd700 1 -- 172.21.15.7:0/3975212972 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd4005d60 con 0x7f8be015c3a0 2023-10-06T10:58:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bdffff700 1 -- 172.21.15.7:0/3975212972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be00aba60 con 0x7f8be015c3a0 2023-10-06T10:58:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bc6ffd700 1 -- 172.21.15.7:0/3975212972 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4007320 con 0x7f8be015c3a0 2023-10-06T10:58:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.160+0000 7f8bdffff700 1 -- 172.21.15.7:0/3975212972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be00ac020 con 0x7f8be015c3a0 2023-10-06T10:58:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.161+0000 7f8bdffff700 1 -- 172.21.15.7:0/3975212972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be00ac7e0 con 0x7f8be015c3a0 2023-10-06T10:58:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.162+0000 7f8bc6ffd700 1 -- 172.21.15.7:0/3975212972 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8bd4007690 con 0x7f8be015c3a0 2023-10-06T10:58:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.162+0000 7f8bc6ffd700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8bcc066f30 0x7f8bcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.162+0000 7f8bc6ffd700 1 -- 172.21.15.7:0/3975212972 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8bd4083e00 con 0x7f8be015c3a0 2023-10-06T10:58:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.162+0000 7f8bdeffd700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8bcc066f30 0x7f8bcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:59.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.163+0000 7f8bdeffd700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8bcc066f30 0x7f8bcc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009ce0 tx=0x7f8bd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:59.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.167+0000 7f8bc6ffd700 1 -- 172.21.15.7:0/3975212972 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bd40512e0 con 0x7f8be015c3a0 2023-10-06T10:58:59.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.371+0000 7f8bdffff700 1 -- 172.21.15.7:0/3975212972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8be0070480 con 0x7f8be015c3a0 2023-10-06T10:58:59.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.372+0000 7f8bc6ffd700 1 -- 172.21.15.7:0/3975212972 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8bd4054900 con 0x7f8be015c3a0 2023-10-06T10:58:59.373 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:58:59.374 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-06T10:58:59.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T10:58:59.374 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-06T10:58:59.374 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": "rbd" 2023-10-06T10:58:59.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T10:58:59.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T10:58:59.374 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 2, 2023-10-06T10:58:59.374 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-06T10:58:59.374 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T10:58:59.374 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-06T10:58:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.374+0000 7f8bdffff700 1 -- 172.21.15.7:0/3975212972 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8bcc066f30 msgr2=0x7f8bcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.374+0000 7f8bdffff700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8bcc066f30 0x7f8bcc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009ce0 tx=0x7f8bd0008040 comp rx=0 tx=0).stop 2023-10-06T10:58:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.374+0000 7f8bdffff700 1 -- 172.21.15.7:0/3975212972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be015c3a0 msgr2=0x7f8be01596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.374+0000 7f8bdffff700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be015c3a0 0x7f8be01596b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c810 tx=0x7f8bd4007db0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.374+0000 7f8bdffff700 1 -- 172.21.15.7:0/3975212972 shutdown_connections 2023-10-06T10:58:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.374+0000 7f8bdffff700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8bcc066f30 0x7f8bcc0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.374+0000 7f8bdffff700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8be015c770 0x7f8be00ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.374+0000 7f8bdffff700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be00b1b90 0x7f8be00acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.374+0000 7f8bdffff700 1 --2- 172.21.15.7:0/3975212972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be015c3a0 0x7f8be01596b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.374+0000 7f8bdffff700 1 -- 172.21.15.7:0/3975212972 >> 172.21.15.7:0/3975212972 conn(0x7f8be0095e80 msgr2=0x7f8be006b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.374+0000 7f8bdffff700 1 -- 172.21.15.7:0/3975212972 shutdown_connections 2023-10-06T10:58:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.374+0000 7f8bdffff700 1 -- 172.21.15.7:0/3975212972 wait complete. 2023-10-06T10:58:59.389 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T10:58:59.390 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T10:58:59.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.524+0000 7f8f7fe06700 1 Processor -- start 2023-10-06T10:58:59.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.524+0000 7f8f7fe06700 1 -- start start 2023-10-06T10:58:59.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.525+0000 7f8f7fe06700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f780695f0 0x7f8f78164590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:59.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.525+0000 7f8f7fe06700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f780b0ca0 con 0x7f8f780af320 2023-10-06T10:58:59.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.525+0000 7f8f7fe06700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f780cf6c0 con 0x7f8f780cfb50 2023-10-06T10:58:59.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.525+0000 7f8f7fe06700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f78159c00 con 0x7f8f780695f0 2023-10-06T10:58:59.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.525+0000 7f8f7dba2700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8f780af320 0x7f8f780cb040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50396/0 (socket says 172.21.15.7:50396) 2023-10-06T10:58:59.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.525+0000 7f8f7dba2700 1 -- 172.21.15.7:0/1468147962 learned_addr learned my addr 172.21.15.7:0/1468147962 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:58:59.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.525+0000 7f8f7e3a3700 1 --2- 172.21.15.7:0/1468147962 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f780695f0 0x7f8f78164590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:59.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.525+0000 7f8f7cba0700 1 -- 172.21.15.7:0/1468147962 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111170900 0 0) 0x7f8f74001110 con 0x7f8f780af320 2023-10-06T10:58:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.525+0000 7f8f7cba0700 1 -- 172.21.15.7:0/1468147962 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f64003570 con 0x7f8f780af320 2023-10-06T10:58:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.525+0000 7f8f7cba0700 1 -- 172.21.15.7:0/1468147962 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833860310 0 0) 0x7f8f780cf6c0 con 0x7f8f780cfb50 2023-10-06T10:58:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.525+0000 7f8f7cba0700 1 -- 172.21.15.7:0/1468147962 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f74001110 con 0x7f8f780cfb50 2023-10-06T10:58:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.526+0000 7f8f7e3a3700 1 -- 172.21.15.7:0/1468147962 >> v1:172.21.15.50:6789/0 conn(0x7f8f780cfb50 legacy=0x7f8f78068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.526+0000 7f8f7e3a3700 1 -- 172.21.15.7:0/1468147962 >> v1:172.21.15.7:6789/0 conn(0x7f8f780af320 legacy=0x7f8f780cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.526+0000 7f8f7cba0700 1 -- 172.21.15.7:0/1468147962 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2618298535 0 0) 0x7f8f64003570 con 0x7f8f780af320 2023-10-06T10:58:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.526+0000 7f8f7e3a3700 1 -- 172.21.15.7:0/1468147962 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f780cb750 con 0x7f8f780695f0 2023-10-06T10:58:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.526+0000 7f8f7e3a3700 1 --2- 172.21.15.7:0/1468147962 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f780695f0 0x7f8f78164590 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009e90 tx=0x7f8f70009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9a90c2eac1d64d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.526+0000 7f8f7cba0700 1 -- 172.21.15.7:0/1468147962 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7000e070 con 0x7f8f780695f0 2023-10-06T10:58:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.526+0000 7f8f7cba0700 1 -- 172.21.15.7:0/1468147962 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7000b900 con 0x7f8f780695f0 2023-10-06T10:58:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.526+0000 7f8f7cba0700 1 -- 172.21.15.7:0/1468147962 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74001600 con 0x7f8f780695f0 2023-10-06T10:58:59.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.527+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1468147962 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f780695f0 msgr2=0x7f8f78164590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:59.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.527+0000 7f8f7fe06700 1 --2- 172.21.15.7:0/1468147962 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f780695f0 0x7f8f78164590 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009e90 tx=0x7f8f70009780 comp rx=0 tx=0).stop 2023-10-06T10:58:59.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.527+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1468147962 shutdown_connections 2023-10-06T10:58:59.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.527+0000 7f8f7fe06700 1 --2- 172.21.15.7:0/1468147962 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f780695f0 0x7f8f78164590 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.527+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1468147962 >> 172.21.15.7:0/1468147962 conn(0x7f8f78067b80 msgr2=0x7f8f780d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:58:59.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.527+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1468147962 shutdown_connections 2023-10-06T10:58:59.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.527+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1468147962 wait complete. 2023-10-06T10:58:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.528+0000 7f8f7fe06700 1 Processor -- start 2023-10-06T10:58:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.528+0000 7f8f7fe06700 1 -- start start 2023-10-06T10:58:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7fe06700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f780695f0 0x7f8f7815bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7fe06700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f780af320 0x7f8f7815a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7fe06700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f780cfb50 0x7f8f78153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7fe06700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7815a0b0 con 0x7f8f780af320 2023-10-06T10:58:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7fe06700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f780c9d90 con 0x7f8f780695f0 2023-10-06T10:58:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7fe06700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f780ca070 con 0x7f8f780cfb50 2023-10-06T10:58:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7d3a1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f780af320 0x7f8f7815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7d3a1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f780af320 0x7f8f7815a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56732/0 (socket says 172.21.15.7:56732) 2023-10-06T10:58:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7d3a1700 1 -- 172.21.15.7:0/1219242745 learned_addr learned my addr 172.21.15.7:0/1219242745 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:58:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7dba2700 1 --2- 172.21.15.7:0/1219242745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f780695f0 0x7f8f7815bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7e3a3700 1 --2- 172.21.15.7:0/1219242745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f780cfb50 0x7f8f78153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7d3a1700 1 -- 172.21.15.7:0/1219242745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f780cfb50 msgr2=0x7f8f78153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7d3a1700 1 --2- 172.21.15.7:0/1219242745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f780cfb50 0x7f8f78153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7d3a1700 1 -- 172.21.15.7:0/1219242745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f780695f0 msgr2=0x7f8f7815bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:58:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7d3a1700 1 --2- 172.21.15.7:0/1219242745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f780695f0 0x7f8f7815bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:58:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7d3a1700 1 -- 172.21.15.7:0/1219242745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f70009a20 con 0x7f8f780af320 2023-10-06T10:58:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.529+0000 7f8f7d3a1700 1 --2- 172.21.15.7:0/1219242745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f780af320 0x7f8f7815a540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800c590 tx=0x7f8f68007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.530+0000 7f8f6dffb700 1 -- 172.21.15.7:0/1219242745 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68010510 con 0x7f8f780af320 2023-10-06T10:58:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.530+0000 7f8f6dffb700 1 -- 172.21.15.7:0/1219242745 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f68010690 con 0x7f8f780af320 2023-10-06T10:58:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.530+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1219242745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f780ca350 con 0x7f8f780af320 2023-10-06T10:58:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.530+0000 7f8f6dffb700 1 -- 172.21.15.7:0/1219242745 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68010a50 con 0x7f8f780af320 2023-10-06T10:58:59.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.530+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1219242745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7815c250 con 0x7f8f780af320 2023-10-06T10:58:59.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.531+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1219242745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7815a260 con 0x7f8f780af320 2023-10-06T10:58:59.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.531+0000 7f8f6dffb700 1 -- 172.21.15.7:0/1219242745 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f68012440 con 0x7f8f780af320 2023-10-06T10:58:59.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.531+0000 7f8f6dffb700 1 --2- 172.21.15.7:0/1219242745 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8f5c066f30 0x7f8f5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:58:59.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.532+0000 7f8f6dffb700 1 -- 172.21.15.7:0/1219242745 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8f680837c0 con 0x7f8f780af320 2023-10-06T10:58:59.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.532+0000 7f8f7dba2700 1 --2- 172.21.15.7:0/1219242745 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8f5c066f30 0x7f8f5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:58:59.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.532+0000 7f8f7dba2700 1 --2- 172.21.15.7:0/1219242745 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8f5c066f30 0x7f8f5c0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f74001370 tx=0x7f8f74000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:58:59.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.536+0000 7f8f6dffb700 1 -- 172.21.15.7:0/1219242745 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f6804b5a0 con 0x7f8f780af320 2023-10-06T10:58:59.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:58:59.740+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1219242745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8f78070480 con 0x7f8f780af320 2023-10-06T10:59:00.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.389+0000 7f8f6dffb700 1 -- 172.21.15.7:0/1219242745 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8f68017020 con 0x7f8f780af320 2023-10-06T10:59:00.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.395+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1219242745 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8f5c066f30 msgr2=0x7f8f5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:00.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.395+0000 7f8f7fe06700 1 --2- 172.21.15.7:0/1219242745 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8f5c066f30 0x7f8f5c0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f74001370 tx=0x7f8f74000bc0 comp rx=0 tx=0).stop 2023-10-06T10:59:00.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.395+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1219242745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f780af320 msgr2=0x7f8f7815a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:00.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.395+0000 7f8f7fe06700 1 --2- 172.21.15.7:0/1219242745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f780af320 0x7f8f7815a540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800c590 tx=0x7f8f68007de0 comp rx=0 tx=0).stop 2023-10-06T10:59:00.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.395+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1219242745 shutdown_connections 2023-10-06T10:59:00.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.395+0000 7f8f7fe06700 1 --2- 172.21.15.7:0/1219242745 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8f5c066f30 0x7f8f5c0693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:00.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.395+0000 7f8f7fe06700 1 --2- 172.21.15.7:0/1219242745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f780cfb50 0x7f8f78153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:00.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.395+0000 7f8f7fe06700 1 --2- 172.21.15.7:0/1219242745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f780695f0 0x7f8f7815bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:00.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.395+0000 7f8f7fe06700 1 --2- 172.21.15.7:0/1219242745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f780af320 0x7f8f7815a540 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:00.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.395+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1219242745 >> 172.21.15.7:0/1219242745 conn(0x7f8f78067b80 msgr2=0x7f8f78157de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:00.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.395+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1219242745 shutdown_connections 2023-10-06T10:59:00.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.395+0000 7f8f7fe06700 1 -- 172.21.15.7:0/1219242745 wait complete. 2023-10-06T10:59:00.399 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-06T10:59:00.413 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-06T10:59:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.553+0000 7f8af8d1c700 1 Processor -- start 2023-10-06T10:59:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.553+0000 7f8af8d1c700 1 -- start start 2023-10-06T10:59:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.554+0000 7f8af8d1c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8af406dac0 0x7f8af415ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.554+0000 7f8af8d1c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8af415b190 0x7f8af4157a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.554+0000 7f8af8d1c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af415bb80 con 0x7f8af406de90 2023-10-06T10:59:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.554+0000 7f8af8d1c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af40c92c0 con 0x7f8af406dac0 2023-10-06T10:59:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.554+0000 7f8af8d1c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af40cc1e0 con 0x7f8af415b190 2023-10-06T10:59:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.555+0000 7f8af259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8af406dac0 0x7f8af415ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.555+0000 7f8af259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8af406dac0 0x7f8af415ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54852/0 (socket says 172.21.15.7:54852) 2023-10-06T10:59:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.555+0000 7f8af259c700 1 -- 172.21.15.7:0/2739698 learned_addr learned my addr 172.21.15.7:0/2739698 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.555+0000 7f8af2d9d700 1 --2- 172.21.15.7:0/2739698 >> v2:172.21.15.50:3300/0 conn(0x7f8af415b190 0x7f8af4157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.555+0000 7f8af259c700 1 -- 172.21.15.7:0/2739698 >> v2:172.21.15.50:3300/0 conn(0x7f8af415b190 msgr2=0x7f8af4157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.555+0000 7f8af259c700 1 --2- 172.21.15.7:0/2739698 >> v2:172.21.15.50:3300/0 conn(0x7f8af415b190 0x7f8af4157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.555+0000 7f8af259c700 1 -- 172.21.15.7:0/2739698 >> v1:172.21.15.50:6789/0 conn(0x7f8af406de90 legacy=0x7f8af40cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.555+0000 7f8af259c700 1 -- 172.21.15.7:0/2739698 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af415b5d0 con 0x7f8af406dac0 2023-10-06T10:59:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.555+0000 7f8af259c700 1 --2- 172.21.15.7:0/2739698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af406dac0 0x7f8af415ac50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8af40c84f0 tx=0x7f8ae8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1690dd48aa09ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.555+0000 7f8af159a700 1 -- 172.21.15.7:0/2739698 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8009e70 con 0x7f8af406dac0 2023-10-06T10:59:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.555+0000 7f8af159a700 1 -- 172.21.15.7:0/2739698 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae800b860 con 0x7f8af406dac0 2023-10-06T10:59:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.555+0000 7f8af159a700 1 -- 172.21.15.7:0/2739698 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800bc00 con 0x7f8af406dac0 2023-10-06T10:59:00.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.556+0000 7f8af8d1c700 1 -- 172.21.15.7:0/2739698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af406dac0 msgr2=0x7f8af415ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:00.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.556+0000 7f8af8d1c700 1 --2- 172.21.15.7:0/2739698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af406dac0 0x7f8af415ac50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8af40c84f0 tx=0x7f8ae8009250 comp rx=0 tx=0).stop 2023-10-06T10:59:00.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.556+0000 7f8af8d1c700 1 -- 172.21.15.7:0/2739698 shutdown_connections 2023-10-06T10:59:00.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.556+0000 7f8af8d1c700 1 --2- 172.21.15.7:0/2739698 >> v2:172.21.15.50:3300/0 conn(0x7f8af415b190 0x7f8af4157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:00.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.556+0000 7f8af8d1c700 1 --2- 172.21.15.7:0/2739698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af406dac0 0x7f8af415ac50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:00.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.556+0000 7f8af8d1c700 1 -- 172.21.15.7:0/2739698 >> 172.21.15.7:0/2739698 conn(0x7f8af406cd00 msgr2=0x7f8af40cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:00.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.556+0000 7f8af8d1c700 1 -- 172.21.15.7:0/2739698 shutdown_connections 2023-10-06T10:59:00.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.556+0000 7f8af8d1c700 1 -- 172.21.15.7:0/2739698 wait complete. 2023-10-06T10:59:00.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.557+0000 7f8af8d1c700 1 Processor -- start 2023-10-06T10:59:00.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.557+0000 7f8af8d1c700 1 -- start start 2023-10-06T10:59:00.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af8d1c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8af406dac0 0x7f8af4168750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:00.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af8d1c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af406de90 0x7f8af40b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:00.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af8d1c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8af415b190 0x7f8af40b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:00.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af8d1c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4168c90 con 0x7f8af406de90 2023-10-06T10:59:00.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af8d1c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40b1c90 con 0x7f8af406dac0 2023-10-06T10:59:00.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af8d1c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40b1080 con 0x7f8af415b190 2023-10-06T10:59:00.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af1d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af406de90 0x7f8af40b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:00.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af1d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af406de90 0x7f8af40b2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54868/0 (socket says 172.21.15.7:54868) 2023-10-06T10:59:00.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af1d9b700 1 -- 172.21.15.7:0/1887201005 learned_addr learned my addr 172.21.15.7:0/1887201005 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:00.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af259c700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8af406dac0 0x7f8af4168750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:00.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af2d9d700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8af415b190 0x7f8af40b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:00.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af1d9b700 1 -- 172.21.15.7:0/1887201005 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8af415b190 msgr2=0x7f8af40b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:00.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af1d9b700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8af415b190 0x7f8af40b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:00.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af1d9b700 1 -- 172.21.15.7:0/1887201005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8af406dac0 msgr2=0x7f8af4168750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:00.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af1d9b700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8af406dac0 0x7f8af4168750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:00.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af1d9b700 1 -- 172.21.15.7:0/1887201005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae80094f0 con 0x7f8af406de90 2023-10-06T10:59:00.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.558+0000 7f8af2d9d700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8af415b190 0x7f8af40b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:00.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.559+0000 7f8af1d9b700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af406de90 0x7f8af40b2c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c5c0 tx=0x7f8ae400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:00.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.559+0000 7f8ae27fc700 1 -- 172.21.15.7:0/1887201005 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4011590 con 0x7f8af406de90 2023-10-06T10:59:00.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.559+0000 7f8ae27fc700 1 -- 172.21.15.7:0/1887201005 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae4011710 con 0x7f8af406de90 2023-10-06T10:59:00.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.559+0000 7f8af8d1c700 1 -- 172.21.15.7:0/1887201005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af40b1360 con 0x7f8af406de90 2023-10-06T10:59:00.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.559+0000 7f8ae27fc700 1 -- 172.21.15.7:0/1887201005 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4011ad0 con 0x7f8af406de90 2023-10-06T10:59:00.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.559+0000 7f8af8d1c700 1 -- 172.21.15.7:0/1887201005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af40b1920 con 0x7f8af406de90 2023-10-06T10:59:00.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.560+0000 7f8af8d1c700 1 -- 172.21.15.7:0/1887201005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af4070480 con 0x7f8af406de90 2023-10-06T10:59:00.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.560+0000 7f8ae27fc700 1 -- 172.21.15.7:0/1887201005 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ae401b3b0 con 0x7f8af406de90 2023-10-06T10:59:00.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.561+0000 7f8ae27fc700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8ad4066f30 0x7f8ad40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:00.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.561+0000 7f8ae27fc700 1 -- 172.21.15.7:0/1887201005 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f8ae4083a50 con 0x7f8af406de90 2023-10-06T10:59:00.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.561+0000 7f8af259c700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8ad4066f30 0x7f8ad40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:00.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.561+0000 7f8af259c700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8ad4066f30 0x7f8ad40693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8af40c84f0 tx=0x7f8ae8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:00.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.566+0000 7f8ae27fc700 1 -- 172.21.15.7:0/1887201005 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ae4050d40 con 0x7f8af406de90 2023-10-06T10:59:00.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:00.770+0000 7f8af8d1c700 1 -- 172.21.15.7:0/1887201005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f8af40b1dd0 con 0x7f8af406de90 2023-10-06T10:59:01.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.403+0000 7f8ae27fc700 1 -- 172.21.15.7:0/1887201005 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f8ae4017070 con 0x7f8af406de90 2023-10-06T10:59:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.410+0000 7f8af8d1c700 1 -- 172.21.15.7:0/1887201005 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8ad4066f30 msgr2=0x7f8ad40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.410+0000 7f8af8d1c700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8ad4066f30 0x7f8ad40693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8af40c84f0 tx=0x7f8ae8017000 comp rx=0 tx=0).stop 2023-10-06T10:59:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.410+0000 7f8af8d1c700 1 -- 172.21.15.7:0/1887201005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af406de90 msgr2=0x7f8af40b2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.410+0000 7f8af8d1c700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af406de90 0x7f8af40b2c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c5c0 tx=0x7f8ae400c8d0 comp rx=0 tx=0).stop 2023-10-06T10:59:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.411+0000 7f8af8d1c700 1 -- 172.21.15.7:0/1887201005 shutdown_connections 2023-10-06T10:59:01.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.411+0000 7f8af8d1c700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8ad4066f30 0x7f8ad40693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:01.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.411+0000 7f8af8d1c700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8af415b190 0x7f8af40b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:01.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.411+0000 7f8af8d1c700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8af406dac0 0x7f8af4168750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:01.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.411+0000 7f8af8d1c700 1 --2- 172.21.15.7:0/1887201005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af406de90 0x7f8af40b2c20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:01.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.411+0000 7f8af8d1c700 1 -- 172.21.15.7:0/1887201005 >> 172.21.15.7:0/1887201005 conn(0x7f8af406cd00 msgr2=0x7f8af4153730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.415+0000 7f8af8d1c700 1 -- 172.21.15.7:0/1887201005 shutdown_connections 2023-10-06T10:59:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.415+0000 7f8af8d1c700 1 -- 172.21.15.7:0/1887201005 wait complete. 2023-10-06T10:59:01.419 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-06T10:59:01.433 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T10:59:01.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.569+0000 7ff20ed0e700 1 Processor -- start 2023-10-06T10:59:01.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.569+0000 7ff20ed0e700 1 -- start start 2023-10-06T10:59:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.570+0000 7ff20ed0e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff2080cab40 0x7ff2080694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.570+0000 7ff20ed0e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2080caf10 0x7ff2080b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.570+0000 7ff20ed0e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2080699e0 con 0x7ff2080b2260 2023-10-06T10:59:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.570+0000 7ff20ed0e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff208069dd0 con 0x7ff2080cab40 2023-10-06T10:59:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.570+0000 7ff20ed0e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20806a070 con 0x7ff2080caf10 2023-10-06T10:59:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.571+0000 7ff20caaa700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff2080cab40 0x7ff2080694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.571+0000 7ff20d2ab700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff2080b2260 0x7ff208159dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36156/0 (socket says 172.21.15.7:36156) 2023-10-06T10:59:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.571+0000 7ff20d2ab700 1 -- 172.21.15.7:0/1040509147 learned_addr learned my addr 172.21.15.7:0/1040509147 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.571+0000 7ff20caaa700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff2080cab40 0x7ff2080694a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54882/0 (socket says 172.21.15.7:54882) 2023-10-06T10:59:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.571+0000 7ff207fff700 1 --2- 172.21.15.7:0/1040509147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2080caf10 0x7ff2080b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.571+0000 7ff20caaa700 1 -- 172.21.15.7:0/1040509147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2080caf10 msgr2=0x7ff2080b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.571+0000 7ff20caaa700 1 --2- 172.21.15.7:0/1040509147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2080caf10 0x7ff2080b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.571+0000 7ff20caaa700 1 -- 172.21.15.7:0/1040509147 >> v1:172.21.15.7:6789/0 conn(0x7ff2080b2260 legacy=0x7ff208159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.571+0000 7ff2077fe700 1 -- 172.21.15.7:0/1040509147 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757781851 0 0) 0x7ff2080699e0 con 0x7ff2080b2260 2023-10-06T10:59:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.571+0000 7ff20caaa700 1 -- 172.21.15.7:0/1040509147 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20806a350 con 0x7ff2080cab40 2023-10-06T10:59:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.571+0000 7ff20caaa700 1 --2- 172.21.15.7:0/1040509147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2080cab40 0x7ff2080694a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800bb90 tx=0x7ff1f800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db65afe27485243 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.571+0000 7ff2077fe700 1 -- 172.21.15.7:0/1040509147 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f800dba0 con 0x7ff2080cab40 2023-10-06T10:59:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.571+0000 7ff2077fe700 1 -- 172.21.15.7:0/1040509147 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f800dd00 con 0x7ff2080cab40 2023-10-06T10:59:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.571+0000 7ff2077fe700 1 -- 172.21.15.7:0/1040509147 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80196b0 con 0x7ff2080cab40 2023-10-06T10:59:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.572+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1040509147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2080cab40 msgr2=0x7ff2080694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.572+0000 7ff20ed0e700 1 --2- 172.21.15.7:0/1040509147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2080cab40 0x7ff2080694a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800bb90 tx=0x7ff1f800b430 comp rx=0 tx=0).stop 2023-10-06T10:59:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.572+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1040509147 shutdown_connections 2023-10-06T10:59:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.572+0000 7ff20ed0e700 1 --2- 172.21.15.7:0/1040509147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2080cab40 0x7ff2080694a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.572+0000 7ff20ed0e700 1 --2- 172.21.15.7:0/1040509147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2080caf10 0x7ff2080b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.572+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1040509147 >> 172.21.15.7:0/1040509147 conn(0x7ff2080afc90 msgr2=0x7ff2080b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:01.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.572+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1040509147 shutdown_connections 2023-10-06T10:59:01.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.572+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1040509147 wait complete. 2023-10-06T10:59:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.573+0000 7ff20ed0e700 1 Processor -- start 2023-10-06T10:59:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.573+0000 7ff20ed0e700 1 -- start start 2023-10-06T10:59:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.574+0000 7ff20ed0e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2080b2260 0x7ff208155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.574+0000 7ff20ed0e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2080cab40 0x7ff2080ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.574+0000 7ff20ed0e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2080caf10 0x7ff20814e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.574+0000 7ff20ed0e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2080c8eb0 con 0x7ff2080b2260 2023-10-06T10:59:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.574+0000 7ff20ed0e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2080c99c0 con 0x7ff2080cab40 2023-10-06T10:59:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.574+0000 7ff20ed0e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2080aeb80 con 0x7ff2080caf10 2023-10-06T10:59:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.574+0000 7ff20caaa700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2080b2260 0x7ff208155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.574+0000 7ff20caaa700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2080b2260 0x7ff208155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54896/0 (socket says 172.21.15.7:54896) 2023-10-06T10:59:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.574+0000 7ff20caaa700 1 -- 172.21.15.7:0/1047515865 learned_addr learned my addr 172.21.15.7:0/1047515865 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.575+0000 7ff207fff700 1 --2- 172.21.15.7:0/1047515865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2080cab40 0x7ff2080ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.575+0000 7ff20d2ab700 1 --2- 172.21.15.7:0/1047515865 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2080caf10 0x7ff20814e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.575+0000 7ff20caaa700 1 -- 172.21.15.7:0/1047515865 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2080caf10 msgr2=0x7ff20814e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.575+0000 7ff20caaa700 1 --2- 172.21.15.7:0/1047515865 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2080caf10 0x7ff20814e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.575+0000 7ff20caaa700 1 -- 172.21.15.7:0/1047515865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2080cab40 msgr2=0x7ff2080ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.575+0000 7ff20caaa700 1 --2- 172.21.15.7:0/1047515865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2080cab40 0x7ff2080ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.575+0000 7ff20caaa700 1 -- 172.21.15.7:0/1047515865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f800b6d0 con 0x7ff2080b2260 2023-10-06T10:59:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.575+0000 7ff20caaa700 1 --2- 172.21.15.7:0/1047515865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2080b2260 0x7ff208155500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800b6a0 tx=0x7ff1f801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.575+0000 7ff204ff9700 1 -- 172.21.15.7:0/1047515865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80106c0 con 0x7ff2080b2260 2023-10-06T10:59:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.575+0000 7ff204ff9700 1 -- 172.21.15.7:0/1047515865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f8010820 con 0x7ff2080b2260 2023-10-06T10:59:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.575+0000 7ff204ff9700 1 -- 172.21.15.7:0/1047515865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8010bc0 con 0x7ff2080b2260 2023-10-06T10:59:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.575+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1047515865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2080c9090 con 0x7ff2080b2260 2023-10-06T10:59:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.575+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1047515865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2080c9650 con 0x7ff2080b2260 2023-10-06T10:59:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.576+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1047515865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff208070480 con 0x7ff2080b2260 2023-10-06T10:59:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.577+0000 7ff204ff9700 1 -- 172.21.15.7:0/1047515865 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1f8024420 con 0x7ff2080b2260 2023-10-06T10:59:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.577+0000 7ff204ff9700 1 --2- 172.21.15.7:0/1047515865 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff1e8066f30 0x7ff1e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.577+0000 7ff204ff9700 1 -- 172.21.15.7:0/1047515865 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5958+0+0 (secure 0 0 0) 0x7ff1f8020070 con 0x7ff2080b2260 2023-10-06T10:59:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.577+0000 7ff207fff700 1 --2- 172.21.15.7:0/1047515865 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff1e8066f30 0x7ff1e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.578+0000 7ff207fff700 1 --2- 172.21.15.7:0/1047515865 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff1e8066f30 0x7ff1e80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0006fd0 tx=0x7ff1f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.582+0000 7ff204ff9700 1 -- 172.21.15.7:0/1047515865 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1f8053a30 con 0x7ff2080b2260 2023-10-06T10:59:01.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:01.831+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1047515865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff2080c7360 con 0x7ff2080b2260 2023-10-06T10:59:02.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.423+0000 7ff204ff9700 1 -- 172.21.15.7:0/1047515865 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff1f8057050 con 0x7ff2080b2260 2023-10-06T10:59:02.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.436+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1047515865 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff1e8066f30 msgr2=0x7ff1e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:02.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.436+0000 7ff20ed0e700 1 --2- 172.21.15.7:0/1047515865 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff1e8066f30 0x7ff1e80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0006fd0 tx=0x7ff1f0008040 comp rx=0 tx=0).stop 2023-10-06T10:59:02.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.436+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1047515865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2080b2260 msgr2=0x7ff208155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:02.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.436+0000 7ff20ed0e700 1 --2- 172.21.15.7:0/1047515865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2080b2260 0x7ff208155500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800b6a0 tx=0x7ff1f801b000 comp rx=0 tx=0).stop 2023-10-06T10:59:02.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.437+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1047515865 shutdown_connections 2023-10-06T10:59:02.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.437+0000 7ff20ed0e700 1 --2- 172.21.15.7:0/1047515865 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff1e8066f30 0x7ff1e80693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:02.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.437+0000 7ff20ed0e700 1 --2- 172.21.15.7:0/1047515865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2080b2260 0x7ff208155500 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:02.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.437+0000 7ff20ed0e700 1 --2- 172.21.15.7:0/1047515865 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2080caf10 0x7ff20814e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:02.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.437+0000 7ff20ed0e700 1 --2- 172.21.15.7:0/1047515865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2080cab40 0x7ff2080ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:02.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.437+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1047515865 >> 172.21.15.7:0/1047515865 conn(0x7ff2080afc90 msgr2=0x7ff208151380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:02.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.438+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1047515865 shutdown_connections 2023-10-06T10:59:02.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.440+0000 7ff20ed0e700 1 -- 172.21.15.7:0/1047515865 wait complete. 2023-10-06T10:59:02.446 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T10:59:02.459 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-06T10:59:02.460 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-06T10:59:02.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.598+0000 7f390963f700 1 Processor -- start 2023-10-06T10:59:02.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.598+0000 7f390963f700 1 -- start start 2023-10-06T10:59:02.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.599+0000 7f390963f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39040af320 0x7f39040cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:02.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.599+0000 7f390963f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39040cb580 0x7f3904068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:02.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.599+0000 7f390963f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39040cfb50 0x7f3904069420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:02.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.599+0000 7f390963f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3904159c00 con 0x7f39040af320 2023-10-06T10:59:02.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.599+0000 7f390963f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39040cf6c0 con 0x7f39040cb580 2023-10-06T10:59:02.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.599+0000 7f390963f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39040ceab0 con 0x7f39040cfb50 2023-10-06T10:59:02.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.599+0000 7f3902ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39040af320 0x7f39040cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:02.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.599+0000 7f3902ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39040af320 0x7f39040cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54910/0 (socket says 172.21.15.7:54910) 2023-10-06T10:59:02.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.599+0000 7f3902ffd700 1 -- 172.21.15.7:0/588516572 learned_addr learned my addr 172.21.15.7:0/588516572 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.599+0000 7f39027fc700 1 --2- 172.21.15.7:0/588516572 >> v2:172.21.15.50:3300/0 conn(0x7f39040cb580 0x7f3904068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.599+0000 7f39037fe700 1 --2- 172.21.15.7:0/588516572 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39040cfb50 0x7f3904069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.600+0000 7f3902ffd700 1 -- 172.21.15.7:0/588516572 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39040cfb50 msgr2=0x7f3904069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.600+0000 7f3902ffd700 1 --2- 172.21.15.7:0/588516572 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39040cfb50 0x7f3904069420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.600+0000 7f3902ffd700 1 -- 172.21.15.7:0/588516572 >> v2:172.21.15.50:3300/0 conn(0x7f39040cb580 msgr2=0x7f3904068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.600+0000 7f3902ffd700 1 --2- 172.21.15.7:0/588516572 >> v2:172.21.15.50:3300/0 conn(0x7f39040cb580 0x7f3904068ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.600+0000 7f3902ffd700 1 -- 172.21.15.7:0/588516572 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39040ced90 con 0x7f39040af320 2023-10-06T10:59:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.600+0000 7f3902ffd700 1 --2- 172.21.15.7:0/588516572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040af320 0x7f39040cb040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f39040cdc00 tx=0x7f38f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce55438e463a952e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.600+0000 7f3901ffb700 1 -- 172.21.15.7:0/588516572 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f400b6d0 con 0x7f39040af320 2023-10-06T10:59:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.600+0000 7f3901ffb700 1 -- 172.21.15.7:0/588516572 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f400b830 con 0x7f39040af320 2023-10-06T10:59:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.600+0000 7f3901ffb700 1 -- 172.21.15.7:0/588516572 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f400bbf0 con 0x7f39040af320 2023-10-06T10:59:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.601+0000 7f390963f700 1 -- 172.21.15.7:0/588516572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040af320 msgr2=0x7f39040cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.601+0000 7f390963f700 1 --2- 172.21.15.7:0/588516572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040af320 0x7f39040cb040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f39040cdc00 tx=0x7f38f4009250 comp rx=0 tx=0).stop 2023-10-06T10:59:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.601+0000 7f390963f700 1 -- 172.21.15.7:0/588516572 shutdown_connections 2023-10-06T10:59:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.601+0000 7f390963f700 1 --2- 172.21.15.7:0/588516572 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39040cfb50 0x7f3904069420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.601+0000 7f390963f700 1 --2- 172.21.15.7:0/588516572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040af320 0x7f39040cb040 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.601+0000 7f390963f700 1 --2- 172.21.15.7:0/588516572 >> v2:172.21.15.50:3300/0 conn(0x7f39040cb580 0x7f3904068ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.601+0000 7f390963f700 1 -- 172.21.15.7:0/588516572 >> 172.21.15.7:0/588516572 conn(0x7f3904067b80 msgr2=0x7f39040d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.601+0000 7f390963f700 1 -- 172.21.15.7:0/588516572 shutdown_connections 2023-10-06T10:59:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.601+0000 7f390963f700 1 -- 172.21.15.7:0/588516572 wait complete. 2023-10-06T10:59:02.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.602+0000 7f390963f700 1 Processor -- start 2023-10-06T10:59:02.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.602+0000 7f390963f700 1 -- start start 2023-10-06T10:59:02.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f390963f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040af320 0x7f39040b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:02.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f390963f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39040cb580 0x7f39040afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:02.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f390963f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39040cfb50 0x7f3904152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:02.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f390963f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390415cbd0 con 0x7f39040af320 2023-10-06T10:59:02.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f390963f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39041696c0 con 0x7f39040cb580 2023-10-06T10:59:02.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f390963f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390415c050 con 0x7f39040cfb50 2023-10-06T10:59:02.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f3902ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040af320 0x7f39040b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:02.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f3902ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040af320 0x7f39040b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54922/0 (socket says 172.21.15.7:54922) 2023-10-06T10:59:02.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f3902ffd700 1 -- 172.21.15.7:0/2679138653 learned_addr learned my addr 172.21.15.7:0/2679138653 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:02.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f39037fe700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39040cfb50 0x7f3904152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:02.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f39027fc700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39040cb580 0x7f39040afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:02.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f3902ffd700 1 -- 172.21.15.7:0/2679138653 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39040cfb50 msgr2=0x7f3904152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:02.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f3902ffd700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39040cfb50 0x7f3904152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:02.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f3902ffd700 1 -- 172.21.15.7:0/2679138653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39040cb580 msgr2=0x7f39040afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f3902ffd700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39040cb580 0x7f39040afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.603+0000 7f3902ffd700 1 -- 172.21.15.7:0/2679138653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f40094f0 con 0x7f39040af320 2023-10-06T10:59:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.604+0000 7f39027fc700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39040cb580 0x7f39040afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.604+0000 7f3902ffd700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040af320 0x7f39040b3fd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f390406fad0 tx=0x7f38f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.604+0000 7f38faffd700 1 -- 172.21.15.7:0/2679138653 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f400bbb0 con 0x7f39040af320 2023-10-06T10:59:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.604+0000 7f38faffd700 1 -- 172.21.15.7:0/2679138653 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f4011420 con 0x7f39040af320 2023-10-06T10:59:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.604+0000 7f390963f700 1 -- 172.21.15.7:0/2679138653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390415c330 con 0x7f39040af320 2023-10-06T10:59:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.604+0000 7f38faffd700 1 -- 172.21.15.7:0/2679138653 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40117c0 con 0x7f39040af320 2023-10-06T10:59:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.604+0000 7f390963f700 1 -- 172.21.15.7:0/2679138653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390415c8f0 con 0x7f39040af320 2023-10-06T10:59:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.605+0000 7f390963f700 1 -- 172.21.15.7:0/2679138653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3904169880 con 0x7f39040af320 2023-10-06T10:59:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.605+0000 7f38faffd700 1 -- 172.21.15.7:0/2679138653 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38f4011b30 con 0x7f39040af320 2023-10-06T10:59:02.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.606+0000 7f38faffd700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f38e4066f30 0x7f38e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:02.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.606+0000 7f38faffd700 1 -- 172.21.15.7:0/2679138653 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f38f4085fc0 con 0x7f39040af320 2023-10-06T10:59:02.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.606+0000 7f39027fc700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f38e4066f30 0x7f38e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:02.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.606+0000 7f39027fc700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f38e4066f30 0x7f38e40693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f38ec006f00 tx=0x7f38ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:02.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.610+0000 7f38faffd700 1 -- 172.21.15.7:0/2679138653 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3904169880 con 0x7f39040af320 2023-10-06T10:59:02.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:02.823+0000 7f390963f700 1 -- 172.21.15.7:0/2679138653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f3904169880 con 0x7f39040af320 2023-10-06T10:59:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.422+0000 7f38faffd700 1 -- 172.21.15.7:0/2679138653 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f3904169880 con 0x7f39040af320 2023-10-06T10:59:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.425+0000 7f390963f700 1 -- 172.21.15.7:0/2679138653 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f38e4066f30 msgr2=0x7f38e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.425+0000 7f390963f700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f38e4066f30 0x7f38e40693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f38ec006f00 tx=0x7f38ec008040 comp rx=0 tx=0).stop 2023-10-06T10:59:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.425+0000 7f390963f700 1 -- 172.21.15.7:0/2679138653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040af320 msgr2=0x7f39040b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.425+0000 7f390963f700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040af320 0x7f39040b3fd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f390406fad0 tx=0x7f38f4017000 comp rx=0 tx=0).stop 2023-10-06T10:59:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.425+0000 7f390963f700 1 -- 172.21.15.7:0/2679138653 shutdown_connections 2023-10-06T10:59:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.425+0000 7f390963f700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f38e4066f30 0x7f38e40693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.425+0000 7f390963f700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040af320 0x7f39040b3fd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.425+0000 7f390963f700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39040cfb50 0x7f3904152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.425+0000 7f390963f700 1 --2- 172.21.15.7:0/2679138653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39040cb580 0x7f39040afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.425+0000 7f390963f700 1 -- 172.21.15.7:0/2679138653 >> 172.21.15.7:0/2679138653 conn(0x7f3904067b80 msgr2=0x7f3904154170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.425+0000 7f390963f700 1 -- 172.21.15.7:0/2679138653 shutdown_connections 2023-10-06T10:59:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.425+0000 7f390963f700 1 -- 172.21.15.7:0/2679138653 wait complete. 2023-10-06T10:59:03.442 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T10:59:03.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.583+0000 7fea2b97d700 1 Processor -- start 2023-10-06T10:59:03.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.584+0000 7fea2b97d700 1 -- start start 2023-10-06T10:59:03.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.584+0000 7fea2b97d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fea24157330 0x7fea240aa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:03.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea2b97d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea240c3b90 con 0x7fea240ccae0 2023-10-06T10:59:03.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea2b97d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea240c2ca0 con 0x7fea240c8e90 2023-10-06T10:59:03.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea2b97d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea240c2f80 con 0x7fea24157330 2023-10-06T10:59:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea29719700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fea24157330 0x7fea240aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea29f1a700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fea240ccae0 0x7fea240c4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36166/0 (socket says 172.21.15.7:36166) 2023-10-06T10:59:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea29f1a700 1 -- 172.21.15.7:0/2464994208 learned_addr learned my addr 172.21.15.7:0/2464994208 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea1bfff700 1 -- 172.21.15.7:0/2464994208 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275630420 0 0) 0x7fea240c3b90 con 0x7fea240ccae0 2023-10-06T10:59:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea1bfff700 1 -- 172.21.15.7:0/2464994208 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea10003570 con 0x7fea240ccae0 2023-10-06T10:59:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea29719700 1 -- 172.21.15.7:0/2464994208 >> v1:172.21.15.50:6789/0 conn(0x7fea240c8e90 legacy=0x7fea240c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea29719700 1 -- 172.21.15.7:0/2464994208 >> v1:172.21.15.7:6789/0 conn(0x7fea240ccae0 legacy=0x7fea240c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea29719700 1 -- 172.21.15.7:0/2464994208 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea240c3260 con 0x7fea24157330 2023-10-06T10:59:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea29719700 1 --2- 172.21.15.7:0/2464994208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea24157330 0x7fea240aa970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea20009910 tx=0x7fea200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7d1990c04102fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea1bfff700 1 -- 172.21.15.7:0/2464994208 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2000b640 con 0x7fea24157330 2023-10-06T10:59:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea1bfff700 1 -- 172.21.15.7:0/2464994208 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2000b7a0 con 0x7fea24157330 2023-10-06T10:59:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.585+0000 7fea1bfff700 1 -- 172.21.15.7:0/2464994208 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2000bb60 con 0x7fea24157330 2023-10-06T10:59:03.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.586+0000 7fea2b97d700 1 -- 172.21.15.7:0/2464994208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea24157330 msgr2=0x7fea240aa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.586+0000 7fea2b97d700 1 --2- 172.21.15.7:0/2464994208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea24157330 0x7fea240aa970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea20009910 tx=0x7fea200091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.586+0000 7fea2b97d700 1 -- 172.21.15.7:0/2464994208 shutdown_connections 2023-10-06T10:59:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.586+0000 7fea2b97d700 1 --2- 172.21.15.7:0/2464994208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea24157330 0x7fea240aa970 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.586+0000 7fea2b97d700 1 -- 172.21.15.7:0/2464994208 >> 172.21.15.7:0/2464994208 conn(0x7fea2406b480 msgr2=0x7fea240cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.586+0000 7fea2b97d700 1 -- 172.21.15.7:0/2464994208 shutdown_connections 2023-10-06T10:59:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.586+0000 7fea2b97d700 1 -- 172.21.15.7:0/2464994208 wait complete. 2023-10-06T10:59:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.587+0000 7fea2b97d700 1 Processor -- start 2023-10-06T10:59:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.587+0000 7fea2b97d700 1 -- start start 2023-10-06T10:59:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.588+0000 7fea2b97d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea240c8e90 0x7fea240b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.588+0000 7fea2b97d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea240ccae0 0x7fea2414da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.588+0000 7fea2b97d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea24157330 0x7fea24158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.588+0000 7fea2b97d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240b11e0 con 0x7fea24157330 2023-10-06T10:59:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.588+0000 7fea2b97d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea24068cc0 con 0x7fea240ccae0 2023-10-06T10:59:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.588+0000 7fea2b97d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea240b1cb0 con 0x7fea240c8e90 2023-10-06T10:59:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.588+0000 7fea29f1a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea24157330 0x7fea24158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.588+0000 7fea29f1a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea24157330 0x7fea24158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54948/0 (socket says 172.21.15.7:54948) 2023-10-06T10:59:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.588+0000 7fea29f1a700 1 -- 172.21.15.7:0/405181924 learned_addr learned my addr 172.21.15.7:0/405181924 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.589+0000 7fea29719700 1 --2- 172.21.15.7:0/405181924 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea240c8e90 0x7fea240b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.589+0000 7fea28f18700 1 --2- 172.21.15.7:0/405181924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea240ccae0 0x7fea2414da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.589+0000 7fea29f1a700 1 -- 172.21.15.7:0/405181924 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea240c8e90 msgr2=0x7fea240b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.589+0000 7fea29f1a700 1 --2- 172.21.15.7:0/405181924 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea240c8e90 0x7fea240b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.589+0000 7fea29f1a700 1 -- 172.21.15.7:0/405181924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea240ccae0 msgr2=0x7fea2414da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.589+0000 7fea29f1a700 1 --2- 172.21.15.7:0/405181924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea240ccae0 0x7fea2414da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.589+0000 7fea29f1a700 1 -- 172.21.15.7:0/405181924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea20009420 con 0x7fea24157330 2023-10-06T10:59:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.589+0000 7fea29f1a700 1 --2- 172.21.15.7:0/405181924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea24157330 0x7fea24158b60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fea1c001460 tx=0x7fea1c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.589+0000 7fea197fa700 1 -- 172.21.15.7:0/405181924 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c00ce80 con 0x7fea24157330 2023-10-06T10:59:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.589+0000 7fea197fa700 1 -- 172.21.15.7:0/405181924 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c00ab70 con 0x7fea24157330 2023-10-06T10:59:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.589+0000 7fea2b97d700 1 -- 172.21.15.7:0/405181924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea240b1410 con 0x7fea24157330 2023-10-06T10:59:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.589+0000 7fea197fa700 1 -- 172.21.15.7:0/405181924 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0070f0 con 0x7fea24157330 2023-10-06T10:59:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.589+0000 7fea2b97d700 1 -- 172.21.15.7:0/405181924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea240b19d0 con 0x7fea24157330 2023-10-06T10:59:03.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.590+0000 7fea2b97d700 1 -- 172.21.15.7:0/405181924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea24068e50 con 0x7fea24157330 2023-10-06T10:59:03.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.591+0000 7fea197fa700 1 -- 172.21.15.7:0/405181924 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea1c007520 con 0x7fea24157330 2023-10-06T10:59:03.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.591+0000 7fea197fa700 1 --2- 172.21.15.7:0/405181924 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fea08066f30 0x7fea080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:03.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.591+0000 7fea197fa700 1 -- 172.21.15.7:0/405181924 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6284+0+0 (secure 0 0 0) 0x7fea1c084cd0 con 0x7fea24157330 2023-10-06T10:59:03.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.591+0000 7fea29719700 1 --2- 172.21.15.7:0/405181924 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fea08066f30 0x7fea080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:03.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.592+0000 7fea29719700 1 --2- 172.21.15.7:0/405181924 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fea08066f30 0x7fea080693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea200093f0 tx=0x7fea20017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:03.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.596+0000 7fea197fa700 1 -- 172.21.15.7:0/405181924 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea1c051cf0 con 0x7fea24157330 2023-10-06T10:59:03.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:03.799+0000 7fea2b97d700 1 -- 172.21.15.7:0/405181924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fea24070480 con 0x7fea24157330 2023-10-06T10:59:05.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.479+0000 7fea197fa700 1 -- 172.21.15.7:0/405181924 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7fea1c055310 con 0x7fea24157330 2023-10-06T10:59:05.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.485+0000 7fea2b97d700 1 -- 172.21.15.7:0/405181924 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fea08066f30 msgr2=0x7fea080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:05.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.485+0000 7fea2b97d700 1 --2- 172.21.15.7:0/405181924 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fea08066f30 0x7fea080693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea200093f0 tx=0x7fea20017000 comp rx=0 tx=0).stop 2023-10-06T10:59:05.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.485+0000 7fea2b97d700 1 -- 172.21.15.7:0/405181924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea24157330 msgr2=0x7fea24158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:05.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.485+0000 7fea2b97d700 1 --2- 172.21.15.7:0/405181924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea24157330 0x7fea24158b60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fea1c001460 tx=0x7fea1c001ae0 comp rx=0 tx=0).stop 2023-10-06T10:59:05.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.492+0000 7fea2b97d700 1 -- 172.21.15.7:0/405181924 shutdown_connections 2023-10-06T10:59:05.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.492+0000 7fea2b97d700 1 --2- 172.21.15.7:0/405181924 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fea08066f30 0x7fea080693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:05.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.492+0000 7fea2b97d700 1 --2- 172.21.15.7:0/405181924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea24157330 0x7fea24158b60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:05.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.492+0000 7fea2b97d700 1 --2- 172.21.15.7:0/405181924 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea240c8e90 0x7fea240b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:05.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.492+0000 7fea2b97d700 1 --2- 172.21.15.7:0/405181924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea240ccae0 0x7fea2414da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:05.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.492+0000 7fea2b97d700 1 -- 172.21.15.7:0/405181924 >> 172.21.15.7:0/405181924 conn(0x7fea2406b480 msgr2=0x7fea241553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:05.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.492+0000 7fea2b97d700 1 -- 172.21.15.7:0/405181924 shutdown_connections 2023-10-06T10:59:05.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.492+0000 7fea2b97d700 1 -- 172.21.15.7:0/405181924 wait complete. 2023-10-06T10:59:05.495 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data_ec' created 2023-10-06T10:59:05.509 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-06T10:59:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.646+0000 7f4f95660700 1 Processor -- start 2023-10-06T10:59:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.646+0000 7f4f95660700 1 -- start start 2023-10-06T10:59:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.647+0000 7f4f95660700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4f900af320 0x7f4f900cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.647+0000 7f4f95660700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f900695f0 0x7f4f900afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.647+0000 7f4f95660700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f900cf6c0 con 0x7f4f900cb580 2023-10-06T10:59:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.647+0000 7f4f95660700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f90159c00 con 0x7f4f900695f0 2023-10-06T10:59:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.647+0000 7f4f95660700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900ceab0 con 0x7f4f900af320 2023-10-06T10:59:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.647+0000 7f4f8effd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4f900af320 0x7f4f900cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.647+0000 7f4f8f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f900695f0 0x7f4f900afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.648+0000 7f4f8effd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4f900af320 0x7f4f900cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:59404/0 (socket says 172.21.15.7:59404) 2023-10-06T10:59:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.648+0000 7f4f8effd700 1 -- 172.21.15.7:0/4116683256 learned_addr learned my addr 172.21.15.7:0/4116683256 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.648+0000 7f4f8f7fe700 1 -- 172.21.15.7:0/4116683256 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4f900af320 msgr2=0x7f4f900cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.648+0000 7f4f8f7fe700 1 --2- 172.21.15.7:0/4116683256 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4f900af320 0x7f4f900cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.648+0000 7f4f8f7fe700 1 -- 172.21.15.7:0/4116683256 >> v1:172.21.15.50:6789/0 conn(0x7f4f900cb580 legacy=0x7f4f90068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.648+0000 7f4f8f7fe700 1 -- 172.21.15.7:0/4116683256 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f900ced90 con 0x7f4f900695f0 2023-10-06T10:59:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.648+0000 7f4f8dffb700 1 -- 172.21.15.7:0/4116683256 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610425522 0 0) 0x7f4f900cf6c0 con 0x7f4f900cb580 2023-10-06T10:59:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.648+0000 7f4f8effd700 1 --2- 172.21.15.7:0/4116683256 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4f900af320 0x7f4f900cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:59:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.648+0000 7f4f8f7fe700 1 --2- 172.21.15.7:0/4116683256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f900695f0 0x7f4f900afc90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009e60 tx=0x7f4f88009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91436a027cbe4cc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.648+0000 7f4f8dffb700 1 -- 172.21.15.7:0/4116683256 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800e070 con 0x7f4f900695f0 2023-10-06T10:59:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.648+0000 7f4f8dffb700 1 -- 172.21.15.7:0/4116683256 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8800bbf0 con 0x7f4f900695f0 2023-10-06T10:59:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.648+0000 7f4f8dffb700 1 -- 172.21.15.7:0/4116683256 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f88012430 con 0x7f4f900695f0 2023-10-06T10:59:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.649+0000 7f4f95660700 1 -- 172.21.15.7:0/4116683256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f900695f0 msgr2=0x7f4f900afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.649+0000 7f4f95660700 1 --2- 172.21.15.7:0/4116683256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f900695f0 0x7f4f900afc90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009e60 tx=0x7f4f88009780 comp rx=0 tx=0).stop 2023-10-06T10:59:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.649+0000 7f4f95660700 1 -- 172.21.15.7:0/4116683256 shutdown_connections 2023-10-06T10:59:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.649+0000 7f4f95660700 1 --2- 172.21.15.7:0/4116683256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f900695f0 0x7f4f900afc90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.649+0000 7f4f95660700 1 --2- 172.21.15.7:0/4116683256 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4f900af320 0x7f4f900cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.649+0000 7f4f95660700 1 -- 172.21.15.7:0/4116683256 >> 172.21.15.7:0/4116683256 conn(0x7f4f90067b80 msgr2=0x7f4f900d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.649+0000 7f4f95660700 1 -- 172.21.15.7:0/4116683256 shutdown_connections 2023-10-06T10:59:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.649+0000 7f4f95660700 1 -- 172.21.15.7:0/4116683256 wait complete. 2023-10-06T10:59:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.651+0000 7f4f95660700 1 Processor -- start 2023-10-06T10:59:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.651+0000 7f4f95660700 1 -- start start 2023-10-06T10:59:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.651+0000 7f4f95660700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4f900695f0 0x7f4f900c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.651+0000 7f4f95660700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f900af320 0x7f4f90144190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.651+0000 7f4f95660700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f900cb580 0x7f4f900b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.651+0000 7f4f95660700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b3210 con 0x7f4f900cb580 2023-10-06T10:59:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.651+0000 7f4f95660700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b3480 con 0x7f4f900af320 2023-10-06T10:59:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.651+0000 7f4f95660700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900ca2b0 con 0x7f4f900695f0 2023-10-06T10:59:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f8f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f900cb580 0x7f4f900b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f8f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f900cb580 0x7f4f900b3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54964/0 (socket says 172.21.15.7:54964) 2023-10-06T10:59:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f8f7fe700 1 -- 172.21.15.7:0/1627712049 learned_addr learned my addr 172.21.15.7:0/1627712049 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f8effd700 1 --2- 172.21.15.7:0/1627712049 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4f900695f0 0x7f4f900c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f8e7fc700 1 --2- 172.21.15.7:0/1627712049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f900af320 0x7f4f90144190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f8f7fe700 1 -- 172.21.15.7:0/1627712049 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4f900695f0 msgr2=0x7f4f900c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f8f7fe700 1 --2- 172.21.15.7:0/1627712049 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4f900695f0 0x7f4f900c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f8f7fe700 1 -- 172.21.15.7:0/1627712049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f900af320 msgr2=0x7f4f90144190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f8f7fe700 1 --2- 172.21.15.7:0/1627712049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f900af320 0x7f4f90144190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f8f7fe700 1 -- 172.21.15.7:0/1627712049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f800094f0 con 0x7f4f900cb580 2023-10-06T10:59:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f8f7fe700 1 --2- 172.21.15.7:0/1627712049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f900cb580 0x7f4f900b3910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4f9006fad0 tx=0x7f4f88019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f86ffd700 1 -- 172.21.15.7:0/1627712049 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f88027470 con 0x7f4f900cb580 2023-10-06T10:59:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f86ffd700 1 -- 172.21.15.7:0/1627712049 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f880275d0 con 0x7f4f900cb580 2023-10-06T10:59:05.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f95660700 1 -- 172.21.15.7:0/1627712049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f88009a20 con 0x7f4f900cb580 2023-10-06T10:59:05.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f86ffd700 1 -- 172.21.15.7:0/1627712049 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f88027990 con 0x7f4f900cb580 2023-10-06T10:59:05.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.652+0000 7f4f95660700 1 -- 172.21.15.7:0/1627712049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f900ca870 con 0x7f4f900cb580 2023-10-06T10:59:05.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.654+0000 7f4f95660700 1 -- 172.21.15.7:0/1627712049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f900cc5a0 con 0x7f4f900cb580 2023-10-06T10:59:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.654+0000 7f4f86ffd700 1 -- 172.21.15.7:0/1627712049 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f88024070 con 0x7f4f900cb580 2023-10-06T10:59:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.654+0000 7f4f86ffd700 1 --2- 172.21.15.7:0/1627712049 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4f70066f30 0x7f4f700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.655+0000 7f4f86ffd700 1 -- 172.21.15.7:0/1627712049 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f4f88087140 con 0x7f4f900cb580 2023-10-06T10:59:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.655+0000 7f4f8effd700 1 --2- 172.21.15.7:0/1627712049 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4f70066f30 0x7f4f700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.655+0000 7f4f8effd700 1 --2- 172.21.15.7:0/1627712049 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4f70066f30 0x7f4f700693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4f80006d20 tx=0x7f4f80009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:05.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.659+0000 7f4f86ffd700 1 -- 172.21.15.7:0/1627712049 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f88053ee0 con 0x7f4f900cb580 2023-10-06T10:59:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:05.860+0000 7f4f95660700 1 -- 172.21.15.7:0/1627712049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f4f900b35f0 con 0x7f4f900cb580 2023-10-06T10:59:06.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.488+0000 7f4f86ffd700 1 -- 172.21.15.7:0/1627712049 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4f88057500 con 0x7f4f900cb580 2023-10-06T10:59:06.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.503+0000 7f4f95660700 1 -- 172.21.15.7:0/1627712049 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4f70066f30 msgr2=0x7f4f700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:06.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.503+0000 7f4f95660700 1 --2- 172.21.15.7:0/1627712049 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4f70066f30 0x7f4f700693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4f80006d20 tx=0x7f4f80009250 comp rx=0 tx=0).stop 2023-10-06T10:59:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.503+0000 7f4f95660700 1 -- 172.21.15.7:0/1627712049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f900cb580 msgr2=0x7f4f900b3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.503+0000 7f4f95660700 1 --2- 172.21.15.7:0/1627712049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f900cb580 0x7f4f900b3910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4f9006fad0 tx=0x7f4f88019000 comp rx=0 tx=0).stop 2023-10-06T10:59:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.504+0000 7f4f95660700 1 -- 172.21.15.7:0/1627712049 shutdown_connections 2023-10-06T10:59:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.504+0000 7f4f95660700 1 --2- 172.21.15.7:0/1627712049 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4f70066f30 0x7f4f700693e0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4f80006d20 tx=0x7f4f80009250 comp rx=0 tx=0).stop 2023-10-06T10:59:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.504+0000 7f4f95660700 1 --2- 172.21.15.7:0/1627712049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f900cb580 0x7f4f900b3910 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.504+0000 7f4f95660700 1 --2- 172.21.15.7:0/1627712049 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4f900695f0 0x7f4f900c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.504+0000 7f4f95660700 1 --2- 172.21.15.7:0/1627712049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f900af320 0x7f4f90144190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.504+0000 7f4f95660700 1 -- 172.21.15.7:0/1627712049 >> 172.21.15.7:0/1627712049 conn(0x7f4f90067b80 msgr2=0x7f4f900cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:06.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.510+0000 7f4f95660700 1 -- 172.21.15.7:0/1627712049 shutdown_connections 2023-10-06T10:59:06.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.511+0000 7f4f95660700 1 -- 172.21.15.7:0/1627712049 wait complete. 2023-10-06T10:59:06.518 INFO:teuthology.orchestra.run.smithi007.stderr:set pool 5 allow_ec_overwrites to true 2023-10-06T10:59:06.531 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-06T10:59:06.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.665+0000 7ff98dfc0700 1 Processor -- start 2023-10-06T10:59:06.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.665+0000 7ff98dfc0700 1 -- start start 2023-10-06T10:59:06.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.666+0000 7ff98dfc0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9880cab40 0x7ff9880694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:06.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.666+0000 7ff98dfc0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9880699e0 con 0x7ff9880b2430 2023-10-06T10:59:06.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.666+0000 7ff98dfc0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff988069dd0 con 0x7ff9880caf10 2023-10-06T10:59:06.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.666+0000 7ff98dfc0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98806a070 con 0x7ff9880cab40 2023-10-06T10:59:06.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.666+0000 7ff987fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff9880b2430 0x7ff9880c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36182/0 (socket says 172.21.15.7:36182) 2023-10-06T10:59:06.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.666+0000 7ff987fff700 1 -- 172.21.15.7:0/4175790683 learned_addr learned my addr 172.21.15.7:0/4175790683 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.666+0000 7ff9877fe700 1 --2- 172.21.15.7:0/4175790683 >> v2:172.21.15.50:3300/0 conn(0x7ff9880cab40 0x7ff9880694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.666+0000 7ff9867fc700 1 -- 172.21.15.7:0/4175790683 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466870862 0 0) 0x7ff9880699e0 con 0x7ff9880b2430 2023-10-06T10:59:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.666+0000 7ff9867fc700 1 -- 172.21.15.7:0/4175790683 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff974003570 con 0x7ff9880b2430 2023-10-06T10:59:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff9867fc700 1 -- 172.21.15.7:0/4175790683 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1037221913 0 0) 0x7ff974003570 con 0x7ff9880b2430 2023-10-06T10:59:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff9867fc700 1 -- 172.21.15.7:0/4175790683 >> v2:172.21.15.50:3300/0 conn(0x7ff9880cab40 msgr2=0x7ff9880694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff9867fc700 1 --2- 172.21.15.7:0/4175790683 >> v2:172.21.15.50:3300/0 conn(0x7ff9880cab40 0x7ff9880694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff9867fc700 1 -- 172.21.15.7:0/4175790683 >> v1:172.21.15.50:6789/0 conn(0x7ff9880caf10 legacy=0x7ff9880b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff9867fc700 1 -- 172.21.15.7:0/4175790683 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98806a350 con 0x7ff9880b2430 2023-10-06T10:59:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff9867fc700 1 -- 172.21.15.7:0/4175790683 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7ff9800017f0 con 0x7ff9880b2430 2023-10-06T10:59:06.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff9867fc700 1 -- 172.21.15.7:0/4175790683 >> v1:172.21.15.7:6789/0 conn(0x7ff9880b2430 legacy=0x7ff9880c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:06.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff9867fc700 1 --2- 172.21.15.7:0/4175790683 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff974003a60 0x7ff974003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:06.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff9867fc700 1 --2- 172.21.15.7:0/4175790683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff974004810 0x7ff974004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:06.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff9867fc700 1 --2- 172.21.15.7:0/4175790683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9740051c0 0x7ff97400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:06.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff9867fc700 1 -- 172.21.15.7:0/4175790683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98806a070 con 0x7ff9740051c0 2023-10-06T10:59:06.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff9867fc700 1 -- 172.21.15.7:0/4175790683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97400c0d0 con 0x7ff974004810 2023-10-06T10:59:06.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff9867fc700 1 -- 172.21.15.7:0/4175790683 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97400c290 con 0x7ff974003a60 2023-10-06T10:59:06.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff987fff700 1 --2- 172.21.15.7:0/4175790683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9740051c0 0x7ff97400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:06.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff9877fe700 1 --2- 172.21.15.7:0/4175790683 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff974003a60 0x7ff974003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:06.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff986ffd700 1 --2- 172.21.15.7:0/4175790683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff974004810 0x7ff974004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:06.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff987fff700 1 -- 172.21.15.7:0/4175790683 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff974003a60 msgr2=0x7ff974003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:06.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff987fff700 1 --2- 172.21.15.7:0/4175790683 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff974003a60 0x7ff974003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:06.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff987fff700 1 -- 172.21.15.7:0/4175790683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff974004810 msgr2=0x7ff974004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:06.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff987fff700 1 --2- 172.21.15.7:0/4175790683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff974004810 0x7ff974004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:06.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff987fff700 1 -- 172.21.15.7:0/4175790683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff974003570 con 0x7ff9740051c0 2023-10-06T10:59:06.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.667+0000 7ff987fff700 1 -- 172.21.15.7:0/4175790683 reap_dead start 2023-10-06T10:59:06.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.668+0000 7ff987fff700 1 --2- 172.21.15.7:0/4175790683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9740051c0 0x7ff97400ba60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff98000a3e0 tx=0x7ff9800021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd5da7b5aa1bbc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:06.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.668+0000 7ff9867fc700 1 -- 172.21.15.7:0/4175790683 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9800104a0 con 0x7ff9740051c0 2023-10-06T10:59:06.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.668+0000 7ff9867fc700 1 -- 172.21.15.7:0/4175790683 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff980010600 con 0x7ff9740051c0 2023-10-06T10:59:06.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.668+0000 7ff9867fc700 1 -- 172.21.15.7:0/4175790683 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9800109a0 con 0x7ff9740051c0 2023-10-06T10:59:06.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.668+0000 7ff98dfc0700 1 -- 172.21.15.7:0/4175790683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9740051c0 msgr2=0x7ff97400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:06.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.668+0000 7ff98dfc0700 1 --2- 172.21.15.7:0/4175790683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9740051c0 0x7ff97400ba60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff98000a3e0 tx=0x7ff9800021d0 comp rx=0 tx=0).stop 2023-10-06T10:59:06.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.668+0000 7ff98dfc0700 1 -- 172.21.15.7:0/4175790683 shutdown_connections 2023-10-06T10:59:06.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.668+0000 7ff98dfc0700 1 --2- 172.21.15.7:0/4175790683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9740051c0 0x7ff97400ba60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:06.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.668+0000 7ff98dfc0700 1 -- 172.21.15.7:0/4175790683 >> 172.21.15.7:0/4175790683 conn(0x7ff9880afc90 msgr2=0x7ff9880b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:06.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.668+0000 7ff98dfc0700 1 -- 172.21.15.7:0/4175790683 shutdown_connections 2023-10-06T10:59:06.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.668+0000 7ff98dfc0700 1 -- 172.21.15.7:0/4175790683 wait complete. 2023-10-06T10:59:06.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.670+0000 7ff98dfc0700 1 Processor -- start 2023-10-06T10:59:06.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.670+0000 7ff98dfc0700 1 -- start start 2023-10-06T10:59:06.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.670+0000 7ff98dfc0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9740051c0 0x7ff9880c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:06.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.670+0000 7ff98dfc0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9880c9660 0x7ff988157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:06.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.670+0000 7ff98dfc0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff988145410 0x7ff988157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.670+0000 7ff98dfc0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff988067940 con 0x7ff988145410 2023-10-06T10:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.670+0000 7ff98dfc0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880c9bd0 con 0x7ff9880c9660 2023-10-06T10:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.670+0000 7ff98dfc0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880c9eb0 con 0x7ff9740051c0 2023-10-06T10:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff987fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff988145410 0x7ff988157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff987fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff988145410 0x7ff988157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54972/0 (socket says 172.21.15.7:54972) 2023-10-06T10:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff987fff700 1 -- 172.21.15.7:0/242994282 learned_addr learned my addr 172.21.15.7:0/242994282 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff986ffd700 1 --2- 172.21.15.7:0/242994282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9880c9660 0x7ff988157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff9877fe700 1 --2- 172.21.15.7:0/242994282 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9740051c0 0x7ff9880c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff987fff700 1 -- 172.21.15.7:0/242994282 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9740051c0 msgr2=0x7ff9880c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff987fff700 1 --2- 172.21.15.7:0/242994282 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9740051c0 0x7ff9880c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff987fff700 1 -- 172.21.15.7:0/242994282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9880c9660 msgr2=0x7ff988157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff987fff700 1 --2- 172.21.15.7:0/242994282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9880c9660 0x7ff988157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff987fff700 1 -- 172.21.15.7:0/242994282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff988067b90 con 0x7ff988145410 2023-10-06T10:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff987fff700 1 --2- 172.21.15.7:0/242994282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff988145410 0x7ff988157690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff980000f80 tx=0x7ff980018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff97f7fe700 1 -- 172.21.15.7:0/242994282 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98001f070 con 0x7ff988145410 2023-10-06T10:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff97f7fe700 1 -- 172.21.15.7:0/242994282 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff980010980 con 0x7ff988145410 2023-10-06T10:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff98dfc0700 1 -- 172.21.15.7:0/242994282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff988067940 con 0x7ff988145410 2023-10-06T10:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff97f7fe700 1 -- 172.21.15.7:0/242994282 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9800116c0 con 0x7ff988145410 2023-10-06T10:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.671+0000 7ff98dfc0700 1 -- 172.21.15.7:0/242994282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff988152810 con 0x7ff988145410 2023-10-06T10:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.673+0000 7ff98dfc0700 1 -- 172.21.15.7:0/242994282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9880680b0 con 0x7ff988145410 2023-10-06T10:59:06.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.673+0000 7ff97f7fe700 1 -- 172.21.15.7:0/242994282 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff980011af0 con 0x7ff988145410 2023-10-06T10:59:06.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.673+0000 7ff97f7fe700 1 --2- 172.21.15.7:0/242994282 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff968066f30 0x7ff9680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:06.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.673+0000 7ff97f7fe700 1 -- 172.21.15.7:0/242994282 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6777+0+0 (secure 0 0 0) 0x7ff9800867e0 con 0x7ff988145410 2023-10-06T10:59:06.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.673+0000 7ff9877fe700 1 --2- 172.21.15.7:0/242994282 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff968066f30 0x7ff9680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:06.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.674+0000 7ff9877fe700 1 --2- 172.21.15.7:0/242994282 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff968066f30 0x7ff9680693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff978006ed0 tx=0x7ff978008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:06.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.678+0000 7ff97f7fe700 1 -- 172.21.15.7:0/242994282 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9880680b0 con 0x7ff988145410 2023-10-06T10:59:06.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:06.932+0000 7ff98dfc0700 1 -- 172.21.15.7:0/242994282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7ff9880680b0 con 0x7ff988145410 2023-10-06T10:59:07.471 INFO:tasks.ceph.mds.a.smithi007.stderr:2023-10-06T10:59:07.469+0000 7fee611ff700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T10:59:07.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.486+0000 7ff97f7fe700 1 -- 172.21.15.7:0/242994282 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7ff9880680b0 con 0x7ff988145410 2023-10-06T10:59:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.490+0000 7ff98dfc0700 1 -- 172.21.15.7:0/242994282 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff968066f30 msgr2=0x7ff9680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.490+0000 7ff98dfc0700 1 --2- 172.21.15.7:0/242994282 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff968066f30 0x7ff9680693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff978006ed0 tx=0x7ff978008040 comp rx=0 tx=0).stop 2023-10-06T10:59:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.490+0000 7ff98dfc0700 1 -- 172.21.15.7:0/242994282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff988145410 msgr2=0x7ff988157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.490+0000 7ff98dfc0700 1 --2- 172.21.15.7:0/242994282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff988145410 0x7ff988157690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff980000f80 tx=0x7ff980018000 comp rx=0 tx=0).stop 2023-10-06T10:59:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.490+0000 7ff98dfc0700 1 -- 172.21.15.7:0/242994282 shutdown_connections 2023-10-06T10:59:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.490+0000 7ff98dfc0700 1 --2- 172.21.15.7:0/242994282 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff968066f30 0x7ff9680693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.490+0000 7ff98dfc0700 1 --2- 172.21.15.7:0/242994282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff988145410 0x7ff988157690 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.490+0000 7ff98dfc0700 1 --2- 172.21.15.7:0/242994282 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9740051c0 0x7ff9880c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.490+0000 7ff98dfc0700 1 --2- 172.21.15.7:0/242994282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9880c9660 0x7ff988157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.490+0000 7ff98dfc0700 1 -- 172.21.15.7:0/242994282 >> 172.21.15.7:0/242994282 conn(0x7ff9880afc90 msgr2=0x7ff98806b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:07.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.490+0000 7ff98dfc0700 1 -- 172.21.15.7:0/242994282 shutdown_connections 2023-10-06T10:59:07.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.490+0000 7ff98dfc0700 1 -- 172.21.15.7:0/242994282 wait complete. 2023-10-06T10:59:07.493 INFO:teuthology.orchestra.run.smithi007.stderr:added data pool 5 to fsmap 2023-10-06T10:59:07.507 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T10:59:07.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.642+0000 7f1d47373700 1 Processor -- start 2023-10-06T10:59:07.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.642+0000 7f1d47373700 1 -- start start 2023-10-06T10:59:07.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.643+0000 7f1d47373700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d400ccda0 0x7f1d400cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:07.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.643+0000 7f1d47373700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d400aaa40 0x7f1d40155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:07.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.643+0000 7f1d47373700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d40069110 con 0x7f1d400ac8d0 2023-10-06T10:59:07.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.643+0000 7f1d47373700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d40068b30 con 0x7f1d400ccda0 2023-10-06T10:59:07.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.643+0000 7f1d47373700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400aafb0 con 0x7f1d400aaa40 2023-10-06T10:59:07.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.643+0000 7f1d4490e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1d400ac8d0 0x7f1d400aa330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36186/0 (socket says 172.21.15.7:36186) 2023-10-06T10:59:07.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.643+0000 7f1d4490e700 1 -- 172.21.15.7:0/2620273124 learned_addr learned my addr 172.21.15.7:0/2620273124 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:07.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d45910700 1 --2- 172.21.15.7:0/2620273124 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d400aaa40 0x7f1d40155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:07.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d4510f700 1 --2- 172.21.15.7:0/2620273124 >> v2:172.21.15.50:3300/0 conn(0x7f1d400ccda0 0x7f1d400cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:07.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 -- 172.21.15.7:0/2620273124 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226138418 0 0) 0x7f1d40069110 con 0x7f1d400ac8d0 2023-10-06T10:59:07.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 -- 172.21.15.7:0/2620273124 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d2c003570 con 0x7f1d400ac8d0 2023-10-06T10:59:07.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 -- 172.21.15.7:0/2620273124 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3907862303 0 0) 0x7f1d2c003570 con 0x7f1d400ac8d0 2023-10-06T10:59:07.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 -- 172.21.15.7:0/2620273124 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d400aaa40 msgr2=0x7f1d40155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:07.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 --2- 172.21.15.7:0/2620273124 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d400aaa40 0x7f1d40155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 -- 172.21.15.7:0/2620273124 >> v2:172.21.15.50:3300/0 conn(0x7f1d400ccda0 msgr2=0x7f1d400cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:07.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 --2- 172.21.15.7:0/2620273124 >> v2:172.21.15.50:3300/0 conn(0x7f1d400ccda0 0x7f1d400cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 -- 172.21.15.7:0/2620273124 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d40068da0 con 0x7f1d400ac8d0 2023-10-06T10:59:07.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 -- 172.21.15.7:0/2620273124 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f1d30001470 con 0x7f1d400ac8d0 2023-10-06T10:59:07.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 -- 172.21.15.7:0/2620273124 >> v1:172.21.15.7:6789/0 conn(0x7f1d400ac8d0 legacy=0x7f1d400aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:07.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 --2- 172.21.15.7:0/2620273124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c003a60 0x7f1d2c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:07.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 --2- 172.21.15.7:0/2620273124 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d400aaa40 0x7f1d2c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:07.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 --2- 172.21.15.7:0/2620273124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d2c004d50 0x7f1d2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:07.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 -- 172.21.15.7:0/2620273124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40068b30 con 0x7f1d2c004d50 2023-10-06T10:59:07.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 -- 172.21.15.7:0/2620273124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400aafb0 con 0x7f1d2c003a60 2023-10-06T10:59:07.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d37fff700 1 -- 172.21.15.7:0/2620273124 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c00ba60 con 0x7f1d400aaa40 2023-10-06T10:59:07.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d45910700 1 --2- 172.21.15.7:0/2620273124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d2c004d50 0x7f1d2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:07.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d4510f700 1 --2- 172.21.15.7:0/2620273124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c003a60 0x7f1d2c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:07.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d4490e700 1 --2- 172.21.15.7:0/2620273124 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d400aaa40 0x7f1d2c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:07.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d45910700 1 -- 172.21.15.7:0/2620273124 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d400aaa40 msgr2=0x7f1d2c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:07.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d45910700 1 --2- 172.21.15.7:0/2620273124 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d400aaa40 0x7f1d2c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d45910700 1 -- 172.21.15.7:0/2620273124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c003a60 msgr2=0x7f1d2c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.644+0000 7f1d45910700 1 --2- 172.21.15.7:0/2620273124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c003a60 0x7f1d2c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.645+0000 7f1d45910700 1 -- 172.21.15.7:0/2620273124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c003570 con 0x7f1d2c004d50 2023-10-06T10:59:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.645+0000 7f1d45910700 1 --2- 172.21.15.7:0/2620273124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d2c004d50 0x7f1d2c0051c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800e210 tx=0x7f1d3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6d967395ac3ff7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.645+0000 7f1d37fff700 1 -- 172.21.15.7:0/2620273124 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3800ea60 con 0x7f1d2c004d50 2023-10-06T10:59:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.645+0000 7f1d37fff700 1 -- 172.21.15.7:0/2620273124 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3800f040 con 0x7f1d2c004d50 2023-10-06T10:59:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.645+0000 7f1d37fff700 1 -- 172.21.15.7:0/2620273124 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3800ee10 con 0x7f1d2c004d50 2023-10-06T10:59:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.645+0000 7f1d47373700 1 -- 172.21.15.7:0/2620273124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d2c004d50 msgr2=0x7f1d2c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.645+0000 7f1d47373700 1 --2- 172.21.15.7:0/2620273124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d2c004d50 0x7f1d2c0051c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800e210 tx=0x7f1d3800b040 comp rx=0 tx=0).stop 2023-10-06T10:59:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.645+0000 7f1d45910700 1 -- 172.21.15.7:0/2620273124 reap_dead start 2023-10-06T10:59:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.645+0000 7f1d47373700 1 -- 172.21.15.7:0/2620273124 shutdown_connections 2023-10-06T10:59:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.645+0000 7f1d47373700 1 -- 172.21.15.7:0/2620273124 >> 172.21.15.7:0/2620273124 conn(0x7f1d40096160 msgr2=0x7f1d400afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.646+0000 7f1d47373700 1 -- 172.21.15.7:0/2620273124 shutdown_connections 2023-10-06T10:59:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.646+0000 7f1d47373700 1 -- 172.21.15.7:0/2620273124 wait complete. 2023-10-06T10:59:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.647+0000 7f1d47373700 1 Processor -- start 2023-10-06T10:59:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.647+0000 7f1d47373700 1 -- start start 2023-10-06T10:59:07.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d47373700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d40150400 0x7f1d4009a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:07.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d47373700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d4009a720 0x7f1d401588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:07.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d47373700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d40158de0 0x7f1d40097b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:07.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d47373700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40159250 con 0x7f1d4009a720 2023-10-06T10:59:07.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d47373700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400976e0 con 0x7f1d40150400 2023-10-06T10:59:07.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d47373700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d401694c0 con 0x7f1d40158de0 2023-10-06T10:59:07.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d4490e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d4009a720 0x7f1d401588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:07.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d4510f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d40150400 0x7f1d4009a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:07.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d4490e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d4009a720 0x7f1d401588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54984/0 (socket says 172.21.15.7:54984) 2023-10-06T10:59:07.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d4510f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d40150400 0x7f1d4009a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:44450/0 (socket says 172.21.15.7:44450) 2023-10-06T10:59:07.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d4490e700 1 -- 172.21.15.7:0/1738965688 learned_addr learned my addr 172.21.15.7:0/1738965688 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:07.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d45910700 1 --2- 172.21.15.7:0/1738965688 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d40158de0 0x7f1d40097b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d4490e700 1 -- 172.21.15.7:0/1738965688 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d40158de0 msgr2=0x7f1d40097b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d4490e700 1 --2- 172.21.15.7:0/1738965688 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d40158de0 0x7f1d40097b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d4490e700 1 -- 172.21.15.7:0/1738965688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d40150400 msgr2=0x7f1d4009a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d4490e700 1 --2- 172.21.15.7:0/1738965688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d40150400 0x7f1d4009a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d4490e700 1 -- 172.21.15.7:0/1738965688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d40096ad0 con 0x7f1d4009a720 2023-10-06T10:59:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.648+0000 7f1d4490e700 1 --2- 172.21.15.7:0/1738965688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d4009a720 0x7f1d401588a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d30007390 tx=0x7f1d30001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.649+0000 7f1d357fa700 1 -- 172.21.15.7:0/1738965688 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30018030 con 0x7f1d4009a720 2023-10-06T10:59:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.649+0000 7f1d357fa700 1 -- 172.21.15.7:0/1738965688 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d30007770 con 0x7f1d4009a720 2023-10-06T10:59:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.649+0000 7f1d47373700 1 -- 172.21.15.7:0/1738965688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d40096db0 con 0x7f1d4009a720 2023-10-06T10:59:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.649+0000 7f1d357fa700 1 -- 172.21.15.7:0/1738965688 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000fb20 con 0x7f1d4009a720 2023-10-06T10:59:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.649+0000 7f1d47373700 1 -- 172.21.15.7:0/1738965688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d40097370 con 0x7f1d4009a720 2023-10-06T10:59:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.650+0000 7f1d47373700 1 -- 172.21.15.7:0/1738965688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d40097890 con 0x7f1d4009a720 2023-10-06T10:59:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.650+0000 7f1d357fa700 1 -- 172.21.15.7:0/1738965688 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d3001b070 con 0x7f1d4009a720 2023-10-06T10:59:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.651+0000 7f1d357fa700 1 --2- 172.21.15.7:0/1738965688 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1d24066f30 0x7f1d240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.651+0000 7f1d357fa700 1 -- 172.21.15.7:0/1738965688 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1d30019070 con 0x7f1d4009a720 2023-10-06T10:59:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.651+0000 7f1d4510f700 1 --2- 172.21.15.7:0/1738965688 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1d24066f30 0x7f1d240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.651+0000 7f1d4510f700 1 --2- 172.21.15.7:0/1738965688 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1d24066f30 0x7f1d240693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c006f00 tx=0x7f1d3c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:07.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.655+0000 7f1d357fa700 1 -- 172.21.15.7:0/1738965688 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d40097890 con 0x7f1d4009a720 2023-10-06T10:59:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.905+0000 7f1d47373700 1 -- 172.21.15.7:0/1738965688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d40097850 con 0x7f1d4009a720 2023-10-06T10:59:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.905+0000 7f1d357fa700 1 -- 172.21.15.7:0/1738965688 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4581 (secure 0 0 0) 0x7f1d30051620 con 0x7f1d4009a720 2023-10-06T10:59:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:07.907 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/941534596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":941534596},{"type":"v1","addr":"172.21.15.50:6835","nonce":941534596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3152699387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3152699387},{"type":"v1","addr":"172.21.15.50:6834","nonce":3152699387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/271704556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":271704556},{"type":"v1","addr":"172.21.15.7:6837","nonce":271704556}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T10:59:01.833627+0000","modified":"2023-10-06T10:59:07.483243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3123178887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3123178887},{"type":"v1","addr":"172.21.15.7:6836","nonce":3123178887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T10:59:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.908+0000 7f1d47373700 1 -- 172.21.15.7:0/1738965688 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1d24066f30 msgr2=0x7f1d240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.908+0000 7f1d47373700 1 --2- 172.21.15.7:0/1738965688 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1d24066f30 0x7f1d240693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c006f00 tx=0x7f1d3c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.908+0000 7f1d47373700 1 -- 172.21.15.7:0/1738965688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d4009a720 msgr2=0x7f1d401588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.908+0000 7f1d47373700 1 --2- 172.21.15.7:0/1738965688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d4009a720 0x7f1d401588a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d30007390 tx=0x7f1d30001e90 comp rx=0 tx=0).stop 2023-10-06T10:59:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.908+0000 7f1d47373700 1 -- 172.21.15.7:0/1738965688 shutdown_connections 2023-10-06T10:59:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.908+0000 7f1d47373700 1 --2- 172.21.15.7:0/1738965688 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1d24066f30 0x7f1d240693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.908+0000 7f1d47373700 1 --2- 172.21.15.7:0/1738965688 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d40158de0 0x7f1d40097b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.908+0000 7f1d47373700 1 --2- 172.21.15.7:0/1738965688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d40150400 0x7f1d4009a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.908+0000 7f1d47373700 1 --2- 172.21.15.7:0/1738965688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d4009a720 0x7f1d401588a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.908+0000 7f1d47373700 1 -- 172.21.15.7:0/1738965688 >> 172.21.15.7:0/1738965688 conn(0x7f1d40096160 msgr2=0x7f1d400cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:07.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.908+0000 7f1d47373700 1 -- 172.21.15.7:0/1738965688 shutdown_connections 2023-10-06T10:59:07.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:07.908+0000 7f1d47373700 1 -- 172.21.15.7:0/1738965688 wait complete. 2023-10-06T10:59:07.911 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 7 2023-10-06T10:59:07.923 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:08.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.054+0000 7fbddf107700 1 Processor -- start 2023-10-06T10:59:08.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.054+0000 7fbddf107700 1 -- start start 2023-10-06T10:59:08.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddf107700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdd80ccda0 0x7fbdd80cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddf107700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbdd80ac8d0 0x7fbdd80aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddf107700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbdd80aa870 0x7fbdd8155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddf107700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd8069110 con 0x7fbdd80aa870 2023-10-06T10:59:08.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddf107700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd8068b30 con 0x7fbdd80ac8d0 2023-10-06T10:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddf107700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80aacf0 con 0x7fbdd80ccda0 2023-10-06T10:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddd6a4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbdd80aa870 0x7fbdd8155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddd6a4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbdd80aa870 0x7fbdd8155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54988/0 (socket says 172.21.15.7:54988) 2023-10-06T10:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddd6a4700 1 -- 172.21.15.7:0/1829535329 learned_addr learned my addr 172.21.15.7:0/1829535329 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddcea3700 1 --2- 172.21.15.7:0/1829535329 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdd80ccda0 0x7fbdd80cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbdd7fff700 1 --2- 172.21.15.7:0/1829535329 >> v2:172.21.15.50:3300/0 conn(0x7fbdd80ac8d0 0x7fbdd80aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddd6a4700 1 -- 172.21.15.7:0/1829535329 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdd80ccda0 msgr2=0x7fbdd80cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddd6a4700 1 --2- 172.21.15.7:0/1829535329 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdd80ccda0 0x7fbdd80cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddd6a4700 1 -- 172.21.15.7:0/1829535329 >> v2:172.21.15.50:3300/0 conn(0x7fbdd80ac8d0 msgr2=0x7fbdd80aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddd6a4700 1 --2- 172.21.15.7:0/1829535329 >> v2:172.21.15.50:3300/0 conn(0x7fbdd80ac8d0 0x7fbdd80aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddd6a4700 1 -- 172.21.15.7:0/1829535329 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd80aafb0 con 0x7fbdd80aa870 2023-10-06T10:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.056+0000 7fbddd6a4700 1 --2- 172.21.15.7:0/1829535329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80aa870 0x7fbdd8155af0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbdd806dc00 tx=0x7fbdd000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31ede9ef2da29d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.057+0000 7fbdd77fe700 1 -- 172.21.15.7:0/1829535329 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0010070 con 0x7fbdd80aa870 2023-10-06T10:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.057+0000 7fbdd77fe700 1 -- 172.21.15.7:0/1829535329 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd000ddc0 con 0x7fbdd80aa870 2023-10-06T10:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.057+0000 7fbdd77fe700 1 -- 172.21.15.7:0/1829535329 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd000b320 con 0x7fbdd80aa870 2023-10-06T10:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.057+0000 7fbddf107700 1 -- 172.21.15.7:0/1829535329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80aa870 msgr2=0x7fbdd8155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.057+0000 7fbddf107700 1 --2- 172.21.15.7:0/1829535329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80aa870 0x7fbdd8155af0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbdd806dc00 tx=0x7fbdd000ba50 comp rx=0 tx=0).stop 2023-10-06T10:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.057+0000 7fbddf107700 1 -- 172.21.15.7:0/1829535329 shutdown_connections 2023-10-06T10:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.057+0000 7fbddf107700 1 --2- 172.21.15.7:0/1829535329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80aa870 0x7fbdd8155af0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.057+0000 7fbddf107700 1 --2- 172.21.15.7:0/1829535329 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdd80ccda0 0x7fbdd80cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.057+0000 7fbddf107700 1 --2- 172.21.15.7:0/1829535329 >> v2:172.21.15.50:3300/0 conn(0x7fbdd80ac8d0 0x7fbdd80aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.057+0000 7fbddf107700 1 -- 172.21.15.7:0/1829535329 >> 172.21.15.7:0/1829535329 conn(0x7fbdd8096160 msgr2=0x7fbdd80afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.057+0000 7fbddf107700 1 -- 172.21.15.7:0/1829535329 shutdown_connections 2023-10-06T10:59:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.057+0000 7fbddf107700 1 -- 172.21.15.7:0/1829535329 wait complete. 2023-10-06T10:59:08.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.058+0000 7fbddf107700 1 Processor -- start 2023-10-06T10:59:08.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.059+0000 7fbddf107700 1 -- start start 2023-10-06T10:59:08.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.059+0000 7fbddf107700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80aa870 0x7fbdd8144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.059+0000 7fbddf107700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdd80ac8d0 0x7fbdd8159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.059+0000 7fbddf107700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdd80ccda0 0x7fbdd8099d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.059+0000 7fbddf107700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd815b2c0 con 0x7fbdd80aa870 2023-10-06T10:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbddf107700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd815a6b0 con 0x7fbdd80ac8d0 2023-10-06T10:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbddf107700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd815a990 con 0x7fbdd80ccda0 2023-10-06T10:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbddcea3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80aa870 0x7fbdd8144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbddcea3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80aa870 0x7fbdd8144760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54990/0 (socket says 172.21.15.7:54990) 2023-10-06T10:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbddcea3700 1 -- 172.21.15.7:0/2534434214 learned_addr learned my addr 172.21.15.7:0/2534434214 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbdd7fff700 1 --2- 172.21.15.7:0/2534434214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdd80ac8d0 0x7fbdd8159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbddd6a4700 1 --2- 172.21.15.7:0/2534434214 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdd80ccda0 0x7fbdd8099d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbddcea3700 1 -- 172.21.15.7:0/2534434214 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdd80ccda0 msgr2=0x7fbdd8099d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbddcea3700 1 --2- 172.21.15.7:0/2534434214 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdd80ccda0 0x7fbdd8099d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbddcea3700 1 -- 172.21.15.7:0/2534434214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdd80ac8d0 msgr2=0x7fbdd8159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbddcea3700 1 --2- 172.21.15.7:0/2534434214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdd80ac8d0 0x7fbdd8159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbddcea3700 1 -- 172.21.15.7:0/2534434214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd000bcf0 con 0x7fbdd80aa870 2023-10-06T10:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbddcea3700 1 --2- 172.21.15.7:0/2534434214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80aa870 0x7fbdd8144760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800ec80 tx=0x7fbdc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbdd4ff9700 1 -- 172.21.15.7:0/2534434214 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc800c850 con 0x7fbdd80aa870 2023-10-06T10:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.060+0000 7fbdd4ff9700 1 -- 172.21.15.7:0/2534434214 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc800c9d0 con 0x7fbdd80aa870 2023-10-06T10:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.061+0000 7fbddf107700 1 -- 172.21.15.7:0/2534434214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd815ac70 con 0x7fbdd80aa870 2023-10-06T10:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.061+0000 7fbdd4ff9700 1 -- 172.21.15.7:0/2534434214 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc800cd90 con 0x7fbdd80aa870 2023-10-06T10:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.061+0000 7fbddf107700 1 -- 172.21.15.7:0/2534434214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd8144ca0 con 0x7fbdd80aa870 2023-10-06T10:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.062+0000 7fbddf107700 1 -- 172.21.15.7:0/2534434214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd8070480 con 0x7fbdd80aa870 2023-10-06T10:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.062+0000 7fbdd4ff9700 1 -- 172.21.15.7:0/2534434214 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbdc8013680 con 0x7fbdd80aa870 2023-10-06T10:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.063+0000 7fbdd4ff9700 1 --2- 172.21.15.7:0/2534434214 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbdb8066f30 0x7fbdb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.063+0000 7fbdd4ff9700 1 -- 172.21.15.7:0/2534434214 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbdc8084c10 con 0x7fbdd80aa870 2023-10-06T10:59:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.063+0000 7fbdd7fff700 1 --2- 172.21.15.7:0/2534434214 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbdb8066f30 0x7fbdb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.063+0000 7fbdd7fff700 1 --2- 172.21.15.7:0/2534434214 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbdb8066f30 0x7fbdb80693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009db0 tx=0x7fbdc00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.067+0000 7fbdd4ff9700 1 -- 172.21.15.7:0/2534434214 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdc8051a30 con 0x7fbdd80aa870 2023-10-06T10:59:08.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.272+0000 7fbddf107700 1 -- 172.21.15.7:0/2534434214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdd80cdb60 con 0x7fbdd80aa870 2023-10-06T10:59:08.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.273+0000 7fbdd4ff9700 1 -- 172.21.15.7:0/2534434214 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fbdc8055050 con 0x7fbdd80aa870 2023-10-06T10:59:08.275 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:06.934264+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:08.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.276+0000 7fbddf107700 1 -- 172.21.15.7:0/2534434214 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbdb8066f30 msgr2=0x7fbdb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.276+0000 7fbddf107700 1 --2- 172.21.15.7:0/2534434214 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbdb8066f30 0x7fbdb80693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009db0 tx=0x7fbdc00091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.276+0000 7fbddf107700 1 -- 172.21.15.7:0/2534434214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80aa870 msgr2=0x7fbdd8144760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.276+0000 7fbddf107700 1 --2- 172.21.15.7:0/2534434214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80aa870 0x7fbdd8144760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800ec80 tx=0x7fbdc80091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.276+0000 7fbddf107700 1 -- 172.21.15.7:0/2534434214 shutdown_connections 2023-10-06T10:59:08.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.276+0000 7fbddf107700 1 --2- 172.21.15.7:0/2534434214 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbdb8066f30 0x7fbdb80693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.276+0000 7fbddf107700 1 --2- 172.21.15.7:0/2534434214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80aa870 0x7fbdd8144760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.276+0000 7fbddf107700 1 --2- 172.21.15.7:0/2534434214 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdd80ccda0 0x7fbdd8099d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.276+0000 7fbddf107700 1 --2- 172.21.15.7:0/2534434214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdd80ac8d0 0x7fbdd8159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.276+0000 7fbddf107700 1 -- 172.21.15.7:0/2534434214 >> 172.21.15.7:0/2534434214 conn(0x7fbdd8096160 msgr2=0x7fbdd8069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:08.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.276+0000 7fbddf107700 1 -- 172.21.15.7:0/2534434214 shutdown_connections 2023-10-06T10:59:08.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.276+0000 7fbddf107700 1 -- 172.21.15.7:0/2534434214 wait complete. 2023-10-06T10:59:08.291 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.421+0000 7fd2488d9700 1 Processor -- start 2023-10-06T10:59:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.422+0000 7fd2488d9700 1 -- start start 2023-10-06T10:59:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.423+0000 7fd2488d9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2440ccda0 0x7fd2440cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.423+0000 7fd2488d9700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2440ac8d0 0x7fd2440aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.423+0000 7fd2488d9700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd244069110 con 0x7fd2440aa870 2023-10-06T10:59:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.423+0000 7fd2488d9700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd244068b30 con 0x7fd2440ac8d0 2023-10-06T10:59:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.423+0000 7fd2488d9700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2440aacf0 con 0x7fd2440ccda0 2023-10-06T10:59:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.423+0000 7fd241d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2440ac8d0 0x7fd2440aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.423+0000 7fd241d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2440ac8d0 0x7fd2440aa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54992/0 (socket says 172.21.15.7:54992) 2023-10-06T10:59:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.423+0000 7fd241d9b700 1 -- 172.21.15.7:0/605661217 learned_addr learned my addr 172.21.15.7:0/605661217 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.423+0000 7fd24259c700 1 --2- 172.21.15.7:0/605661217 >> v2:172.21.15.50:3300/0 conn(0x7fd2440ccda0 0x7fd2440cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.423+0000 7fd241d9b700 1 -- 172.21.15.7:0/605661217 >> v2:172.21.15.50:3300/0 conn(0x7fd2440ccda0 msgr2=0x7fd2440cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.423+0000 7fd241d9b700 1 --2- 172.21.15.7:0/605661217 >> v2:172.21.15.50:3300/0 conn(0x7fd2440ccda0 0x7fd2440cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.423+0000 7fd241d9b700 1 -- 172.21.15.7:0/605661217 >> v1:172.21.15.50:6789/0 conn(0x7fd2440aa870 legacy=0x7fd244155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.423+0000 7fd241d9b700 1 -- 172.21.15.7:0/605661217 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2440aafb0 con 0x7fd2440ac8d0 2023-10-06T10:59:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.423+0000 7fd241d9b700 1 --2- 172.21.15.7:0/605661217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2440ac8d0 0x7fd2440aa330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd24406e5e0 tx=0x7fd23800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8bc44203d6dfdd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.424+0000 7fd24159a700 1 -- 172.21.15.7:0/605661217 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23800dc50 con 0x7fd2440ac8d0 2023-10-06T10:59:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.424+0000 7fd24159a700 1 -- 172.21.15.7:0/605661217 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23800ddb0 con 0x7fd2440ac8d0 2023-10-06T10:59:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.424+0000 7fd24159a700 1 -- 172.21.15.7:0/605661217 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380196d0 con 0x7fd2440ac8d0 2023-10-06T10:59:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.424+0000 7fd2488d9700 1 -- 172.21.15.7:0/605661217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2440ac8d0 msgr2=0x7fd2440aa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.424+0000 7fd2488d9700 1 --2- 172.21.15.7:0/605661217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2440ac8d0 0x7fd2440aa330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd24406e5e0 tx=0x7fd23800b4f0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.424+0000 7fd2488d9700 1 -- 172.21.15.7:0/605661217 shutdown_connections 2023-10-06T10:59:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.424+0000 7fd2488d9700 1 --2- 172.21.15.7:0/605661217 >> v2:172.21.15.50:3300/0 conn(0x7fd2440ccda0 0x7fd2440cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.424+0000 7fd2488d9700 1 --2- 172.21.15.7:0/605661217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2440ac8d0 0x7fd2440aa330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.424+0000 7fd2488d9700 1 -- 172.21.15.7:0/605661217 >> 172.21.15.7:0/605661217 conn(0x7fd244096160 msgr2=0x7fd2440afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.424+0000 7fd2488d9700 1 -- 172.21.15.7:0/605661217 shutdown_connections 2023-10-06T10:59:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.424+0000 7fd2488d9700 1 -- 172.21.15.7:0/605661217 wait complete. 2023-10-06T10:59:08.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.425+0000 7fd2488d9700 1 Processor -- start 2023-10-06T10:59:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.425+0000 7fd2488d9700 1 -- start start 2023-10-06T10:59:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.426+0000 7fd2488d9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2440aa870 0x7fd244097890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.426+0000 7fd2488d9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2440ac8d0 0x7fd24416a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.426+0000 7fd2488d9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2440ccda0 0x7fd2440985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.426+0000 7fd2488d9700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd244097400 con 0x7fd2440ac8d0 2023-10-06T10:59:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.426+0000 7fd2488d9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd244097dd0 con 0x7fd2440ccda0 2023-10-06T10:59:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.426+0000 7fd2488d9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24415e820 con 0x7fd2440aa870 2023-10-06T10:59:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.426+0000 7fd241d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2440ac8d0 0x7fd24416a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.426+0000 7fd241d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2440ac8d0 0x7fd24416a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55000/0 (socket says 172.21.15.7:55000) 2023-10-06T10:59:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.426+0000 7fd241d9b700 1 -- 172.21.15.7:0/2602477533 learned_addr learned my addr 172.21.15.7:0/2602477533 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.426+0000 7fd24259c700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2440aa870 0x7fd244097890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.426+0000 7fd242d9d700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2440ccda0 0x7fd2440985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.427+0000 7fd241d9b700 1 -- 172.21.15.7:0/2602477533 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2440aa870 msgr2=0x7fd244097890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.427+0000 7fd241d9b700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2440aa870 0x7fd244097890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.427+0000 7fd241d9b700 1 -- 172.21.15.7:0/2602477533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2440ccda0 msgr2=0x7fd2440985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.427+0000 7fd241d9b700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2440ccda0 0x7fd2440985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.427+0000 7fd241d9b700 1 -- 172.21.15.7:0/2602477533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23800b790 con 0x7fd2440ac8d0 2023-10-06T10:59:08.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.427+0000 7fd24259c700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2440aa870 0x7fd244097890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:08.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.427+0000 7fd241d9b700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2440ac8d0 0x7fd24416a350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd2440b2e50 tx=0x7fd23801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:08.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.427+0000 7fd2327fc700 1 -- 172.21.15.7:0/2602477533 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238010750 con 0x7fd2440ac8d0 2023-10-06T10:59:08.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.427+0000 7fd2327fc700 1 -- 172.21.15.7:0/2602477533 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2380108b0 con 0x7fd2440ac8d0 2023-10-06T10:59:08.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.427+0000 7fd2488d9700 1 -- 172.21.15.7:0/2602477533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd244096ad0 con 0x7fd2440ac8d0 2023-10-06T10:59:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.427+0000 7fd2327fc700 1 -- 172.21.15.7:0/2602477533 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238010c70 con 0x7fd2440ac8d0 2023-10-06T10:59:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.427+0000 7fd2488d9700 1 -- 172.21.15.7:0/2602477533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd244097090 con 0x7fd2440ac8d0 2023-10-06T10:59:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.428+0000 7fd2488d9700 1 -- 172.21.15.7:0/2602477533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd244097570 con 0x7fd2440ac8d0 2023-10-06T10:59:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.429+0000 7fd2327fc700 1 -- 172.21.15.7:0/2602477533 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd23802c430 con 0x7fd2440ac8d0 2023-10-06T10:59:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.429+0000 7fd2327fc700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd224066f30 0x7fd2240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.429+0000 7fd2327fc700 1 -- 172.21.15.7:0/2602477533 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd238014070 con 0x7fd2440ac8d0 2023-10-06T10:59:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.429+0000 7fd24259c700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd224066f30 0x7fd2240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.430+0000 7fd24259c700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd224066f30 0x7fd2240693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd24415e010 tx=0x7fd234008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:08.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.434+0000 7fd2327fc700 1 -- 172.21.15.7:0/2602477533 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2380536d0 con 0x7fd2440ac8d0 2023-10-06T10:59:08.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.640+0000 7fd2488d9700 1 -- 172.21.15.7:0/2602477533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd244070480 con 0x7fd2440ac8d0 2023-10-06T10:59:08.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.641+0000 7fd2327fc700 1 -- 172.21.15.7:0/2602477533 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fd238056cf0 con 0x7fd2440ac8d0 2023-10-06T10:59:08.643 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:08.643 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:06.934264+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:08.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.643+0000 7fd2488d9700 1 -- 172.21.15.7:0/2602477533 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd224066f30 msgr2=0x7fd2240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.643+0000 7fd2488d9700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd224066f30 0x7fd2240693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd24415e010 tx=0x7fd234008040 comp rx=0 tx=0).stop 2023-10-06T10:59:08.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.643+0000 7fd2488d9700 1 -- 172.21.15.7:0/2602477533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2440ac8d0 msgr2=0x7fd24416a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.643+0000 7fd2488d9700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2440ac8d0 0x7fd24416a350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd2440b2e50 tx=0x7fd23801b000 comp rx=0 tx=0).stop 2023-10-06T10:59:08.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.643+0000 7fd2488d9700 1 -- 172.21.15.7:0/2602477533 shutdown_connections 2023-10-06T10:59:08.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.643+0000 7fd2488d9700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd224066f30 0x7fd2240693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.643+0000 7fd2488d9700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2440ccda0 0x7fd2440985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.643+0000 7fd2488d9700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2440aa870 0x7fd244097890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.643+0000 7fd2488d9700 1 --2- 172.21.15.7:0/2602477533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2440ac8d0 0x7fd24416a350 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.643+0000 7fd2488d9700 1 -- 172.21.15.7:0/2602477533 >> 172.21.15.7:0/2602477533 conn(0x7fd244096160 msgr2=0x7fd244154950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:08.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.643+0000 7fd2488d9700 1 -- 172.21.15.7:0/2602477533 shutdown_connections 2023-10-06T10:59:08.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.643+0000 7fd2488d9700 1 -- 172.21.15.7:0/2602477533 wait complete. 2023-10-06T10:59:08.670 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T10:59:08.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.801+0000 7f0733570700 1 Processor -- start 2023-10-06T10:59:08.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.801+0000 7f0733570700 1 -- start start 2023-10-06T10:59:08.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.802+0000 7f0733570700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f072c0a6e20 0x7f072c0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.802+0000 7f0733570700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f072c0ad990 0x7f072c0ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.802+0000 7f0733570700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072c0670f0 con 0x7f072c0afb40 2023-10-06T10:59:08.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.802+0000 7f0733570700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072c0affb0 con 0x7f072c0ad990 2023-10-06T10:59:08.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.802+0000 7f0733570700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072c067c70 con 0x7f072c0a6e20 2023-10-06T10:59:08.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.802+0000 7f0731b0d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f072c0ad990 0x7f072c0ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.802+0000 7f0730b0b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f072c0afb40 0x7f072c0ad280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36196/0 (socket says 172.21.15.7:36196) 2023-10-06T10:59:08.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.802+0000 7f0730b0b700 1 -- 172.21.15.7:0/1162089781 learned_addr learned my addr 172.21.15.7:0/1162089781 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:08.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.802+0000 7f073130c700 1 --2- 172.21.15.7:0/1162089781 >> v2:172.21.15.50:3300/0 conn(0x7f072c0a6e20 0x7f072c0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.802+0000 7f0731b0d700 1 -- 172.21.15.7:0/1162089781 >> v2:172.21.15.50:3300/0 conn(0x7f072c0a6e20 msgr2=0x7f072c0c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:08.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.802+0000 7f0731b0d700 1 --2- 172.21.15.7:0/1162089781 >> v2:172.21.15.50:3300/0 conn(0x7f072c0a6e20 0x7f072c0c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.802+0000 7f0731b0d700 1 -- 172.21.15.7:0/1162089781 >> v1:172.21.15.7:6789/0 conn(0x7f072c0afb40 legacy=0x7f072c0ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.802+0000 7f0723fff700 1 -- 172.21.15.7:0/1162089781 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486982069 0 0) 0x7f072c0670f0 con 0x7f072c0afb40 2023-10-06T10:59:08.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.802+0000 7f0731b0d700 1 -- 172.21.15.7:0/1162089781 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c1565a0 con 0x7f072c0ad990 2023-10-06T10:59:08.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.803+0000 7f0731b0d700 1 --2- 172.21.15.7:0/1162089781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f072c0ad990 0x7f072c0ac7f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f072c0b25c0 tx=0x7f0724009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08a7c2e459727c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:08.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.803+0000 7f0723fff700 1 -- 172.21.15.7:0/1162089781 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072400e070 con 0x7f072c0ad990 2023-10-06T10:59:08.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.803+0000 7f0723fff700 1 -- 172.21.15.7:0/1162089781 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072400bb60 con 0x7f072c0ad990 2023-10-06T10:59:08.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.803+0000 7f0723fff700 1 -- 172.21.15.7:0/1162089781 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724012430 con 0x7f072c0ad990 2023-10-06T10:59:08.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.803+0000 7f0733570700 1 -- 172.21.15.7:0/1162089781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f072c0ad990 msgr2=0x7f072c0ac7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.803+0000 7f0733570700 1 --2- 172.21.15.7:0/1162089781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f072c0ad990 0x7f072c0ac7f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f072c0b25c0 tx=0x7f0724009780 comp rx=0 tx=0).stop 2023-10-06T10:59:08.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.803+0000 7f0733570700 1 -- 172.21.15.7:0/1162089781 shutdown_connections 2023-10-06T10:59:08.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.803+0000 7f0733570700 1 --2- 172.21.15.7:0/1162089781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f072c0ad990 0x7f072c0ac7f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.803+0000 7f0733570700 1 --2- 172.21.15.7:0/1162089781 >> v2:172.21.15.50:3300/0 conn(0x7f072c0a6e20 0x7f072c0c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.803+0000 7f0733570700 1 -- 172.21.15.7:0/1162089781 >> 172.21.15.7:0/1162089781 conn(0x7f072c095a70 msgr2=0x7f072c0af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:08.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.804+0000 7f0733570700 1 -- 172.21.15.7:0/1162089781 shutdown_connections 2023-10-06T10:59:08.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.804+0000 7f0733570700 1 -- 172.21.15.7:0/1162089781 wait complete. 2023-10-06T10:59:08.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.805+0000 7f0733570700 1 Processor -- start 2023-10-06T10:59:08.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.805+0000 7f0733570700 1 -- start start 2023-10-06T10:59:08.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0733570700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f072c0a6e20 0x7f072c0c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0733570700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f072c0ad990 0x7f072c0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0733570700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f072c0afb40 0x7f072c0c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0733570700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0c9bb0 con 0x7f072c0afb40 2023-10-06T10:59:08.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0733570700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c16d2b0 con 0x7f072c0a6e20 2023-10-06T10:59:08.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0733570700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c16d590 con 0x7f072c0ad990 2023-10-06T10:59:08.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0731b0d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f072c0afb40 0x7f072c0c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0731b0d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f072c0afb40 0x7f072c0c5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55020/0 (socket says 172.21.15.7:55020) 2023-10-06T10:59:08.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0731b0d700 1 -- 172.21.15.7:0/3894646488 learned_addr learned my addr 172.21.15.7:0/3894646488 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:08.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f073130c700 1 --2- 172.21.15.7:0/3894646488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f072c0a6e20 0x7f072c0c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0730b0b700 1 --2- 172.21.15.7:0/3894646488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f072c0ad990 0x7f072c0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0731b0d700 1 -- 172.21.15.7:0/3894646488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f072c0ad990 msgr2=0x7f072c0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0731b0d700 1 --2- 172.21.15.7:0/3894646488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f072c0ad990 0x7f072c0cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0731b0d700 1 -- 172.21.15.7:0/3894646488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f072c0a6e20 msgr2=0x7f072c0c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:08.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0731b0d700 1 --2- 172.21.15.7:0/3894646488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f072c0a6e20 0x7f072c0c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:08.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0731b0d700 1 -- 172.21.15.7:0/3894646488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0724009a20 con 0x7f072c0afb40 2023-10-06T10:59:08.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.806+0000 7f0731b0d700 1 --2- 172.21.15.7:0/3894646488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f072c0afb40 0x7f072c0c5720 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07240099f0 tx=0x7f0724019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:08.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.807+0000 7f07217fa700 1 -- 172.21.15.7:0/3894646488 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724027470 con 0x7f072c0afb40 2023-10-06T10:59:08.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.807+0000 7f07217fa700 1 -- 172.21.15.7:0/3894646488 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0724027610 con 0x7f072c0afb40 2023-10-06T10:59:08.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.807+0000 7f0733570700 1 -- 172.21.15.7:0/3894646488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072c16d870 con 0x7f072c0afb40 2023-10-06T10:59:08.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.807+0000 7f07217fa700 1 -- 172.21.15.7:0/3894646488 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240279d0 con 0x7f072c0afb40 2023-10-06T10:59:08.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.807+0000 7f0733570700 1 -- 172.21.15.7:0/3894646488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072c0cbcd0 con 0x7f072c0afb40 2023-10-06T10:59:08.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.808+0000 7f0733570700 1 -- 172.21.15.7:0/3894646488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072c070480 con 0x7f072c0afb40 2023-10-06T10:59:08.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.808+0000 7f07217fa700 1 -- 172.21.15.7:0/3894646488 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0724024070 con 0x7f072c0afb40 2023-10-06T10:59:08.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.808+0000 7f07217fa700 1 --2- 172.21.15.7:0/3894646488 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0710066f30 0x7f07100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:08.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.809+0000 7f07217fa700 1 -- 172.21.15.7:0/3894646488 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0724086f40 con 0x7f072c0afb40 2023-10-06T10:59:08.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.809+0000 7f073130c700 1 --2- 172.21.15.7:0/3894646488 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0710066f30 0x7f07100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:08.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.809+0000 7f073130c700 1 --2- 172.21.15.7:0/3894646488 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0710066f30 0x7f07100693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0728009db0 tx=0x7f07280091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:08.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:08.813+0000 7f07217fa700 1 -- 172.21.15.7:0/3894646488 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0724053d60 con 0x7f072c0afb40 2023-10-06T10:59:09.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.067+0000 7f0733570700 1 -- 172.21.15.7:0/3894646488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f072c067340 con 0x7f072c0afb40 2023-10-06T10:59:09.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.067+0000 7f07217fa700 1 -- 172.21.15.7:0/3894646488 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4581 (secure 0 0 0) 0x7f072402c090 con 0x7f072c0afb40 2023-10-06T10:59:09.069 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:09.069 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/941534596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":941534596},{"type":"v1","addr":"172.21.15.50:6835","nonce":941534596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3152699387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3152699387},{"type":"v1","addr":"172.21.15.50:6834","nonce":3152699387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/271704556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":271704556},{"type":"v1","addr":"172.21.15.7:6837","nonce":271704556}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T10:59:01.833627+0000","modified":"2023-10-06T10:59:07.483243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3123178887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3123178887},{"type":"v1","addr":"172.21.15.7:6836","nonce":3123178887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T10:59:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.070+0000 7f0733570700 1 -- 172.21.15.7:0/3894646488 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0710066f30 msgr2=0x7f07100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.070+0000 7f0733570700 1 --2- 172.21.15.7:0/3894646488 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0710066f30 0x7f07100693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0728009db0 tx=0x7f07280091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.070+0000 7f0733570700 1 -- 172.21.15.7:0/3894646488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f072c0afb40 msgr2=0x7f072c0c5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.070+0000 7f0733570700 1 --2- 172.21.15.7:0/3894646488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f072c0afb40 0x7f072c0c5720 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07240099f0 tx=0x7f0724019000 comp rx=0 tx=0).stop 2023-10-06T10:59:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.070+0000 7f0733570700 1 -- 172.21.15.7:0/3894646488 shutdown_connections 2023-10-06T10:59:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.070+0000 7f0733570700 1 --2- 172.21.15.7:0/3894646488 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0710066f30 0x7f07100693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.070+0000 7f0733570700 1 --2- 172.21.15.7:0/3894646488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f072c0afb40 0x7f072c0c5720 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.070+0000 7f0733570700 1 --2- 172.21.15.7:0/3894646488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f072c0a6e20 0x7f072c0c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.070+0000 7f0733570700 1 --2- 172.21.15.7:0/3894646488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f072c0ad990 0x7f072c0cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:09.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.070+0000 7f0733570700 1 -- 172.21.15.7:0/3894646488 >> 172.21.15.7:0/3894646488 conn(0x7f072c095a70 msgr2=0x7f072c06afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:09.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.070+0000 7f0733570700 1 -- 172.21.15.7:0/3894646488 shutdown_connections 2023-10-06T10:59:09.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.070+0000 7f0733570700 1 -- 172.21.15.7:0/3894646488 wait complete. 2023-10-06T10:59:09.073 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 7 2023-10-06T10:59:09.085 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:09.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.215+0000 7ff9a2651700 1 Processor -- start 2023-10-06T10:59:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.215+0000 7ff9a2651700 1 -- start start 2023-10-06T10:59:09.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff9a2651700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff99c068100 0x7ff99c0a6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:09.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff9a2651700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff99c0ac7f0 0x7ff99c0a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:09.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff9a2651700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99c0b0250 con 0x7ff99c159360 2023-10-06T10:59:09.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff9a2651700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c0aeba0 con 0x7ff99c068100 2023-10-06T10:59:09.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff9a2651700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c159730 con 0x7ff99c0ac7f0 2023-10-06T10:59:09.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff99b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff99c068100 0x7ff99c0a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:09.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff99b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff99c068100 0x7ff99c0a6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55024/0 (socket says 172.21.15.7:55024) 2023-10-06T10:59:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff99bfff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff99c159360 0x7ff99c0afb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36200/0 (socket says 172.21.15.7:36200) 2023-10-06T10:59:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff99b7fe700 1 -- 172.21.15.7:0/1812375282 learned_addr learned my addr 172.21.15.7:0/1812375282 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff9a0bee700 1 --2- 172.21.15.7:0/1812375282 >> v2:172.21.15.50:3300/0 conn(0x7ff99c0ac7f0 0x7ff99c0a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff99b7fe700 1 -- 172.21.15.7:0/1812375282 >> v2:172.21.15.50:3300/0 conn(0x7ff99c0ac7f0 msgr2=0x7ff99c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff99b7fe700 1 --2- 172.21.15.7:0/1812375282 >> v2:172.21.15.50:3300/0 conn(0x7ff99c0ac7f0 0x7ff99c0a6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff99b7fe700 1 -- 172.21.15.7:0/1812375282 >> v1:172.21.15.7:6789/0 conn(0x7ff99c159360 legacy=0x7ff99c0afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff99affd700 1 -- 172.21.15.7:0/1812375282 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223292892 0 0) 0x7ff98c001110 con 0x7ff99c159360 2023-10-06T10:59:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff99b7fe700 1 -- 172.21.15.7:0/1812375282 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c0ae270 con 0x7ff99c068100 2023-10-06T10:59:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff99b7fe700 1 --2- 172.21.15.7:0/1812375282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff99c068100 0x7ff99c0a6980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff99c06fc90 tx=0x7ff990009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7ef007bd86ee26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff99affd700 1 -- 172.21.15.7:0/1812375282 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990009e70 con 0x7ff99c068100 2023-10-06T10:59:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff99affd700 1 -- 172.21.15.7:0/1812375282 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99000b860 con 0x7ff99c068100 2023-10-06T10:59:09.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.216+0000 7ff99affd700 1 -- 172.21.15.7:0/1812375282 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99000bc00 con 0x7ff99c068100 2023-10-06T10:59:09.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.217+0000 7ff9a2651700 1 -- 172.21.15.7:0/1812375282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff99c068100 msgr2=0x7ff99c0a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:09.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.217+0000 7ff9a2651700 1 --2- 172.21.15.7:0/1812375282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff99c068100 0x7ff99c0a6980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff99c06fc90 tx=0x7ff990009250 comp rx=0 tx=0).stop 2023-10-06T10:59:09.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.217+0000 7ff9a2651700 1 -- 172.21.15.7:0/1812375282 shutdown_connections 2023-10-06T10:59:09.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.217+0000 7ff9a2651700 1 --2- 172.21.15.7:0/1812375282 >> v2:172.21.15.50:3300/0 conn(0x7ff99c0ac7f0 0x7ff99c0a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:09.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.217+0000 7ff9a2651700 1 --2- 172.21.15.7:0/1812375282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff99c068100 0x7ff99c0a6980 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:09.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.217+0000 7ff9a2651700 1 -- 172.21.15.7:0/1812375282 >> 172.21.15.7:0/1812375282 conn(0x7ff99c095a70 msgr2=0x7ff99c0af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:09.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.217+0000 7ff9a2651700 1 -- 172.21.15.7:0/1812375282 shutdown_connections 2023-10-06T10:59:09.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.217+0000 7ff9a2651700 1 -- 172.21.15.7:0/1812375282 wait complete. 2023-10-06T10:59:09.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.218+0000 7ff9a2651700 1 Processor -- start 2023-10-06T10:59:09.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.219+0000 7ff9a2651700 1 -- start start 2023-10-06T10:59:09.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.219+0000 7ff9a2651700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c068100 0x7ff99c0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:09.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.219+0000 7ff9a2651700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff99c0ac7f0 0x7ff99c153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:09.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.219+0000 7ff9a2651700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff99c159360 0x7ff99c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:09.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.219+0000 7ff9a2651700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c0ccdd0 con 0x7ff99c159360 2023-10-06T10:59:09.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.219+0000 7ff9a2651700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c098df0 con 0x7ff99c068100 2023-10-06T10:59:09.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff9a2651700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c0cc810 con 0x7ff99c0ac7f0 2023-10-06T10:59:09.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff9a0bee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff99c159360 0x7ff99c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:09.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff9a0bee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff99c159360 0x7ff99c0c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55040/0 (socket says 172.21.15.7:55040) 2023-10-06T10:59:09.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff9a0bee700 1 -- 172.21.15.7:0/3446038993 learned_addr learned my addr 172.21.15.7:0/3446038993 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:09.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff99bfff700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c068100 0x7ff99c0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:09.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff99b7fe700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff99c0ac7f0 0x7ff99c153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff9a0bee700 1 -- 172.21.15.7:0/3446038993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff99c0ac7f0 msgr2=0x7ff99c153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff9a0bee700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff99c0ac7f0 0x7ff99c153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff9a0bee700 1 -- 172.21.15.7:0/3446038993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c068100 msgr2=0x7ff99c0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff9a0bee700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c068100 0x7ff99c0cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff9a0bee700 1 -- 172.21.15.7:0/3446038993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9900094f0 con 0x7ff99c159360 2023-10-06T10:59:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff99b7fe700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff99c0ac7f0 0x7ff99c153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff99bfff700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c068100 0x7ff99c0cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff9a0bee700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff99c159360 0x7ff99c0c9700 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff994009e90 tx=0x7ff99400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff983fff700 1 -- 172.21.15.7:0/3446038993 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99400cc20 con 0x7ff99c159360 2023-10-06T10:59:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff983fff700 1 -- 172.21.15.7:0/3446038993 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99400f040 con 0x7ff99c159360 2023-10-06T10:59:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff983fff700 1 -- 172.21.15.7:0/3446038993 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994014480 con 0x7ff99c159360 2023-10-06T10:59:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff9a2651700 1 -- 172.21.15.7:0/3446038993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99c0ccaf0 con 0x7ff99c159360 2023-10-06T10:59:09.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.220+0000 7ff9a2651700 1 -- 172.21.15.7:0/3446038993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99c0c8f30 con 0x7ff99c159360 2023-10-06T10:59:09.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.221+0000 7ff9a2651700 1 -- 172.21.15.7:0/3446038993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99c0988e0 con 0x7ff99c159360 2023-10-06T10:59:09.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.222+0000 7ff983fff700 1 -- 172.21.15.7:0/3446038993 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9940147f0 con 0x7ff99c159360 2023-10-06T10:59:09.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.222+0000 7ff983fff700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff988066f30 0x7ff9880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:09.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.222+0000 7ff99bfff700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff988066f30 0x7ff9880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:09.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.222+0000 7ff983fff700 1 -- 172.21.15.7:0/3446038993 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff9940856d0 con 0x7ff99c159360 2023-10-06T10:59:09.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.223+0000 7ff99bfff700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff988066f30 0x7ff9880693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff99c158f70 tx=0x7ff98c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:09.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.227+0000 7ff983fff700 1 -- 172.21.15.7:0/3446038993 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff99c0988e0 con 0x7ff99c159360 2023-10-06T10:59:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.434+0000 7ff9a2651700 1 -- 172.21.15.7:0/3446038993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff99c0988e0 con 0x7ff99c159360 2023-10-06T10:59:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.435+0000 7ff983fff700 1 -- 172.21.15.7:0/3446038993 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7ff99c0988e0 con 0x7ff99c159360 2023-10-06T10:59:09.437 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:09.437 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:06.934264+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.437+0000 7ff9a2651700 1 -- 172.21.15.7:0/3446038993 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff988066f30 msgr2=0x7ff9880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.437+0000 7ff9a2651700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff988066f30 0x7ff9880693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff99c158f70 tx=0x7ff98c009040 comp rx=0 tx=0).stop 2023-10-06T10:59:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.437+0000 7ff9a2651700 1 -- 172.21.15.7:0/3446038993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff99c159360 msgr2=0x7ff99c0c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.437+0000 7ff9a2651700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff99c159360 0x7ff99c0c9700 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff994009e90 tx=0x7ff99400b040 comp rx=0 tx=0).stop 2023-10-06T10:59:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.438+0000 7ff9a2651700 1 -- 172.21.15.7:0/3446038993 shutdown_connections 2023-10-06T10:59:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.438+0000 7ff9a2651700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff988066f30 0x7ff9880693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.438+0000 7ff9a2651700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff99c159360 0x7ff99c0c9700 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.438+0000 7ff9a2651700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c068100 0x7ff99c0cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.438+0000 7ff9a2651700 1 --2- 172.21.15.7:0/3446038993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff99c0ac7f0 0x7ff99c153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:09.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.438+0000 7ff9a2651700 1 -- 172.21.15.7:0/3446038993 >> 172.21.15.7:0/3446038993 conn(0x7ff99c095a70 msgr2=0x7ff99c159990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:09.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.438+0000 7ff9a2651700 1 -- 172.21.15.7:0/3446038993 shutdown_connections 2023-10-06T10:59:09.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.438+0000 7ff9a2651700 1 -- 172.21.15.7:0/3446038993 wait complete. 2023-10-06T10:59:09.855 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T10:59:01.833627+0000', 'modified': '2023-10-06T10:59:07.483243+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6836/3123178887', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3123178887}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3123178887}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-10-06T10:59:09.856 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T10:59:09.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T10:59:09.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.996+0000 7f9ac317e700 1 Processor -- start 2023-10-06T10:59:09.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.996+0000 7f9ac317e700 1 -- start start 2023-10-06T10:59:10.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.997+0000 7f9ac317e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9abc15d5e0 0x7f9abc15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.997+0000 7f9ac317e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9abc0cc8e0 0x7f9abc0ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.997+0000 7f9ac317e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9abc15b210 con 0x7f9abc159240 2023-10-06T10:59:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.997+0000 7f9ac317e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9abc068a90 con 0x7f9abc0cc8e0 2023-10-06T10:59:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.997+0000 7f9ac317e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc0698b0 con 0x7f9abc15d5e0 2023-10-06T10:59:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.997+0000 7f9ac171b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9abc0cc8e0 0x7f9abc0ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.997+0000 7f9ac171b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9abc0cc8e0 0x7f9abc0ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55054/0 (socket says 172.21.15.7:55054) 2023-10-06T10:59:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.997+0000 7f9ac171b700 1 -- 172.21.15.7:0/3926428965 learned_addr learned my addr 172.21.15.7:0/3926428965 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.998+0000 7f9abbfff700 1 --2- 172.21.15.7:0/3926428965 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9abc15d5e0 0x7f9abc15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.998+0000 7f9ac171b700 1 -- 172.21.15.7:0/3926428965 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9abc15d5e0 msgr2=0x7f9abc15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.998+0000 7f9ac171b700 1 --2- 172.21.15.7:0/3926428965 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9abc15d5e0 0x7f9abc15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.998+0000 7f9ac171b700 1 -- 172.21.15.7:0/3926428965 >> v1:172.21.15.50:6789/0 conn(0x7f9abc159240 legacy=0x7f9abc15ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.998+0000 7f9ac171b700 1 -- 172.21.15.7:0/3926428965 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc0cd2a0 con 0x7f9abc0cc8e0 2023-10-06T10:59:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.998+0000 7f9ac171b700 1 --2- 172.21.15.7:0/3926428965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9abc0cc8e0 0x7f9abc0ccd60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009f20 tx=0x7f9ab4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac760f58c3fd772c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.998+0000 7f9abb7fe700 1 -- 172.21.15.7:0/3926428965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab400e070 con 0x7f9abc0cc8e0 2023-10-06T10:59:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.998+0000 7f9abb7fe700 1 -- 172.21.15.7:0/3926428965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab400ba80 con 0x7f9abc0cc8e0 2023-10-06T10:59:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.998+0000 7f9abb7fe700 1 -- 172.21.15.7:0/3926428965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40092e0 con 0x7f9abc0cc8e0 2023-10-06T10:59:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.999+0000 7f9ac317e700 1 -- 172.21.15.7:0/3926428965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9abc0cc8e0 msgr2=0x7f9abc0ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.999+0000 7f9ac317e700 1 --2- 172.21.15.7:0/3926428965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9abc0cc8e0 0x7f9abc0ccd60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009f20 tx=0x7f9ab4009840 comp rx=0 tx=0).stop 2023-10-06T10:59:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.999+0000 7f9ac317e700 1 -- 172.21.15.7:0/3926428965 shutdown_connections 2023-10-06T10:59:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.999+0000 7f9ac317e700 1 --2- 172.21.15.7:0/3926428965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9abc0cc8e0 0x7f9abc0ccd60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.999+0000 7f9ac317e700 1 --2- 172.21.15.7:0/3926428965 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9abc15d5e0 0x7f9abc15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.999+0000 7f9ac317e700 1 -- 172.21.15.7:0/3926428965 >> 172.21.15.7:0/3926428965 conn(0x7f9abc087920 msgr2=0x7f9abc097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:10.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.999+0000 7f9ac317e700 1 -- 172.21.15.7:0/3926428965 shutdown_connections 2023-10-06T10:59:10.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:09.999+0000 7f9ac317e700 1 -- 172.21.15.7:0/3926428965 wait complete. 2023-10-06T10:59:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.000+0000 7f9ac317e700 1 Processor -- start 2023-10-06T10:59:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.000+0000 7f9ac317e700 1 -- start start 2023-10-06T10:59:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac317e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9abc0cc8e0 0x7f9abc0b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac317e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9abc159240 0x7f9abc069d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac317e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9abc15d5e0 0x7f9abc06a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac317e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc1547b0 con 0x7f9abc15d5e0 2023-10-06T10:59:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac317e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc0c56f0 con 0x7f9abc159240 2023-10-06T10:59:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac317e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc0c6270 con 0x7f9abc0cc8e0 2023-10-06T10:59:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac171b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9abc15d5e0 0x7f9abc06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac171b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9abc15d5e0 0x7f9abc06a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55062/0 (socket says 172.21.15.7:55062) 2023-10-06T10:59:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac171b700 1 -- 172.21.15.7:0/1949743100 learned_addr learned my addr 172.21.15.7:0/1949743100 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9abbfff700 1 --2- 172.21.15.7:0/1949743100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9abc159240 0x7f9abc069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac0f1a700 1 --2- 172.21.15.7:0/1949743100 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9abc0cc8e0 0x7f9abc0b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac171b700 1 -- 172.21.15.7:0/1949743100 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9abc0cc8e0 msgr2=0x7f9abc0b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac171b700 1 --2- 172.21.15.7:0/1949743100 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9abc0cc8e0 0x7f9abc0b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac171b700 1 -- 172.21.15.7:0/1949743100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9abc159240 msgr2=0x7f9abc069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac171b700 1 --2- 172.21.15.7:0/1949743100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9abc159240 0x7f9abc069d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.001+0000 7f9ac171b700 1 -- 172.21.15.7:0/1949743100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab4009ae0 con 0x7f9abc15d5e0 2023-10-06T10:59:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.002+0000 7f9ac171b700 1 --2- 172.21.15.7:0/1949743100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9abc15d5e0 0x7f9abc06a280 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400b6c0 tx=0x7f9ab4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.002+0000 7f9ab8ff9700 1 -- 172.21.15.7:0/1949743100 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40032f0 con 0x7f9abc15d5e0 2023-10-06T10:59:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.002+0000 7f9ab8ff9700 1 -- 172.21.15.7:0/1949743100 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab4008d10 con 0x7f9abc15d5e0 2023-10-06T10:59:10.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.002+0000 7f9ac317e700 1 -- 172.21.15.7:0/1949743100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9abc0c5940 con 0x7f9abc15d5e0 2023-10-06T10:59:10.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.002+0000 7f9ab8ff9700 1 -- 172.21.15.7:0/1949743100 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4025690 con 0x7f9abc15d5e0 2023-10-06T10:59:10.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.002+0000 7f9ac317e700 1 -- 172.21.15.7:0/1949743100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9abc0c5f00 con 0x7f9abc15d5e0 2023-10-06T10:59:10.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.003+0000 7f9ab8ff9700 1 -- 172.21.15.7:0/1949743100 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ab4003040 con 0x7f9abc15d5e0 2023-10-06T10:59:10.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.004+0000 7f9ab8ff9700 1 --2- 172.21.15.7:0/1949743100 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9a9c066f30 0x7f9a9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.004+0000 7f9ab8ff9700 1 -- 172.21.15.7:0/1949743100 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9ab4086500 con 0x7f9abc15d5e0 2023-10-06T10:59:10.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.004+0000 7f9ac0f1a700 1 --2- 172.21.15.7:0/1949743100 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9a9c066f30 0x7f9a9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.004+0000 7f9ac0f1a700 1 --2- 172.21.15.7:0/1949743100 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9a9c066f30 0x7f9a9c0693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0c4e70 tx=0x7f9aac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:10.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.006+0000 7f9acc492b80 1 Processor -- start 2023-10-06T10:59:10.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.006+0000 7f9acc492b80 1 -- start start 2023-10-06T10:59:10.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.006+0000 7f9acc492b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 0x559ec4602820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.006+0000 7f9acc492b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec45e7f40 0x559ec460af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.006+0000 7f9acc492b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec460b4d0 0x559ec460b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9acc492b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ec44d5310 con 0x559ec460b4d0 2023-10-06T10:59:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9acc492b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ec4512130 con 0x559ec4602450 2023-10-06T10:59:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9acc492b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ec450faf0 con 0x559ec45e7f40 2023-10-06T10:59:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9ac171b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec460b4d0 0x559ec460b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9ac171b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec460b4d0 0x559ec460b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55076/0 (socket says 172.21.15.7:55076) 2023-10-06T10:59:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9ac171b700 1 -- 172.21.15.7:0/2524458847 learned_addr learned my addr 172.21.15.7:0/2524458847 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9abbfff700 1 --2- 172.21.15.7:0/2524458847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec45e7f40 0x559ec460af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9ac0f1a700 1 --2- 172.21.15.7:0/2524458847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 0x559ec4602820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9ac171b700 1 -- 172.21.15.7:0/2524458847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec45e7f40 msgr2=0x559ec460af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9ac171b700 1 --2- 172.21.15.7:0/2524458847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec45e7f40 0x559ec460af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9ac171b700 1 -- 172.21.15.7:0/2524458847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 msgr2=0x559ec4602820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9ac171b700 1 --2- 172.21.15.7:0/2524458847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 0x559ec4602820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9ac171b700 1 -- 172.21.15.7:0/2524458847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ec4311790 con 0x559ec460b4d0 2023-10-06T10:59:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9ac171b700 1 --2- 172.21.15.7:0/2524458847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec460b4d0 0x559ec460b940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40094b0 tx=0x7f9ab4084530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cac7ad62cb7b4fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9ab1ffb700 1 -- 172.21.15.7:0/2524458847 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab400e040 con 0x559ec460b4d0 2023-10-06T10:59:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9ab1ffb700 1 -- 172.21.15.7:0/2524458847 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab40070e0 con 0x559ec460b4d0 2023-10-06T10:59:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.007+0000 7f9ab1ffb700 1 -- 172.21.15.7:0/2524458847 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4011390 con 0x559ec460b4d0 2023-10-06T10:59:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.008+0000 7f9acc492b80 1 -- 172.21.15.7:0/2524458847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec460b4d0 msgr2=0x559ec460b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.008+0000 7f9acc492b80 1 --2- 172.21.15.7:0/2524458847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec460b4d0 0x559ec460b940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40094b0 tx=0x7f9ab4084530 comp rx=0 tx=0).stop 2023-10-06T10:59:10.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.008+0000 7f9acc492b80 1 -- 172.21.15.7:0/2524458847 shutdown_connections 2023-10-06T10:59:10.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.008+0000 7f9acc492b80 1 --2- 172.21.15.7:0/2524458847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec460b4d0 0x559ec460b940 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.008+0000 7f9acc492b80 1 --2- 172.21.15.7:0/2524458847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 0x559ec4602820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.008+0000 7f9acc492b80 1 --2- 172.21.15.7:0/2524458847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec45e7f40 0x559ec460af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.008+0000 7f9acc492b80 1 -- 172.21.15.7:0/2524458847 >> 172.21.15.7:0/2524458847 conn(0x559ec4605880 msgr2=0x559ec4605c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:10.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.008+0000 7f9acc492b80 1 -- 172.21.15.7:0/2524458847 shutdown_connections 2023-10-06T10:59:10.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.008+0000 7f9acc492b80 1 -- 172.21.15.7:0/2524458847 wait complete. 2023-10-06T10:59:10.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.009+0000 7f9acc492b80 1 -- start start 2023-10-06T10:59:10.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.009+0000 7f9acc492b80 1 Processor -- start 2023-10-06T10:59:10.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9acc492b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec45e7f40 0x559ec4604400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9acc492b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 0x559ec45d92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9acc492b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec460b4d0 0x559ec45dfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9acc492b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ec450b8e0 con 0x559ec45e7f40 2023-10-06T10:59:10.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9acc492b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ec44b7980 con 0x559ec4602450 2023-10-06T10:59:10.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9acc492b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ec44b7620 con 0x559ec460b4d0 2023-10-06T10:59:10.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9acc492b80 10 client.0 _ll_register_callbacks cb 0x559ec431aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T10:59:10.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9ac0f1a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec45e7f40 0x559ec4604400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9ac0f1a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec45e7f40 0x559ec4604400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55080/0 (socket says 172.21.15.7:55080) 2023-10-06T10:59:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9ac0f1a700 1 -- 172.21.15.7:0/308976834 learned_addr learned my addr 172.21.15.7:0/308976834 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9abbfff700 1 --2- 172.21.15.7:0/308976834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 0x559ec45d92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9ac171b700 1 --2- 172.21.15.7:0/308976834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec460b4d0 0x559ec45dfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9ac0f1a700 1 -- 172.21.15.7:0/308976834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec460b4d0 msgr2=0x559ec45dfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9ac0f1a700 1 --2- 172.21.15.7:0/308976834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec460b4d0 0x559ec45dfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9ac0f1a700 1 -- 172.21.15.7:0/308976834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 msgr2=0x559ec45d92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9ac0f1a700 1 --2- 172.21.15.7:0/308976834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 0x559ec45d92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9ac0f1a700 1 -- 172.21.15.7:0/308976834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9abc0c5f00 con 0x559ec45e7f40 2023-10-06T10:59:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.010+0000 7f9ac0f1a700 1 --2- 172.21.15.7:0/308976834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec45e7f40 0x559ec4604400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9aac014830 tx=0x7f9aac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12b80e4f98c3ab6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9a9affd700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-06T10:59:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9a9affd700 1 -- 172.21.15.7:0/308976834 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac021400 con 0x559ec45e7f40 2023-10-06T10:59:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9acc492b80 1 -- 172.21.15.7:0/308976834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ec45afd60 con 0x559ec45e7f40 2023-10-06T10:59:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9a9affd700 1 -- 172.21.15.7:0/308976834 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9aac01c040 con 0x559ec45e7f40 2023-10-06T10:59:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9a9affd700 1 -- 172.21.15.7:0/308976834 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9aac021770 con 0x559ec45e7f40 2023-10-06T10:59:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9acc492b80 10 client.4428 fetch_fsmap learned FSMap version 7 2023-10-06T10:59:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9acc492b80 1 -- 172.21.15.7:0/308976834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x559ec43fe0a0 con 0x559ec45e7f40 2023-10-06T10:59:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9a9affd700 1 -- 172.21.15.7:0/308976834 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ec45afd60 con 0x559ec45e7f40 2023-10-06T10:59:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9a9affd700 1 -- 172.21.15.7:0/308976834 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f9aac0218d0 con 0x559ec45e7f40 2023-10-06T10:59:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9acc492b80 10 client.4428 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T10:59:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9acc492b80 10 client.4428 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T10:59:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9acc492b80 20 client.4428 populate_metadata read hostname 'smithi007' 2023-10-06T10:59:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9acc492b80 1 --2- 172.21.15.7:0/308976834 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x559ec45e0690 0x559ec45e0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9acc492b80 4 client.4428 mds_command: new command op to 4272 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T10:59:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9acc492b80 1 -- 172.21.15.7:0/308976834 --> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ec458cb30 con 0x559ec45e0690 2023-10-06T10:59:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.011+0000 7f9abbfff700 1 --2- 172.21.15.7:0/308976834 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x559ec45e0690 0x559ec45e0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.012+0000 7f9a9affd700 10 client.4428 ms_handle_connect on v2:172.21.15.7:6834/3123178887 2023-10-06T10:59:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.012+0000 7f9abbfff700 1 --2- 172.21.15.7:0/308976834 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x559ec45e0690 0x559ec45e0a60 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f493498591365e19 server_cookie=ed97147efd2caf8e in_seq=0 out_seq=0 2023-10-06T10:59:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.012+0000 7f9a9affd700 1 -- 172.21.15.7:0/308976834 <== mds.0 v2:172.21.15.7:6834/3123178887 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559ec458cb30 con 0x559ec45e0690 2023-10-06T10:59:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.012+0000 7f9a9affd700 10 client.4428 handle_command_reply: tid=0 2023-10-06T10:59:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.012+0000 7f9acc492b80 1 client.4428 shutdown 2023-10-06T10:59:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.012+0000 7f9acc492b80 1 -- 172.21.15.7:0/308976834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec45e7f40 msgr2=0x559ec4604400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.012+0000 7f9acc492b80 1 --2- 172.21.15.7:0/308976834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec45e7f40 0x559ec4604400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9aac014830 tx=0x7f9aac015000 comp rx=0 tx=0).stop 2023-10-06T10:59:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.013+0000 7f9acc492b80 1 -- 172.21.15.7:0/308976834 shutdown_connections 2023-10-06T10:59:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.013+0000 7f9acc492b80 1 --2- 172.21.15.7:0/308976834 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x559ec45e0690 0x559ec45e0a60 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.013+0000 7f9acc492b80 1 --2- 172.21.15.7:0/308976834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec45e7f40 0x559ec4604400 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.013+0000 7f9acc492b80 1 --2- 172.21.15.7:0/308976834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec460b4d0 0x559ec45dfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.013+0000 7f9a9affd700 0 client.4428 ms_handle_reset on v2:172.21.15.7:6834/3123178887 2023-10-06T10:59:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.013+0000 7f9acc492b80 1 --2- 172.21.15.7:0/308976834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 0x559ec45d92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.013+0000 7f9acc492b80 1 -- 172.21.15.7:0/308976834 >> 172.21.15.7:0/308976834 conn(0x559ec4605880 msgr2=0x559ec45b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.013+0000 7f9acc492b80 1 -- 172.21.15.7:0/308976834 shutdown_connections 2023-10-06T10:59:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.013+0000 7f9acc492b80 1 -- 172.21.15.7:0/308976834 wait complete. 2023-10-06T10:59:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.013+0000 7f9acc492b80 20 client.4428 trim_cache size 0 max 16384 2023-10-06T10:59:10.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.031+0000 7f9acc492b80 1 Processor -- start 2023-10-06T10:59:10.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.031+0000 7f9acc492b80 1 -- start start 2023-10-06T10:59:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9acc492b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec45e7f40 0x559ec4601c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9acc492b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec4602450 0x559ec45e3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9acc492b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec460b4d0 0x559ec45b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9acc492b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ec43a31e0 con 0x559ec4602450 2023-10-06T10:59:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9acc492b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ec45beaa0 con 0x559ec460b4d0 2023-10-06T10:59:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9acc492b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ec45d9660 con 0x559ec45e7f40 2023-10-06T10:59:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9abbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec4602450 0x559ec45e3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9abbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec4602450 0x559ec45e3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55088/0 (socket says 172.21.15.7:55088) 2023-10-06T10:59:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9abbfff700 1 -- 172.21.15.7:0/3541883603 learned_addr learned my addr 172.21.15.7:0/3541883603 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9ac171b700 1 --2- 172.21.15.7:0/3541883603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec460b4d0 0x559ec45b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9ac0f1a700 1 --2- 172.21.15.7:0/3541883603 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec45e7f40 0x559ec4601c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9abbfff700 1 -- 172.21.15.7:0/3541883603 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec45e7f40 msgr2=0x559ec4601c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9abbfff700 1 --2- 172.21.15.7:0/3541883603 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec45e7f40 0x559ec4601c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9abbfff700 1 -- 172.21.15.7:0/3541883603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec460b4d0 msgr2=0x559ec45b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9abbfff700 1 --2- 172.21.15.7:0/3541883603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec460b4d0 0x559ec45b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9abbfff700 1 -- 172.21.15.7:0/3541883603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ec44da3c0 con 0x559ec4602450 2023-10-06T10:59:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9ac171b700 1 --2- 172.21.15.7:0/3541883603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec460b4d0 0x559ec45b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9abbfff700 1 --2- 172.21.15.7:0/3541883603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec4602450 0x559ec45e3e40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4006fd0 tx=0x7f9aa4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391872ec83e0fbba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9ab27fc700 1 -- 172.21.15.7:0/3541883603 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa401f470 con 0x559ec4602450 2023-10-06T10:59:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9ab27fc700 1 -- 172.21.15.7:0/3541883603 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa401f5d0 con 0x559ec4602450 2023-10-06T10:59:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.032+0000 7f9ab27fc700 1 -- 172.21.15.7:0/3541883603 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa401f990 con 0x559ec4602450 2023-10-06T10:59:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.033+0000 7f9acc492b80 1 -- 172.21.15.7:0/3541883603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec4602450 msgr2=0x559ec45e3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.033+0000 7f9acc492b80 1 --2- 172.21.15.7:0/3541883603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec4602450 0x559ec45e3e40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4006fd0 tx=0x7f9aa4008040 comp rx=0 tx=0).stop 2023-10-06T10:59:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.033+0000 7f9acc492b80 1 -- 172.21.15.7:0/3541883603 shutdown_connections 2023-10-06T10:59:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.033+0000 7f9acc492b80 1 --2- 172.21.15.7:0/3541883603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec460b4d0 0x559ec45b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.033+0000 7f9acc492b80 1 --2- 172.21.15.7:0/3541883603 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec45e7f40 0x559ec4601c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.033+0000 7f9acc492b80 1 --2- 172.21.15.7:0/3541883603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec4602450 0x559ec45e3e40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.033+0000 7f9acc492b80 1 -- 172.21.15.7:0/3541883603 >> 172.21.15.7:0/3541883603 conn(0x559ec4605880 msgr2=0x559ec45dcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.033+0000 7f9acc492b80 1 -- 172.21.15.7:0/3541883603 shutdown_connections 2023-10-06T10:59:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.033+0000 7f9acc492b80 1 -- 172.21.15.7:0/3541883603 wait complete. 2023-10-06T10:59:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.034+0000 7f9acc492b80 1 -- start start 2023-10-06T10:59:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.034+0000 7f9acc492b80 1 Processor -- start 2023-10-06T10:59:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9acc492b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec45e7f40 0x559ec45d7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9acc492b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 0x559ec45b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9acc492b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec460b4d0 0x559ec45b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9acc492b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ec4667f20 con 0x559ec45e7f40 2023-10-06T10:59:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9acc492b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ec4602ed0 con 0x559ec4602450 2023-10-06T10:59:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9acc492b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ec45df760 con 0x559ec460b4d0 2023-10-06T10:59:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9acc492b80 10 client.0 _ll_register_callbacks cb 0x559ec431aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T10:59:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9ac0f1a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec45e7f40 0x559ec45d7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9ac0f1a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec45e7f40 0x559ec45d7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55090/0 (socket says 172.21.15.7:55090) 2023-10-06T10:59:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9ac0f1a700 1 -- 172.21.15.7:0/2098687628 learned_addr learned my addr 172.21.15.7:0/2098687628 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9abbfff700 1 --2- 172.21.15.7:0/2098687628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 0x559ec45b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9ac171b700 1 --2- 172.21.15.7:0/2098687628 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec460b4d0 0x559ec45b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9ac0f1a700 1 -- 172.21.15.7:0/2098687628 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec460b4d0 msgr2=0x559ec45b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9ac0f1a700 1 --2- 172.21.15.7:0/2098687628 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec460b4d0 0x559ec45b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9ac0f1a700 1 -- 172.21.15.7:0/2098687628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 msgr2=0x559ec45b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9ac0f1a700 1 --2- 172.21.15.7:0/2098687628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 0x559ec45b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.035+0000 7f9ac0f1a700 1 -- 172.21.15.7:0/2098687628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa400e040 con 0x559ec45e7f40 2023-10-06T10:59:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9ac0f1a700 1 --2- 172.21.15.7:0/2098687628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec45e7f40 0x559ec45d7bc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0214b0 tx=0x7f9aac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1611d6a802005cda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9a9affd700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-06T10:59:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9a9affd700 1 -- 172.21.15.7:0/2098687628 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac014b40 con 0x559ec45e7f40 2023-10-06T10:59:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9a9affd700 1 -- 172.21.15.7:0/2098687628 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9aac021770 con 0x559ec45e7f40 2023-10-06T10:59:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9acc492b80 1 -- 172.21.15.7:0/2098687628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ab40070e0 con 0x559ec45e7f40 2023-10-06T10:59:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9a9affd700 1 -- 172.21.15.7:0/2098687628 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9aac029360 con 0x559ec45e7f40 2023-10-06T10:59:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9acc492b80 10 client.4434 fetch_fsmap learned FSMap version 7 2023-10-06T10:59:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9acc492b80 1 -- 172.21.15.7:0/2098687628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x559ec43721d0 con 0x559ec45e7f40 2023-10-06T10:59:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9a9affd700 1 -- 172.21.15.7:0/2098687628 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab40070e0 con 0x559ec45e7f40 2023-10-06T10:59:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9a9affd700 1 -- 172.21.15.7:0/2098687628 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f9aac0294c0 con 0x559ec45e7f40 2023-10-06T10:59:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9acc492b80 10 client.4434 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T10:59:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9acc492b80 10 client.4434 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T10:59:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9acc492b80 20 client.4434 populate_metadata read hostname 'smithi007' 2023-10-06T10:59:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9acc492b80 1 --2- 172.21.15.7:0/2098687628 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x559ec4666fc0 0x559ec4667390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9acc492b80 4 client.4434 mds_command: new command op to 4272 tid=0[{"prefix": "status"}] 2023-10-06T10:59:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9acc492b80 1 -- 172.21.15.7:0/2098687628 --> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559ec44ae8d0 con 0x559ec4666fc0 2023-10-06T10:59:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.036+0000 7f9abbfff700 1 --2- 172.21.15.7:0/2098687628 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x559ec4666fc0 0x559ec4667390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9a9affd700 10 client.4434 ms_handle_connect on v2:172.21.15.7:6834/3123178887 2023-10-06T10:59:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9abbfff700 1 --2- 172.21.15.7:0/2098687628 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x559ec4666fc0 0x559ec4667390 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4082788d69684886 server_cookie=4542e2553f28bc9 in_seq=0 out_seq=0 2023-10-06T10:59:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9a9affd700 1 -- 172.21.15.7:0/2098687628 <== mds.0 v2:172.21.15.7:6834/3123178887 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x559ec44ae8d0 con 0x559ec4666fc0 2023-10-06T10:59:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9a9affd700 10 client.4434 handle_command_reply: tid=0 2023-10-06T10:59:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9acc492b80 1 client.4434 shutdown 2023-10-06T10:59:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9acc492b80 1 -- 172.21.15.7:0/2098687628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec45e7f40 msgr2=0x559ec45d7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9acc492b80 1 --2- 172.21.15.7:0/2098687628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec45e7f40 0x559ec45d7bc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0214b0 tx=0x7f9aac019000 comp rx=0 tx=0).stop 2023-10-06T10:59:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9acc492b80 1 -- 172.21.15.7:0/2098687628 shutdown_connections 2023-10-06T10:59:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9acc492b80 1 --2- 172.21.15.7:0/2098687628 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x559ec4666fc0 0x559ec4667390 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9acc492b80 1 --2- 172.21.15.7:0/2098687628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ec45e7f40 0x559ec45d7bc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9acc492b80 1 --2- 172.21.15.7:0/2098687628 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559ec460b4d0 0x559ec45b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9a9affd700 0 client.4434 ms_handle_reset on v2:172.21.15.7:6834/3123178887 2023-10-06T10:59:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9acc492b80 1 --2- 172.21.15.7:0/2098687628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ec4602450 0x559ec45b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9acc492b80 1 -- 172.21.15.7:0/2098687628 >> 172.21.15.7:0/2098687628 conn(0x559ec4605880 msgr2=0x559ec45e0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9acc492b80 1 -- 172.21.15.7:0/2098687628 shutdown_connections 2023-10-06T10:59:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.037+0000 7f9acc492b80 1 -- 172.21.15.7:0/2098687628 wait complete. 2023-10-06T10:59:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.038+0000 7f9acc492b80 20 client.4434 trim_cache size 0 max 16384 2023-10-06T10:59:10.047 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T10:59:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "ff7fc17b-4d49-4596-ba3b-1d865cad8f21", 2023-10-06T10:59:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-06T10:59:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4272, 2023-10-06T10:59:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-06T10:59:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-06T10:59:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-06T10:59:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 7.6234707730000002, 2023-10-06T10:59:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 7, 2023-10-06T10:59:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 25, 2023-10-06T10:59:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 24, 2023-10-06T10:59:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 13.543633294999999 2023-10-06T10:59:10.048 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T10:59:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.038+0000 7f9ac317e700 1 -- 172.21.15.7:0/1949743100 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9a9c066f30 msgr2=0x7f9a9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.038+0000 7f9ac317e700 1 --2- 172.21.15.7:0/1949743100 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9a9c066f30 0x7f9a9c0693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0c4e70 tx=0x7f9aac009040 comp rx=0 tx=0).stop 2023-10-06T10:59:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.038+0000 7f9ac317e700 1 -- 172.21.15.7:0/1949743100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9abc15d5e0 msgr2=0x7f9abc06a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.038+0000 7f9ac317e700 1 --2- 172.21.15.7:0/1949743100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9abc15d5e0 0x7f9abc06a280 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400b6c0 tx=0x7f9ab4018000 comp rx=0 tx=0).stop 2023-10-06T10:59:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.038+0000 7f9ac317e700 1 -- 172.21.15.7:0/1949743100 shutdown_connections 2023-10-06T10:59:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.038+0000 7f9ac317e700 1 --2- 172.21.15.7:0/1949743100 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9a9c066f30 0x7f9a9c0693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.038+0000 7f9ac317e700 1 --2- 172.21.15.7:0/1949743100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9abc15d5e0 0x7f9abc06a280 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.038+0000 7f9ac317e700 1 --2- 172.21.15.7:0/1949743100 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9abc0cc8e0 0x7f9abc0b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.038+0000 7f9ac317e700 1 --2- 172.21.15.7:0/1949743100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9abc159240 0x7f9abc069d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.038+0000 7f9ac317e700 1 -- 172.21.15.7:0/1949743100 >> 172.21.15.7:0/1949743100 conn(0x7f9abc087920 msgr2=0x7f9abc15b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.038+0000 7f9ac317e700 1 -- 172.21.15.7:0/1949743100 shutdown_connections 2023-10-06T10:59:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.038+0000 7f9ac317e700 1 -- 172.21.15.7:0/1949743100 wait complete. 2023-10-06T10:59:10.054 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T10:59:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.185+0000 7fa683fd1700 1 Processor -- start 2023-10-06T10:59:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.185+0000 7fa683fd1700 1 -- start start 2023-10-06T10:59:10.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.186+0000 7fa683fd1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa67c0abdb0 0x7fa67c0ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.186+0000 7fa683fd1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa67c15b830 0x7fa67c157110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.186+0000 7fa683fd1700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67c0cdc30 con 0x7fa67c0ac180 2023-10-06T10:59:10.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.186+0000 7fa683fd1700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa67c068d60 con 0x7fa67c15b830 2023-10-06T10:59:10.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.186+0000 7fa683fd1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c0cd390 con 0x7fa67c0abdb0 2023-10-06T10:59:10.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.186+0000 7fa68256e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa67c15b830 0x7fa67c157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.186+0000 7fa681d6d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa67c0abdb0 0x7fa67c0ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.186+0000 7fa68256e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa67c15b830 0x7fa67c157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:50094/0 (socket says 172.21.15.7:50094) 2023-10-06T10:59:10.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.186+0000 7fa68256e700 1 -- 172.21.15.7:0/2246738554 learned_addr learned my addr 172.21.15.7:0/2246738554 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:10.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.186+0000 7fa68156c700 1 --1- 172.21.15.7:0/2246738554 >> v1:172.21.15.50:6789/0 conn(0x7fa67c0ac180 0x7fa67c156a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:40936/0 (socket says 172.21.15.7:40936) 2023-10-06T10:59:10.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.187+0000 7fa68256e700 1 -- 172.21.15.7:0/2246738554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa67c0abdb0 msgr2=0x7fa67c0ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:10.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.187+0000 7fa68256e700 1 --2- 172.21.15.7:0/2246738554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa67c0abdb0 0x7fa67c0ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.187+0000 7fa68256e700 1 -- 172.21.15.7:0/2246738554 >> v1:172.21.15.50:6789/0 conn(0x7fa67c0ac180 legacy=0x7fa67c156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.187+0000 7fa68256e700 1 -- 172.21.15.7:0/2246738554 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c0cd670 con 0x7fa67c15b830 2023-10-06T10:59:10.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.187+0000 7fa68256e700 1 --2- 172.21.15.7:0/2246738554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c15b830 0x7fa67c157110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa674009f20 tx=0x7fa674009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d837cd750e47b118 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:10.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.187+0000 7fa680d6b700 1 -- 172.21.15.7:0/2246738554 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67400e070 con 0x7fa67c15b830 2023-10-06T10:59:10.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.187+0000 7fa680d6b700 1 -- 172.21.15.7:0/2246738554 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67400b9d0 con 0x7fa67c15b830 2023-10-06T10:59:10.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.187+0000 7fa680d6b700 1 -- 172.21.15.7:0/2246738554 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6740092e0 con 0x7fa67c15b830 2023-10-06T10:59:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.188+0000 7fa683fd1700 1 -- 172.21.15.7:0/2246738554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c15b830 msgr2=0x7fa67c157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.188+0000 7fa683fd1700 1 --2- 172.21.15.7:0/2246738554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c15b830 0x7fa67c157110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa674009f20 tx=0x7fa674009840 comp rx=0 tx=0).stop 2023-10-06T10:59:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.188+0000 7fa683fd1700 1 -- 172.21.15.7:0/2246738554 shutdown_connections 2023-10-06T10:59:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.188+0000 7fa683fd1700 1 --2- 172.21.15.7:0/2246738554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c15b830 0x7fa67c157110 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.188+0000 7fa683fd1700 1 --2- 172.21.15.7:0/2246738554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa67c0abdb0 0x7fa67c0ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.188+0000 7fa683fd1700 1 -- 172.21.15.7:0/2246738554 >> 172.21.15.7:0/2246738554 conn(0x7fa67c096160 msgr2=0x7fa67c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.188+0000 7fa683fd1700 1 -- 172.21.15.7:0/2246738554 shutdown_connections 2023-10-06T10:59:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.188+0000 7fa683fd1700 1 -- 172.21.15.7:0/2246738554 wait complete. 2023-10-06T10:59:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.189+0000 7fa683fd1700 1 Processor -- start 2023-10-06T10:59:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.189+0000 7fa683fd1700 1 -- start start 2023-10-06T10:59:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa683fd1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa67c0abdb0 0x7fa67c16a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa683fd1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c0ac180 0x7fa67c169230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa683fd1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa67c15b830 0x7fa67c16d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa683fd1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c16a260 con 0x7fa67c15b830 2023-10-06T10:59:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa683fd1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c157a00 con 0x7fa67c0ac180 2023-10-06T10:59:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa683fd1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c16dff0 con 0x7fa67c0abdb0 2023-10-06T10:59:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa68256e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa67c15b830 0x7fa67c16d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa68256e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa67c15b830 0x7fa67c16d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32958/0 (socket says 172.21.15.7:32958) 2023-10-06T10:59:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa68256e700 1 -- 172.21.15.7:0/1013531577 learned_addr learned my addr 172.21.15.7:0/1013531577 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa681d6d700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa67c0abdb0 0x7fa67c16a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa68156c700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c0ac180 0x7fa67c169230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa68256e700 1 -- 172.21.15.7:0/1013531577 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa67c0abdb0 msgr2=0x7fa67c16a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa68256e700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa67c0abdb0 0x7fa67c16a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa68256e700 1 -- 172.21.15.7:0/1013531577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c0ac180 msgr2=0x7fa67c169230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa68256e700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c0ac180 0x7fa67c169230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa68256e700 1 -- 172.21.15.7:0/1013531577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674009ae0 con 0x7fa67c15b830 2023-10-06T10:59:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.190+0000 7fa68156c700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c0ac180 0x7fa67c169230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.191+0000 7fa68256e700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa67c15b830 0x7fa67c16d100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0b2e50 tx=0x7fa674018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.191+0000 7fa671ffb700 1 -- 172.21.15.7:0/1013531577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674008c70 con 0x7fa67c15b830 2023-10-06T10:59:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.191+0000 7fa671ffb700 1 -- 172.21.15.7:0/1013531577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa674008e10 con 0x7fa67c15b830 2023-10-06T10:59:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.191+0000 7fa683fd1700 1 -- 172.21.15.7:0/1013531577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67c16dd10 con 0x7fa67c15b830 2023-10-06T10:59:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.191+0000 7fa671ffb700 1 -- 172.21.15.7:0/1013531577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6740256b0 con 0x7fa67c15b830 2023-10-06T10:59:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.191+0000 7fa683fd1700 1 -- 172.21.15.7:0/1013531577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67c169ef0 con 0x7fa67c15b830 2023-10-06T10:59:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.192+0000 7fa683fd1700 1 -- 172.21.15.7:0/1013531577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67c16a410 con 0x7fa67c15b830 2023-10-06T10:59:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.192+0000 7fa671ffb700 1 -- 172.21.15.7:0/1013531577 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa674003040 con 0x7fa67c15b830 2023-10-06T10:59:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.193+0000 7fa671ffb700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa660066f30 0x7fa6600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:10.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.193+0000 7fa671ffb700 1 -- 172.21.15.7:0/1013531577 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa674086630 con 0x7fa67c15b830 2023-10-06T10:59:10.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.193+0000 7fa681d6d700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa660066f30 0x7fa6600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:10.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.193+0000 7fa681d6d700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa660066f30 0x7fa6600693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa678009d40 tx=0x7fa678008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:10.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.197+0000 7fa671ffb700 1 -- 172.21.15.7:0/1013531577 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa67c16a410 con 0x7fa67c15b830 2023-10-06T10:59:10.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.452+0000 7fa683fd1700 1 -- 172.21.15.7:0/1013531577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa67c070480 con 0x7fa67c15b830 2023-10-06T10:59:10.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.452+0000 7fa671ffb700 1 -- 172.21.15.7:0/1013531577 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa674053450 con 0x7fa67c15b830 2023-10-06T10:59:10.454 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T10:59:10.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.454+0000 7fa683fd1700 1 -- 172.21.15.7:0/1013531577 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa660066f30 msgr2=0x7fa6600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.454+0000 7fa683fd1700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa660066f30 0x7fa6600693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa678009d40 tx=0x7fa678008040 comp rx=0 tx=0).stop 2023-10-06T10:59:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.454+0000 7fa683fd1700 1 -- 172.21.15.7:0/1013531577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa67c15b830 msgr2=0x7fa67c16d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.454+0000 7fa683fd1700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa67c15b830 0x7fa67c16d100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0b2e50 tx=0x7fa674018000 comp rx=0 tx=0).stop 2023-10-06T10:59:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.454+0000 7fa683fd1700 1 -- 172.21.15.7:0/1013531577 shutdown_connections 2023-10-06T10:59:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.454+0000 7fa683fd1700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa660066f30 0x7fa6600693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.454+0000 7fa683fd1700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa67c15b830 0x7fa67c16d100 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.454+0000 7fa683fd1700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa67c0abdb0 0x7fa67c16a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.454+0000 7fa683fd1700 1 --2- 172.21.15.7:0/1013531577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c0ac180 0x7fa67c169230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.454+0000 7fa683fd1700 1 -- 172.21.15.7:0/1013531577 >> 172.21.15.7:0/1013531577 conn(0x7fa67c096160 msgr2=0x7fa67c0691f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.454+0000 7fa683fd1700 1 -- 172.21.15.7:0/1013531577 shutdown_connections 2023-10-06T10:59:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:10.454+0000 7fa683fd1700 1 -- 172.21.15.7:0/1013531577 wait complete. 2023-10-06T10:59:10.469 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T10:59:10.469 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T10:59:10.469 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-06T10:59:10.470 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-06T10:59:10.470 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-06T10:59:10.470 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T10:59:10.470 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T10:59:10.470 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T10:59:10.470 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T10:59:10.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:10.470 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-06T10:59:10.490 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T10:59:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T10:59:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T10:59:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-06T10:59:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:10.491 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-06T10:59:10.491 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-06T10:59:10.491 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T10:59:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-06T10:59:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T10:59:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42415sec preferred_lft 42415sec 2023-10-06T10:59:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-06T10:59:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:10.492 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-06T10:59:10.493 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T10:59:10.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:10.493 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T10:59:10.493 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T10:59:10.493 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2023-10-06T10:59:10.493 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2023-10-06T10:59:10.493 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2023-10-06T10:59:10.493 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T10:59:10.493 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T10:59:10.511 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T10:59:10.536 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T10:59:10.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:10.711 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T10:59:10.755 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-06T10:59:10.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:10.757 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-06T10:59:10.796 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-06T10:59:10.796 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T10:59:10.796 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T10:59:10.796 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T10:59:10.797 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T10:59:10.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:10.797 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T10:59:10.797 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T10:59:10.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T10:59:10.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T10:59:10.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T10:59:10.797 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T10:59:11.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:11.117 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-06T10:59:11.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:11.140 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2023-10-06T10:59:11.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:11.203 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T10:59:11.203 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T10:59:11.203 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T10:59:11.203 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-06T10:59:11.203 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T10:59:11.315 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-06T10:59:11.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:11.316 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T10:59:11.316 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T10:59:11.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-06T10:59:11.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T10:59:11.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-06T10:59:11.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-06T10:59:11.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-06T10:59:11.316 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T10:59:11.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:11.530 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T10:59:11.530 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T10:59:11.530 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-06T10:59:11.530 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T10:59:11.530 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T10:59:11.642 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-06T10:59:11.642 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T10:59:11.642 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-06T10:59:11.663 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T10:59:11.664 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T10:59:11.664 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-06T10:59:11.726 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T10:59:11.802 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T10:59:11.802 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T10:59:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T10:59:11.878 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T10:59:11.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:11.879 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T10:59:11.943 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T10:59:11.943 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-06T10:59:11.986 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T10:59:12.021 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T10:59:12.022 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T10:59:12.091 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:2023-10-06T10:59:12.089+0000 7f28e7344540 -1 init, newargv = 0x555cc6de4a10 newargc=15 2023-10-06T10:59:12.091 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[126966]: starting ceph client 2023-10-06T10:59:12.095 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T10:59:12.097 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T10:59:12.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:12.097 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T10:59:12.098 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[126966]: starting fuse 2023-10-06T10:59:12.118 INFO:teuthology.orchestra.run.smithi007.stdout:47 2023-10-06T10:59:12.118 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T10:59:12.118 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T10:59:12.118 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2023-10-06T10:59:12.118 DEBUG:teuthology.orchestra.run.smithi007:> import re 2023-10-06T10:59:12.118 DEBUG:teuthology.orchestra.run.smithi007:> import os 2023-10-06T10:59:12.118 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2023-10-06T10:59:12.119 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T10:59:12.119 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2023-10-06T10:59:12.119 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-06T10:59:12.119 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2023-10-06T10:59:12.119 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-06T10:59:12.119 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T10:59:12.119 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2023-10-06T10:59:12.119 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2023-10-06T10:59:12.119 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2023-10-06T10:59:12.119 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2023-10-06T10:59:12.119 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T10:59:12.119 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2023-10-06T10:59:12.120 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T10:59:12.120 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T10:59:12.120 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T10:59:12.120 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2023-10-06T10:59:12.120 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2023-10-06T10:59:12.120 DEBUG:teuthology.orchestra.run.smithi007:> return f 2023-10-06T10:59:12.120 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T10:59:12.120 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T10:59:12.120 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.admin")) 2023-10-06T10:59:12.120 DEBUG:teuthology.orchestra.run.smithi007:> ' 2023-10-06T10:59:12.256 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.admin.126966.asok 2023-10-06T10:59:12.438 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.126966.asok 2023-10-06T10:59:12.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:12.438 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.126966.asok status 2023-10-06T10:59:12.614 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T10:59:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2023-10-06T10:59:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T10:59:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T10:59:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "admin", 2023-10-06T10:59:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2023-10-06T10:59:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-06T10:59:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "126966", 2023-10-06T10:59:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2023-10-06T10:59:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T10:59:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2023-10-06T10:59:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2023-10-06T10:59:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4446, 2023-10-06T10:59:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2023-10-06T10:59:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2023-10-06T10:59:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2023-10-06T10:59:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 4446 2023-10-06T10:59:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T10:59:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T10:59:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T10:59:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T10:59:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3396312475 2023-10-06T10:59:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T10:59:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T10:59:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T10:59:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T10:59:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T10:59:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3396312475 2023-10-06T10:59:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T10:59:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.4446 192.168.0.1:0/3396312475", 2023-10-06T10:59:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.1:0/3396312475", 2023-10-06T10:59:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2023-10-06T10:59:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 7, 2023-10-06T10:59:12.618 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 25, 2023-10-06T10:59:12.618 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2023-10-06T10:59:12.618 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2023-10-06T10:59:12.618 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2023-10-06T10:59:12.618 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T10:59:12.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:12.625 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2023-10-06T10:59:12.626 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-06T10:59:12.646 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2023-10-06T10:59:12.646 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-06T10:59:12.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:12.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-06T10:59:12.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:12.719 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-06T10:59:12.829 INFO:teuthology.orchestra.run.smithi007.stdout:# file: . 2023-10-06T10:59:12.829 INFO:teuthology.orchestra.run.smithi007.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-06T10:59:12.829 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:12.830 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2023-10-06T10:59:12.830 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T10:59:12.830 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-06T10:59:12.876 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[126966]: fuse finished with error 0 and tester_r 0 2023-10-06T10:59:12.878 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T10:59:18.980 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T10:59:18.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:18.981 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-06T10:59:19.017 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:19.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.198+0000 7ff88c009700 1 Processor -- start 2023-10-06T10:59:19.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.198+0000 7ff88c009700 1 -- start start 2023-10-06T10:59:19.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.199+0000 7ff88c009700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8840aaa40 0x7ff8840cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.199+0000 7ff88c009700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff884069110 con 0x7ff8840ac8d0 2023-10-06T10:59:19.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.199+0000 7ff88c009700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff884068b30 con 0x7ff8840ccda0 2023-10-06T10:59:19.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.199+0000 7ff88c009700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8840aafb0 con 0x7ff8840aaa40 2023-10-06T10:59:19.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.199+0000 7ff88a5a6700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff8840ac8d0 0x7ff884155af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60786/0 (socket says 172.21.15.7:60786) 2023-10-06T10:59:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.199+0000 7ff88a5a6700 1 -- 172.21.15.7:0/4156014867 learned_addr learned my addr 172.21.15.7:0/4156014867 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.200+0000 7ff8895a4700 1 --2- 172.21.15.7:0/4156014867 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8840aaa40 0x7ff8840cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.200+0000 7ff888da3700 1 -- 172.21.15.7:0/4156014867 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827799051 0 0) 0x7ff884069110 con 0x7ff8840ac8d0 2023-10-06T10:59:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.200+0000 7ff888da3700 1 -- 172.21.15.7:0/4156014867 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff870003570 con 0x7ff8840ac8d0 2023-10-06T10:59:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.200+0000 7ff8895a4700 1 -- 172.21.15.7:0/4156014867 >> v1:172.21.15.50:6789/0 conn(0x7ff8840ccda0 legacy=0x7ff8840aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.200+0000 7ff8895a4700 1 -- 172.21.15.7:0/4156014867 >> v1:172.21.15.7:6789/0 conn(0x7ff8840ac8d0 legacy=0x7ff884155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.200+0000 7ff888da3700 1 -- 172.21.15.7:0/4156014867 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3608526495 0 0) 0x7ff870003570 con 0x7ff8840ac8d0 2023-10-06T10:59:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.200+0000 7ff8895a4700 1 -- 172.21.15.7:0/4156014867 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff884068da0 con 0x7ff8840aaa40 2023-10-06T10:59:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.200+0000 7ff8895a4700 1 --2- 172.21.15.7:0/4156014867 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8840aaa40 0x7ff8840cd170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff874009910 tx=0x7ff8740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b9b4ccfb3346b29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.200+0000 7ff888da3700 1 -- 172.21.15.7:0/4156014867 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c001770 con 0x7ff8840aaa40 2023-10-06T10:59:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.201+0000 7ff888da3700 1 -- 172.21.15.7:0/4156014867 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff874011420 con 0x7ff8840aaa40 2023-10-06T10:59:19.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.201+0000 7ff888da3700 1 -- 172.21.15.7:0/4156014867 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8740117a0 con 0x7ff8840aaa40 2023-10-06T10:59:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.201+0000 7ff88c009700 1 -- 172.21.15.7:0/4156014867 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8840aaa40 msgr2=0x7ff8840cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.201+0000 7ff88c009700 1 --2- 172.21.15.7:0/4156014867 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8840aaa40 0x7ff8840cd170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff874009910 tx=0x7ff8740091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.201+0000 7ff88c009700 1 -- 172.21.15.7:0/4156014867 shutdown_connections 2023-10-06T10:59:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.201+0000 7ff88c009700 1 --2- 172.21.15.7:0/4156014867 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8840aaa40 0x7ff8840cd170 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.201+0000 7ff88c009700 1 -- 172.21.15.7:0/4156014867 >> 172.21.15.7:0/4156014867 conn(0x7ff884096160 msgr2=0x7ff8840afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.201+0000 7ff88c009700 1 -- 172.21.15.7:0/4156014867 shutdown_connections 2023-10-06T10:59:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.201+0000 7ff88c009700 1 -- 172.21.15.7:0/4156014867 wait complete. 2023-10-06T10:59:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.202+0000 7ff88c009700 1 Processor -- start 2023-10-06T10:59:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.202+0000 7ff88c009700 1 -- start start 2023-10-06T10:59:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.203+0000 7ff88c009700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8840aaa40 0x7ff88414ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.203+0000 7ff88c009700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8840ac8d0 0x7ff88414faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.203+0000 7ff88c009700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8840ccda0 0x7ff8841548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.203+0000 7ff88c009700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff884151440 con 0x7ff8840aaa40 2023-10-06T10:59:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.203+0000 7ff88c009700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff884150fb0 con 0x7ff8840ccda0 2023-10-06T10:59:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.203+0000 7ff88c009700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8841503a0 con 0x7ff8840ac8d0 2023-10-06T10:59:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.203+0000 7ff889da5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8840aaa40 0x7ff88414ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.203+0000 7ff889da5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8840aaa40 0x7ff88414ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32962/0 (socket says 172.21.15.7:32962) 2023-10-06T10:59:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.203+0000 7ff889da5700 1 -- 172.21.15.7:0/773238427 learned_addr learned my addr 172.21.15.7:0/773238427 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.204+0000 7ff88a5a6700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8840ccda0 0x7ff8841548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.204+0000 7ff8895a4700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8840ac8d0 0x7ff88414faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.204+0000 7ff889da5700 1 -- 172.21.15.7:0/773238427 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8840ac8d0 msgr2=0x7ff88414faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.204+0000 7ff889da5700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8840ac8d0 0x7ff88414faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.204+0000 7ff889da5700 1 -- 172.21.15.7:0/773238427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8840ccda0 msgr2=0x7ff8841548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.204+0000 7ff889da5700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8840ccda0 0x7ff8841548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.204+0000 7ff889da5700 1 -- 172.21.15.7:0/773238427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff874009420 con 0x7ff8840aaa40 2023-10-06T10:59:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.204+0000 7ff88a5a6700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8840ccda0 0x7ff8841548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.204+0000 7ff889da5700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8840aaa40 0x7ff88414ade0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff88000c5d0 tx=0x7ff880007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.204+0000 7ff879ffb700 1 -- 172.21.15.7:0/773238427 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880011590 con 0x7ff8840aaa40 2023-10-06T10:59:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.204+0000 7ff879ffb700 1 -- 172.21.15.7:0/773238427 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff880011710 con 0x7ff8840aaa40 2023-10-06T10:59:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.204+0000 7ff88c009700 1 -- 172.21.15.7:0/773238427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff884150680 con 0x7ff8840aaa40 2023-10-06T10:59:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.204+0000 7ff879ffb700 1 -- 172.21.15.7:0/773238427 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880011ad0 con 0x7ff8840aaa40 2023-10-06T10:59:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.204+0000 7ff88c009700 1 -- 172.21.15.7:0/773238427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff884150c40 con 0x7ff8840aaa40 2023-10-06T10:59:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.205+0000 7ff88c009700 1 -- 172.21.15.7:0/773238427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff884151290 con 0x7ff8840aaa40 2023-10-06T10:59:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.206+0000 7ff879ffb700 1 -- 172.21.15.7:0/773238427 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff88001b3b0 con 0x7ff8840aaa40 2023-10-06T10:59:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.206+0000 7ff879ffb700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff868066f30 0x7ff8680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.206+0000 7ff8895a4700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff868066f30 0x7ff8680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.206+0000 7ff879ffb700 1 -- 172.21.15.7:0/773238427 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff880083ee0 con 0x7ff8840aaa40 2023-10-06T10:59:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.207+0000 7ff8895a4700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff868066f30 0x7ff8680693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff884097a70 tx=0x7ff874017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.211+0000 7ff879ffb700 1 -- 172.21.15.7:0/773238427 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff880050d00 con 0x7ff8840aaa40 2023-10-06T10:59:19.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.415+0000 7ff88c009700 1 -- 172.21.15.7:0/773238427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff884070480 con 0x7ff8840aaa40 2023-10-06T10:59:19.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.416+0000 7ff879ffb700 1 -- 172.21.15.7:0/773238427 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7ff880017070 con 0x7ff8840aaa40 2023-10-06T10:59:19.417 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:19.417 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:06.934264+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:19.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.418+0000 7ff88c009700 1 -- 172.21.15.7:0/773238427 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff868066f30 msgr2=0x7ff8680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.418+0000 7ff88c009700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff868066f30 0x7ff8680693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff884097a70 tx=0x7ff874017000 comp rx=0 tx=0).stop 2023-10-06T10:59:19.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.418+0000 7ff88c009700 1 -- 172.21.15.7:0/773238427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8840aaa40 msgr2=0x7ff88414ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.418+0000 7ff88c009700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8840aaa40 0x7ff88414ade0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff88000c5d0 tx=0x7ff880007f20 comp rx=0 tx=0).stop 2023-10-06T10:59:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.418+0000 7ff88c009700 1 -- 172.21.15.7:0/773238427 shutdown_connections 2023-10-06T10:59:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.418+0000 7ff88c009700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff868066f30 0x7ff8680693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.418+0000 7ff88c009700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8840aaa40 0x7ff88414ade0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.418+0000 7ff88c009700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8840ccda0 0x7ff8841548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.418+0000 7ff88c009700 1 --2- 172.21.15.7:0/773238427 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8840ac8d0 0x7ff88414faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.418+0000 7ff88c009700 1 -- 172.21.15.7:0/773238427 >> 172.21.15.7:0/773238427 conn(0x7ff884096160 msgr2=0x7ff88414bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.418+0000 7ff88c009700 1 -- 172.21.15.7:0/773238427 shutdown_connections 2023-10-06T10:59:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.418+0000 7ff88c009700 1 -- 172.21.15.7:0/773238427 wait complete. 2023-10-06T10:59:19.433 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:19.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.564+0000 7f33f4d7e700 1 Processor -- start 2023-10-06T10:59:19.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.564+0000 7f33f4d7e700 1 -- start start 2023-10-06T10:59:19.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.565+0000 7f33f4d7e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f33f0159360 0x7f33f00afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.565+0000 7f33f4d7e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33f00ac7f0 0x7f33f00a6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.565+0000 7f33f4d7e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f00aeba0 con 0x7f33f00a6ec0 2023-10-06T10:59:19.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.565+0000 7f33f4d7e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f00a7340 con 0x7f33f0159360 2023-10-06T10:59:19.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.565+0000 7f33f4d7e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f0159730 con 0x7f33f00ac7f0 2023-10-06T10:59:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.566+0000 7f33ee59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f33f0159360 0x7f33f00afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.566+0000 7f33ee59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f33f0159360 0x7f33f00afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32968/0 (socket says 172.21.15.7:32968) 2023-10-06T10:59:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.566+0000 7f33ee59c700 1 -- 172.21.15.7:0/1918211658 learned_addr learned my addr 172.21.15.7:0/1918211658 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.566+0000 7f33eed9d700 1 --1- 172.21.15.7:0/1918211658 >> v1:172.21.15.7:6789/0 conn(0x7f33f00a6ec0 0x7f33f00670f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60794/0 (socket says 172.21.15.7:60794) 2023-10-06T10:59:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.566+0000 7f33edd9b700 1 --2- 172.21.15.7:0/1918211658 >> v2:172.21.15.50:3300/0 conn(0x7f33f00ac7f0 0x7f33f00a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.566+0000 7f33ee59c700 1 -- 172.21.15.7:0/1918211658 >> v2:172.21.15.50:3300/0 conn(0x7f33f00ac7f0 msgr2=0x7f33f00a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.566+0000 7f33ee59c700 1 --2- 172.21.15.7:0/1918211658 >> v2:172.21.15.50:3300/0 conn(0x7f33f00ac7f0 0x7f33f00a6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.566+0000 7f33ee59c700 1 -- 172.21.15.7:0/1918211658 >> v1:172.21.15.7:6789/0 conn(0x7f33f00a6ec0 legacy=0x7f33f00670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.566+0000 7f33ee59c700 1 -- 172.21.15.7:0/1918211658 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f00ae270 con 0x7f33f0159360 2023-10-06T10:59:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.566+0000 7f33ee59c700 1 --2- 172.21.15.7:0/1918211658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f0159360 0x7f33f00afb40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f33f006d9b0 tx=0x7f33e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a70f90ab41c714 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.566+0000 7f33ed59a700 1 -- 172.21.15.7:0/1918211658 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e000b860 con 0x7f33f0159360 2023-10-06T10:59:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.566+0000 7f33ed59a700 1 -- 172.21.15.7:0/1918211658 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e000b9c0 con 0x7f33f0159360 2023-10-06T10:59:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.566+0000 7f33ed59a700 1 -- 172.21.15.7:0/1918211658 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e000bd60 con 0x7f33f0159360 2023-10-06T10:59:19.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.567+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1918211658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f0159360 msgr2=0x7f33f00afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.567+0000 7f33f4d7e700 1 --2- 172.21.15.7:0/1918211658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f0159360 0x7f33f00afb40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f33f006d9b0 tx=0x7f33e0009250 comp rx=0 tx=0).stop 2023-10-06T10:59:19.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.567+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1918211658 shutdown_connections 2023-10-06T10:59:19.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.567+0000 7f33f4d7e700 1 --2- 172.21.15.7:0/1918211658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f0159360 0x7f33f00afb40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.567+0000 7f33f4d7e700 1 --2- 172.21.15.7:0/1918211658 >> v2:172.21.15.50:3300/0 conn(0x7f33f00ac7f0 0x7f33f00a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.567+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1918211658 >> 172.21.15.7:0/1918211658 conn(0x7f33f0095a70 msgr2=0x7f33f00af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:19.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.567+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1918211658 shutdown_connections 2023-10-06T10:59:19.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.567+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1918211658 wait complete. 2023-10-06T10:59:19.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.568+0000 7f33f4d7e700 1 Processor -- start 2023-10-06T10:59:19.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.568+0000 7f33f4d7e700 1 -- start start 2023-10-06T10:59:19.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.569+0000 7f33f4d7e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33f00a6ec0 0x7f33f0169920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.569+0000 7f33f4d7e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f33f00ac7f0 0x7f33f006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.569+0000 7f33f4d7e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f0159360 0x7f33f0099050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.569+0000 7f33f4d7e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0169f70 con 0x7f33f0159360 2023-10-06T10:59:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.569+0000 7f33f4d7e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f016a250 con 0x7f33f00a6ec0 2023-10-06T10:59:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.569+0000 7f33f4d7e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f016a530 con 0x7f33f00ac7f0 2023-10-06T10:59:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.569+0000 7f33eed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f0159360 0x7f33f0099050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.569+0000 7f33eed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f0159360 0x7f33f0099050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32978/0 (socket says 172.21.15.7:32978) 2023-10-06T10:59:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.569+0000 7f33eed9d700 1 -- 172.21.15.7:0/1175272830 learned_addr learned my addr 172.21.15.7:0/1175272830 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.569+0000 7f33edd9b700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f33f00ac7f0 0x7f33f006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.569+0000 7f33ee59c700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33f00a6ec0 0x7f33f0169920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.569+0000 7f33eed9d700 1 -- 172.21.15.7:0/1175272830 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f33f00ac7f0 msgr2=0x7f33f006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.569+0000 7f33eed9d700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f33f00ac7f0 0x7f33f006bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.570+0000 7f33eed9d700 1 -- 172.21.15.7:0/1175272830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33f00a6ec0 msgr2=0x7f33f0169920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.570+0000 7f33eed9d700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33f00a6ec0 0x7f33f0169920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.570+0000 7f33eed9d700 1 -- 172.21.15.7:0/1175272830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e00094f0 con 0x7f33f0159360 2023-10-06T10:59:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.570+0000 7f33ee59c700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33f00a6ec0 0x7f33f0169920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.570+0000 7f33eed9d700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f0159360 0x7f33f0099050 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f33e800cd00 tx=0x7f33e8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.570+0000 7f33e67fc700 1 -- 172.21.15.7:0/1175272830 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8005df0 con 0x7f33f0159360 2023-10-06T10:59:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.570+0000 7f33e67fc700 1 -- 172.21.15.7:0/1175272830 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e800a960 con 0x7f33f0159360 2023-10-06T10:59:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.570+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1175272830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f016a810 con 0x7f33f0159360 2023-10-06T10:59:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.570+0000 7f33e67fc700 1 -- 172.21.15.7:0/1175272830 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800ad00 con 0x7f33f0159360 2023-10-06T10:59:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.570+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1175272830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f0097a30 con 0x7f33f0159360 2023-10-06T10:59:19.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.571+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1175272830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f0070480 con 0x7f33f0159360 2023-10-06T10:59:19.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.572+0000 7f33e67fc700 1 -- 172.21.15.7:0/1175272830 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f33e8007300 con 0x7f33f0159360 2023-10-06T10:59:19.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.572+0000 7f33e67fc700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f33d0066f30 0x7f33d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.572+0000 7f33ee59c700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f33d0066f30 0x7f33d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.572+0000 7f33e67fc700 1 -- 172.21.15.7:0/1175272830 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f33e8084ac0 con 0x7f33f0159360 2023-10-06T10:59:19.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.573+0000 7f33ee59c700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f33d0066f30 0x7f33d00693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f33f006d9b0 tx=0x7f33e0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:19.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.577+0000 7f33e67fc700 1 -- 172.21.15.7:0/1175272830 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33e8051960 con 0x7f33f0159360 2023-10-06T10:59:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.780+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1175272830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33f00ae550 con 0x7f33f0159360 2023-10-06T10:59:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.781+0000 7f33e67fc700 1 -- 172.21.15.7:0/1175272830 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f33e8084e60 con 0x7f33f0159360 2023-10-06T10:59:19.782 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:19.783 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:06.934264+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.784+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1175272830 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f33d0066f30 msgr2=0x7f33d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.784+0000 7f33f4d7e700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f33d0066f30 0x7f33d00693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f33f006d9b0 tx=0x7f33e0017000 comp rx=0 tx=0).stop 2023-10-06T10:59:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.784+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1175272830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f0159360 msgr2=0x7f33f0099050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.784+0000 7f33f4d7e700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f0159360 0x7f33f0099050 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f33e800cd00 tx=0x7f33e8001b10 comp rx=0 tx=0).stop 2023-10-06T10:59:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.784+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1175272830 shutdown_connections 2023-10-06T10:59:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.784+0000 7f33f4d7e700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f33d0066f30 0x7f33d00693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.784+0000 7f33f4d7e700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f0159360 0x7f33f0099050 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.784+0000 7f33f4d7e700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33f00a6ec0 0x7f33f0169920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.784+0000 7f33f4d7e700 1 --2- 172.21.15.7:0/1175272830 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f33f00ac7f0 0x7f33f006bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.784+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1175272830 >> 172.21.15.7:0/1175272830 conn(0x7f33f0095a70 msgr2=0x7f33f015a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.784+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1175272830 shutdown_connections 2023-10-06T10:59:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.784+0000 7f33f4d7e700 1 -- 172.21.15.7:0/1175272830 wait complete. 2023-10-06T10:59:19.798 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T10:59:19.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.932+0000 7fd051c6f700 1 Processor -- start 2023-10-06T10:59:19.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.932+0000 7fd051c6f700 1 -- start start 2023-10-06T10:59:19.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.933+0000 7fd051c6f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd04c0c9a10 0x7fd04c069d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.933+0000 7fd051c6f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd04c06a240 0x7fd04c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.933+0000 7fd051c6f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd04c0c9de0 0x7fd04c1571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.933+0000 7fd051c6f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04c0c7fd0 con 0x7fd04c0c9de0 2023-10-06T10:59:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.933+0000 7fd051c6f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04c0c7400 con 0x7fd04c0c9a10 2023-10-06T10:59:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.933+0000 7fd051c6f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0c76a0 con 0x7fd04c06a240 2023-10-06T10:59:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.933+0000 7fd04bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd04c0c9de0 0x7fd04c1571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.934+0000 7fd04bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd04c0c9de0 0x7fd04c1571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32990/0 (socket says 172.21.15.7:32990) 2023-10-06T10:59:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.934+0000 7fd04bfff700 1 -- 172.21.15.7:0/1474449090 learned_addr learned my addr 172.21.15.7:0/1474449090 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.934+0000 7fd04b7fe700 1 --2- 172.21.15.7:0/1474449090 >> v2:172.21.15.50:3300/0 conn(0x7fd04c0c9a10 0x7fd04c069d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.934+0000 7fd04affd700 1 --2- 172.21.15.7:0/1474449090 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd04c06a240 0x7fd04c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.934+0000 7fd04bfff700 1 -- 172.21.15.7:0/1474449090 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd04c06a240 msgr2=0x7fd04c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.934+0000 7fd04bfff700 1 --2- 172.21.15.7:0/1474449090 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd04c06a240 0x7fd04c156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.934+0000 7fd04bfff700 1 -- 172.21.15.7:0/1474449090 >> v2:172.21.15.50:3300/0 conn(0x7fd04c0c9a10 msgr2=0x7fd04c069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:19.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.934+0000 7fd04bfff700 1 --2- 172.21.15.7:0/1474449090 >> v2:172.21.15.50:3300/0 conn(0x7fd04c0c9a10 0x7fd04c069d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.934+0000 7fd04bfff700 1 -- 172.21.15.7:0/1474449090 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c0c7980 con 0x7fd04c0c9de0 2023-10-06T10:59:19.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.934+0000 7fd04b7fe700 1 --2- 172.21.15.7:0/1474449090 >> v2:172.21.15.50:3300/0 conn(0x7fd04c0c9a10 0x7fd04c069d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:19.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.934+0000 7fd04bfff700 1 --2- 172.21.15.7:0/1474449090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd04c0c9de0 0x7fd04c1571c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd044009f20 tx=0x7fd044009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c0b7a7fbb16f2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:19.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.934+0000 7fd04a7fc700 1 -- 172.21.15.7:0/1474449090 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04400e070 con 0x7fd04c0c9de0 2023-10-06T10:59:19.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.934+0000 7fd04a7fc700 1 -- 172.21.15.7:0/1474449090 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04400b990 con 0x7fd04c0c9de0 2023-10-06T10:59:19.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.934+0000 7fd04a7fc700 1 -- 172.21.15.7:0/1474449090 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0440092e0 con 0x7fd04c0c9de0 2023-10-06T10:59:19.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.935+0000 7fd051c6f700 1 -- 172.21.15.7:0/1474449090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd04c0c9de0 msgr2=0x7fd04c1571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.935+0000 7fd051c6f700 1 --2- 172.21.15.7:0/1474449090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd04c0c9de0 0x7fd04c1571c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd044009f20 tx=0x7fd044009840 comp rx=0 tx=0).stop 2023-10-06T10:59:19.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.935+0000 7fd051c6f700 1 -- 172.21.15.7:0/1474449090 shutdown_connections 2023-10-06T10:59:19.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.935+0000 7fd051c6f700 1 --2- 172.21.15.7:0/1474449090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd04c0c9de0 0x7fd04c1571c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.935+0000 7fd051c6f700 1 --2- 172.21.15.7:0/1474449090 >> v2:172.21.15.50:3300/0 conn(0x7fd04c0c9a10 0x7fd04c069d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.935+0000 7fd051c6f700 1 --2- 172.21.15.7:0/1474449090 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd04c06a240 0x7fd04c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.935+0000 7fd051c6f700 1 -- 172.21.15.7:0/1474449090 >> 172.21.15.7:0/1474449090 conn(0x7fd04c0afc90 msgr2=0x7fd04c0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:19.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.935+0000 7fd051c6f700 1 -- 172.21.15.7:0/1474449090 shutdown_connections 2023-10-06T10:59:19.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.935+0000 7fd051c6f700 1 -- 172.21.15.7:0/1474449090 wait complete. 2023-10-06T10:59:19.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.936+0000 7fd051c6f700 1 Processor -- start 2023-10-06T10:59:19.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.936+0000 7fd051c6f700 1 -- start start 2023-10-06T10:59:19.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.937+0000 7fd051c6f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd04c06a240 0x7fd04c1493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.937+0000 7fd051c6f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd04c0c9a10 0x7fd04c0c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.937+0000 7fd051c6f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd04c0c9de0 0x7fd04c14e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.937+0000 7fd051c6f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0c52e0 con 0x7fd04c0c9de0 2023-10-06T10:59:19.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.937+0000 7fd051c6f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0c46d0 con 0x7fd04c06a240 2023-10-06T10:59:19.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.937+0000 7fd051c6f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0c49b0 con 0x7fd04c0c9a10 2023-10-06T10:59:19.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.937+0000 7fd04bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd04c0c9de0 0x7fd04c14e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.937+0000 7fd04bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd04c0c9de0 0x7fd04c14e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32998/0 (socket says 172.21.15.7:32998) 2023-10-06T10:59:19.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.937+0000 7fd04bfff700 1 -- 172.21.15.7:0/426088471 learned_addr learned my addr 172.21.15.7:0/426088471 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:19.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.937+0000 7fd04affd700 1 --2- 172.21.15.7:0/426088471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd04c0c9a10 0x7fd04c0c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.937+0000 7fd04b7fe700 1 --2- 172.21.15.7:0/426088471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd04c06a240 0x7fd04c1493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.938+0000 7fd04bfff700 1 -- 172.21.15.7:0/426088471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd04c0c9a10 msgr2=0x7fd04c0c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.938+0000 7fd04bfff700 1 --2- 172.21.15.7:0/426088471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd04c0c9a10 0x7fd04c0c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.938+0000 7fd04bfff700 1 -- 172.21.15.7:0/426088471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd04c06a240 msgr2=0x7fd04c1493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:19.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.938+0000 7fd04bfff700 1 --2- 172.21.15.7:0/426088471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd04c06a240 0x7fd04c1493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:19.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.938+0000 7fd04bfff700 1 -- 172.21.15.7:0/426088471 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044009ae0 con 0x7fd04c0c9de0 2023-10-06T10:59:19.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.938+0000 7fd04bfff700 1 --2- 172.21.15.7:0/426088471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd04c0c9de0 0x7fd04c14e750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd04400b610 tx=0x7fd044018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:19.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.938+0000 7fd0337fe700 1 -- 172.21.15.7:0/426088471 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0440094e0 con 0x7fd04c0c9de0 2023-10-06T10:59:19.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.938+0000 7fd0337fe700 1 -- 172.21.15.7:0/426088471 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd044008ad0 con 0x7fd04c0c9de0 2023-10-06T10:59:19.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.938+0000 7fd051c6f700 1 -- 172.21.15.7:0/426088471 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04c0c4c90 con 0x7fd04c0c9de0 2023-10-06T10:59:19.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.938+0000 7fd0337fe700 1 -- 172.21.15.7:0/426088471 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044008e70 con 0x7fd04c0c9de0 2023-10-06T10:59:19.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.938+0000 7fd051c6f700 1 -- 172.21.15.7:0/426088471 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04c149900 con 0x7fd04c0c9de0 2023-10-06T10:59:19.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.939+0000 7fd051c6f700 1 -- 172.21.15.7:0/426088471 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04c0c5450 con 0x7fd04c0c9de0 2023-10-06T10:59:19.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.939+0000 7fd0337fe700 1 -- 172.21.15.7:0/426088471 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd044003040 con 0x7fd04c0c9de0 2023-10-06T10:59:19.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.940+0000 7fd0337fe700 1 --2- 172.21.15.7:0/426088471 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd038066f30 0x7fd0380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:19.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.940+0000 7fd0337fe700 1 -- 172.21.15.7:0/426088471 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd044086330 con 0x7fd04c0c9de0 2023-10-06T10:59:19.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.940+0000 7fd04b7fe700 1 --2- 172.21.15.7:0/426088471 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd038066f30 0x7fd0380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:19.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.940+0000 7fd04b7fe700 1 --2- 172.21.15.7:0/426088471 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd038066f30 0x7fd0380693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd03c006f00 tx=0x7fd03c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:19.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:19.944+0000 7fd0337fe700 1 -- 172.21.15.7:0/426088471 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd044053150 con 0x7fd04c0c9de0 2023-10-06T10:59:20.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.198+0000 7fd051c6f700 1 -- 172.21.15.7:0/426088471 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd04c070480 con 0x7fd04c0c9de0 2023-10-06T10:59:20.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.516+0000 7fd0337fe700 1 -- 172.21.15.7:0/426088471 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd04401be60 con 0x7fd04c0c9de0 2023-10-06T10:59:20.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.519+0000 7fd051c6f700 1 -- 172.21.15.7:0/426088471 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd038066f30 msgr2=0x7fd0380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:20.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.519+0000 7fd051c6f700 1 --2- 172.21.15.7:0/426088471 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd038066f30 0x7fd0380693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd03c006f00 tx=0x7fd03c008040 comp rx=0 tx=0).stop 2023-10-06T10:59:20.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.519+0000 7fd051c6f700 1 -- 172.21.15.7:0/426088471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd04c0c9de0 msgr2=0x7fd04c14e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:20.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.519+0000 7fd051c6f700 1 --2- 172.21.15.7:0/426088471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd04c0c9de0 0x7fd04c14e750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd04400b610 tx=0x7fd044018000 comp rx=0 tx=0).stop 2023-10-06T10:59:20.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.519+0000 7fd051c6f700 1 -- 172.21.15.7:0/426088471 shutdown_connections 2023-10-06T10:59:20.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.519+0000 7fd051c6f700 1 --2- 172.21.15.7:0/426088471 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd038066f30 0x7fd0380693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:20.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.519+0000 7fd051c6f700 1 --2- 172.21.15.7:0/426088471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd04c0c9de0 0x7fd04c14e750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:20.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.519+0000 7fd051c6f700 1 --2- 172.21.15.7:0/426088471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd04c06a240 0x7fd04c1493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:20.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.519+0000 7fd051c6f700 1 --2- 172.21.15.7:0/426088471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd04c0c9a10 0x7fd04c0c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:20.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.519+0000 7fd051c6f700 1 -- 172.21.15.7:0/426088471 >> 172.21.15.7:0/426088471 conn(0x7fd04c0afc90 msgr2=0x7fd04c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:20.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.519+0000 7fd051c6f700 1 -- 172.21.15.7:0/426088471 shutdown_connections 2023-10-06T10:59:20.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.519+0000 7fd051c6f700 1 -- 172.21.15.7:0/426088471 wait complete. 2023-10-06T10:59:20.535 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T10:59:20.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.673+0000 7f38dd0ab700 1 Processor -- start 2023-10-06T10:59:20.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.673+0000 7f38dd0ab700 1 -- start start 2023-10-06T10:59:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.674+0000 7f38dd0ab700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38d80ccc10 0x7f38d80c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.674+0000 7f38dd0ab700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38d80b0590 0x7f38d80c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.674+0000 7f38dd0ab700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d80cedc0 con 0x7f38d80b01c0 2023-10-06T10:59:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.674+0000 7f38dd0ab700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d80c9530 con 0x7f38d80ccc10 2023-10-06T10:59:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.674+0000 7f38dd0ab700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80c9720 con 0x7f38d80b0590 2023-10-06T10:59:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.674+0000 7f38d659c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38d80ccc10 0x7f38d80c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.675+0000 7f38d6d9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f38d80b01c0 0x7f38d80cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44212/0 (socket says 172.21.15.7:44212) 2023-10-06T10:59:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.675+0000 7f38d659c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38d80ccc10 0x7f38d80c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43136/0 (socket says 172.21.15.7:43136) 2023-10-06T10:59:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.675+0000 7f38d6d9d700 1 -- 172.21.15.7:0/3658845947 learned_addr learned my addr 172.21.15.7:0/3658845947 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.675+0000 7f38d759e700 1 --2- 172.21.15.7:0/3658845947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38d80b0590 0x7f38d80c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.675+0000 7f38d659c700 1 -- 172.21.15.7:0/3658845947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38d80b0590 msgr2=0x7f38d80c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.675+0000 7f38d659c700 1 --2- 172.21.15.7:0/3658845947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38d80b0590 0x7f38d80c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.675+0000 7f38d659c700 1 -- 172.21.15.7:0/3658845947 >> v1:172.21.15.7:6789/0 conn(0x7f38d80b01c0 legacy=0x7f38d80cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.675+0000 7f38d659c700 1 -- 172.21.15.7:0/3658845947 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d80c9a00 con 0x7f38d80ccc10 2023-10-06T10:59:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.675+0000 7f38d5d9b700 1 -- 172.21.15.7:0/3658845947 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621218978 0 0) 0x7f38d80cedc0 con 0x7f38d80b01c0 2023-10-06T10:59:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.675+0000 7f38d759e700 1 --2- 172.21.15.7:0/3658845947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38d80b0590 0x7f38d80c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.675+0000 7f38d659c700 1 --2- 172.21.15.7:0/3658845947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d80ccc10 0x7f38d80c8ab0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0098e0 tx=0x7f38cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d86774e37edc342 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.675+0000 7f38d5d9b700 1 -- 172.21.15.7:0/3658845947 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc009e80 con 0x7f38d80ccc10 2023-10-06T10:59:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.675+0000 7f38d5d9b700 1 -- 172.21.15.7:0/3658845947 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc00b860 con 0x7f38d80ccc10 2023-10-06T10:59:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.675+0000 7f38d5d9b700 1 -- 172.21.15.7:0/3658845947 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc00bbe0 con 0x7f38d80ccc10 2023-10-06T10:59:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.676+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3658845947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d80ccc10 msgr2=0x7f38d80c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:20.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.676+0000 7f38dd0ab700 1 --2- 172.21.15.7:0/3658845947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d80ccc10 0x7f38d80c8ab0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0098e0 tx=0x7f38cc0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:20.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.676+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3658845947 shutdown_connections 2023-10-06T10:59:20.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.676+0000 7f38dd0ab700 1 --2- 172.21.15.7:0/3658845947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38d80b0590 0x7f38d80c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:20.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.676+0000 7f38dd0ab700 1 --2- 172.21.15.7:0/3658845947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d80ccc10 0x7f38d80c8ab0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:20.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.676+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3658845947 >> 172.21.15.7:0/3658845947 conn(0x7f38d806cd00 msgr2=0x7f38d80cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:20.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.676+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3658845947 shutdown_connections 2023-10-06T10:59:20.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.676+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3658845947 wait complete. 2023-10-06T10:59:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.677+0000 7f38dd0ab700 1 Processor -- start 2023-10-06T10:59:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.677+0000 7f38dd0ab700 1 -- start start 2023-10-06T10:59:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.678+0000 7f38dd0ab700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d80b01c0 0x7f38d814dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.678+0000 7f38dd0ab700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38d80b0590 0x7f38d80b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.678+0000 7f38dd0ab700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38d80ccc10 0x7f38d8069bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.678+0000 7f38dd0ab700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80c61a0 con 0x7f38d80b01c0 2023-10-06T10:59:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.678+0000 7f38dd0ab700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80c5100 con 0x7f38d80b0590 2023-10-06T10:59:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.678+0000 7f38dd0ab700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80c53e0 con 0x7f38d80ccc10 2023-10-06T10:59:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.678+0000 7f38d6d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d80b01c0 0x7f38d814dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.678+0000 7f38d6d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d80b01c0 0x7f38d814dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43146/0 (socket says 172.21.15.7:43146) 2023-10-06T10:59:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.678+0000 7f38d6d9d700 1 -- 172.21.15.7:0/3388004649 learned_addr learned my addr 172.21.15.7:0/3388004649 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.679+0000 7f38d759e700 1 --2- 172.21.15.7:0/3388004649 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38d80ccc10 0x7f38d8069bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.679+0000 7f38d659c700 1 --2- 172.21.15.7:0/3388004649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38d80b0590 0x7f38d80b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.679+0000 7f38d6d9d700 1 -- 172.21.15.7:0/3388004649 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38d80ccc10 msgr2=0x7f38d8069bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.679+0000 7f38d6d9d700 1 --2- 172.21.15.7:0/3388004649 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38d80ccc10 0x7f38d8069bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.679+0000 7f38d6d9d700 1 -- 172.21.15.7:0/3388004649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38d80b0590 msgr2=0x7f38d80b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.679+0000 7f38d6d9d700 1 --2- 172.21.15.7:0/3388004649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38d80b0590 0x7f38d80b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.679+0000 7f38d6d9d700 1 -- 172.21.15.7:0/3388004649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc009420 con 0x7f38d80b01c0 2023-10-06T10:59:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.679+0000 7f38d6d9d700 1 --2- 172.21.15.7:0/3388004649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d80b01c0 0x7f38d814dde0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38c800c7e0 tx=0x7f38c8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.679+0000 7f38beffd700 1 -- 172.21.15.7:0/3388004649 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c8005b30 con 0x7f38d80b01c0 2023-10-06T10:59:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.679+0000 7f38beffd700 1 -- 172.21.15.7:0/3388004649 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c8005c90 con 0x7f38d80b01c0 2023-10-06T10:59:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.679+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3388004649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d80c56c0 con 0x7f38d80b01c0 2023-10-06T10:59:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.679+0000 7f38beffd700 1 -- 172.21.15.7:0/3388004649 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c8007300 con 0x7f38d80b01c0 2023-10-06T10:59:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.679+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3388004649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d80c5c80 con 0x7f38d80b01c0 2023-10-06T10:59:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.680+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3388004649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d80c5ea0 con 0x7f38d80b01c0 2023-10-06T10:59:20.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.681+0000 7f38beffd700 1 -- 172.21.15.7:0/3388004649 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38c801b400 con 0x7f38d80b01c0 2023-10-06T10:59:20.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.681+0000 7f38beffd700 1 --2- 172.21.15.7:0/3388004649 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f38c4066f30 0x7f38c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:20.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.681+0000 7f38beffd700 1 -- 172.21.15.7:0/3388004649 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f38c8084410 con 0x7f38d80b01c0 2023-10-06T10:59:20.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.681+0000 7f38d659c700 1 --2- 172.21.15.7:0/3388004649 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f38c4066f30 0x7f38c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:20.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.682+0000 7f38d659c700 1 --2- 172.21.15.7:0/3388004649 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f38c4066f30 0x7f38c40693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0091e0 tx=0x7f38cc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.686+0000 7f38beffd700 1 -- 172.21.15.7:0/3388004649 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38c8051360 con 0x7f38d80b01c0 2023-10-06T10:59:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:20.939+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3388004649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f38d806da60 con 0x7f38d80b01c0 2023-10-06T10:59:21.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.522+0000 7f38beffd700 1 -- 172.21.15.7:0/3388004649 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f38c8007730 con 0x7f38d80b01c0 2023-10-06T10:59:21.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.524+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3388004649 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f38c4066f30 msgr2=0x7f38c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:21.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.524+0000 7f38dd0ab700 1 --2- 172.21.15.7:0/3388004649 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f38c4066f30 0x7f38c40693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0091e0 tx=0x7f38cc017000 comp rx=0 tx=0).stop 2023-10-06T10:59:21.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.525+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3388004649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d80b01c0 msgr2=0x7f38d814dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:21.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.525+0000 7f38dd0ab700 1 --2- 172.21.15.7:0/3388004649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d80b01c0 0x7f38d814dde0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38c800c7e0 tx=0x7f38c8007df0 comp rx=0 tx=0).stop 2023-10-06T10:59:21.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.525+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3388004649 shutdown_connections 2023-10-06T10:59:21.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.525+0000 7f38dd0ab700 1 --2- 172.21.15.7:0/3388004649 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f38c4066f30 0x7f38c40693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:21.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.525+0000 7f38dd0ab700 1 --2- 172.21.15.7:0/3388004649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d80b01c0 0x7f38d814dde0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:21.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.525+0000 7f38dd0ab700 1 --2- 172.21.15.7:0/3388004649 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38d80ccc10 0x7f38d8069bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:21.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.525+0000 7f38dd0ab700 1 --2- 172.21.15.7:0/3388004649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38d80b0590 0x7f38d80b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:21.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.525+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3388004649 >> 172.21.15.7:0/3388004649 conn(0x7f38d806cd00 msgr2=0x7f38d80cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:21.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.525+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3388004649 shutdown_connections 2023-10-06T10:59:21.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.525+0000 7f38dd0ab700 1 -- 172.21.15.7:0/3388004649 wait complete. 2023-10-06T10:59:21.542 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T10:59:21.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.680+0000 7f382c8bb700 1 Processor -- start 2023-10-06T10:59:21.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.680+0000 7f382c8bb700 1 -- start start 2023-10-06T10:59:21.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.681+0000 7f382c8bb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38280ccda0 0x7f38280cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:21.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.681+0000 7f382c8bb700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38280aaa40 0x7f3828155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:21.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.681+0000 7f382c8bb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3828069110 con 0x7f38280ac8d0 2023-10-06T10:59:21.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.681+0000 7f382c8bb700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3828068b30 con 0x7f38280aaa40 2023-10-06T10:59:21.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.681+0000 7f382c8bb700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38280aafb0 con 0x7f38280ccda0 2023-10-06T10:59:21.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.682+0000 7f3826d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38280aaa40 0x7f3828155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:21.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.682+0000 7f3826d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38280aaa40 0x7f3828155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43154/0 (socket says 172.21.15.7:43154) 2023-10-06T10:59:21.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.682+0000 7f3826d9d700 1 -- 172.21.15.7:0/655832704 learned_addr learned my addr 172.21.15.7:0/655832704 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:21.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.682+0000 7f382659c700 1 --2- 172.21.15.7:0/655832704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38280ccda0 0x7f38280cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:21.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.682+0000 7f3826d9d700 1 -- 172.21.15.7:0/655832704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38280ccda0 msgr2=0x7f38280cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:21.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.682+0000 7f3826d9d700 1 --2- 172.21.15.7:0/655832704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38280ccda0 0x7f38280cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:21.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.682+0000 7f3826d9d700 1 -- 172.21.15.7:0/655832704 >> v1:172.21.15.50:6789/0 conn(0x7f38280ac8d0 legacy=0x7f38280aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:21.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.682+0000 7f3826d9d700 1 -- 172.21.15.7:0/655832704 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3828068da0 con 0x7f38280aaa40 2023-10-06T10:59:21.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.682+0000 7f3826d9d700 1 --2- 172.21.15.7:0/655832704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38280aaa40 0x7f3828155af0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3820009f20 tx=0x7f3820009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0d3d4f8e342653 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:21.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.682+0000 7f382559a700 1 -- 172.21.15.7:0/655832704 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382000e070 con 0x7f38280aaa40 2023-10-06T10:59:21.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.682+0000 7f382559a700 1 -- 172.21.15.7:0/655832704 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382000bb10 con 0x7f38280aaa40 2023-10-06T10:59:21.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.682+0000 7f382559a700 1 -- 172.21.15.7:0/655832704 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38200092e0 con 0x7f38280aaa40 2023-10-06T10:59:21.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.683+0000 7f382c8bb700 1 -- 172.21.15.7:0/655832704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38280aaa40 msgr2=0x7f3828155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:21.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.683+0000 7f382c8bb700 1 --2- 172.21.15.7:0/655832704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38280aaa40 0x7f3828155af0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3820009f20 tx=0x7f3820009840 comp rx=0 tx=0).stop 2023-10-06T10:59:21.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.683+0000 7f382c8bb700 1 -- 172.21.15.7:0/655832704 shutdown_connections 2023-10-06T10:59:21.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.683+0000 7f382c8bb700 1 --2- 172.21.15.7:0/655832704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38280aaa40 0x7f3828155af0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:21.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.683+0000 7f382c8bb700 1 --2- 172.21.15.7:0/655832704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38280ccda0 0x7f38280cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:21.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.683+0000 7f382c8bb700 1 -- 172.21.15.7:0/655832704 >> 172.21.15.7:0/655832704 conn(0x7f3828096160 msgr2=0x7f38280afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:21.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.683+0000 7f382c8bb700 1 -- 172.21.15.7:0/655832704 shutdown_connections 2023-10-06T10:59:21.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.683+0000 7f382c8bb700 1 -- 172.21.15.7:0/655832704 wait complete. 2023-10-06T10:59:21.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.684+0000 7f382c8bb700 1 Processor -- start 2023-10-06T10:59:21.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.684+0000 7f382c8bb700 1 -- start start 2023-10-06T10:59:21.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f382c8bb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38280aaa40 0x7f382815a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:21.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f382c8bb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38280ac8d0 0x7f3828099350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:21.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f382c8bb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38280ccda0 0x7f3828099890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:21.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f382c8bb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3828098ec0 con 0x7f38280ac8d0 2023-10-06T10:59:21.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f382c8bb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38280982d0 con 0x7f38280aaa40 2023-10-06T10:59:21.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f382c8bb700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3828098590 con 0x7f38280ccda0 2023-10-06T10:59:21.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f3825d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38280ac8d0 0x7f3828099350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:21.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f3825d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38280ac8d0 0x7f3828099350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43170/0 (socket says 172.21.15.7:43170) 2023-10-06T10:59:21.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f3825d9b700 1 -- 172.21.15.7:0/120058597 learned_addr learned my addr 172.21.15.7:0/120058597 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:21.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f3826d9d700 1 --2- 172.21.15.7:0/120058597 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38280ccda0 0x7f3828099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:21.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f382659c700 1 --2- 172.21.15.7:0/120058597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38280aaa40 0x7f382815a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:21.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f3825d9b700 1 -- 172.21.15.7:0/120058597 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38280ccda0 msgr2=0x7f3828099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:21.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f3825d9b700 1 --2- 172.21.15.7:0/120058597 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38280ccda0 0x7f3828099890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:21.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f3825d9b700 1 -- 172.21.15.7:0/120058597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38280aaa40 msgr2=0x7f382815a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:21.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.685+0000 7f3825d9b700 1 --2- 172.21.15.7:0/120058597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38280aaa40 0x7f382815a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:21.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.686+0000 7f3825d9b700 1 -- 172.21.15.7:0/120058597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3820009ae0 con 0x7f38280ac8d0 2023-10-06T10:59:21.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.686+0000 7f3825d9b700 1 --2- 172.21.15.7:0/120058597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38280ac8d0 0x7f3828099350 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f381000c590 tx=0x7f381000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:21.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.686+0000 7f381e7fc700 1 -- 172.21.15.7:0/120058597 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810011590 con 0x7f38280ac8d0 2023-10-06T10:59:21.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.686+0000 7f381e7fc700 1 -- 172.21.15.7:0/120058597 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38100116f0 con 0x7f38280ac8d0 2023-10-06T10:59:21.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.686+0000 7f382c8bb700 1 -- 172.21.15.7:0/120058597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3828098870 con 0x7f38280ac8d0 2023-10-06T10:59:21.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.686+0000 7f381e7fc700 1 -- 172.21.15.7:0/120058597 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810011ab0 con 0x7f38280ac8d0 2023-10-06T10:59:21.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.686+0000 7f382c8bb700 1 -- 172.21.15.7:0/120058597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3828150f20 con 0x7f38280ac8d0 2023-10-06T10:59:21.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.687+0000 7f382c8bb700 1 -- 172.21.15.7:0/120058597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3828099030 con 0x7f38280ac8d0 2023-10-06T10:59:21.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.688+0000 7f381e7fc700 1 -- 172.21.15.7:0/120058597 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f381001b3b0 con 0x7f38280ac8d0 2023-10-06T10:59:21.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.688+0000 7f381e7fc700 1 --2- 172.21.15.7:0/120058597 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3808066f30 0x7f38080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:21.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.688+0000 7f381e7fc700 1 -- 172.21.15.7:0/120058597 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3810083f30 con 0x7f38280ac8d0 2023-10-06T10:59:21.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.688+0000 7f382659c700 1 --2- 172.21.15.7:0/120058597 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3808066f30 0x7f38080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:21.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.689+0000 7f382659c700 1 --2- 172.21.15.7:0/120058597 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3808066f30 0x7f38080693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3818006fd0 tx=0x7f3818008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:21.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.693+0000 7f381e7fc700 1 -- 172.21.15.7:0/120058597 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3810050d50 con 0x7f38280ac8d0 2023-10-06T10:59:21.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.946+0000 7f382c8bb700 1 -- 172.21.15.7:0/120058597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3828070480 con 0x7f38280ac8d0 2023-10-06T10:59:21.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.946+0000 7f381e7fc700 1 -- 172.21.15.7:0/120058597 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4581 (secure 0 0 0) 0x7f3810017070 con 0x7f38280ac8d0 2023-10-06T10:59:21.947 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:21.948 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/941534596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":941534596},{"type":"v1","addr":"172.21.15.50:6835","nonce":941534596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3152699387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3152699387},{"type":"v1","addr":"172.21.15.50:6834","nonce":3152699387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/271704556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":271704556},{"type":"v1","addr":"172.21.15.7:6837","nonce":271704556}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T10:59:01.833627+0000","modified":"2023-10-06T10:59:21.515113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3123178887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3123178887},{"type":"v1","addr":"172.21.15.7:6836","nonce":3123178887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T10:59:21.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.948+0000 7f382c8bb700 1 -- 172.21.15.7:0/120058597 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3808066f30 msgr2=0x7f38080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.948+0000 7f382c8bb700 1 --2- 172.21.15.7:0/120058597 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3808066f30 0x7f38080693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3818006fd0 tx=0x7f3818008040 comp rx=0 tx=0).stop 2023-10-06T10:59:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.948+0000 7f382c8bb700 1 -- 172.21.15.7:0/120058597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38280ac8d0 msgr2=0x7f3828099350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.948+0000 7f382c8bb700 1 --2- 172.21.15.7:0/120058597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38280ac8d0 0x7f3828099350 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f381000c590 tx=0x7f381000c950 comp rx=0 tx=0).stop 2023-10-06T10:59:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.948+0000 7f382c8bb700 1 -- 172.21.15.7:0/120058597 shutdown_connections 2023-10-06T10:59:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.948+0000 7f382c8bb700 1 --2- 172.21.15.7:0/120058597 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3808066f30 0x7f38080693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.948+0000 7f382c8bb700 1 --2- 172.21.15.7:0/120058597 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38280ccda0 0x7f3828099890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.949+0000 7f382c8bb700 1 --2- 172.21.15.7:0/120058597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38280aaa40 0x7f382815a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:21.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.949+0000 7f382c8bb700 1 --2- 172.21.15.7:0/120058597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38280ac8d0 0x7f3828099350 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:21.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.949+0000 7f382c8bb700 1 -- 172.21.15.7:0/120058597 >> 172.21.15.7:0/120058597 conn(0x7f3828096160 msgr2=0x7f38280a9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:21.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.949+0000 7f382c8bb700 1 -- 172.21.15.7:0/120058597 shutdown_connections 2023-10-06T10:59:21.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:21.949+0000 7f382c8bb700 1 -- 172.21.15.7:0/120058597 wait complete. 2023-10-06T10:59:21.952 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2023-10-06T10:59:21.963 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:22.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.093+0000 7f60d1023700 1 Processor -- start 2023-10-06T10:59:22.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.093+0000 7f60d1023700 1 -- start start 2023-10-06T10:59:22.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.094+0000 7f60d1023700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60cc158120 0x7f60cc0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.094+0000 7f60d1023700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f60cc0cae30 0x7f60cc0cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.094+0000 7f60d1023700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc0cbd10 con 0x7f60cc0c8ba0 2023-10-06T10:59:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.094+0000 7f60d1023700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc0cb9e0 con 0x7f60cc158120 2023-10-06T10:59:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.094+0000 7f60d1023700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc0c9300 con 0x7f60cc0cae30 2023-10-06T10:59:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.094+0000 7f60cad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60cc158120 0x7f60cc0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.094+0000 7f60cad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60cc158120 0x7f60cc0c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43184/0 (socket says 172.21.15.7:43184) 2023-10-06T10:59:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.094+0000 7f60cad9d700 1 -- 172.21.15.7:0/1444420601 learned_addr learned my addr 172.21.15.7:0/1444420601 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.094+0000 7f60cb59e700 1 --2- 172.21.15.7:0/1444420601 >> v2:172.21.15.50:3300/0 conn(0x7f60cc0cae30 0x7f60cc0cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.094+0000 7f60cad9d700 1 -- 172.21.15.7:0/1444420601 >> v2:172.21.15.50:3300/0 conn(0x7f60cc0cae30 msgr2=0x7f60cc0cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.094+0000 7f60cad9d700 1 --2- 172.21.15.7:0/1444420601 >> v2:172.21.15.50:3300/0 conn(0x7f60cc0cae30 0x7f60cc0cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.094+0000 7f60cad9d700 1 -- 172.21.15.7:0/1444420601 >> v1:172.21.15.50:6789/0 conn(0x7f60cc0c8ba0 legacy=0x7f60cc0ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.094+0000 7f60cad9d700 1 -- 172.21.15.7:0/1444420601 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc0c95e0 con 0x7f60cc158120 2023-10-06T10:59:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.095+0000 7f60cad9d700 1 --2- 172.21.15.7:0/1444420601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc158120 0x7f60cc0c8660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f60cc06bb00 tx=0x7f60bc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc43f9567463ead server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.095+0000 7f60c9d9b700 1 -- 172.21.15.7:0/1444420601 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc005c10 con 0x7f60cc158120 2023-10-06T10:59:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.095+0000 7f60c9d9b700 1 -- 172.21.15.7:0/1444420601 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc005d70 con 0x7f60cc158120 2023-10-06T10:59:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.095+0000 7f60c9d9b700 1 -- 172.21.15.7:0/1444420601 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc006260 con 0x7f60cc158120 2023-10-06T10:59:22.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.095+0000 7f60d1023700 1 -- 172.21.15.7:0/1444420601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc158120 msgr2=0x7f60cc0c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.095+0000 7f60d1023700 1 --2- 172.21.15.7:0/1444420601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc158120 0x7f60cc0c8660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f60cc06bb00 tx=0x7f60bc009220 comp rx=0 tx=0).stop 2023-10-06T10:59:22.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.095+0000 7f60d1023700 1 -- 172.21.15.7:0/1444420601 shutdown_connections 2023-10-06T10:59:22.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.095+0000 7f60d1023700 1 --2- 172.21.15.7:0/1444420601 >> v2:172.21.15.50:3300/0 conn(0x7f60cc0cae30 0x7f60cc0cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.095+0000 7f60d1023700 1 --2- 172.21.15.7:0/1444420601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc158120 0x7f60cc0c8660 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.095+0000 7f60d1023700 1 -- 172.21.15.7:0/1444420601 >> 172.21.15.7:0/1444420601 conn(0x7f60cc087920 msgr2=0x7f60cc097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:22.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.095+0000 7f60d1023700 1 -- 172.21.15.7:0/1444420601 shutdown_connections 2023-10-06T10:59:22.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.095+0000 7f60d1023700 1 -- 172.21.15.7:0/1444420601 wait complete. 2023-10-06T10:59:22.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.097+0000 7f60d1023700 1 Processor -- start 2023-10-06T10:59:22.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.097+0000 7f60d1023700 1 -- start start 2023-10-06T10:59:22.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60d1023700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60cc0c8ba0 0x7f60cc097980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60d1023700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc0cae30 0x7f60cc097ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60d1023700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60cc158120 0x7f60cc167ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60d1023700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0c4390 con 0x7f60cc0cae30 2023-10-06T10:59:22.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60d1023700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc09a980 con 0x7f60cc0c8ba0 2023-10-06T10:59:22.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60d1023700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc099d70 con 0x7f60cc158120 2023-10-06T10:59:22.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60ca59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc0cae30 0x7f60cc097ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60ca59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc0cae30 0x7f60cc097ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43200/0 (socket says 172.21.15.7:43200) 2023-10-06T10:59:22.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60cad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60cc0c8ba0 0x7f60cc097980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60ca59c700 1 -- 172.21.15.7:0/2201759212 learned_addr learned my addr 172.21.15.7:0/2201759212 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:22.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60cb59e700 1 --2- 172.21.15.7:0/2201759212 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60cc158120 0x7f60cc167ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60ca59c700 1 -- 172.21.15.7:0/2201759212 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60cc158120 msgr2=0x7f60cc167ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60ca59c700 1 --2- 172.21.15.7:0/2201759212 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60cc158120 0x7f60cc167ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60ca59c700 1 -- 172.21.15.7:0/2201759212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60cc0c8ba0 msgr2=0x7f60cc097980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60ca59c700 1 --2- 172.21.15.7:0/2201759212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60cc0c8ba0 0x7f60cc097980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60ca59c700 1 -- 172.21.15.7:0/2201759212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc009480 con 0x7f60cc0cae30 2023-10-06T10:59:22.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.098+0000 7f60ca59c700 1 --2- 172.21.15.7:0/2201759212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc0cae30 0x7f60cc097ec0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f60b400c5c0 tx=0x7f60b400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:22.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.099+0000 7f60c2ffd700 1 -- 172.21.15.7:0/2201759212 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4011590 con 0x7f60cc0cae30 2023-10-06T10:59:22.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.099+0000 7f60c2ffd700 1 -- 172.21.15.7:0/2201759212 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b4011710 con 0x7f60cc0cae30 2023-10-06T10:59:22.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.099+0000 7f60d1023700 1 -- 172.21.15.7:0/2201759212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc09a050 con 0x7f60cc0cae30 2023-10-06T10:59:22.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.099+0000 7f60c2ffd700 1 -- 172.21.15.7:0/2201759212 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4011ad0 con 0x7f60cc0cae30 2023-10-06T10:59:22.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.099+0000 7f60d1023700 1 -- 172.21.15.7:0/2201759212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc09a610 con 0x7f60cc0cae30 2023-10-06T10:59:22.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.100+0000 7f60d1023700 1 -- 172.21.15.7:0/2201759212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60cc070480 con 0x7f60cc0cae30 2023-10-06T10:59:22.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.100+0000 7f60c2ffd700 1 -- 172.21.15.7:0/2201759212 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60b401b3b0 con 0x7f60cc0cae30 2023-10-06T10:59:22.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.101+0000 7f60c2ffd700 1 --2- 172.21.15.7:0/2201759212 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f60ac066f30 0x7f60ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.101+0000 7f60c2ffd700 1 -- 172.21.15.7:0/2201759212 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f60b4083dd0 con 0x7f60cc0cae30 2023-10-06T10:59:22.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.101+0000 7f60cad9d700 1 --2- 172.21.15.7:0/2201759212 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f60ac066f30 0x7f60ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.101+0000 7f60cad9d700 1 --2- 172.21.15.7:0/2201759212 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f60ac066f30 0x7f60ac0693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009260 tx=0x7f60bc016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:22.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.105+0000 7f60c2ffd700 1 -- 172.21.15.7:0/2201759212 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60b4050bf0 con 0x7f60cc0cae30 2023-10-06T10:59:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.307+0000 7f60d1023700 1 -- 172.21.15.7:0/2201759212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60cc0c98c0 con 0x7f60cc0cae30 2023-10-06T10:59:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.308+0000 7f60c2ffd700 1 -- 172.21.15.7:0/2201759212 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f60b4017070 con 0x7f60cc0cae30 2023-10-06T10:59:22.309 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:22.310 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:06.934264+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:22.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.311+0000 7f60d1023700 1 -- 172.21.15.7:0/2201759212 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f60ac066f30 msgr2=0x7f60ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.311+0000 7f60d1023700 1 --2- 172.21.15.7:0/2201759212 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f60ac066f30 0x7f60ac0693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009260 tx=0x7f60bc016000 comp rx=0 tx=0).stop 2023-10-06T10:59:22.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.311+0000 7f60d1023700 1 -- 172.21.15.7:0/2201759212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc0cae30 msgr2=0x7f60cc097ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.311+0000 7f60d1023700 1 --2- 172.21.15.7:0/2201759212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc0cae30 0x7f60cc097ec0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f60b400c5c0 tx=0x7f60b400c8d0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.311+0000 7f60d1023700 1 -- 172.21.15.7:0/2201759212 shutdown_connections 2023-10-06T10:59:22.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.311+0000 7f60d1023700 1 --2- 172.21.15.7:0/2201759212 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f60ac066f30 0x7f60ac0693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.311+0000 7f60d1023700 1 --2- 172.21.15.7:0/2201759212 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60cc158120 0x7f60cc167ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.311+0000 7f60d1023700 1 --2- 172.21.15.7:0/2201759212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60cc0c8ba0 0x7f60cc097980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.311+0000 7f60d1023700 1 --2- 172.21.15.7:0/2201759212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc0cae30 0x7f60cc097ec0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.311+0000 7f60d1023700 1 -- 172.21.15.7:0/2201759212 >> 172.21.15.7:0/2201759212 conn(0x7f60cc087920 msgr2=0x7f60cc0cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.311+0000 7f60d1023700 1 -- 172.21.15.7:0/2201759212 shutdown_connections 2023-10-06T10:59:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.311+0000 7f60d1023700 1 -- 172.21.15.7:0/2201759212 wait complete. 2023-10-06T10:59:22.325 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T10:59:22.326 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T10:59:22.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.457+0000 7fe3d609e700 1 Processor -- start 2023-10-06T10:59:22.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.457+0000 7fe3d609e700 1 -- start start 2023-10-06T10:59:22.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3d609e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3d01590d0 0x7fe3d0069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3d609e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe3d015d520 0x7fe3d01594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3d609e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d00694d0 con 0x7fe3d006a0f0 2023-10-06T10:59:22.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3d609e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d0068990 con 0x7fe3d015d520 2023-10-06T10:59:22.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3d609e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0068ba0 con 0x7fe3d01590d0 2023-10-06T10:59:22.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3ceffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe3d006a0f0 0x7fe3d015ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44228/0 (socket says 172.21.15.7:44228) 2023-10-06T10:59:22.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3ceffd700 1 -- 172.21.15.7:0/2504022378 learned_addr learned my addr 172.21.15.7:0/2504022378 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:22.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3cffff700 1 --2- 172.21.15.7:0/2504022378 >> v2:172.21.15.7:3300/0 conn(0x7fe3d015d520 0x7fe3d01594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3cf7fe700 1 --2- 172.21.15.7:0/2504022378 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3d01590d0 0x7fe3d0069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3ce7fc700 1 -- 172.21.15.7:0/2504022378 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398327003 0 0) 0x7fe3d00694d0 con 0x7fe3d006a0f0 2023-10-06T10:59:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3ce7fc700 1 -- 172.21.15.7:0/2504022378 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b8003570 con 0x7fe3d006a0f0 2023-10-06T10:59:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3cffff700 1 -- 172.21.15.7:0/2504022378 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3d01590d0 msgr2=0x7fe3d0069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3cffff700 1 --2- 172.21.15.7:0/2504022378 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3d01590d0 0x7fe3d0069bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3cffff700 1 -- 172.21.15.7:0/2504022378 >> v1:172.21.15.7:6789/0 conn(0x7fe3d006a0f0 legacy=0x7fe3d015ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3cffff700 1 -- 172.21.15.7:0/2504022378 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d0068e80 con 0x7fe3d015d520 2023-10-06T10:59:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3cffff700 1 --2- 172.21.15.7:0/2504022378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3d015d520 0x7fe3d01594a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80098e0 tx=0x7fe3c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599ca21f8e3e5e1f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3ce7fc700 1 -- 172.21.15.7:0/2504022378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8011630 con 0x7fe3d015d520 2023-10-06T10:59:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3ce7fc700 1 -- 172.21.15.7:0/2504022378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c8011790 con 0x7fe3d015d520 2023-10-06T10:59:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.458+0000 7fe3ce7fc700 1 -- 172.21.15.7:0/2504022378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8011b30 con 0x7fe3d015d520 2023-10-06T10:59:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.459+0000 7fe3d609e700 1 -- 172.21.15.7:0/2504022378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3d015d520 msgr2=0x7fe3d01594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.459+0000 7fe3d609e700 1 --2- 172.21.15.7:0/2504022378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3d015d520 0x7fe3d01594a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80098e0 tx=0x7fe3c80091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.459+0000 7fe3d609e700 1 -- 172.21.15.7:0/2504022378 shutdown_connections 2023-10-06T10:59:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.459+0000 7fe3d609e700 1 --2- 172.21.15.7:0/2504022378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3d015d520 0x7fe3d01594a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.459+0000 7fe3d609e700 1 --2- 172.21.15.7:0/2504022378 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3d01590d0 0x7fe3d0069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.459+0000 7fe3d609e700 1 -- 172.21.15.7:0/2504022378 >> 172.21.15.7:0/2504022378 conn(0x7fe3d0096160 msgr2=0x7fe3d00afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.459+0000 7fe3d609e700 1 -- 172.21.15.7:0/2504022378 shutdown_connections 2023-10-06T10:59:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.459+0000 7fe3d609e700 1 -- 172.21.15.7:0/2504022378 wait complete. 2023-10-06T10:59:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.460+0000 7fe3d609e700 1 Processor -- start 2023-10-06T10:59:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.461+0000 7fe3d609e700 1 -- start start 2023-10-06T10:59:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.461+0000 7fe3d609e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3d006a0f0 0x7fe3d0156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.461+0000 7fe3d609e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d01590d0 0x7fe3d0156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.461+0000 7fe3d609e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3d015d520 0x7fe3d01511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.461+0000 7fe3d609e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0158660 con 0x7fe3d015d520 2023-10-06T10:59:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.461+0000 7fe3d609e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0157380 con 0x7fe3d01590d0 2023-10-06T10:59:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.461+0000 7fe3d609e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d01575c0 con 0x7fe3d006a0f0 2023-10-06T10:59:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.461+0000 7fe3cffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3d015d520 0x7fe3d01511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.461+0000 7fe3cffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3d015d520 0x7fe3d01511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43228/0 (socket says 172.21.15.7:43228) 2023-10-06T10:59:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.461+0000 7fe3cffff700 1 -- 172.21.15.7:0/812142773 learned_addr learned my addr 172.21.15.7:0/812142773 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.462+0000 7fe3cf7fe700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3d006a0f0 0x7fe3d0156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.462+0000 7fe3ceffd700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d01590d0 0x7fe3d0156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.462+0000 7fe3cffff700 1 -- 172.21.15.7:0/812142773 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3d006a0f0 msgr2=0x7fe3d0156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.462+0000 7fe3cffff700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3d006a0f0 0x7fe3d0156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.462+0000 7fe3cffff700 1 -- 172.21.15.7:0/812142773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d01590d0 msgr2=0x7fe3d0156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.462+0000 7fe3cffff700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d01590d0 0x7fe3d0156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.462+0000 7fe3cffff700 1 -- 172.21.15.7:0/812142773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8009420 con 0x7fe3d015d520 2023-10-06T10:59:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.462+0000 7fe3ceffd700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d01590d0 0x7fe3d0156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.462+0000 7fe3cffff700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3d015d520 0x7fe3d01511c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00b2e50 tx=0x7fe3c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.462+0000 7fe3b77fe700 1 -- 172.21.15.7:0/812142773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c80253f0 con 0x7fe3d015d520 2023-10-06T10:59:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.462+0000 7fe3b77fe700 1 -- 172.21.15.7:0/812142773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c8025550 con 0x7fe3d015d520 2023-10-06T10:59:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.462+0000 7fe3d609e700 1 -- 172.21.15.7:0/812142773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d01578a0 con 0x7fe3d015d520 2023-10-06T10:59:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.462+0000 7fe3b77fe700 1 -- 172.21.15.7:0/812142773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8025910 con 0x7fe3d015d520 2023-10-06T10:59:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.462+0000 7fe3d609e700 1 -- 172.21.15.7:0/812142773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d0157e60 con 0x7fe3d015d520 2023-10-06T10:59:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.463+0000 7fe3d609e700 1 -- 172.21.15.7:0/812142773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d0070480 con 0x7fe3d015d520 2023-10-06T10:59:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.464+0000 7fe3b77fe700 1 -- 172.21.15.7:0/812142773 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3c8025d00 con 0x7fe3d015d520 2023-10-06T10:59:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.464+0000 7fe3b77fe700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe3bc066f30 0x7fe3bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.464+0000 7fe3b77fe700 1 -- 172.21.15.7:0/812142773 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe3c80862b0 con 0x7fe3d015d520 2023-10-06T10:59:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.464+0000 7fe3cf7fe700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe3bc066f30 0x7fe3bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.465+0000 7fe3cf7fe700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe3bc066f30 0x7fe3bc0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000f570 tx=0x7fe3c000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.469+0000 7fe3b77fe700 1 -- 172.21.15.7:0/812142773 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3c80530d0 con 0x7fe3d015d520 2023-10-06T10:59:22.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.674+0000 7fe3d609e700 1 -- 172.21.15.7:0/812142773 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3d0069160 con 0x7fe3bc066f30 2023-10-06T10:59:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.686+0000 7fe3b77fe700 1 -- 172.21.15.7:0/812142773 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367578 (secure 0 0 0) 0x7fe3d0069160 con 0x7fe3bc066f30 2023-10-06T10:59:22.691 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.689+0000 7fe3d609e700 1 -- 172.21.15.7:0/812142773 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe3bc066f30 msgr2=0x7fe3bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.689+0000 7fe3d609e700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe3bc066f30 0x7fe3bc0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000f570 tx=0x7fe3c000b040 comp rx=0 tx=0).stop 2023-10-06T10:59:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.689+0000 7fe3d609e700 1 -- 172.21.15.7:0/812142773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3d015d520 msgr2=0x7fe3d01511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.689+0000 7fe3d609e700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3d015d520 0x7fe3d01511c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00b2e50 tx=0x7fe3c8017000 comp rx=0 tx=0).stop 2023-10-06T10:59:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.689+0000 7fe3d609e700 1 -- 172.21.15.7:0/812142773 shutdown_connections 2023-10-06T10:59:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.689+0000 7fe3d609e700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe3bc066f30 0x7fe3bc0693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.689+0000 7fe3d609e700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3d015d520 0x7fe3d01511c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.689+0000 7fe3d609e700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3d006a0f0 0x7fe3d0156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.689+0000 7fe3d609e700 1 --2- 172.21.15.7:0/812142773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d01590d0 0x7fe3d0156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.689+0000 7fe3d609e700 1 -- 172.21.15.7:0/812142773 >> 172.21.15.7:0/812142773 conn(0x7fe3d0096160 msgr2=0x7fe3d00acdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.690+0000 7fe3d609e700 1 -- 172.21.15.7:0/812142773 shutdown_connections 2023-10-06T10:59:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.690+0000 7fe3d609e700 1 -- 172.21.15.7:0/812142773 wait complete. 2023-10-06T10:59:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-06T10:59:22.704 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-10-06T10:59:21.976774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594853,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381592,"kb_used_data":3288,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593128,"statfs":{"total":773094113280,"available":770655363072,"internally_reserved":0,"allocated":3366912,"data_stored":2061458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003211"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492562+0000","last_change":"2023-10-06T10:59:02.436169+0000","last_active":"2023-10-06T10:59:06.492562+0000","last_peered":"2023-10-06T10:59:06.492562+0000","last_clean":"2023-10-06T10:59:06.492562+0000","last_became_active":"2023-10-06T10:59:02.435876+0000","last_became_peered":"2023-10-06T10:59:02.435876+0000","last_unstale":"2023-10-06T10:59:06.492562+0000","last_undegraded":"2023-10-06T10:59:06.492562+0000","last_fullsized":"2023-10-06T10:59:06.492562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:41.015749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493906+0000","last_change":"2023-10-06T10:59:02.436149+0000","last_active":"2023-10-06T10:59:06.493906+0000","last_peered":"2023-10-06T10:59:06.493906+0000","last_clean":"2023-10-06T10:59:06.493906+0000","last_became_active":"2023-10-06T10:59:02.435828+0000","last_became_peered":"2023-10-06T10:59:02.435828+0000","last_unstale":"2023-10-06T10:59:06.493906+0000","last_undegraded":"2023-10-06T10:59:06.493906+0000","last_fullsized":"2023-10-06T10:59:06.493906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:28:49.922872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488695+0000","last_change":"2023-10-06T10:59:02.431176+0000","last_active":"2023-10-06T10:59:06.488695+0000","last_peered":"2023-10-06T10:59:06.488695+0000","last_clean":"2023-10-06T10:59:06.488695+0000","last_became_active":"2023-10-06T10:59:02.430717+0000","last_became_peered":"2023-10-06T10:59:02.430717+0000","last_unstale":"2023-10-06T10:59:06.488695+0000","last_undegraded":"2023-10-06T10:59:06.488695+0000","last_fullsized":"2023-10-06T10:59:06.488695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:50:46.657726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486050+0000","last_change":"2023-10-06T10:59:02.431021+0000","last_active":"2023-10-06T10:59:06.486050+0000","last_peered":"2023-10-06T10:59:06.486050+0000","last_clean":"2023-10-06T10:59:06.486050+0000","last_became_active":"2023-10-06T10:59:02.430698+0000","last_became_peered":"2023-10-06T10:59:02.430698+0000","last_unstale":"2023-10-06T10:59:06.486050+0000","last_undegraded":"2023-10-06T10:59:06.486050+0000","last_fullsized":"2023-10-06T10:59:06.486050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:40.405676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501016+0000","last_change":"2023-10-06T10:59:02.437710+0000","last_active":"2023-10-06T10:59:06.501016+0000","last_peered":"2023-10-06T10:59:06.501016+0000","last_clean":"2023-10-06T10:59:06.501016+0000","last_became_active":"2023-10-06T10:59:02.437363+0000","last_became_peered":"2023-10-06T10:59:02.437363+0000","last_unstale":"2023-10-06T10:59:06.501016+0000","last_undegraded":"2023-10-06T10:59:06.501016+0000","last_fullsized":"2023-10-06T10:59:06.501016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:17.096084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487005+0000","last_change":"2023-10-06T10:59:02.431827+0000","last_active":"2023-10-06T10:59:06.487005+0000","last_peered":"2023-10-06T10:59:06.487005+0000","last_clean":"2023-10-06T10:59:06.487005+0000","last_became_active":"2023-10-06T10:59:02.431489+0000","last_became_peered":"2023-10-06T10:59:02.431489+0000","last_unstale":"2023-10-06T10:59:06.487005+0000","last_undegraded":"2023-10-06T10:59:06.487005+0000","last_fullsized":"2023-10-06T10:59:06.487005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:08:38.269689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.502047+0000","last_change":"2023-10-06T10:59:02.444025+0000","last_active":"2023-10-06T10:59:06.502047+0000","last_peered":"2023-10-06T10:59:06.502047+0000","last_clean":"2023-10-06T10:59:06.502047+0000","last_became_active":"2023-10-06T10:59:02.443754+0000","last_became_peered":"2023-10-06T10:59:02.443754+0000","last_unstale":"2023-10-06T10:59:06.502047+0000","last_undegraded":"2023-10-06T10:59:06.502047+0000","last_fullsized":"2023-10-06T10:59:06.502047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492806+0000","last_change":"2023-10-06T10:59:02.421077+0000","last_active":"2023-10-06T10:59:06.492806+0000","last_peered":"2023-10-06T10:59:06.492806+0000","last_clean":"2023-10-06T10:59:06.492806+0000","last_became_active":"2023-10-06T10:59:02.420781+0000","last_became_peered":"2023-10-06T10:59:02.420781+0000","last_unstale":"2023-10-06T10:59:06.492806+0000","last_undegraded":"2023-10-06T10:59:06.492806+0000","last_fullsized":"2023-10-06T10:59:06.492806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:20.715518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503818+0000","last_change":"2023-10-06T10:59:02.438976+0000","last_active":"2023-10-06T10:59:06.503818+0000","last_peered":"2023-10-06T10:59:06.503818+0000","last_clean":"2023-10-06T10:59:06.503818+0000","last_became_active":"2023-10-06T10:59:02.437626+0000","last_became_peered":"2023-10-06T10:59:02.437626+0000","last_unstale":"2023-10-06T10:59:06.503818+0000","last_undegraded":"2023-10-06T10:59:06.503818+0000","last_fullsized":"2023-10-06T10:59:06.503818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:38.092745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494111+0000","last_change":"2023-10-06T10:59:02.430066+0000","last_active":"2023-10-06T10:59:06.494111+0000","last_peered":"2023-10-06T10:59:06.494111+0000","last_clean":"2023-10-06T10:59:06.494111+0000","last_became_active":"2023-10-06T10:59:02.429786+0000","last_became_peered":"2023-10-06T10:59:02.429786+0000","last_unstale":"2023-10-06T10:59:06.494111+0000","last_undegraded":"2023-10-06T10:59:06.494111+0000","last_fullsized":"2023-10-06T10:59:06.494111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488572+0000","last_change":"2023-10-06T10:59:02.429174+0000","last_active":"2023-10-06T10:59:06.488572+0000","last_peered":"2023-10-06T10:59:06.488572+0000","last_clean":"2023-10-06T10:59:06.488572+0000","last_became_active":"2023-10-06T10:59:02.428460+0000","last_became_peered":"2023-10-06T10:59:02.428460+0000","last_unstale":"2023-10-06T10:59:06.488572+0000","last_undegraded":"2023-10-06T10:59:06.488572+0000","last_fullsized":"2023-10-06T10:59:06.488572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.497917+0000","last_change":"2023-10-06T10:59:02.417958+0000","last_active":"2023-10-06T10:59:06.497917+0000","last_peered":"2023-10-06T10:59:06.497917+0000","last_clean":"2023-10-06T10:59:06.497917+0000","last_became_active":"2023-10-06T10:59:02.417612+0000","last_became_peered":"2023-10-06T10:59:02.417612+0000","last_unstale":"2023-10-06T10:59:06.497917+0000","last_undegraded":"2023-10-06T10:59:06.497917+0000","last_fullsized":"2023-10-06T10:59:06.497917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:51.449145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.495493+0000","last_change":"2023-10-06T10:59:02.436783+0000","last_active":"2023-10-06T10:59:06.495493+0000","last_peered":"2023-10-06T10:59:06.495493+0000","last_clean":"2023-10-06T10:59:06.495493+0000","last_became_active":"2023-10-06T10:59:02.436507+0000","last_became_peered":"2023-10-06T10:59:02.436507+0000","last_unstale":"2023-10-06T10:59:06.495493+0000","last_undegraded":"2023-10-06T10:59:06.495493+0000","last_fullsized":"2023-10-06T10:59:06.495493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:04.586026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493130+0000","last_change":"2023-10-06T10:59:02.425873+0000","last_active":"2023-10-06T10:59:06.493130+0000","last_peered":"2023-10-06T10:59:06.493130+0000","last_clean":"2023-10-06T10:59:06.493130+0000","last_became_active":"2023-10-06T10:59:02.425566+0000","last_became_peered":"2023-10-06T10:59:02.425566+0000","last_unstale":"2023-10-06T10:59:06.493130+0000","last_undegraded":"2023-10-06T10:59:06.493130+0000","last_fullsized":"2023-10-06T10:59:06.493130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:23.772944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501838+0000","last_change":"2023-10-06T10:59:02.444199+0000","last_active":"2023-10-06T10:59:06.501838+0000","last_peered":"2023-10-06T10:59:06.501838+0000","last_clean":"2023-10-06T10:59:06.501838+0000","last_became_active":"2023-10-06T10:59:02.443956+0000","last_became_peered":"2023-10-06T10:59:02.443956+0000","last_unstale":"2023-10-06T10:59:06.501838+0000","last_undegraded":"2023-10-06T10:59:06.501838+0000","last_fullsized":"2023-10-06T10:59:06.501838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:56.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.489640+0000","last_change":"2023-10-06T10:59:02.426577+0000","last_active":"2023-10-06T10:59:06.489640+0000","last_peered":"2023-10-06T10:59:06.489640+0000","last_clean":"2023-10-06T10:59:06.489640+0000","last_became_active":"2023-10-06T10:59:02.426242+0000","last_became_peered":"2023-10-06T10:59:02.426242+0000","last_unstale":"2023-10-06T10:59:06.489640+0000","last_undegraded":"2023-10-06T10:59:06.489640+0000","last_fullsized":"2023-10-06T10:59:06.489640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:31.375932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503914+0000","last_change":"2023-10-06T10:59:02.438604+0000","last_active":"2023-10-06T10:59:06.503914+0000","last_peered":"2023-10-06T10:59:06.503914+0000","last_clean":"2023-10-06T10:59:06.503914+0000","last_became_active":"2023-10-06T10:59:02.438014+0000","last_became_peered":"2023-10-06T10:59:02.438014+0000","last_unstale":"2023-10-06T10:59:06.503914+0000","last_undegraded":"2023-10-06T10:59:06.503914+0000","last_fullsized":"2023-10-06T10:59:06.503914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487888+0000","last_change":"2023-10-06T10:59:02.426707+0000","last_active":"2023-10-06T10:59:06.487888+0000","last_peered":"2023-10-06T10:59:06.487888+0000","last_clean":"2023-10-06T10:59:06.487888+0000","last_became_active":"2023-10-06T10:59:02.426263+0000","last_became_peered":"2023-10-06T10:59:02.426263+0000","last_unstale":"2023-10-06T10:59:06.487888+0000","last_undegraded":"2023-10-06T10:59:06.487888+0000","last_fullsized":"2023-10-06T10:59:06.487888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:58.642289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.496996+0000","last_change":"2023-10-06T10:59:02.419676+0000","last_active":"2023-10-06T10:59:06.496996+0000","last_peered":"2023-10-06T10:59:06.496996+0000","last_clean":"2023-10-06T10:59:06.496996+0000","last_became_active":"2023-10-06T10:59:02.419356+0000","last_became_peered":"2023-10-06T10:59:02.419356+0000","last_unstale":"2023-10-06T10:59:06.496996+0000","last_undegraded":"2023-10-06T10:59:06.496996+0000","last_fullsized":"2023-10-06T10:59:06.496996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:42.646222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486894+0000","last_change":"2023-10-06T10:59:02.420221+0000","last_active":"2023-10-06T10:59:06.486894+0000","last_peered":"2023-10-06T10:59:06.486894+0000","last_clean":"2023-10-06T10:59:06.486894+0000","last_became_active":"2023-10-06T10:59:02.419881+0000","last_became_peered":"2023-10-06T10:59:02.419881+0000","last_unstale":"2023-10-06T10:59:06.486894+0000","last_undegraded":"2023-10-06T10:59:06.486894+0000","last_fullsized":"2023-10-06T10:59:06.486894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:17.096084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503250+0000","last_change":"2023-10-06T10:59:02.436623+0000","last_active":"2023-10-06T10:59:06.503250+0000","last_peered":"2023-10-06T10:59:06.503250+0000","last_clean":"2023-10-06T10:59:06.503250+0000","last_became_active":"2023-10-06T10:59:02.436288+0000","last_became_peered":"2023-10-06T10:59:02.436288+0000","last_unstale":"2023-10-06T10:59:06.503250+0000","last_undegraded":"2023-10-06T10:59:06.503250+0000","last_fullsized":"2023-10-06T10:59:06.503250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:31.081513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.500640+0000","last_change":"2023-10-06T10:59:02.436300+0000","last_active":"2023-10-06T10:59:06.500640+0000","last_peered":"2023-10-06T10:59:06.500640+0000","last_clean":"2023-10-06T10:59:06.500640+0000","last_became_active":"2023-10-06T10:59:02.435769+0000","last_became_peered":"2023-10-06T10:59:02.435769+0000","last_unstale":"2023-10-06T10:59:06.500640+0000","last_undegraded":"2023-10-06T10:59:06.500640+0000","last_fullsized":"2023-10-06T10:59:06.500640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493156+0000","last_change":"2023-10-06T10:59:02.440684+0000","last_active":"2023-10-06T10:59:06.493156+0000","last_peered":"2023-10-06T10:59:06.493156+0000","last_clean":"2023-10-06T10:59:06.493156+0000","last_became_active":"2023-10-06T10:59:02.440157+0000","last_became_peered":"2023-10-06T10:59:02.440157+0000","last_unstale":"2023-10-06T10:59:06.493156+0000","last_undegraded":"2023-10-06T10:59:06.493156+0000","last_fullsized":"2023-10-06T10:59:06.493156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:17.384456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501602+0000","last_change":"2023-10-06T10:59:02.439323+0000","last_active":"2023-10-06T10:59:06.501602+0000","last_peered":"2023-10-06T10:59:06.501602+0000","last_clean":"2023-10-06T10:59:06.501602+0000","last_became_active":"2023-10-06T10:59:02.439038+0000","last_became_peered":"2023-10-06T10:59:02.439038+0000","last_unstale":"2023-10-06T10:59:06.501602+0000","last_undegraded":"2023-10-06T10:59:06.501602+0000","last_fullsized":"2023-10-06T10:59:06.501602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487277+0000","last_change":"2023-10-06T10:59:02.422230+0000","last_active":"2023-10-06T10:59:06.487277+0000","last_peered":"2023-10-06T10:59:06.487277+0000","last_clean":"2023-10-06T10:59:06.487277+0000","last_became_active":"2023-10-06T10:59:02.421846+0000","last_became_peered":"2023-10-06T10:59:02.421846+0000","last_unstale":"2023-10-06T10:59:06.487277+0000","last_undegraded":"2023-10-06T10:59:06.487277+0000","last_fullsized":"2023-10-06T10:59:06.487277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:20.715518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487304+0000","last_change":"2023-10-06T10:59:02.419258+0000","last_active":"2023-10-06T10:59:06.487304+0000","last_peered":"2023-10-06T10:59:06.487304+0000","last_clean":"2023-10-06T10:59:06.487304+0000","last_became_active":"2023-10-06T10:59:02.418921+0000","last_became_peered":"2023-10-06T10:59:02.418921+0000","last_unstale":"2023-10-06T10:59:06.487304+0000","last_undegraded":"2023-10-06T10:59:06.487304+0000","last_fullsized":"2023-10-06T10:59:06.487304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:17.558201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493500+0000","last_change":"2023-10-06T10:59:02.429047+0000","last_active":"2023-10-06T10:59:06.493500+0000","last_peered":"2023-10-06T10:59:06.493500+0000","last_clean":"2023-10-06T10:59:06.493500+0000","last_became_active":"2023-10-06T10:59:02.428070+0000","last_became_peered":"2023-10-06T10:59:02.428070+0000","last_unstale":"2023-10-06T10:59:06.493500+0000","last_undegraded":"2023-10-06T10:59:06.493500+0000","last_fullsized":"2023-10-06T10:59:06.493500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:17.286697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511536+0000","last_change":"2023-10-06T10:59:06.505906+0000","last_active":"2023-10-06T10:59:06.511536+0000","last_peered":"2023-10-06T10:59:06.511536+0000","last_clean":"2023-10-06T10:59:06.511536+0000","last_became_active":"2023-10-06T10:59:06.505502+0000","last_became_peered":"2023-10-06T10:59:06.505502+0000","last_unstale":"2023-10-06T10:59:06.511536+0000","last_undegraded":"2023-10-06T10:59:06.511536+0000","last_fullsized":"2023-10-06T10:59:06.511536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:58:13.075195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486926+0000","last_change":"2023-10-06T10:59:01.410556+0000","last_active":"2023-10-06T10:59:06.486926+0000","last_peered":"2023-10-06T10:59:06.486926+0000","last_clean":"2023-10-06T10:59:06.486926+0000","last_became_active":"2023-10-06T10:59:01.410304+0000","last_became_peered":"2023-10-06T10:59:01.410304+0000","last_unstale":"2023-10-06T10:59:06.486926+0000","last_undegraded":"2023-10-06T10:59:06.486926+0000","last_fullsized":"2023-10-06T10:59:06.486926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494194+0000","last_change":"2023-10-06T10:59:02.446346+0000","last_active":"2023-10-06T10:59:06.494194+0000","last_peered":"2023-10-06T10:59:06.494194+0000","last_clean":"2023-10-06T10:59:06.494194+0000","last_became_active":"2023-10-06T10:59:02.446029+0000","last_became_peered":"2023-10-06T10:59:02.446029+0000","last_unstale":"2023-10-06T10:59:06.494194+0000","last_undegraded":"2023-10-06T10:59:06.494194+0000","last_fullsized":"2023-10-06T10:59:06.494194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:48.645632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516676+0000","last_change":"2023-10-06T10:59:06.508187+0000","last_active":"2023-10-06T10:59:06.516676+0000","last_peered":"2023-10-06T10:59:06.516676+0000","last_clean":"2023-10-06T10:59:06.516676+0000","last_became_active":"2023-10-06T10:59:06.507722+0000","last_became_peered":"2023-10-06T10:59:06.507722+0000","last_unstale":"2023-10-06T10:59:06.516676+0000","last_undegraded":"2023-10-06T10:59:06.516676+0000","last_fullsized":"2023-10-06T10:59:06.516676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:52.733607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485843+0000","last_change":"2023-10-06T10:59:01.406095+0000","last_active":"2023-10-06T10:59:06.485843+0000","last_peered":"2023-10-06T10:59:06.485843+0000","last_clean":"2023-10-06T10:59:06.485843+0000","last_became_active":"2023-10-06T10:59:01.405687+0000","last_became_peered":"2023-10-06T10:59:01.405687+0000","last_unstale":"2023-10-06T10:59:06.485843+0000","last_undegraded":"2023-10-06T10:59:06.485843+0000","last_fullsized":"2023-10-06T10:59:06.485843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:55.921829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504174+0000","last_change":"2023-10-06T10:59:02.427693+0000","last_active":"2023-10-06T10:59:06.504174+0000","last_peered":"2023-10-06T10:59:06.504174+0000","last_clean":"2023-10-06T10:59:06.504174+0000","last_became_active":"2023-10-06T10:59:02.427352+0000","last_became_peered":"2023-10-06T10:59:02.427352+0000","last_unstale":"2023-10-06T10:59:06.504174+0000","last_undegraded":"2023-10-06T10:59:06.504174+0000","last_fullsized":"2023-10-06T10:59:06.504174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:28:49.922872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514081+0000","last_change":"2023-10-06T10:59:06.507380+0000","last_active":"2023-10-06T10:59:06.514081+0000","last_peered":"2023-10-06T10:59:06.514081+0000","last_clean":"2023-10-06T10:59:06.514081+0000","last_became_active":"2023-10-06T10:59:06.506977+0000","last_became_peered":"2023-10-06T10:59:06.506977+0000","last_unstale":"2023-10-06T10:59:06.514081+0000","last_undegraded":"2023-10-06T10:59:06.514081+0000","last_fullsized":"2023-10-06T10:59:06.514081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:50.861372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493785+0000","last_change":"2023-10-06T10:59:01.411985+0000","last_active":"2023-10-06T10:59:06.493785+0000","last_peered":"2023-10-06T10:59:06.493785+0000","last_clean":"2023-10-06T10:59:06.493785+0000","last_became_active":"2023-10-06T10:59:01.411513+0000","last_became_peered":"2023-10-06T10:59:01.411513+0000","last_unstale":"2023-10-06T10:59:06.493785+0000","last_undegraded":"2023-10-06T10:59:06.493785+0000","last_fullsized":"2023-10-06T10:59:06.493785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:50.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487360+0000","last_change":"2023-10-06T10:59:02.422860+0000","last_active":"2023-10-06T10:59:06.487360+0000","last_peered":"2023-10-06T10:59:06.487360+0000","last_clean":"2023-10-06T10:59:06.487360+0000","last_became_active":"2023-10-06T10:59:02.422552+0000","last_became_peered":"2023-10-06T10:59:02.422552+0000","last_unstale":"2023-10-06T10:59:06.487360+0000","last_undegraded":"2023-10-06T10:59:06.487360+0000","last_fullsized":"2023-10-06T10:59:06.487360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:20.715518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516565+0000","last_change":"2023-10-06T10:59:06.508111+0000","last_active":"2023-10-06T10:59:06.516565+0000","last_peered":"2023-10-06T10:59:06.516565+0000","last_clean":"2023-10-06T10:59:06.516565+0000","last_became_active":"2023-10-06T10:59:06.507685+0000","last_became_peered":"2023-10-06T10:59:06.507685+0000","last_unstale":"2023-10-06T10:59:06.516565+0000","last_undegraded":"2023-10-06T10:59:06.516565+0000","last_fullsized":"2023-10-06T10:59:06.516565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:21.184059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504004+0000","last_change":"2023-10-06T10:59:01.415316+0000","last_active":"2023-10-06T10:59:06.504004+0000","last_peered":"2023-10-06T10:59:06.504004+0000","last_clean":"2023-10-06T10:59:06.504004+0000","last_became_active":"2023-10-06T10:59:01.415052+0000","last_became_peered":"2023-10-06T10:59:01.415052+0000","last_unstale":"2023-10-06T10:59:06.504004+0000","last_undegraded":"2023-10-06T10:59:06.504004+0000","last_fullsized":"2023-10-06T10:59:06.504004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:03.581242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493689+0000","last_change":"2023-10-06T10:59:02.445937+0000","last_active":"2023-10-06T10:59:06.493689+0000","last_peered":"2023-10-06T10:59:06.493689+0000","last_clean":"2023-10-06T10:59:06.493689+0000","last_became_active":"2023-10-06T10:59:02.444001+0000","last_became_peered":"2023-10-06T10:59:02.444001+0000","last_unstale":"2023-10-06T10:59:06.493689+0000","last_undegraded":"2023-10-06T10:59:06.493689+0000","last_fullsized":"2023-10-06T10:59:06.493689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:31.375932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516837+0000","last_change":"2023-10-06T10:59:06.515426+0000","last_active":"2023-10-06T10:59:06.516837+0000","last_peered":"2023-10-06T10:59:06.516837+0000","last_clean":"2023-10-06T10:59:06.516837+0000","last_became_active":"2023-10-06T10:59:06.514929+0000","last_became_peered":"2023-10-06T10:59:06.514929+0000","last_unstale":"2023-10-06T10:59:06.516837+0000","last_undegraded":"2023-10-06T10:59:06.516837+0000","last_fullsized":"2023-10-06T10:59:06.516837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:29.878658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494014+0000","last_change":"2023-10-06T10:59:01.413409+0000","last_active":"2023-10-06T10:59:06.494014+0000","last_peered":"2023-10-06T10:59:06.494014+0000","last_clean":"2023-10-06T10:59:06.494014+0000","last_became_active":"2023-10-06T10:59:01.413132+0000","last_became_peered":"2023-10-06T10:59:01.413132+0000","last_unstale":"2023-10-06T10:59:06.494014+0000","last_undegraded":"2023-10-06T10:59:06.494014+0000","last_fullsized":"2023-10-06T10:59:06.494014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:19.192242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492779+0000","last_change":"2023-10-06T10:59:02.433507+0000","last_active":"2023-10-06T10:59:06.492779+0000","last_peered":"2023-10-06T10:59:06.492779+0000","last_clean":"2023-10-06T10:59:06.492779+0000","last_became_active":"2023-10-06T10:59:02.433196+0000","last_became_peered":"2023-10-06T10:59:02.433196+0000","last_unstale":"2023-10-06T10:59:06.492779+0000","last_undegraded":"2023-10-06T10:59:06.492779+0000","last_fullsized":"2023-10-06T10:59:06.492779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.506197+0000","last_change":"2023-10-06T10:59:06.502951+0000","last_active":"2023-10-06T10:59:06.506197+0000","last_peered":"2023-10-06T10:59:06.506197+0000","last_clean":"2023-10-06T10:59:06.506197+0000","last_became_active":"2023-10-06T10:59:06.502527+0000","last_became_peered":"2023-10-06T10:59:06.502527+0000","last_unstale":"2023-10-06T10:59:06.506197+0000","last_undegraded":"2023-10-06T10:59:06.506197+0000","last_fullsized":"2023-10-06T10:59:06.506197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:18.864841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503418+0000","last_change":"2023-10-06T10:59:01.415005+0000","last_active":"2023-10-06T10:59:06.503418+0000","last_peered":"2023-10-06T10:59:06.503418+0000","last_clean":"2023-10-06T10:59:06.503418+0000","last_became_active":"2023-10-06T10:59:01.414705+0000","last_became_peered":"2023-10-06T10:59:01.414705+0000","last_unstale":"2023-10-06T10:59:06.503418+0000","last_undegraded":"2023-10-06T10:59:06.503418+0000","last_fullsized":"2023-10-06T10:59:06.503418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:16.553416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485948+0000","last_change":"2023-10-06T10:59:02.423861+0000","last_active":"2023-10-06T10:59:06.485948+0000","last_peered":"2023-10-06T10:59:06.485948+0000","last_clean":"2023-10-06T10:59:06.485948+0000","last_became_active":"2023-10-06T10:59:02.419690+0000","last_became_peered":"2023-10-06T10:59:02.419690+0000","last_unstale":"2023-10-06T10:59:06.485948+0000","last_undegraded":"2023-10-06T10:59:06.485948+0000","last_fullsized":"2023-10-06T10:59:06.485948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:36.050017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513155+0000","last_change":"2023-10-06T10:59:06.506470+0000","last_active":"2023-10-06T10:59:06.513155+0000","last_peered":"2023-10-06T10:59:06.513155+0000","last_clean":"2023-10-06T10:59:06.513155+0000","last_became_active":"2023-10-06T10:59:06.506061+0000","last_became_peered":"2023-10-06T10:59:06.506061+0000","last_unstale":"2023-10-06T10:59:06.513155+0000","last_undegraded":"2023-10-06T10:59:06.513155+0000","last_fullsized":"2023-10-06T10:59:06.513155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:49.928746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T10:59:12.825833+0000","last_change":"2023-10-06T10:59:01.409923+0000","last_active":"2023-10-06T10:59:12.825833+0000","last_peered":"2023-10-06T10:59:12.825833+0000","last_clean":"2023-10-06T10:59:12.825833+0000","last_became_active":"2023-10-06T10:59:01.409615+0000","last_became_peered":"2023-10-06T10:59:01.409615+0000","last_unstale":"2023-10-06T10:59:12.825833+0000","last_undegraded":"2023-10-06T10:59:12.825833+0000","last_fullsized":"2023-10-06T10:59:12.825833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:02.802656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488353+0000","last_change":"2023-10-06T10:59:02.420107+0000","last_active":"2023-10-06T10:59:06.488353+0000","last_peered":"2023-10-06T10:59:06.488353+0000","last_clean":"2023-10-06T10:59:06.488353+0000","last_became_active":"2023-10-06T10:59:02.419814+0000","last_became_peered":"2023-10-06T10:59:02.419814+0000","last_unstale":"2023-10-06T10:59:06.488353+0000","last_undegraded":"2023-10-06T10:59:06.488353+0000","last_fullsized":"2023-10-06T10:59:06.488353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:53.107388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511474+0000","last_change":"2023-10-06T10:59:06.504882+0000","last_active":"2023-10-06T10:59:06.511474+0000","last_peered":"2023-10-06T10:59:06.511474+0000","last_clean":"2023-10-06T10:59:06.511474+0000","last_became_active":"2023-10-06T10:59:06.504478+0000","last_became_peered":"2023-10-06T10:59:06.504478+0000","last_unstale":"2023-10-06T10:59:06.511474+0000","last_undegraded":"2023-10-06T10:59:06.511474+0000","last_fullsized":"2023-10-06T10:59:06.511474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:25.148933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503121+0000","last_change":"2023-10-06T10:59:01.418211+0000","last_active":"2023-10-06T10:59:06.503121+0000","last_peered":"2023-10-06T10:59:06.503121+0000","last_clean":"2023-10-06T10:59:06.503121+0000","last_became_active":"2023-10-06T10:59:01.417924+0000","last_became_peered":"2023-10-06T10:59:01.417924+0000","last_unstale":"2023-10-06T10:59:06.503121+0000","last_undegraded":"2023-10-06T10:59:06.503121+0000","last_fullsized":"2023-10-06T10:59:06.503121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:44.340657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493921+0000","last_change":"2023-10-06T10:59:02.446135+0000","last_active":"2023-10-06T10:59:06.493921+0000","last_peered":"2023-10-06T10:59:06.493921+0000","last_clean":"2023-10-06T10:59:06.493921+0000","last_became_active":"2023-10-06T10:59:02.445893+0000","last_became_peered":"2023-10-06T10:59:02.445893+0000","last_unstale":"2023-10-06T10:59:06.493921+0000","last_undegraded":"2023-10-06T10:59:06.493921+0000","last_fullsized":"2023-10-06T10:59:06.493921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:38.092745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513350+0000","last_change":"2023-10-06T10:59:06.508048+0000","last_active":"2023-10-06T10:59:06.513350+0000","last_peered":"2023-10-06T10:59:06.513350+0000","last_clean":"2023-10-06T10:59:06.513350+0000","last_became_active":"2023-10-06T10:59:06.507619+0000","last_became_peered":"2023-10-06T10:59:06.507619+0000","last_unstale":"2023-10-06T10:59:06.513350+0000","last_undegraded":"2023-10-06T10:59:06.513350+0000","last_fullsized":"2023-10-06T10:59:06.513350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:26:48.345083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.500810+0000","last_change":"2023-10-06T10:59:01.407912+0000","last_active":"2023-10-06T10:59:06.500810+0000","last_peered":"2023-10-06T10:59:06.500810+0000","last_clean":"2023-10-06T10:59:06.500810+0000","last_became_active":"2023-10-06T10:59:01.407345+0000","last_became_peered":"2023-10-06T10:59:01.407345+0000","last_unstale":"2023-10-06T10:59:06.500810+0000","last_undegraded":"2023-10-06T10:59:06.500810+0000","last_fullsized":"2023-10-06T10:59:06.500810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:40.010964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493409+0000","last_change":"2023-10-06T10:59:02.429169+0000","last_active":"2023-10-06T10:59:06.493409+0000","last_peered":"2023-10-06T10:59:06.493409+0000","last_clean":"2023-10-06T10:59:06.493409+0000","last_became_active":"2023-10-06T10:59:02.428497+0000","last_became_peered":"2023-10-06T10:59:02.428497+0000","last_unstale":"2023-10-06T10:59:06.493409+0000","last_undegraded":"2023-10-06T10:59:06.493409+0000","last_fullsized":"2023-10-06T10:59:06.493409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:36.050017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514019+0000","last_change":"2023-10-06T10:59:06.509198+0000","last_active":"2023-10-06T10:59:06.514019+0000","last_peered":"2023-10-06T10:59:06.514019+0000","last_clean":"2023-10-06T10:59:06.514019+0000","last_became_active":"2023-10-06T10:59:06.508723+0000","last_became_peered":"2023-10-06T10:59:06.508723+0000","last_unstale":"2023-10-06T10:59:06.514019+0000","last_undegraded":"2023-10-06T10:59:06.514019+0000","last_fullsized":"2023-10-06T10:59:06.514019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:00.501898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501932+0000","last_change":"2023-10-06T10:59:01.417026+0000","last_active":"2023-10-06T10:59:06.501932+0000","last_peered":"2023-10-06T10:59:06.501932+0000","last_clean":"2023-10-06T10:59:06.501932+0000","last_became_active":"2023-10-06T10:59:01.416734+0000","last_became_peered":"2023-10-06T10:59:01.416734+0000","last_unstale":"2023-10-06T10:59:06.501932+0000","last_undegraded":"2023-10-06T10:59:06.501932+0000","last_fullsized":"2023-10-06T10:59:06.501932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:05:13.017527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504438+0000","last_change":"2023-10-06T10:59:02.437995+0000","last_active":"2023-10-06T10:59:06.504438+0000","last_peered":"2023-10-06T10:59:06.504438+0000","last_clean":"2023-10-06T10:59:06.504438+0000","last_became_active":"2023-10-06T10:59:02.437537+0000","last_became_peered":"2023-10-06T10:59:02.437537+0000","last_unstale":"2023-10-06T10:59:06.504438+0000","last_undegraded":"2023-10-06T10:59:06.504438+0000","last_fullsized":"2023-10-06T10:59:06.504438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:53.107388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.510983+0000","last_change":"2023-10-06T10:59:06.505596+0000","last_active":"2023-10-06T10:59:06.510983+0000","last_peered":"2023-10-06T10:59:06.510983+0000","last_clean":"2023-10-06T10:59:06.510983+0000","last_became_active":"2023-10-06T10:59:06.505171+0000","last_became_peered":"2023-10-06T10:59:06.505171+0000","last_unstale":"2023-10-06T10:59:06.510983+0000","last_undegraded":"2023-10-06T10:59:06.510983+0000","last_fullsized":"2023-10-06T10:59:06.510983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:43.846344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485606+0000","last_change":"2023-10-06T10:59:01.407896+0000","last_active":"2023-10-06T10:59:06.485606+0000","last_peered":"2023-10-06T10:59:06.485606+0000","last_clean":"2023-10-06T10:59:06.485606+0000","last_became_active":"2023-10-06T10:59:01.407443+0000","last_became_peered":"2023-10-06T10:59:01.407443+0000","last_unstale":"2023-10-06T10:59:06.485606+0000","last_undegraded":"2023-10-06T10:59:06.485606+0000","last_fullsized":"2023-10-06T10:59:06.485606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:08.334923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494412+0000","last_change":"2023-10-06T10:59:02.434282+0000","last_active":"2023-10-06T10:59:06.494412+0000","last_peered":"2023-10-06T10:59:06.494412+0000","last_clean":"2023-10-06T10:59:06.494412+0000","last_became_active":"2023-10-06T10:59:02.433977+0000","last_became_peered":"2023-10-06T10:59:02.433977+0000","last_unstale":"2023-10-06T10:59:06.494412+0000","last_undegraded":"2023-10-06T10:59:06.494412+0000","last_fullsized":"2023-10-06T10:59:06.494412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.517644+0000","last_change":"2023-10-06T10:59:06.516059+0000","last_active":"2023-10-06T10:59:06.517644+0000","last_peered":"2023-10-06T10:59:06.517644+0000","last_clean":"2023-10-06T10:59:06.517644+0000","last_became_active":"2023-10-06T10:59:06.515669+0000","last_became_peered":"2023-10-06T10:59:06.515669+0000","last_unstale":"2023-10-06T10:59:06.517644+0000","last_undegraded":"2023-10-06T10:59:06.517644+0000","last_fullsized":"2023-10-06T10:59:06.517644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:52:08.979101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.505660+0000","last_change":"2023-10-06T10:59:01.417634+0000","last_active":"2023-10-06T10:59:06.505660+0000","last_peered":"2023-10-06T10:59:06.505660+0000","last_clean":"2023-10-06T10:59:06.505660+0000","last_became_active":"2023-10-06T10:59:01.417355+0000","last_became_peered":"2023-10-06T10:59:01.417355+0000","last_unstale":"2023-10-06T10:59:06.505660+0000","last_undegraded":"2023-10-06T10:59:06.505660+0000","last_fullsized":"2023-10-06T10:59:06.505660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:19.433940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492678+0000","last_change":"2023-10-06T10:59:02.428141+0000","last_active":"2023-10-06T10:59:06.492678+0000","last_peered":"2023-10-06T10:59:06.492678+0000","last_clean":"2023-10-06T10:59:06.492678+0000","last_became_active":"2023-10-06T10:59:02.427848+0000","last_became_peered":"2023-10-06T10:59:02.427848+0000","last_unstale":"2023-10-06T10:59:06.492678+0000","last_undegraded":"2023-10-06T10:59:06.492678+0000","last_fullsized":"2023-10-06T10:59:06.492678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:56.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513719+0000","last_change":"2023-10-06T10:59:06.510996+0000","last_active":"2023-10-06T10:59:06.513719+0000","last_peered":"2023-10-06T10:59:06.513719+0000","last_clean":"2023-10-06T10:59:06.513719+0000","last_became_active":"2023-10-06T10:59:06.510585+0000","last_became_peered":"2023-10-06T10:59:06.510585+0000","last_unstale":"2023-10-06T10:59:06.513719+0000","last_undegraded":"2023-10-06T10:59:06.513719+0000","last_fullsized":"2023-10-06T10:59:06.513719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:21.184059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503478+0000","last_change":"2023-10-06T10:59:01.411248+0000","last_active":"2023-10-06T10:59:06.503478+0000","last_peered":"2023-10-06T10:59:06.503478+0000","last_clean":"2023-10-06T10:59:06.503478+0000","last_became_active":"2023-10-06T10:59:01.410969+0000","last_became_peered":"2023-10-06T10:59:01.410969+0000","last_unstale":"2023-10-06T10:59:06.503478+0000","last_undegraded":"2023-10-06T10:59:06.503478+0000","last_fullsized":"2023-10-06T10:59:06.503478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:39.400891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486641+0000","last_change":"2023-10-06T10:59:02.419362+0000","last_active":"2023-10-06T10:59:06.486641+0000","last_peered":"2023-10-06T10:59:06.486641+0000","last_clean":"2023-10-06T10:59:06.486641+0000","last_became_active":"2023-10-06T10:59:02.419038+0000","last_became_peered":"2023-10-06T10:59:02.419038+0000","last_unstale":"2023-10-06T10:59:06.486641+0000","last_undegraded":"2023-10-06T10:59:06.486641+0000","last_fullsized":"2023-10-06T10:59:06.486641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:31.081513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516460+0000","last_change":"2023-10-06T10:59:06.515261+0000","last_active":"2023-10-06T10:59:06.516460+0000","last_peered":"2023-10-06T10:59:06.516460+0000","last_clean":"2023-10-06T10:59:06.516460+0000","last_became_active":"2023-10-06T10:59:06.514809+0000","last_became_peered":"2023-10-06T10:59:06.514809+0000","last_unstale":"2023-10-06T10:59:06.516460+0000","last_undegraded":"2023-10-06T10:59:06.516460+0000","last_fullsized":"2023-10-06T10:59:06.516460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:57.195363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503300+0000","last_change":"2023-10-06T10:59:01.411278+0000","last_active":"2023-10-06T10:59:06.503300+0000","last_peered":"2023-10-06T10:59:06.503300+0000","last_clean":"2023-10-06T10:59:06.503300+0000","last_became_active":"2023-10-06T10:59:01.410987+0000","last_became_peered":"2023-10-06T10:59:01.410987+0000","last_unstale":"2023-10-06T10:59:06.503300+0000","last_undegraded":"2023-10-06T10:59:06.503300+0000","last_fullsized":"2023-10-06T10:59:06.503300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:19.710733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485812+0000","last_change":"2023-10-06T10:59:02.435246+0000","last_active":"2023-10-06T10:59:06.485812+0000","last_peered":"2023-10-06T10:59:06.485812+0000","last_clean":"2023-10-06T10:59:06.485812+0000","last_became_active":"2023-10-06T10:59:02.434939+0000","last_became_peered":"2023-10-06T10:59:02.434939+0000","last_unstale":"2023-10-06T10:59:06.485812+0000","last_undegraded":"2023-10-06T10:59:06.485812+0000","last_fullsized":"2023-10-06T10:59:06.485812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:05:14.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513726+0000","last_change":"2023-10-06T10:59:06.511803+0000","last_active":"2023-10-06T10:59:06.513726+0000","last_peered":"2023-10-06T10:59:06.513726+0000","last_clean":"2023-10-06T10:59:06.513726+0000","last_became_active":"2023-10-06T10:59:06.511080+0000","last_became_peered":"2023-10-06T10:59:06.511080+0000","last_unstale":"2023-10-06T10:59:06.513726+0000","last_undegraded":"2023-10-06T10:59:06.513726+0000","last_fullsized":"2023-10-06T10:59:06.513726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:27.869916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492883+0000","last_change":"2023-10-06T10:59:01.414476+0000","last_active":"2023-10-06T10:59:06.492883+0000","last_peered":"2023-10-06T10:59:06.492883+0000","last_clean":"2023-10-06T10:59:06.492883+0000","last_became_active":"2023-10-06T10:59:01.414242+0000","last_became_peered":"2023-10-06T10:59:01.414242+0000","last_unstale":"2023-10-06T10:59:06.492883+0000","last_undegraded":"2023-10-06T10:59:06.492883+0000","last_fullsized":"2023-10-06T10:59:06.492883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501421+0000","last_change":"2023-10-06T10:59:02.436874+0000","last_active":"2023-10-06T10:59:06.501421+0000","last_peered":"2023-10-06T10:59:06.501421+0000","last_clean":"2023-10-06T10:59:06.501421+0000","last_became_active":"2023-10-06T10:59:02.435358+0000","last_became_peered":"2023-10-06T10:59:02.435358+0000","last_unstale":"2023-10-06T10:59:06.501421+0000","last_undegraded":"2023-10-06T10:59:06.501421+0000","last_fullsized":"2023-10-06T10:59:06.501421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:31.081513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514473+0000","last_change":"2023-10-06T10:59:06.513646+0000","last_active":"2023-10-06T10:59:06.514473+0000","last_peered":"2023-10-06T10:59:06.514473+0000","last_clean":"2023-10-06T10:59:06.514473+0000","last_became_active":"2023-10-06T10:59:06.511423+0000","last_became_peered":"2023-10-06T10:59:06.511423+0000","last_unstale":"2023-10-06T10:59:06.514473+0000","last_undegraded":"2023-10-06T10:59:06.514473+0000","last_fullsized":"2023-10-06T10:59:06.514473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:37.882998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493353+0000","last_change":"2023-10-06T10:59:01.411242+0000","last_active":"2023-10-06T10:59:06.493353+0000","last_peered":"2023-10-06T10:59:06.493353+0000","last_clean":"2023-10-06T10:59:06.493353+0000","last_became_active":"2023-10-06T10:59:01.410924+0000","last_became_peered":"2023-10-06T10:59:01.410924+0000","last_unstale":"2023-10-06T10:59:06.493353+0000","last_undegraded":"2023-10-06T10:59:06.493353+0000","last_fullsized":"2023-10-06T10:59:06.493353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:00.499256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486649+0000","last_change":"2023-10-06T10:59:02.435108+0000","last_active":"2023-10-06T10:59:06.486649+0000","last_peered":"2023-10-06T10:59:06.486649+0000","last_clean":"2023-10-06T10:59:06.486649+0000","last_became_active":"2023-10-06T10:59:02.434852+0000","last_became_peered":"2023-10-06T10:59:02.434852+0000","last_unstale":"2023-10-06T10:59:06.486649+0000","last_undegraded":"2023-10-06T10:59:06.486649+0000","last_fullsized":"2023-10-06T10:59:06.486649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:17.384456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.506844+0000","last_change":"2023-10-06T10:59:06.502413+0000","last_active":"2023-10-06T10:59:06.506844+0000","last_peered":"2023-10-06T10:59:06.506844+0000","last_clean":"2023-10-06T10:59:06.506844+0000","last_became_active":"2023-10-06T10:59:06.501975+0000","last_became_peered":"2023-10-06T10:59:06.501975+0000","last_unstale":"2023-10-06T10:59:06.506844+0000","last_undegraded":"2023-10-06T10:59:06.506844+0000","last_fullsized":"2023-10-06T10:59:06.506844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:43.846344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485900+0000","last_change":"2023-10-06T10:59:01.419087+0000","last_active":"2023-10-06T10:59:06.485900+0000","last_peered":"2023-10-06T10:59:06.485900+0000","last_clean":"2023-10-06T10:59:06.485900+0000","last_became_active":"2023-10-06T10:59:01.418650+0000","last_became_peered":"2023-10-06T10:59:01.418650+0000","last_unstale":"2023-10-06T10:59:06.485900+0000","last_undegraded":"2023-10-06T10:59:06.485900+0000","last_fullsized":"2023-10-06T10:59:06.485900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488263+0000","last_change":"2023-10-06T10:59:02.418122+0000","last_active":"2023-10-06T10:59:06.488263+0000","last_peered":"2023-10-06T10:59:06.488263+0000","last_clean":"2023-10-06T10:59:06.488263+0000","last_became_active":"2023-10-06T10:59:02.417375+0000","last_became_peered":"2023-10-06T10:59:02.417375+0000","last_unstale":"2023-10-06T10:59:06.488263+0000","last_undegraded":"2023-10-06T10:59:06.488263+0000","last_fullsized":"2023-10-06T10:59:06.488263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513139+0000","last_change":"2023-10-06T10:59:06.507077+0000","last_active":"2023-10-06T10:59:06.513139+0000","last_peered":"2023-10-06T10:59:06.513139+0000","last_clean":"2023-10-06T10:59:06.513139+0000","last_became_active":"2023-10-06T10:59:06.506613+0000","last_became_peered":"2023-10-06T10:59:06.506613+0000","last_unstale":"2023-10-06T10:59:06.513139+0000","last_undegraded":"2023-10-06T10:59:06.513139+0000","last_fullsized":"2023-10-06T10:59:06.513139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:18.864841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486454+0000","last_change":"2023-10-06T10:59:01.407028+0000","last_active":"2023-10-06T10:59:06.486454+0000","last_peered":"2023-10-06T10:59:06.486454+0000","last_clean":"2023-10-06T10:59:06.486454+0000","last_became_active":"2023-10-06T10:59:01.406571+0000","last_became_peered":"2023-10-06T10:59:01.406571+0000","last_unstale":"2023-10-06T10:59:06.486454+0000","last_undegraded":"2023-10-06T10:59:06.486454+0000","last_fullsized":"2023-10-06T10:59:06.486454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:08.334923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487914+0000","last_change":"2023-10-06T10:59:02.419692+0000","last_active":"2023-10-06T10:59:06.487914+0000","last_peered":"2023-10-06T10:59:06.487914+0000","last_clean":"2023-10-06T10:59:06.487914+0000","last_became_active":"2023-10-06T10:59:02.419394+0000","last_became_peered":"2023-10-06T10:59:02.419394+0000","last_unstale":"2023-10-06T10:59:06.487914+0000","last_undegraded":"2023-10-06T10:59:06.487914+0000","last_fullsized":"2023-10-06T10:59:06.487914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:23.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511521+0000","last_change":"2023-10-06T10:59:06.506565+0000","last_active":"2023-10-06T10:59:06.511521+0000","last_peered":"2023-10-06T10:59:06.511521+0000","last_clean":"2023-10-06T10:59:06.511521+0000","last_became_active":"2023-10-06T10:59:06.506131+0000","last_became_peered":"2023-10-06T10:59:06.506131+0000","last_unstale":"2023-10-06T10:59:06.511521+0000","last_undegraded":"2023-10-06T10:59:06.511521+0000","last_fullsized":"2023-10-06T10:59:06.511521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:15:42.861403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493594+0000","last_change":"2023-10-06T10:59:01.417797+0000","last_active":"2023-10-06T10:59:06.493594+0000","last_peered":"2023-10-06T10:59:06.493594+0000","last_clean":"2023-10-06T10:59:06.493594+0000","last_became_active":"2023-10-06T10:59:01.416920+0000","last_became_peered":"2023-10-06T10:59:01.416920+0000","last_unstale":"2023-10-06T10:59:06.493594+0000","last_undegraded":"2023-10-06T10:59:06.493594+0000","last_fullsized":"2023-10-06T10:59:06.493594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:40.010964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487484+0000","last_change":"2023-10-06T10:59:02.435810+0000","last_active":"2023-10-06T10:59:06.487484+0000","last_peered":"2023-10-06T10:59:06.487484+0000","last_clean":"2023-10-06T10:59:06.487484+0000","last_became_active":"2023-10-06T10:59:02.435540+0000","last_became_peered":"2023-10-06T10:59:02.435540+0000","last_unstale":"2023-10-06T10:59:06.487484+0000","last_undegraded":"2023-10-06T10:59:06.487484+0000","last_fullsized":"2023-10-06T10:59:06.487484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:23.772944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513384+0000","last_change":"2023-10-06T10:59:06.509833+0000","last_active":"2023-10-06T10:59:06.513384+0000","last_peered":"2023-10-06T10:59:06.513384+0000","last_clean":"2023-10-06T10:59:06.513384+0000","last_became_active":"2023-10-06T10:59:06.508637+0000","last_became_peered":"2023-10-06T10:59:06.508637+0000","last_unstale":"2023-10-06T10:59:06.513384+0000","last_undegraded":"2023-10-06T10:59:06.513384+0000","last_fullsized":"2023-10-06T10:59:06.513384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:46:49.548101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494181+0000","last_change":"2023-10-06T10:59:01.415343+0000","last_active":"2023-10-06T10:59:06.494181+0000","last_peered":"2023-10-06T10:59:06.494181+0000","last_clean":"2023-10-06T10:59:06.494181+0000","last_became_active":"2023-10-06T10:59:01.414933+0000","last_became_peered":"2023-10-06T10:59:01.414933+0000","last_unstale":"2023-10-06T10:59:06.494181+0000","last_undegraded":"2023-10-06T10:59:06.494181+0000","last_fullsized":"2023-10-06T10:59:06.494181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:23:07.954687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488471+0000","last_change":"2023-10-06T10:58:56.328381+0000","last_active":"2023-10-06T10:59:06.488471+0000","last_peered":"2023-10-06T10:59:06.488471+0000","last_clean":"2023-10-06T10:59:06.488471+0000","last_became_active":"2023-10-06T10:58:56.328054+0000","last_became_peered":"2023-10-06T10:58:56.328054+0000","last_unstale":"2023-10-06T10:59:06.488471+0000","last_undegraded":"2023-10-06T10:59:06.488471+0000","last_fullsized":"2023-10-06T10:59:06.488471+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493494+0000","last_change":"2023-10-06T10:59:02.429942+0000","last_active":"2023-10-06T10:59:06.493494+0000","last_peered":"2023-10-06T10:59:06.493494+0000","last_clean":"2023-10-06T10:59:06.493494+0000","last_became_active":"2023-10-06T10:59:02.429646+0000","last_became_peered":"2023-10-06T10:59:02.429646+0000","last_unstale":"2023-10-06T10:59:06.493494+0000","last_undegraded":"2023-10-06T10:59:06.493494+0000","last_fullsized":"2023-10-06T10:59:06.493494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.506117+0000","last_change":"2023-10-06T10:59:06.502679+0000","last_active":"2023-10-06T10:59:06.506117+0000","last_peered":"2023-10-06T10:59:06.506117+0000","last_clean":"2023-10-06T10:59:06.506117+0000","last_became_active":"2023-10-06T10:59:06.502273+0000","last_became_peered":"2023-10-06T10:59:06.502273+0000","last_unstale":"2023-10-06T10:59:06.506117+0000","last_undegraded":"2023-10-06T10:59:06.506117+0000","last_fullsized":"2023-10-06T10:59:06.506117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:14:44.651801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493821+0000","last_change":"2023-10-06T10:58:56.326189+0000","last_active":"2023-10-06T10:59:06.493821+0000","last_peered":"2023-10-06T10:59:06.493821+0000","last_clean":"2023-10-06T10:59:06.493821+0000","last_became_active":"2023-10-06T10:58:56.325852+0000","last_became_peered":"2023-10-06T10:58:56.325852+0000","last_unstale":"2023-10-06T10:59:06.493821+0000","last_undegraded":"2023-10-06T10:59:06.493821+0000","last_fullsized":"2023-10-06T10:59:06.493821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:28.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516357+0000","last_change":"2023-10-06T10:59:01.411178+0000","last_active":"2023-10-06T10:59:06.516357+0000","last_peered":"2023-10-06T10:59:06.516357+0000","last_clean":"2023-10-06T10:59:06.516357+0000","last_became_active":"2023-10-06T10:59:01.410703+0000","last_became_peered":"2023-10-06T10:59:01.410703+0000","last_unstale":"2023-10-06T10:59:06.516357+0000","last_undegraded":"2023-10-06T10:59:06.516357+0000","last_fullsized":"2023-10-06T10:59:06.516357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:50.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486551+0000","last_change":"2023-10-06T10:59:02.425180+0000","last_active":"2023-10-06T10:59:06.486551+0000","last_peered":"2023-10-06T10:59:06.486551+0000","last_clean":"2023-10-06T10:59:06.486551+0000","last_became_active":"2023-10-06T10:59:02.424767+0000","last_became_peered":"2023-10-06T10:59:02.424767+0000","last_unstale":"2023-10-06T10:59:06.486551+0000","last_undegraded":"2023-10-06T10:59:06.486551+0000","last_fullsized":"2023-10-06T10:59:06.486551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:33.795023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503741+0000","last_change":"2023-10-06T10:59:06.501263+0000","last_active":"2023-10-06T10:59:06.503741+0000","last_peered":"2023-10-06T10:59:06.503741+0000","last_clean":"2023-10-06T10:59:06.503741+0000","last_became_active":"2023-10-06T10:59:06.500784+0000","last_became_peered":"2023-10-06T10:59:06.500784+0000","last_unstale":"2023-10-06T10:59:06.503741+0000","last_undegraded":"2023-10-06T10:59:06.503741+0000","last_fullsized":"2023-10-06T10:59:06.503741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:49.205787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486205+0000","last_change":"2023-10-06T10:58:56.325363+0000","last_active":"2023-10-06T10:59:06.486205+0000","last_peered":"2023-10-06T10:59:06.486205+0000","last_clean":"2023-10-06T10:59:06.486205+0000","last_became_active":"2023-10-06T10:58:56.325095+0000","last_became_peered":"2023-10-06T10:58:56.325095+0000","last_unstale":"2023-10-06T10:59:06.486205+0000","last_undegraded":"2023-10-06T10:59:06.486205+0000","last_fullsized":"2023-10-06T10:59:06.486205+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501704+0000","last_change":"2023-10-06T10:58:57.328525+0000","last_active":"2023-10-06T10:59:06.501704+0000","last_peered":"2023-10-06T10:59:06.501704+0000","last_clean":"2023-10-06T10:59:06.501704+0000","last_became_active":"2023-10-06T10:58:57.327509+0000","last_became_peered":"2023-10-06T10:58:57.327509+0000","last_unstale":"2023-10-06T10:59:06.501704+0000","last_undegraded":"2023-10-06T10:59:06.501704+0000","last_fullsized":"2023-10-06T10:59:06.501704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_clean_scrub_stamp":"2023-10-06T10:58:56.314996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:45.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501654+0000","last_change":"2023-10-06T10:59:01.415927+0000","last_active":"2023-10-06T10:59:06.501654+0000","last_peered":"2023-10-06T10:59:06.501654+0000","last_clean":"2023-10-06T10:59:06.501654+0000","last_became_active":"2023-10-06T10:59:01.415660+0000","last_became_peered":"2023-10-06T10:59:01.415660+0000","last_unstale":"2023-10-06T10:59:06.501654+0000","last_undegraded":"2023-10-06T10:59:06.501654+0000","last_fullsized":"2023-10-06T10:59:06.501654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:07.977576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504353+0000","last_change":"2023-10-06T10:59:02.435783+0000","last_active":"2023-10-06T10:59:06.504353+0000","last_peered":"2023-10-06T10:59:06.504353+0000","last_clean":"2023-10-06T10:59:06.504353+0000","last_became_active":"2023-10-06T10:59:02.435445+0000","last_became_peered":"2023-10-06T10:59:02.435445+0000","last_unstale":"2023-10-06T10:59:06.504353+0000","last_undegraded":"2023-10-06T10:59:06.504353+0000","last_fullsized":"2023-10-06T10:59:06.504353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516018+0000","last_change":"2023-10-06T10:59:06.514112+0000","last_active":"2023-10-06T10:59:06.516018+0000","last_peered":"2023-10-06T10:59:06.516018+0000","last_clean":"2023-10-06T10:59:06.516018+0000","last_became_active":"2023-10-06T10:59:06.513425+0000","last_became_peered":"2023-10-06T10:59:06.513425+0000","last_unstale":"2023-10-06T10:59:06.516018+0000","last_undegraded":"2023-10-06T10:59:06.516018+0000","last_fullsized":"2023-10-06T10:59:06.516018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:35.463907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501411+0000","last_change":"2023-10-06T10:58:56.331567+0000","last_active":"2023-10-06T10:59:06.501411+0000","last_peered":"2023-10-06T10:59:06.501411+0000","last_clean":"2023-10-06T10:59:06.501411+0000","last_became_active":"2023-10-06T10:58:56.331244+0000","last_became_peered":"2023-10-06T10:58:56.331244+0000","last_unstale":"2023-10-06T10:59:06.501411+0000","last_undegraded":"2023-10-06T10:59:06.501411+0000","last_fullsized":"2023-10-06T10:59:06.501411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486388+0000","last_change":"2023-10-06T10:59:01.401314+0000","last_active":"2023-10-06T10:59:06.486388+0000","last_peered":"2023-10-06T10:59:06.486388+0000","last_clean":"2023-10-06T10:59:06.486388+0000","last_became_active":"2023-10-06T10:59:01.400645+0000","last_became_peered":"2023-10-06T10:59:01.400645+0000","last_unstale":"2023-10-06T10:59:06.486388+0000","last_undegraded":"2023-10-06T10:59:06.486388+0000","last_fullsized":"2023-10-06T10:59:06.486388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:02.802656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487378+0000","last_change":"2023-10-06T10:59:02.433907+0000","last_active":"2023-10-06T10:59:06.487378+0000","last_peered":"2023-10-06T10:59:06.487378+0000","last_clean":"2023-10-06T10:59:06.487378+0000","last_became_active":"2023-10-06T10:59:02.430274+0000","last_became_peered":"2023-10-06T10:59:02.430274+0000","last_unstale":"2023-10-06T10:59:06.487378+0000","last_undegraded":"2023-10-06T10:59:06.487378+0000","last_fullsized":"2023-10-06T10:59:06.487378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:17.286697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516658+0000","last_change":"2023-10-06T10:59:06.515095+0000","last_active":"2023-10-06T10:59:06.516658+0000","last_peered":"2023-10-06T10:59:06.516658+0000","last_clean":"2023-10-06T10:59:06.516658+0000","last_became_active":"2023-10-06T10:59:06.514669+0000","last_became_peered":"2023-10-06T10:59:06.514669+0000","last_unstale":"2023-10-06T10:59:06.516658+0000","last_undegraded":"2023-10-06T10:59:06.516658+0000","last_fullsized":"2023-10-06T10:59:06.516658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:49.205787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501486+0000","last_change":"2023-10-06T10:58:56.332184+0000","last_active":"2023-10-06T10:59:06.501486+0000","last_peered":"2023-10-06T10:59:06.501486+0000","last_clean":"2023-10-06T10:59:06.501486+0000","last_became_active":"2023-10-06T10:58:56.331830+0000","last_became_peered":"2023-10-06T10:58:56.331830+0000","last_unstale":"2023-10-06T10:59:06.501486+0000","last_undegraded":"2023-10-06T10:59:06.501486+0000","last_fullsized":"2023-10-06T10:59:06.501486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:54:02.320834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493508+0000","last_change":"2023-10-06T10:59:01.414711+0000","last_active":"2023-10-06T10:59:06.493508+0000","last_peered":"2023-10-06T10:59:06.493508+0000","last_clean":"2023-10-06T10:59:06.493508+0000","last_became_active":"2023-10-06T10:59:01.414409+0000","last_became_peered":"2023-10-06T10:59:01.414409+0000","last_unstale":"2023-10-06T10:59:06.493508+0000","last_undegraded":"2023-10-06T10:59:06.493508+0000","last_fullsized":"2023-10-06T10:59:06.493508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:44.340657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486245+0000","last_change":"2023-10-06T10:59:02.424669+0000","last_active":"2023-10-06T10:59:06.486245+0000","last_peered":"2023-10-06T10:59:06.486245+0000","last_clean":"2023-10-06T10:59:06.486245+0000","last_became_active":"2023-10-06T10:59:02.424353+0000","last_became_peered":"2023-10-06T10:59:02.424353+0000","last_unstale":"2023-10-06T10:59:06.486245+0000","last_undegraded":"2023-10-06T10:59:06.486245+0000","last_fullsized":"2023-10-06T10:59:06.486245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:17.558201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514130+0000","last_change":"2023-10-06T10:59:06.504921+0000","last_active":"2023-10-06T10:59:06.514130+0000","last_peered":"2023-10-06T10:59:06.514130+0000","last_clean":"2023-10-06T10:59:06.514130+0000","last_became_active":"2023-10-06T10:59:06.501375+0000","last_became_peered":"2023-10-06T10:59:06.501375+0000","last_unstale":"2023-10-06T10:59:06.514130+0000","last_undegraded":"2023-10-06T10:59:06.514130+0000","last_fullsized":"2023-10-06T10:59:06.514130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:29.878658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493427+0000","last_change":"2023-10-06T10:58:56.331654+0000","last_active":"2023-10-06T10:59:06.493427+0000","last_peered":"2023-10-06T10:59:06.493427+0000","last_clean":"2023-10-06T10:59:06.493427+0000","last_became_active":"2023-10-06T10:58:56.331345+0000","last_became_peered":"2023-10-06T10:58:56.331345+0000","last_unstale":"2023-10-06T10:59:06.493427+0000","last_undegraded":"2023-10-06T10:59:06.493427+0000","last_fullsized":"2023-10-06T10:59:06.493427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488547+0000","last_change":"2023-10-06T10:59:01.416484+0000","last_active":"2023-10-06T10:59:06.488547+0000","last_peered":"2023-10-06T10:59:06.488547+0000","last_clean":"2023-10-06T10:59:06.488547+0000","last_became_active":"2023-10-06T10:59:01.416159+0000","last_became_peered":"2023-10-06T10:59:01.416159+0000","last_unstale":"2023-10-06T10:59:06.488547+0000","last_undegraded":"2023-10-06T10:59:06.488547+0000","last_fullsized":"2023-10-06T10:59:06.488547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:19.192242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486436+0000","last_change":"2023-10-06T10:59:02.419009+0000","last_active":"2023-10-06T10:59:06.486436+0000","last_peered":"2023-10-06T10:59:06.486436+0000","last_clean":"2023-10-06T10:59:06.486436+0000","last_became_active":"2023-10-06T10:59:02.418715+0000","last_became_peered":"2023-10-06T10:59:02.418715+0000","last_unstale":"2023-10-06T10:59:06.486436+0000","last_undegraded":"2023-10-06T10:59:06.486436+0000","last_fullsized":"2023-10-06T10:59:06.486436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:20.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514101+0000","last_change":"2023-10-06T10:59:06.504749+0000","last_active":"2023-10-06T10:59:06.514101+0000","last_peered":"2023-10-06T10:59:06.514101+0000","last_clean":"2023-10-06T10:59:06.514101+0000","last_became_active":"2023-10-06T10:59:06.504360+0000","last_became_peered":"2023-10-06T10:59:06.504360+0000","last_unstale":"2023-10-06T10:59:06.514101+0000","last_undegraded":"2023-10-06T10:59:06.514101+0000","last_fullsized":"2023-10-06T10:59:06.514101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:37.882998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486520+0000","last_change":"2023-10-06T10:58:56.331650+0000","last_active":"2023-10-06T10:59:06.486520+0000","last_peered":"2023-10-06T10:59:06.486520+0000","last_clean":"2023-10-06T10:59:06.486520+0000","last_became_active":"2023-10-06T10:58:56.331344+0000","last_became_peered":"2023-10-06T10:58:56.331344+0000","last_unstale":"2023-10-06T10:59:06.486520+0000","last_undegraded":"2023-10-06T10:59:06.486520+0000","last_fullsized":"2023-10-06T10:59:06.486520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:45.584545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486640+0000","last_change":"2023-10-06T10:59:01.405750+0000","last_active":"2023-10-06T10:59:06.486640+0000","last_peered":"2023-10-06T10:59:06.486640+0000","last_clean":"2023-10-06T10:59:06.486640+0000","last_became_active":"2023-10-06T10:59:01.403128+0000","last_became_peered":"2023-10-06T10:59:01.403128+0000","last_unstale":"2023-10-06T10:59:06.486640+0000","last_undegraded":"2023-10-06T10:59:06.486640+0000","last_fullsized":"2023-10-06T10:59:06.486640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501123+0000","last_change":"2023-10-06T10:59:02.427758+0000","last_active":"2023-10-06T10:59:06.501123+0000","last_peered":"2023-10-06T10:59:06.501123+0000","last_clean":"2023-10-06T10:59:06.501123+0000","last_became_active":"2023-10-06T10:59:02.427472+0000","last_became_peered":"2023-10-06T10:59:02.427472+0000","last_unstale":"2023-10-06T10:59:06.501123+0000","last_undegraded":"2023-10-06T10:59:06.501123+0000","last_fullsized":"2023-10-06T10:59:06.501123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:23.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513991+0000","last_change":"2023-10-06T10:59:06.505716+0000","last_active":"2023-10-06T10:59:06.513991+0000","last_peered":"2023-10-06T10:59:06.513991+0000","last_clean":"2023-10-06T10:59:06.513991+0000","last_became_active":"2023-10-06T10:59:06.505243+0000","last_became_peered":"2023-10-06T10:59:06.505243+0000","last_unstale":"2023-10-06T10:59:06.513991+0000","last_undegraded":"2023-10-06T10:59:06.513991+0000","last_fullsized":"2023-10-06T10:59:06.513991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:56.480286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487451+0000","last_change":"2023-10-06T10:58:56.326315+0000","last_active":"2023-10-06T10:59:06.487451+0000","last_peered":"2023-10-06T10:59:06.487451+0000","last_clean":"2023-10-06T10:59:06.487451+0000","last_became_active":"2023-10-06T10:58:56.325897+0000","last_became_peered":"2023-10-06T10:58:56.325897+0000","last_unstale":"2023-10-06T10:59:06.487451+0000","last_undegraded":"2023-10-06T10:59:06.487451+0000","last_fullsized":"2023-10-06T10:59:06.487451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493235+0000","last_change":"2023-10-06T10:59:01.416023+0000","last_active":"2023-10-06T10:59:06.493235+0000","last_peered":"2023-10-06T10:59:06.493235+0000","last_clean":"2023-10-06T10:59:06.493235+0000","last_became_active":"2023-10-06T10:59:01.415727+0000","last_became_peered":"2023-10-06T10:59:01.415727+0000","last_unstale":"2023-10-06T10:59:06.493235+0000","last_undegraded":"2023-10-06T10:59:06.493235+0000","last_fullsized":"2023-10-06T10:59:06.493235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:40.010964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485839+0000","last_change":"2023-10-06T10:59:02.427425+0000","last_active":"2023-10-06T10:59:06.485839+0000","last_peered":"2023-10-06T10:59:06.485839+0000","last_clean":"2023-10-06T10:59:06.485839+0000","last_became_active":"2023-10-06T10:59:02.427000+0000","last_became_peered":"2023-10-06T10:59:02.427000+0000","last_unstale":"2023-10-06T10:59:06.485839+0000","last_undegraded":"2023-10-06T10:59:06.485839+0000","last_fullsized":"2023-10-06T10:59:06.485839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.512322+0000","last_change":"2023-10-06T10:59:06.505584+0000","last_active":"2023-10-06T10:59:06.512322+0000","last_peered":"2023-10-06T10:59:06.512322+0000","last_clean":"2023-10-06T10:59:06.512322+0000","last_became_active":"2023-10-06T10:59:06.505152+0000","last_became_peered":"2023-10-06T10:59:06.505152+0000","last_unstale":"2023-10-06T10:59:06.512322+0000","last_undegraded":"2023-10-06T10:59:06.512322+0000","last_fullsized":"2023-10-06T10:59:06.512322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:50.861372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501237+0000","last_change":"2023-10-06T10:59:01.420277+0000","last_active":"2023-10-06T10:59:06.501237+0000","last_peered":"2023-10-06T10:59:06.501237+0000","last_clean":"2023-10-06T10:59:06.501237+0000","last_became_active":"2023-10-06T10:59:01.419959+0000","last_became_peered":"2023-10-06T10:59:01.419959+0000","last_unstale":"2023-10-06T10:59:06.501237+0000","last_undegraded":"2023-10-06T10:59:06.501237+0000","last_fullsized":"2023-10-06T10:59:06.501237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:19.192242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.498094+0000","last_change":"2023-10-06T10:59:02.420998+0000","last_active":"2023-10-06T10:59:06.498094+0000","last_peered":"2023-10-06T10:59:06.498094+0000","last_clean":"2023-10-06T10:59:06.498094+0000","last_became_active":"2023-10-06T10:59:02.420652+0000","last_became_peered":"2023-10-06T10:59:02.420652+0000","last_unstale":"2023-10-06T10:59:06.498094+0000","last_undegraded":"2023-10-06T10:59:06.498094+0000","last_fullsized":"2023-10-06T10:59:06.498094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:20.197027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516738+0000","last_change":"2023-10-06T10:59:06.513383+0000","last_active":"2023-10-06T10:59:06.516738+0000","last_peered":"2023-10-06T10:59:06.516738+0000","last_clean":"2023-10-06T10:59:06.516738+0000","last_became_active":"2023-10-06T10:59:06.512919+0000","last_became_peered":"2023-10-06T10:59:06.512919+0000","last_unstale":"2023-10-06T10:59:06.516738+0000","last_undegraded":"2023-10-06T10:59:06.516738+0000","last_fullsized":"2023-10-06T10:59:06.516738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:56.480286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492779+0000","last_change":"2023-10-06T10:59:01.417023+0000","last_active":"2023-10-06T10:59:06.492779+0000","last_peered":"2023-10-06T10:59:06.492779+0000","last_clean":"2023-10-06T10:59:06.492779+0000","last_became_active":"2023-10-06T10:59:01.416742+0000","last_became_peered":"2023-10-06T10:59:01.416742+0000","last_unstale":"2023-10-06T10:59:06.492779+0000","last_undegraded":"2023-10-06T10:59:06.492779+0000","last_fullsized":"2023-10-06T10:59:06.492779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:50.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488089+0000","last_change":"2023-10-06T10:59:02.435269+0000","last_active":"2023-10-06T10:59:06.488089+0000","last_peered":"2023-10-06T10:59:06.488089+0000","last_clean":"2023-10-06T10:59:06.488089+0000","last_became_active":"2023-10-06T10:59:02.434615+0000","last_became_peered":"2023-10-06T10:59:02.434615+0000","last_unstale":"2023-10-06T10:59:06.488089+0000","last_undegraded":"2023-10-06T10:59:06.488089+0000","last_fullsized":"2023-10-06T10:59:06.488089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:48.645632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.512751+0000","last_change":"2023-10-06T10:59:06.511957+0000","last_active":"2023-10-06T10:59:06.512751+0000","last_peered":"2023-10-06T10:59:06.512751+0000","last_clean":"2023-10-06T10:59:06.512751+0000","last_became_active":"2023-10-06T10:59:06.511470+0000","last_became_peered":"2023-10-06T10:59:06.511470+0000","last_unstale":"2023-10-06T10:59:06.512751+0000","last_undegraded":"2023-10-06T10:59:06.512751+0000","last_fullsized":"2023-10-06T10:59:06.512751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:56.480286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493131+0000","last_change":"2023-10-06T10:59:01.418640+0000","last_active":"2023-10-06T10:59:06.493131+0000","last_peered":"2023-10-06T10:59:06.493131+0000","last_clean":"2023-10-06T10:59:06.493131+0000","last_became_active":"2023-10-06T10:59:01.418365+0000","last_became_peered":"2023-10-06T10:59:01.418365+0000","last_unstale":"2023-10-06T10:59:06.493131+0000","last_undegraded":"2023-10-06T10:59:06.493131+0000","last_fullsized":"2023-10-06T10:59:06.493131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:08.334923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486781+0000","last_change":"2023-10-06T10:59:02.431977+0000","last_active":"2023-10-06T10:59:06.486781+0000","last_peered":"2023-10-06T10:59:06.486781+0000","last_clean":"2023-10-06T10:59:06.486781+0000","last_became_active":"2023-10-06T10:59:02.431706+0000","last_became_peered":"2023-10-06T10:59:02.431706+0000","last_unstale":"2023-10-06T10:59:06.486781+0000","last_undegraded":"2023-10-06T10:59:06.486781+0000","last_fullsized":"2023-10-06T10:59:06.486781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:56.596950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511641+0000","last_change":"2023-10-06T10:59:06.507385+0000","last_active":"2023-10-06T10:59:06.511641+0000","last_peered":"2023-10-06T10:59:06.511641+0000","last_clean":"2023-10-06T10:59:06.511641+0000","last_became_active":"2023-10-06T10:59:06.506688+0000","last_became_peered":"2023-10-06T10:59:06.506688+0000","last_unstale":"2023-10-06T10:59:06.511641+0000","last_undegraded":"2023-10-06T10:59:06.511641+0000","last_fullsized":"2023-10-06T10:59:06.511641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:27.154530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493578+0000","last_change":"2023-10-06T10:59:01.416098+0000","last_active":"2023-10-06T10:59:06.493578+0000","last_peered":"2023-10-06T10:59:06.493578+0000","last_clean":"2023-10-06T10:59:06.493578+0000","last_became_active":"2023-10-06T10:59:01.415763+0000","last_became_peered":"2023-10-06T10:59:01.415763+0000","last_unstale":"2023-10-06T10:59:06.493578+0000","last_undegraded":"2023-10-06T10:59:06.493578+0000","last_fullsized":"2023-10-06T10:59:06.493578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:03.581242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492967+0000","last_change":"2023-10-06T10:59:02.440465+0000","last_active":"2023-10-06T10:59:06.492967+0000","last_peered":"2023-10-06T10:59:06.492967+0000","last_clean":"2023-10-06T10:59:06.492967+0000","last_became_active":"2023-10-06T10:59:02.439835+0000","last_became_peered":"2023-10-06T10:59:02.439835+0000","last_unstale":"2023-10-06T10:59:06.492967+0000","last_undegraded":"2023-10-06T10:59:06.492967+0000","last_fullsized":"2023-10-06T10:59:06.492967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:23.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.509823+0000","last_change":"2023-10-06T10:59:06.504483+0000","last_active":"2023-10-06T10:59:06.509823+0000","last_peered":"2023-10-06T10:59:06.509823+0000","last_clean":"2023-10-06T10:59:06.509823+0000","last_became_active":"2023-10-06T10:59:06.504086+0000","last_became_peered":"2023-10-06T10:59:06.504086+0000","last_unstale":"2023-10-06T10:59:06.509823+0000","last_undegraded":"2023-10-06T10:59:06.509823+0000","last_fullsized":"2023-10-06T10:59:06.509823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:59.889292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504114+0000","last_change":"2023-10-06T10:59:01.413820+0000","last_active":"2023-10-06T10:59:06.504114+0000","last_peered":"2023-10-06T10:59:06.504114+0000","last_clean":"2023-10-06T10:59:06.504114+0000","last_became_active":"2023-10-06T10:59:01.413502+0000","last_became_peered":"2023-10-06T10:59:01.413502+0000","last_unstale":"2023-10-06T10:59:06.504114+0000","last_undegraded":"2023-10-06T10:59:06.504114+0000","last_fullsized":"2023-10-06T10:59:06.504114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:23:07.954687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.489549+0000","last_change":"2023-10-06T10:59:02.419538+0000","last_active":"2023-10-06T10:59:06.489549+0000","last_peered":"2023-10-06T10:59:06.489549+0000","last_clean":"2023-10-06T10:59:06.489549+0000","last_became_active":"2023-10-06T10:59:02.419185+0000","last_became_peered":"2023-10-06T10:59:02.419185+0000","last_unstale":"2023-10-06T10:59:06.489549+0000","last_undegraded":"2023-10-06T10:59:06.489549+0000","last_fullsized":"2023-10-06T10:59:06.489549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:38.092745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485604+0000","last_change":"2023-10-06T10:59:02.428782+0000","last_active":"2023-10-06T10:59:06.485604+0000","last_peered":"2023-10-06T10:59:06.485604+0000","last_clean":"2023-10-06T10:59:06.485604+0000","last_became_active":"2023-10-06T10:59:02.428518+0000","last_became_peered":"2023-10-06T10:59:02.428518+0000","last_unstale":"2023-10-06T10:59:06.485604+0000","last_undegraded":"2023-10-06T10:59:06.485604+0000","last_fullsized":"2023-10-06T10:59:06.485604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:20.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493061+0000","last_change":"2023-10-06T10:59:02.444220+0000","last_active":"2023-10-06T10:59:06.493061+0000","last_peered":"2023-10-06T10:59:06.493061+0000","last_clean":"2023-10-06T10:59:06.493061+0000","last_became_active":"2023-10-06T10:59:02.443920+0000","last_became_peered":"2023-10-06T10:59:02.443920+0000","last_unstale":"2023-10-06T10:59:06.493061+0000","last_undegraded":"2023-10-06T10:59:06.493061+0000","last_fullsized":"2023-10-06T10:59:06.493061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:17.096084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486954+0000","last_change":"2023-10-06T10:59:02.420323+0000","last_active":"2023-10-06T10:59:06.486954+0000","last_peered":"2023-10-06T10:59:06.486954+0000","last_clean":"2023-10-06T10:59:06.486954+0000","last_became_active":"2023-10-06T10:59:02.419903+0000","last_became_peered":"2023-10-06T10:59:02.419903+0000","last_unstale":"2023-10-06T10:59:06.486954+0000","last_undegraded":"2023-10-06T10:59:06.486954+0000","last_fullsized":"2023-10-06T10:59:06.486954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:52.603660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493896+0000","last_change":"2023-10-06T10:59:02.435228+0000","last_active":"2023-10-06T10:59:06.493896+0000","last_peered":"2023-10-06T10:59:06.493896+0000","last_clean":"2023-10-06T10:59:06.493896+0000","last_became_active":"2023-10-06T10:59:02.434847+0000","last_became_peered":"2023-10-06T10:59:02.434847+0000","last_unstale":"2023-10-06T10:59:06.493896+0000","last_undegraded":"2023-10-06T10:59:06.493896+0000","last_fullsized":"2023-10-06T10:59:06.493896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:53.107388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486540+0000","last_change":"2023-10-06T10:59:02.431384+0000","last_active":"2023-10-06T10:59:06.486540+0000","last_peered":"2023-10-06T10:59:06.486540+0000","last_clean":"2023-10-06T10:59:06.486540+0000","last_became_active":"2023-10-06T10:59:02.431073+0000","last_became_peered":"2023-10-06T10:59:02.431073+0000","last_unstale":"2023-10-06T10:59:06.486540+0000","last_undegraded":"2023-10-06T10:59:06.486540+0000","last_fullsized":"2023-10-06T10:59:06.486540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:05:14.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298128,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073712,"statfs":{"total":96636764160,"available":96331481088,"internally_reserved":0,"allocated":860160,"data_stored":699826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":108570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T10:59:22.714 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T10:59:22.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.879+0000 7faad90ef700 1 Processor -- start 2023-10-06T10:59:22.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.879+0000 7faad90ef700 1 -- start start 2023-10-06T10:59:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad90ef700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faad41590d0 0x7faad4069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad90ef700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faad406a0f0 0x7faad415ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad90ef700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad40694d0 con 0x7faad415d350 2023-10-06T10:59:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad90ef700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad415d770 con 0x7faad406a0f0 2023-10-06T10:59:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad90ef700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad4068ba0 con 0x7faad41590d0 2023-10-06T10:59:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faad406a0f0 0x7faad415ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faad406a0f0 0x7faad415ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43232/0 (socket says 172.21.15.7:43232) 2023-10-06T10:59:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad259c700 1 -- 172.21.15.7:0/1331590729 learned_addr learned my addr 172.21.15.7:0/1331590729 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad2d9d700 1 --2- 172.21.15.7:0/1331590729 >> v2:172.21.15.50:3300/0 conn(0x7faad41590d0 0x7faad4069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad259c700 1 -- 172.21.15.7:0/1331590729 >> v2:172.21.15.50:3300/0 conn(0x7faad41590d0 msgr2=0x7faad4069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad1d9b700 1 -- 172.21.15.7:0/1331590729 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992278310 0 0) 0x7faad40694d0 con 0x7faad415d350 2023-10-06T10:59:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad259c700 1 --2- 172.21.15.7:0/1331590729 >> v2:172.21.15.50:3300/0 conn(0x7faad41590d0 0x7faad4069bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad259c700 1 -- 172.21.15.7:0/1331590729 >> v1:172.21.15.50:6789/0 conn(0x7faad415d350 legacy=0x7faad4067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad259c700 1 -- 172.21.15.7:0/1331590729 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad4068e80 con 0x7faad406a0f0 2023-10-06T10:59:22.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.880+0000 7faad259c700 1 --2- 172.21.15.7:0/1331590729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad406a0f0 0x7faad415ce10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faad406ec40 tx=0x7faac8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d332c16805a78930 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:22.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.881+0000 7faad1d9b700 1 -- 172.21.15.7:0/1331590729 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8009e70 con 0x7faad406a0f0 2023-10-06T10:59:22.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.881+0000 7faad1d9b700 1 -- 172.21.15.7:0/1331590729 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac800b860 con 0x7faad406a0f0 2023-10-06T10:59:22.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.881+0000 7faad1d9b700 1 -- 172.21.15.7:0/1331590729 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac800bc00 con 0x7faad406a0f0 2023-10-06T10:59:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.881+0000 7faad90ef700 1 -- 172.21.15.7:0/1331590729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad406a0f0 msgr2=0x7faad415ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.881+0000 7faad90ef700 1 --2- 172.21.15.7:0/1331590729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad406a0f0 0x7faad415ce10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faad406ec40 tx=0x7faac8009250 comp rx=0 tx=0).stop 2023-10-06T10:59:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.881+0000 7faad90ef700 1 -- 172.21.15.7:0/1331590729 shutdown_connections 2023-10-06T10:59:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.881+0000 7faad90ef700 1 --2- 172.21.15.7:0/1331590729 >> v2:172.21.15.50:3300/0 conn(0x7faad41590d0 0x7faad4069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.881+0000 7faad90ef700 1 --2- 172.21.15.7:0/1331590729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad406a0f0 0x7faad415ce10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.881+0000 7faad90ef700 1 -- 172.21.15.7:0/1331590729 >> 172.21.15.7:0/1331590729 conn(0x7faad4096160 msgr2=0x7faad40afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.881+0000 7faad90ef700 1 -- 172.21.15.7:0/1331590729 shutdown_connections 2023-10-06T10:59:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.881+0000 7faad90ef700 1 -- 172.21.15.7:0/1331590729 wait complete. 2023-10-06T10:59:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.883+0000 7faad90ef700 1 Processor -- start 2023-10-06T10:59:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.883+0000 7faad90ef700 1 -- start start 2023-10-06T10:59:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.883+0000 7faad90ef700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad406a0f0 0x7faad4153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.883+0000 7faad90ef700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad41590d0 0x7faad4098680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.883+0000 7faad90ef700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad415d350 0x7faad4098bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.883+0000 7faad90ef700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad409a030 con 0x7faad41590d0 2023-10-06T10:59:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.883+0000 7faad90ef700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad4099420 con 0x7faad406a0f0 2023-10-06T10:59:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.883+0000 7faad90ef700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad4099700 con 0x7faad415d350 2023-10-06T10:59:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faad259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad41590d0 0x7faad4098680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faad259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad41590d0 0x7faad4098680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43236/0 (socket says 172.21.15.7:43236) 2023-10-06T10:59:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faad259c700 1 -- 172.21.15.7:0/3423615422 learned_addr learned my addr 172.21.15.7:0/3423615422 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faad2d9d700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad406a0f0 0x7faad4153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faad359e700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad415d350 0x7faad4098bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faad259c700 1 -- 172.21.15.7:0/3423615422 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad415d350 msgr2=0x7faad4098bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faad259c700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad415d350 0x7faad4098bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faad259c700 1 -- 172.21.15.7:0/3423615422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad406a0f0 msgr2=0x7faad4153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faad259c700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad406a0f0 0x7faad4153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faad259c700 1 -- 172.21.15.7:0/3423615422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac80094f0 con 0x7faad41590d0 2023-10-06T10:59:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faad359e700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad415d350 0x7faad4098bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faad259c700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad41590d0 0x7faad4098680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faac80094c0 tx=0x7faac8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faabaffd700 1 -- 172.21.15.7:0/3423615422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac800b9d0 con 0x7faad41590d0 2023-10-06T10:59:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faabaffd700 1 -- 172.21.15.7:0/3423615422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac800bb50 con 0x7faad41590d0 2023-10-06T10:59:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faad90ef700 1 -- 172.21.15.7:0/3423615422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad40999e0 con 0x7faad41590d0 2023-10-06T10:59:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faabaffd700 1 -- 172.21.15.7:0/3423615422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8025670 con 0x7faad41590d0 2023-10-06T10:59:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.884+0000 7faad90ef700 1 -- 172.21.15.7:0/3423615422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad4099100 con 0x7faad41590d0 2023-10-06T10:59:22.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.885+0000 7faad90ef700 1 -- 172.21.15.7:0/3423615422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad4070480 con 0x7faad41590d0 2023-10-06T10:59:22.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.886+0000 7faabaffd700 1 -- 172.21.15.7:0/3423615422 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faac8023070 con 0x7faad41590d0 2023-10-06T10:59:22.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.886+0000 7faabaffd700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:22.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.886+0000 7faabaffd700 1 -- 172.21.15.7:0/3423615422 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7faac8085fe0 con 0x7faad41590d0 2023-10-06T10:59:22.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.886+0000 7faad2d9d700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:22.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.887+0000 7faad2d9d700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faac0066f30 0x7faac00693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faac4009db0 tx=0x7faac40091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:22.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:22.891+0000 7faabaffd700 1 -- 172.21.15.7:0/3423615422 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faac8052d60 con 0x7faad41590d0 2023-10-06T10:59:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.085+0000 7faad90ef700 1 -- 172.21.15.7:0/3423615422 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faad4069160 con 0x7faac0066f30 2023-10-06T10:59:23.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.096+0000 7faabaffd700 1 -- 172.21.15.7:0/3423615422 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367578 (secure 0 0 0) 0x7faad4069160 con 0x7faac0066f30 2023-10-06T10:59:23.101 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.100+0000 7faad90ef700 1 -- 172.21.15.7:0/3423615422 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faac0066f30 msgr2=0x7faac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.100+0000 7faad90ef700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faac0066f30 0x7faac00693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faac4009db0 tx=0x7faac40091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.100+0000 7faad90ef700 1 -- 172.21.15.7:0/3423615422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad41590d0 msgr2=0x7faad4098680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.100+0000 7faad90ef700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad41590d0 0x7faad4098680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faac80094c0 tx=0x7faac8017000 comp rx=0 tx=0).stop 2023-10-06T10:59:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.100+0000 7faad90ef700 1 -- 172.21.15.7:0/3423615422 shutdown_connections 2023-10-06T10:59:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.100+0000 7faad90ef700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.100+0000 7faad90ef700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad415d350 0x7faad4098bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.100+0000 7faad90ef700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad406a0f0 0x7faad4153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.100+0000 7faad90ef700 1 --2- 172.21.15.7:0/3423615422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad41590d0 0x7faad4098680 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.100+0000 7faad90ef700 1 -- 172.21.15.7:0/3423615422 >> 172.21.15.7:0/3423615422 conn(0x7faad4096160 msgr2=0x7faad40afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.100+0000 7faad90ef700 1 -- 172.21.15.7:0/3423615422 shutdown_connections 2023-10-06T10:59:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.100+0000 7faad90ef700 1 -- 172.21.15.7:0/3423615422 wait complete. 2023-10-06T10:59:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-06T10:59:23.114 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-10-06T10:59:21.976774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594853,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381592,"kb_used_data":3288,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593128,"statfs":{"total":773094113280,"available":770655363072,"internally_reserved":0,"allocated":3366912,"data_stored":2061458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003211"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492562+0000","last_change":"2023-10-06T10:59:02.436169+0000","last_active":"2023-10-06T10:59:06.492562+0000","last_peered":"2023-10-06T10:59:06.492562+0000","last_clean":"2023-10-06T10:59:06.492562+0000","last_became_active":"2023-10-06T10:59:02.435876+0000","last_became_peered":"2023-10-06T10:59:02.435876+0000","last_unstale":"2023-10-06T10:59:06.492562+0000","last_undegraded":"2023-10-06T10:59:06.492562+0000","last_fullsized":"2023-10-06T10:59:06.492562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:41.015749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493906+0000","last_change":"2023-10-06T10:59:02.436149+0000","last_active":"2023-10-06T10:59:06.493906+0000","last_peered":"2023-10-06T10:59:06.493906+0000","last_clean":"2023-10-06T10:59:06.493906+0000","last_became_active":"2023-10-06T10:59:02.435828+0000","last_became_peered":"2023-10-06T10:59:02.435828+0000","last_unstale":"2023-10-06T10:59:06.493906+0000","last_undegraded":"2023-10-06T10:59:06.493906+0000","last_fullsized":"2023-10-06T10:59:06.493906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:28:49.922872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488695+0000","last_change":"2023-10-06T10:59:02.431176+0000","last_active":"2023-10-06T10:59:06.488695+0000","last_peered":"2023-10-06T10:59:06.488695+0000","last_clean":"2023-10-06T10:59:06.488695+0000","last_became_active":"2023-10-06T10:59:02.430717+0000","last_became_peered":"2023-10-06T10:59:02.430717+0000","last_unstale":"2023-10-06T10:59:06.488695+0000","last_undegraded":"2023-10-06T10:59:06.488695+0000","last_fullsized":"2023-10-06T10:59:06.488695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:50:46.657726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486050+0000","last_change":"2023-10-06T10:59:02.431021+0000","last_active":"2023-10-06T10:59:06.486050+0000","last_peered":"2023-10-06T10:59:06.486050+0000","last_clean":"2023-10-06T10:59:06.486050+0000","last_became_active":"2023-10-06T10:59:02.430698+0000","last_became_peered":"2023-10-06T10:59:02.430698+0000","last_unstale":"2023-10-06T10:59:06.486050+0000","last_undegraded":"2023-10-06T10:59:06.486050+0000","last_fullsized":"2023-10-06T10:59:06.486050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:40.405676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501016+0000","last_change":"2023-10-06T10:59:02.437710+0000","last_active":"2023-10-06T10:59:06.501016+0000","last_peered":"2023-10-06T10:59:06.501016+0000","last_clean":"2023-10-06T10:59:06.501016+0000","last_became_active":"2023-10-06T10:59:02.437363+0000","last_became_peered":"2023-10-06T10:59:02.437363+0000","last_unstale":"2023-10-06T10:59:06.501016+0000","last_undegraded":"2023-10-06T10:59:06.501016+0000","last_fullsized":"2023-10-06T10:59:06.501016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:17.096084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487005+0000","last_change":"2023-10-06T10:59:02.431827+0000","last_active":"2023-10-06T10:59:06.487005+0000","last_peered":"2023-10-06T10:59:06.487005+0000","last_clean":"2023-10-06T10:59:06.487005+0000","last_became_active":"2023-10-06T10:59:02.431489+0000","last_became_peered":"2023-10-06T10:59:02.431489+0000","last_unstale":"2023-10-06T10:59:06.487005+0000","last_undegraded":"2023-10-06T10:59:06.487005+0000","last_fullsized":"2023-10-06T10:59:06.487005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:08:38.269689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.502047+0000","last_change":"2023-10-06T10:59:02.444025+0000","last_active":"2023-10-06T10:59:06.502047+0000","last_peered":"2023-10-06T10:59:06.502047+0000","last_clean":"2023-10-06T10:59:06.502047+0000","last_became_active":"2023-10-06T10:59:02.443754+0000","last_became_peered":"2023-10-06T10:59:02.443754+0000","last_unstale":"2023-10-06T10:59:06.502047+0000","last_undegraded":"2023-10-06T10:59:06.502047+0000","last_fullsized":"2023-10-06T10:59:06.502047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492806+0000","last_change":"2023-10-06T10:59:02.421077+0000","last_active":"2023-10-06T10:59:06.492806+0000","last_peered":"2023-10-06T10:59:06.492806+0000","last_clean":"2023-10-06T10:59:06.492806+0000","last_became_active":"2023-10-06T10:59:02.420781+0000","last_became_peered":"2023-10-06T10:59:02.420781+0000","last_unstale":"2023-10-06T10:59:06.492806+0000","last_undegraded":"2023-10-06T10:59:06.492806+0000","last_fullsized":"2023-10-06T10:59:06.492806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:20.715518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503818+0000","last_change":"2023-10-06T10:59:02.438976+0000","last_active":"2023-10-06T10:59:06.503818+0000","last_peered":"2023-10-06T10:59:06.503818+0000","last_clean":"2023-10-06T10:59:06.503818+0000","last_became_active":"2023-10-06T10:59:02.437626+0000","last_became_peered":"2023-10-06T10:59:02.437626+0000","last_unstale":"2023-10-06T10:59:06.503818+0000","last_undegraded":"2023-10-06T10:59:06.503818+0000","last_fullsized":"2023-10-06T10:59:06.503818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:38.092745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494111+0000","last_change":"2023-10-06T10:59:02.430066+0000","last_active":"2023-10-06T10:59:06.494111+0000","last_peered":"2023-10-06T10:59:06.494111+0000","last_clean":"2023-10-06T10:59:06.494111+0000","last_became_active":"2023-10-06T10:59:02.429786+0000","last_became_peered":"2023-10-06T10:59:02.429786+0000","last_unstale":"2023-10-06T10:59:06.494111+0000","last_undegraded":"2023-10-06T10:59:06.494111+0000","last_fullsized":"2023-10-06T10:59:06.494111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488572+0000","last_change":"2023-10-06T10:59:02.429174+0000","last_active":"2023-10-06T10:59:06.488572+0000","last_peered":"2023-10-06T10:59:06.488572+0000","last_clean":"2023-10-06T10:59:06.488572+0000","last_became_active":"2023-10-06T10:59:02.428460+0000","last_became_peered":"2023-10-06T10:59:02.428460+0000","last_unstale":"2023-10-06T10:59:06.488572+0000","last_undegraded":"2023-10-06T10:59:06.488572+0000","last_fullsized":"2023-10-06T10:59:06.488572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.497917+0000","last_change":"2023-10-06T10:59:02.417958+0000","last_active":"2023-10-06T10:59:06.497917+0000","last_peered":"2023-10-06T10:59:06.497917+0000","last_clean":"2023-10-06T10:59:06.497917+0000","last_became_active":"2023-10-06T10:59:02.417612+0000","last_became_peered":"2023-10-06T10:59:02.417612+0000","last_unstale":"2023-10-06T10:59:06.497917+0000","last_undegraded":"2023-10-06T10:59:06.497917+0000","last_fullsized":"2023-10-06T10:59:06.497917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:51.449145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.495493+0000","last_change":"2023-10-06T10:59:02.436783+0000","last_active":"2023-10-06T10:59:06.495493+0000","last_peered":"2023-10-06T10:59:06.495493+0000","last_clean":"2023-10-06T10:59:06.495493+0000","last_became_active":"2023-10-06T10:59:02.436507+0000","last_became_peered":"2023-10-06T10:59:02.436507+0000","last_unstale":"2023-10-06T10:59:06.495493+0000","last_undegraded":"2023-10-06T10:59:06.495493+0000","last_fullsized":"2023-10-06T10:59:06.495493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:04.586026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493130+0000","last_change":"2023-10-06T10:59:02.425873+0000","last_active":"2023-10-06T10:59:06.493130+0000","last_peered":"2023-10-06T10:59:06.493130+0000","last_clean":"2023-10-06T10:59:06.493130+0000","last_became_active":"2023-10-06T10:59:02.425566+0000","last_became_peered":"2023-10-06T10:59:02.425566+0000","last_unstale":"2023-10-06T10:59:06.493130+0000","last_undegraded":"2023-10-06T10:59:06.493130+0000","last_fullsized":"2023-10-06T10:59:06.493130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:23.772944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501838+0000","last_change":"2023-10-06T10:59:02.444199+0000","last_active":"2023-10-06T10:59:06.501838+0000","last_peered":"2023-10-06T10:59:06.501838+0000","last_clean":"2023-10-06T10:59:06.501838+0000","last_became_active":"2023-10-06T10:59:02.443956+0000","last_became_peered":"2023-10-06T10:59:02.443956+0000","last_unstale":"2023-10-06T10:59:06.501838+0000","last_undegraded":"2023-10-06T10:59:06.501838+0000","last_fullsized":"2023-10-06T10:59:06.501838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:56.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.489640+0000","last_change":"2023-10-06T10:59:02.426577+0000","last_active":"2023-10-06T10:59:06.489640+0000","last_peered":"2023-10-06T10:59:06.489640+0000","last_clean":"2023-10-06T10:59:06.489640+0000","last_became_active":"2023-10-06T10:59:02.426242+0000","last_became_peered":"2023-10-06T10:59:02.426242+0000","last_unstale":"2023-10-06T10:59:06.489640+0000","last_undegraded":"2023-10-06T10:59:06.489640+0000","last_fullsized":"2023-10-06T10:59:06.489640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:31.375932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503914+0000","last_change":"2023-10-06T10:59:02.438604+0000","last_active":"2023-10-06T10:59:06.503914+0000","last_peered":"2023-10-06T10:59:06.503914+0000","last_clean":"2023-10-06T10:59:06.503914+0000","last_became_active":"2023-10-06T10:59:02.438014+0000","last_became_peered":"2023-10-06T10:59:02.438014+0000","last_unstale":"2023-10-06T10:59:06.503914+0000","last_undegraded":"2023-10-06T10:59:06.503914+0000","last_fullsized":"2023-10-06T10:59:06.503914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487888+0000","last_change":"2023-10-06T10:59:02.426707+0000","last_active":"2023-10-06T10:59:06.487888+0000","last_peered":"2023-10-06T10:59:06.487888+0000","last_clean":"2023-10-06T10:59:06.487888+0000","last_became_active":"2023-10-06T10:59:02.426263+0000","last_became_peered":"2023-10-06T10:59:02.426263+0000","last_unstale":"2023-10-06T10:59:06.487888+0000","last_undegraded":"2023-10-06T10:59:06.487888+0000","last_fullsized":"2023-10-06T10:59:06.487888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:58.642289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.496996+0000","last_change":"2023-10-06T10:59:02.419676+0000","last_active":"2023-10-06T10:59:06.496996+0000","last_peered":"2023-10-06T10:59:06.496996+0000","last_clean":"2023-10-06T10:59:06.496996+0000","last_became_active":"2023-10-06T10:59:02.419356+0000","last_became_peered":"2023-10-06T10:59:02.419356+0000","last_unstale":"2023-10-06T10:59:06.496996+0000","last_undegraded":"2023-10-06T10:59:06.496996+0000","last_fullsized":"2023-10-06T10:59:06.496996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:42.646222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486894+0000","last_change":"2023-10-06T10:59:02.420221+0000","last_active":"2023-10-06T10:59:06.486894+0000","last_peered":"2023-10-06T10:59:06.486894+0000","last_clean":"2023-10-06T10:59:06.486894+0000","last_became_active":"2023-10-06T10:59:02.419881+0000","last_became_peered":"2023-10-06T10:59:02.419881+0000","last_unstale":"2023-10-06T10:59:06.486894+0000","last_undegraded":"2023-10-06T10:59:06.486894+0000","last_fullsized":"2023-10-06T10:59:06.486894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:17.096084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503250+0000","last_change":"2023-10-06T10:59:02.436623+0000","last_active":"2023-10-06T10:59:06.503250+0000","last_peered":"2023-10-06T10:59:06.503250+0000","last_clean":"2023-10-06T10:59:06.503250+0000","last_became_active":"2023-10-06T10:59:02.436288+0000","last_became_peered":"2023-10-06T10:59:02.436288+0000","last_unstale":"2023-10-06T10:59:06.503250+0000","last_undegraded":"2023-10-06T10:59:06.503250+0000","last_fullsized":"2023-10-06T10:59:06.503250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:31.081513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.500640+0000","last_change":"2023-10-06T10:59:02.436300+0000","last_active":"2023-10-06T10:59:06.500640+0000","last_peered":"2023-10-06T10:59:06.500640+0000","last_clean":"2023-10-06T10:59:06.500640+0000","last_became_active":"2023-10-06T10:59:02.435769+0000","last_became_peered":"2023-10-06T10:59:02.435769+0000","last_unstale":"2023-10-06T10:59:06.500640+0000","last_undegraded":"2023-10-06T10:59:06.500640+0000","last_fullsized":"2023-10-06T10:59:06.500640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493156+0000","last_change":"2023-10-06T10:59:02.440684+0000","last_active":"2023-10-06T10:59:06.493156+0000","last_peered":"2023-10-06T10:59:06.493156+0000","last_clean":"2023-10-06T10:59:06.493156+0000","last_became_active":"2023-10-06T10:59:02.440157+0000","last_became_peered":"2023-10-06T10:59:02.440157+0000","last_unstale":"2023-10-06T10:59:06.493156+0000","last_undegraded":"2023-10-06T10:59:06.493156+0000","last_fullsized":"2023-10-06T10:59:06.493156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:17.384456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501602+0000","last_change":"2023-10-06T10:59:02.439323+0000","last_active":"2023-10-06T10:59:06.501602+0000","last_peered":"2023-10-06T10:59:06.501602+0000","last_clean":"2023-10-06T10:59:06.501602+0000","last_became_active":"2023-10-06T10:59:02.439038+0000","last_became_peered":"2023-10-06T10:59:02.439038+0000","last_unstale":"2023-10-06T10:59:06.501602+0000","last_undegraded":"2023-10-06T10:59:06.501602+0000","last_fullsized":"2023-10-06T10:59:06.501602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487277+0000","last_change":"2023-10-06T10:59:02.422230+0000","last_active":"2023-10-06T10:59:06.487277+0000","last_peered":"2023-10-06T10:59:06.487277+0000","last_clean":"2023-10-06T10:59:06.487277+0000","last_became_active":"2023-10-06T10:59:02.421846+0000","last_became_peered":"2023-10-06T10:59:02.421846+0000","last_unstale":"2023-10-06T10:59:06.487277+0000","last_undegraded":"2023-10-06T10:59:06.487277+0000","last_fullsized":"2023-10-06T10:59:06.487277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:20.715518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487304+0000","last_change":"2023-10-06T10:59:02.419258+0000","last_active":"2023-10-06T10:59:06.487304+0000","last_peered":"2023-10-06T10:59:06.487304+0000","last_clean":"2023-10-06T10:59:06.487304+0000","last_became_active":"2023-10-06T10:59:02.418921+0000","last_became_peered":"2023-10-06T10:59:02.418921+0000","last_unstale":"2023-10-06T10:59:06.487304+0000","last_undegraded":"2023-10-06T10:59:06.487304+0000","last_fullsized":"2023-10-06T10:59:06.487304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:17.558201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493500+0000","last_change":"2023-10-06T10:59:02.429047+0000","last_active":"2023-10-06T10:59:06.493500+0000","last_peered":"2023-10-06T10:59:06.493500+0000","last_clean":"2023-10-06T10:59:06.493500+0000","last_became_active":"2023-10-06T10:59:02.428070+0000","last_became_peered":"2023-10-06T10:59:02.428070+0000","last_unstale":"2023-10-06T10:59:06.493500+0000","last_undegraded":"2023-10-06T10:59:06.493500+0000","last_fullsized":"2023-10-06T10:59:06.493500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:17.286697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511536+0000","last_change":"2023-10-06T10:59:06.505906+0000","last_active":"2023-10-06T10:59:06.511536+0000","last_peered":"2023-10-06T10:59:06.511536+0000","last_clean":"2023-10-06T10:59:06.511536+0000","last_became_active":"2023-10-06T10:59:06.505502+0000","last_became_peered":"2023-10-06T10:59:06.505502+0000","last_unstale":"2023-10-06T10:59:06.511536+0000","last_undegraded":"2023-10-06T10:59:06.511536+0000","last_fullsized":"2023-10-06T10:59:06.511536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:58:13.075195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486926+0000","last_change":"2023-10-06T10:59:01.410556+0000","last_active":"2023-10-06T10:59:06.486926+0000","last_peered":"2023-10-06T10:59:06.486926+0000","last_clean":"2023-10-06T10:59:06.486926+0000","last_became_active":"2023-10-06T10:59:01.410304+0000","last_became_peered":"2023-10-06T10:59:01.410304+0000","last_unstale":"2023-10-06T10:59:06.486926+0000","last_undegraded":"2023-10-06T10:59:06.486926+0000","last_fullsized":"2023-10-06T10:59:06.486926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494194+0000","last_change":"2023-10-06T10:59:02.446346+0000","last_active":"2023-10-06T10:59:06.494194+0000","last_peered":"2023-10-06T10:59:06.494194+0000","last_clean":"2023-10-06T10:59:06.494194+0000","last_became_active":"2023-10-06T10:59:02.446029+0000","last_became_peered":"2023-10-06T10:59:02.446029+0000","last_unstale":"2023-10-06T10:59:06.494194+0000","last_undegraded":"2023-10-06T10:59:06.494194+0000","last_fullsized":"2023-10-06T10:59:06.494194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:48.645632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516676+0000","last_change":"2023-10-06T10:59:06.508187+0000","last_active":"2023-10-06T10:59:06.516676+0000","last_peered":"2023-10-06T10:59:06.516676+0000","last_clean":"2023-10-06T10:59:06.516676+0000","last_became_active":"2023-10-06T10:59:06.507722+0000","last_became_peered":"2023-10-06T10:59:06.507722+0000","last_unstale":"2023-10-06T10:59:06.516676+0000","last_undegraded":"2023-10-06T10:59:06.516676+0000","last_fullsized":"2023-10-06T10:59:06.516676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:52.733607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485843+0000","last_change":"2023-10-06T10:59:01.406095+0000","last_active":"2023-10-06T10:59:06.485843+0000","last_peered":"2023-10-06T10:59:06.485843+0000","last_clean":"2023-10-06T10:59:06.485843+0000","last_became_active":"2023-10-06T10:59:01.405687+0000","last_became_peered":"2023-10-06T10:59:01.405687+0000","last_unstale":"2023-10-06T10:59:06.485843+0000","last_undegraded":"2023-10-06T10:59:06.485843+0000","last_fullsized":"2023-10-06T10:59:06.485843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:55.921829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504174+0000","last_change":"2023-10-06T10:59:02.427693+0000","last_active":"2023-10-06T10:59:06.504174+0000","last_peered":"2023-10-06T10:59:06.504174+0000","last_clean":"2023-10-06T10:59:06.504174+0000","last_became_active":"2023-10-06T10:59:02.427352+0000","last_became_peered":"2023-10-06T10:59:02.427352+0000","last_unstale":"2023-10-06T10:59:06.504174+0000","last_undegraded":"2023-10-06T10:59:06.504174+0000","last_fullsized":"2023-10-06T10:59:06.504174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:28:49.922872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514081+0000","last_change":"2023-10-06T10:59:06.507380+0000","last_active":"2023-10-06T10:59:06.514081+0000","last_peered":"2023-10-06T10:59:06.514081+0000","last_clean":"2023-10-06T10:59:06.514081+0000","last_became_active":"2023-10-06T10:59:06.506977+0000","last_became_peered":"2023-10-06T10:59:06.506977+0000","last_unstale":"2023-10-06T10:59:06.514081+0000","last_undegraded":"2023-10-06T10:59:06.514081+0000","last_fullsized":"2023-10-06T10:59:06.514081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:50.861372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493785+0000","last_change":"2023-10-06T10:59:01.411985+0000","last_active":"2023-10-06T10:59:06.493785+0000","last_peered":"2023-10-06T10:59:06.493785+0000","last_clean":"2023-10-06T10:59:06.493785+0000","last_became_active":"2023-10-06T10:59:01.411513+0000","last_became_peered":"2023-10-06T10:59:01.411513+0000","last_unstale":"2023-10-06T10:59:06.493785+0000","last_undegraded":"2023-10-06T10:59:06.493785+0000","last_fullsized":"2023-10-06T10:59:06.493785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:50.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487360+0000","last_change":"2023-10-06T10:59:02.422860+0000","last_active":"2023-10-06T10:59:06.487360+0000","last_peered":"2023-10-06T10:59:06.487360+0000","last_clean":"2023-10-06T10:59:06.487360+0000","last_became_active":"2023-10-06T10:59:02.422552+0000","last_became_peered":"2023-10-06T10:59:02.422552+0000","last_unstale":"2023-10-06T10:59:06.487360+0000","last_undegraded":"2023-10-06T10:59:06.487360+0000","last_fullsized":"2023-10-06T10:59:06.487360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:20.715518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516565+0000","last_change":"2023-10-06T10:59:06.508111+0000","last_active":"2023-10-06T10:59:06.516565+0000","last_peered":"2023-10-06T10:59:06.516565+0000","last_clean":"2023-10-06T10:59:06.516565+0000","last_became_active":"2023-10-06T10:59:06.507685+0000","last_became_peered":"2023-10-06T10:59:06.507685+0000","last_unstale":"2023-10-06T10:59:06.516565+0000","last_undegraded":"2023-10-06T10:59:06.516565+0000","last_fullsized":"2023-10-06T10:59:06.516565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:21.184059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504004+0000","last_change":"2023-10-06T10:59:01.415316+0000","last_active":"2023-10-06T10:59:06.504004+0000","last_peered":"2023-10-06T10:59:06.504004+0000","last_clean":"2023-10-06T10:59:06.504004+0000","last_became_active":"2023-10-06T10:59:01.415052+0000","last_became_peered":"2023-10-06T10:59:01.415052+0000","last_unstale":"2023-10-06T10:59:06.504004+0000","last_undegraded":"2023-10-06T10:59:06.504004+0000","last_fullsized":"2023-10-06T10:59:06.504004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:03.581242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493689+0000","last_change":"2023-10-06T10:59:02.445937+0000","last_active":"2023-10-06T10:59:06.493689+0000","last_peered":"2023-10-06T10:59:06.493689+0000","last_clean":"2023-10-06T10:59:06.493689+0000","last_became_active":"2023-10-06T10:59:02.444001+0000","last_became_peered":"2023-10-06T10:59:02.444001+0000","last_unstale":"2023-10-06T10:59:06.493689+0000","last_undegraded":"2023-10-06T10:59:06.493689+0000","last_fullsized":"2023-10-06T10:59:06.493689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:31.375932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516837+0000","last_change":"2023-10-06T10:59:06.515426+0000","last_active":"2023-10-06T10:59:06.516837+0000","last_peered":"2023-10-06T10:59:06.516837+0000","last_clean":"2023-10-06T10:59:06.516837+0000","last_became_active":"2023-10-06T10:59:06.514929+0000","last_became_peered":"2023-10-06T10:59:06.514929+0000","last_unstale":"2023-10-06T10:59:06.516837+0000","last_undegraded":"2023-10-06T10:59:06.516837+0000","last_fullsized":"2023-10-06T10:59:06.516837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:29.878658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494014+0000","last_change":"2023-10-06T10:59:01.413409+0000","last_active":"2023-10-06T10:59:06.494014+0000","last_peered":"2023-10-06T10:59:06.494014+0000","last_clean":"2023-10-06T10:59:06.494014+0000","last_became_active":"2023-10-06T10:59:01.413132+0000","last_became_peered":"2023-10-06T10:59:01.413132+0000","last_unstale":"2023-10-06T10:59:06.494014+0000","last_undegraded":"2023-10-06T10:59:06.494014+0000","last_fullsized":"2023-10-06T10:59:06.494014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:19.192242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492779+0000","last_change":"2023-10-06T10:59:02.433507+0000","last_active":"2023-10-06T10:59:06.492779+0000","last_peered":"2023-10-06T10:59:06.492779+0000","last_clean":"2023-10-06T10:59:06.492779+0000","last_became_active":"2023-10-06T10:59:02.433196+0000","last_became_peered":"2023-10-06T10:59:02.433196+0000","last_unstale":"2023-10-06T10:59:06.492779+0000","last_undegraded":"2023-10-06T10:59:06.492779+0000","last_fullsized":"2023-10-06T10:59:06.492779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.506197+0000","last_change":"2023-10-06T10:59:06.502951+0000","last_active":"2023-10-06T10:59:06.506197+0000","last_peered":"2023-10-06T10:59:06.506197+0000","last_clean":"2023-10-06T10:59:06.506197+0000","last_became_active":"2023-10-06T10:59:06.502527+0000","last_became_peered":"2023-10-06T10:59:06.502527+0000","last_unstale":"2023-10-06T10:59:06.506197+0000","last_undegraded":"2023-10-06T10:59:06.506197+0000","last_fullsized":"2023-10-06T10:59:06.506197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:18.864841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503418+0000","last_change":"2023-10-06T10:59:01.415005+0000","last_active":"2023-10-06T10:59:06.503418+0000","last_peered":"2023-10-06T10:59:06.503418+0000","last_clean":"2023-10-06T10:59:06.503418+0000","last_became_active":"2023-10-06T10:59:01.414705+0000","last_became_peered":"2023-10-06T10:59:01.414705+0000","last_unstale":"2023-10-06T10:59:06.503418+0000","last_undegraded":"2023-10-06T10:59:06.503418+0000","last_fullsized":"2023-10-06T10:59:06.503418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:16.553416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485948+0000","last_change":"2023-10-06T10:59:02.423861+0000","last_active":"2023-10-06T10:59:06.485948+0000","last_peered":"2023-10-06T10:59:06.485948+0000","last_clean":"2023-10-06T10:59:06.485948+0000","last_became_active":"2023-10-06T10:59:02.419690+0000","last_became_peered":"2023-10-06T10:59:02.419690+0000","last_unstale":"2023-10-06T10:59:06.485948+0000","last_undegraded":"2023-10-06T10:59:06.485948+0000","last_fullsized":"2023-10-06T10:59:06.485948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:36.050017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513155+0000","last_change":"2023-10-06T10:59:06.506470+0000","last_active":"2023-10-06T10:59:06.513155+0000","last_peered":"2023-10-06T10:59:06.513155+0000","last_clean":"2023-10-06T10:59:06.513155+0000","last_became_active":"2023-10-06T10:59:06.506061+0000","last_became_peered":"2023-10-06T10:59:06.506061+0000","last_unstale":"2023-10-06T10:59:06.513155+0000","last_undegraded":"2023-10-06T10:59:06.513155+0000","last_fullsized":"2023-10-06T10:59:06.513155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:49.928746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T10:59:12.825833+0000","last_change":"2023-10-06T10:59:01.409923+0000","last_active":"2023-10-06T10:59:12.825833+0000","last_peered":"2023-10-06T10:59:12.825833+0000","last_clean":"2023-10-06T10:59:12.825833+0000","last_became_active":"2023-10-06T10:59:01.409615+0000","last_became_peered":"2023-10-06T10:59:01.409615+0000","last_unstale":"2023-10-06T10:59:12.825833+0000","last_undegraded":"2023-10-06T10:59:12.825833+0000","last_fullsized":"2023-10-06T10:59:12.825833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:02.802656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488353+0000","last_change":"2023-10-06T10:59:02.420107+0000","last_active":"2023-10-06T10:59:06.488353+0000","last_peered":"2023-10-06T10:59:06.488353+0000","last_clean":"2023-10-06T10:59:06.488353+0000","last_became_active":"2023-10-06T10:59:02.419814+0000","last_became_peered":"2023-10-06T10:59:02.419814+0000","last_unstale":"2023-10-06T10:59:06.488353+0000","last_undegraded":"2023-10-06T10:59:06.488353+0000","last_fullsized":"2023-10-06T10:59:06.488353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:53.107388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511474+0000","last_change":"2023-10-06T10:59:06.504882+0000","last_active":"2023-10-06T10:59:06.511474+0000","last_peered":"2023-10-06T10:59:06.511474+0000","last_clean":"2023-10-06T10:59:06.511474+0000","last_became_active":"2023-10-06T10:59:06.504478+0000","last_became_peered":"2023-10-06T10:59:06.504478+0000","last_unstale":"2023-10-06T10:59:06.511474+0000","last_undegraded":"2023-10-06T10:59:06.511474+0000","last_fullsized":"2023-10-06T10:59:06.511474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:25.148933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503121+0000","last_change":"2023-10-06T10:59:01.418211+0000","last_active":"2023-10-06T10:59:06.503121+0000","last_peered":"2023-10-06T10:59:06.503121+0000","last_clean":"2023-10-06T10:59:06.503121+0000","last_became_active":"2023-10-06T10:59:01.417924+0000","last_became_peered":"2023-10-06T10:59:01.417924+0000","last_unstale":"2023-10-06T10:59:06.503121+0000","last_undegraded":"2023-10-06T10:59:06.503121+0000","last_fullsized":"2023-10-06T10:59:06.503121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:44.340657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493921+0000","last_change":"2023-10-06T10:59:02.446135+0000","last_active":"2023-10-06T10:59:06.493921+0000","last_peered":"2023-10-06T10:59:06.493921+0000","last_clean":"2023-10-06T10:59:06.493921+0000","last_became_active":"2023-10-06T10:59:02.445893+0000","last_became_peered":"2023-10-06T10:59:02.445893+0000","last_unstale":"2023-10-06T10:59:06.493921+0000","last_undegraded":"2023-10-06T10:59:06.493921+0000","last_fullsized":"2023-10-06T10:59:06.493921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:38.092745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513350+0000","last_change":"2023-10-06T10:59:06.508048+0000","last_active":"2023-10-06T10:59:06.513350+0000","last_peered":"2023-10-06T10:59:06.513350+0000","last_clean":"2023-10-06T10:59:06.513350+0000","last_became_active":"2023-10-06T10:59:06.507619+0000","last_became_peered":"2023-10-06T10:59:06.507619+0000","last_unstale":"2023-10-06T10:59:06.513350+0000","last_undegraded":"2023-10-06T10:59:06.513350+0000","last_fullsized":"2023-10-06T10:59:06.513350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:26:48.345083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.500810+0000","last_change":"2023-10-06T10:59:01.407912+0000","last_active":"2023-10-06T10:59:06.500810+0000","last_peered":"2023-10-06T10:59:06.500810+0000","last_clean":"2023-10-06T10:59:06.500810+0000","last_became_active":"2023-10-06T10:59:01.407345+0000","last_became_peered":"2023-10-06T10:59:01.407345+0000","last_unstale":"2023-10-06T10:59:06.500810+0000","last_undegraded":"2023-10-06T10:59:06.500810+0000","last_fullsized":"2023-10-06T10:59:06.500810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:40.010964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493409+0000","last_change":"2023-10-06T10:59:02.429169+0000","last_active":"2023-10-06T10:59:06.493409+0000","last_peered":"2023-10-06T10:59:06.493409+0000","last_clean":"2023-10-06T10:59:06.493409+0000","last_became_active":"2023-10-06T10:59:02.428497+0000","last_became_peered":"2023-10-06T10:59:02.428497+0000","last_unstale":"2023-10-06T10:59:06.493409+0000","last_undegraded":"2023-10-06T10:59:06.493409+0000","last_fullsized":"2023-10-06T10:59:06.493409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:36.050017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514019+0000","last_change":"2023-10-06T10:59:06.509198+0000","last_active":"2023-10-06T10:59:06.514019+0000","last_peered":"2023-10-06T10:59:06.514019+0000","last_clean":"2023-10-06T10:59:06.514019+0000","last_became_active":"2023-10-06T10:59:06.508723+0000","last_became_peered":"2023-10-06T10:59:06.508723+0000","last_unstale":"2023-10-06T10:59:06.514019+0000","last_undegraded":"2023-10-06T10:59:06.514019+0000","last_fullsized":"2023-10-06T10:59:06.514019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:00.501898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501932+0000","last_change":"2023-10-06T10:59:01.417026+0000","last_active":"2023-10-06T10:59:06.501932+0000","last_peered":"2023-10-06T10:59:06.501932+0000","last_clean":"2023-10-06T10:59:06.501932+0000","last_became_active":"2023-10-06T10:59:01.416734+0000","last_became_peered":"2023-10-06T10:59:01.416734+0000","last_unstale":"2023-10-06T10:59:06.501932+0000","last_undegraded":"2023-10-06T10:59:06.501932+0000","last_fullsized":"2023-10-06T10:59:06.501932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:05:13.017527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504438+0000","last_change":"2023-10-06T10:59:02.437995+0000","last_active":"2023-10-06T10:59:06.504438+0000","last_peered":"2023-10-06T10:59:06.504438+0000","last_clean":"2023-10-06T10:59:06.504438+0000","last_became_active":"2023-10-06T10:59:02.437537+0000","last_became_peered":"2023-10-06T10:59:02.437537+0000","last_unstale":"2023-10-06T10:59:06.504438+0000","last_undegraded":"2023-10-06T10:59:06.504438+0000","last_fullsized":"2023-10-06T10:59:06.504438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:53.107388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.510983+0000","last_change":"2023-10-06T10:59:06.505596+0000","last_active":"2023-10-06T10:59:06.510983+0000","last_peered":"2023-10-06T10:59:06.510983+0000","last_clean":"2023-10-06T10:59:06.510983+0000","last_became_active":"2023-10-06T10:59:06.505171+0000","last_became_peered":"2023-10-06T10:59:06.505171+0000","last_unstale":"2023-10-06T10:59:06.510983+0000","last_undegraded":"2023-10-06T10:59:06.510983+0000","last_fullsized":"2023-10-06T10:59:06.510983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:43.846344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485606+0000","last_change":"2023-10-06T10:59:01.407896+0000","last_active":"2023-10-06T10:59:06.485606+0000","last_peered":"2023-10-06T10:59:06.485606+0000","last_clean":"2023-10-06T10:59:06.485606+0000","last_became_active":"2023-10-06T10:59:01.407443+0000","last_became_peered":"2023-10-06T10:59:01.407443+0000","last_unstale":"2023-10-06T10:59:06.485606+0000","last_undegraded":"2023-10-06T10:59:06.485606+0000","last_fullsized":"2023-10-06T10:59:06.485606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:08.334923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494412+0000","last_change":"2023-10-06T10:59:02.434282+0000","last_active":"2023-10-06T10:59:06.494412+0000","last_peered":"2023-10-06T10:59:06.494412+0000","last_clean":"2023-10-06T10:59:06.494412+0000","last_became_active":"2023-10-06T10:59:02.433977+0000","last_became_peered":"2023-10-06T10:59:02.433977+0000","last_unstale":"2023-10-06T10:59:06.494412+0000","last_undegraded":"2023-10-06T10:59:06.494412+0000","last_fullsized":"2023-10-06T10:59:06.494412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.517644+0000","last_change":"2023-10-06T10:59:06.516059+0000","last_active":"2023-10-06T10:59:06.517644+0000","last_peered":"2023-10-06T10:59:06.517644+0000","last_clean":"2023-10-06T10:59:06.517644+0000","last_became_active":"2023-10-06T10:59:06.515669+0000","last_became_peered":"2023-10-06T10:59:06.515669+0000","last_unstale":"2023-10-06T10:59:06.517644+0000","last_undegraded":"2023-10-06T10:59:06.517644+0000","last_fullsized":"2023-10-06T10:59:06.517644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:52:08.979101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.505660+0000","last_change":"2023-10-06T10:59:01.417634+0000","last_active":"2023-10-06T10:59:06.505660+0000","last_peered":"2023-10-06T10:59:06.505660+0000","last_clean":"2023-10-06T10:59:06.505660+0000","last_became_active":"2023-10-06T10:59:01.417355+0000","last_became_peered":"2023-10-06T10:59:01.417355+0000","last_unstale":"2023-10-06T10:59:06.505660+0000","last_undegraded":"2023-10-06T10:59:06.505660+0000","last_fullsized":"2023-10-06T10:59:06.505660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:19.433940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492678+0000","last_change":"2023-10-06T10:59:02.428141+0000","last_active":"2023-10-06T10:59:06.492678+0000","last_peered":"2023-10-06T10:59:06.492678+0000","last_clean":"2023-10-06T10:59:06.492678+0000","last_became_active":"2023-10-06T10:59:02.427848+0000","last_became_peered":"2023-10-06T10:59:02.427848+0000","last_unstale":"2023-10-06T10:59:06.492678+0000","last_undegraded":"2023-10-06T10:59:06.492678+0000","last_fullsized":"2023-10-06T10:59:06.492678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:56.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513719+0000","last_change":"2023-10-06T10:59:06.510996+0000","last_active":"2023-10-06T10:59:06.513719+0000","last_peered":"2023-10-06T10:59:06.513719+0000","last_clean":"2023-10-06T10:59:06.513719+0000","last_became_active":"2023-10-06T10:59:06.510585+0000","last_became_peered":"2023-10-06T10:59:06.510585+0000","last_unstale":"2023-10-06T10:59:06.513719+0000","last_undegraded":"2023-10-06T10:59:06.513719+0000","last_fullsized":"2023-10-06T10:59:06.513719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:21.184059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503478+0000","last_change":"2023-10-06T10:59:01.411248+0000","last_active":"2023-10-06T10:59:06.503478+0000","last_peered":"2023-10-06T10:59:06.503478+0000","last_clean":"2023-10-06T10:59:06.503478+0000","last_became_active":"2023-10-06T10:59:01.410969+0000","last_became_peered":"2023-10-06T10:59:01.410969+0000","last_unstale":"2023-10-06T10:59:06.503478+0000","last_undegraded":"2023-10-06T10:59:06.503478+0000","last_fullsized":"2023-10-06T10:59:06.503478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:39.400891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486641+0000","last_change":"2023-10-06T10:59:02.419362+0000","last_active":"2023-10-06T10:59:06.486641+0000","last_peered":"2023-10-06T10:59:06.486641+0000","last_clean":"2023-10-06T10:59:06.486641+0000","last_became_active":"2023-10-06T10:59:02.419038+0000","last_became_peered":"2023-10-06T10:59:02.419038+0000","last_unstale":"2023-10-06T10:59:06.486641+0000","last_undegraded":"2023-10-06T10:59:06.486641+0000","last_fullsized":"2023-10-06T10:59:06.486641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:31.081513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516460+0000","last_change":"2023-10-06T10:59:06.515261+0000","last_active":"2023-10-06T10:59:06.516460+0000","last_peered":"2023-10-06T10:59:06.516460+0000","last_clean":"2023-10-06T10:59:06.516460+0000","last_became_active":"2023-10-06T10:59:06.514809+0000","last_became_peered":"2023-10-06T10:59:06.514809+0000","last_unstale":"2023-10-06T10:59:06.516460+0000","last_undegraded":"2023-10-06T10:59:06.516460+0000","last_fullsized":"2023-10-06T10:59:06.516460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:57.195363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503300+0000","last_change":"2023-10-06T10:59:01.411278+0000","last_active":"2023-10-06T10:59:06.503300+0000","last_peered":"2023-10-06T10:59:06.503300+0000","last_clean":"2023-10-06T10:59:06.503300+0000","last_became_active":"2023-10-06T10:59:01.410987+0000","last_became_peered":"2023-10-06T10:59:01.410987+0000","last_unstale":"2023-10-06T10:59:06.503300+0000","last_undegraded":"2023-10-06T10:59:06.503300+0000","last_fullsized":"2023-10-06T10:59:06.503300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:19.710733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485812+0000","last_change":"2023-10-06T10:59:02.435246+0000","last_active":"2023-10-06T10:59:06.485812+0000","last_peered":"2023-10-06T10:59:06.485812+0000","last_clean":"2023-10-06T10:59:06.485812+0000","last_became_active":"2023-10-06T10:59:02.434939+0000","last_became_peered":"2023-10-06T10:59:02.434939+0000","last_unstale":"2023-10-06T10:59:06.485812+0000","last_undegraded":"2023-10-06T10:59:06.485812+0000","last_fullsized":"2023-10-06T10:59:06.485812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:05:14.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513726+0000","last_change":"2023-10-06T10:59:06.511803+0000","last_active":"2023-10-06T10:59:06.513726+0000","last_peered":"2023-10-06T10:59:06.513726+0000","last_clean":"2023-10-06T10:59:06.513726+0000","last_became_active":"2023-10-06T10:59:06.511080+0000","last_became_peered":"2023-10-06T10:59:06.511080+0000","last_unstale":"2023-10-06T10:59:06.513726+0000","last_undegraded":"2023-10-06T10:59:06.513726+0000","last_fullsized":"2023-10-06T10:59:06.513726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:27.869916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492883+0000","last_change":"2023-10-06T10:59:01.414476+0000","last_active":"2023-10-06T10:59:06.492883+0000","last_peered":"2023-10-06T10:59:06.492883+0000","last_clean":"2023-10-06T10:59:06.492883+0000","last_became_active":"2023-10-06T10:59:01.414242+0000","last_became_peered":"2023-10-06T10:59:01.414242+0000","last_unstale":"2023-10-06T10:59:06.492883+0000","last_undegraded":"2023-10-06T10:59:06.492883+0000","last_fullsized":"2023-10-06T10:59:06.492883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501421+0000","last_change":"2023-10-06T10:59:02.436874+0000","last_active":"2023-10-06T10:59:06.501421+0000","last_peered":"2023-10-06T10:59:06.501421+0000","last_clean":"2023-10-06T10:59:06.501421+0000","last_became_active":"2023-10-06T10:59:02.435358+0000","last_became_peered":"2023-10-06T10:59:02.435358+0000","last_unstale":"2023-10-06T10:59:06.501421+0000","last_undegraded":"2023-10-06T10:59:06.501421+0000","last_fullsized":"2023-10-06T10:59:06.501421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:31.081513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514473+0000","last_change":"2023-10-06T10:59:06.513646+0000","last_active":"2023-10-06T10:59:06.514473+0000","last_peered":"2023-10-06T10:59:06.514473+0000","last_clean":"2023-10-06T10:59:06.514473+0000","last_became_active":"2023-10-06T10:59:06.511423+0000","last_became_peered":"2023-10-06T10:59:06.511423+0000","last_unstale":"2023-10-06T10:59:06.514473+0000","last_undegraded":"2023-10-06T10:59:06.514473+0000","last_fullsized":"2023-10-06T10:59:06.514473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:37.882998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493353+0000","last_change":"2023-10-06T10:59:01.411242+0000","last_active":"2023-10-06T10:59:06.493353+0000","last_peered":"2023-10-06T10:59:06.493353+0000","last_clean":"2023-10-06T10:59:06.493353+0000","last_became_active":"2023-10-06T10:59:01.410924+0000","last_became_peered":"2023-10-06T10:59:01.410924+0000","last_unstale":"2023-10-06T10:59:06.493353+0000","last_undegraded":"2023-10-06T10:59:06.493353+0000","last_fullsized":"2023-10-06T10:59:06.493353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:00.499256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486649+0000","last_change":"2023-10-06T10:59:02.435108+0000","last_active":"2023-10-06T10:59:06.486649+0000","last_peered":"2023-10-06T10:59:06.486649+0000","last_clean":"2023-10-06T10:59:06.486649+0000","last_became_active":"2023-10-06T10:59:02.434852+0000","last_became_peered":"2023-10-06T10:59:02.434852+0000","last_unstale":"2023-10-06T10:59:06.486649+0000","last_undegraded":"2023-10-06T10:59:06.486649+0000","last_fullsized":"2023-10-06T10:59:06.486649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:17.384456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.506844+0000","last_change":"2023-10-06T10:59:06.502413+0000","last_active":"2023-10-06T10:59:06.506844+0000","last_peered":"2023-10-06T10:59:06.506844+0000","last_clean":"2023-10-06T10:59:06.506844+0000","last_became_active":"2023-10-06T10:59:06.501975+0000","last_became_peered":"2023-10-06T10:59:06.501975+0000","last_unstale":"2023-10-06T10:59:06.506844+0000","last_undegraded":"2023-10-06T10:59:06.506844+0000","last_fullsized":"2023-10-06T10:59:06.506844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:43.846344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485900+0000","last_change":"2023-10-06T10:59:01.419087+0000","last_active":"2023-10-06T10:59:06.485900+0000","last_peered":"2023-10-06T10:59:06.485900+0000","last_clean":"2023-10-06T10:59:06.485900+0000","last_became_active":"2023-10-06T10:59:01.418650+0000","last_became_peered":"2023-10-06T10:59:01.418650+0000","last_unstale":"2023-10-06T10:59:06.485900+0000","last_undegraded":"2023-10-06T10:59:06.485900+0000","last_fullsized":"2023-10-06T10:59:06.485900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488263+0000","last_change":"2023-10-06T10:59:02.418122+0000","last_active":"2023-10-06T10:59:06.488263+0000","last_peered":"2023-10-06T10:59:06.488263+0000","last_clean":"2023-10-06T10:59:06.488263+0000","last_became_active":"2023-10-06T10:59:02.417375+0000","last_became_peered":"2023-10-06T10:59:02.417375+0000","last_unstale":"2023-10-06T10:59:06.488263+0000","last_undegraded":"2023-10-06T10:59:06.488263+0000","last_fullsized":"2023-10-06T10:59:06.488263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513139+0000","last_change":"2023-10-06T10:59:06.507077+0000","last_active":"2023-10-06T10:59:06.513139+0000","last_peered":"2023-10-06T10:59:06.513139+0000","last_clean":"2023-10-06T10:59:06.513139+0000","last_became_active":"2023-10-06T10:59:06.506613+0000","last_became_peered":"2023-10-06T10:59:06.506613+0000","last_unstale":"2023-10-06T10:59:06.513139+0000","last_undegraded":"2023-10-06T10:59:06.513139+0000","last_fullsized":"2023-10-06T10:59:06.513139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:18.864841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486454+0000","last_change":"2023-10-06T10:59:01.407028+0000","last_active":"2023-10-06T10:59:06.486454+0000","last_peered":"2023-10-06T10:59:06.486454+0000","last_clean":"2023-10-06T10:59:06.486454+0000","last_became_active":"2023-10-06T10:59:01.406571+0000","last_became_peered":"2023-10-06T10:59:01.406571+0000","last_unstale":"2023-10-06T10:59:06.486454+0000","last_undegraded":"2023-10-06T10:59:06.486454+0000","last_fullsized":"2023-10-06T10:59:06.486454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:08.334923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487914+0000","last_change":"2023-10-06T10:59:02.419692+0000","last_active":"2023-10-06T10:59:06.487914+0000","last_peered":"2023-10-06T10:59:06.487914+0000","last_clean":"2023-10-06T10:59:06.487914+0000","last_became_active":"2023-10-06T10:59:02.419394+0000","last_became_peered":"2023-10-06T10:59:02.419394+0000","last_unstale":"2023-10-06T10:59:06.487914+0000","last_undegraded":"2023-10-06T10:59:06.487914+0000","last_fullsized":"2023-10-06T10:59:06.487914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:23.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511521+0000","last_change":"2023-10-06T10:59:06.506565+0000","last_active":"2023-10-06T10:59:06.511521+0000","last_peered":"2023-10-06T10:59:06.511521+0000","last_clean":"2023-10-06T10:59:06.511521+0000","last_became_active":"2023-10-06T10:59:06.506131+0000","last_became_peered":"2023-10-06T10:59:06.506131+0000","last_unstale":"2023-10-06T10:59:06.511521+0000","last_undegraded":"2023-10-06T10:59:06.511521+0000","last_fullsized":"2023-10-06T10:59:06.511521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:15:42.861403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493594+0000","last_change":"2023-10-06T10:59:01.417797+0000","last_active":"2023-10-06T10:59:06.493594+0000","last_peered":"2023-10-06T10:59:06.493594+0000","last_clean":"2023-10-06T10:59:06.493594+0000","last_became_active":"2023-10-06T10:59:01.416920+0000","last_became_peered":"2023-10-06T10:59:01.416920+0000","last_unstale":"2023-10-06T10:59:06.493594+0000","last_undegraded":"2023-10-06T10:59:06.493594+0000","last_fullsized":"2023-10-06T10:59:06.493594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:40.010964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487484+0000","last_change":"2023-10-06T10:59:02.435810+0000","last_active":"2023-10-06T10:59:06.487484+0000","last_peered":"2023-10-06T10:59:06.487484+0000","last_clean":"2023-10-06T10:59:06.487484+0000","last_became_active":"2023-10-06T10:59:02.435540+0000","last_became_peered":"2023-10-06T10:59:02.435540+0000","last_unstale":"2023-10-06T10:59:06.487484+0000","last_undegraded":"2023-10-06T10:59:06.487484+0000","last_fullsized":"2023-10-06T10:59:06.487484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:23.772944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513384+0000","last_change":"2023-10-06T10:59:06.509833+0000","last_active":"2023-10-06T10:59:06.513384+0000","last_peered":"2023-10-06T10:59:06.513384+0000","last_clean":"2023-10-06T10:59:06.513384+0000","last_became_active":"2023-10-06T10:59:06.508637+0000","last_became_peered":"2023-10-06T10:59:06.508637+0000","last_unstale":"2023-10-06T10:59:06.513384+0000","last_undegraded":"2023-10-06T10:59:06.513384+0000","last_fullsized":"2023-10-06T10:59:06.513384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:46:49.548101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494181+0000","last_change":"2023-10-06T10:59:01.415343+0000","last_active":"2023-10-06T10:59:06.494181+0000","last_peered":"2023-10-06T10:59:06.494181+0000","last_clean":"2023-10-06T10:59:06.494181+0000","last_became_active":"2023-10-06T10:59:01.414933+0000","last_became_peered":"2023-10-06T10:59:01.414933+0000","last_unstale":"2023-10-06T10:59:06.494181+0000","last_undegraded":"2023-10-06T10:59:06.494181+0000","last_fullsized":"2023-10-06T10:59:06.494181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:23:07.954687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488471+0000","last_change":"2023-10-06T10:58:56.328381+0000","last_active":"2023-10-06T10:59:06.488471+0000","last_peered":"2023-10-06T10:59:06.488471+0000","last_clean":"2023-10-06T10:59:06.488471+0000","last_became_active":"2023-10-06T10:58:56.328054+0000","last_became_peered":"2023-10-06T10:58:56.328054+0000","last_unstale":"2023-10-06T10:59:06.488471+0000","last_undegraded":"2023-10-06T10:59:06.488471+0000","last_fullsized":"2023-10-06T10:59:06.488471+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493494+0000","last_change":"2023-10-06T10:59:02.429942+0000","last_active":"2023-10-06T10:59:06.493494+0000","last_peered":"2023-10-06T10:59:06.493494+0000","last_clean":"2023-10-06T10:59:06.493494+0000","last_became_active":"2023-10-06T10:59:02.429646+0000","last_became_peered":"2023-10-06T10:59:02.429646+0000","last_unstale":"2023-10-06T10:59:06.493494+0000","last_undegraded":"2023-10-06T10:59:06.493494+0000","last_fullsized":"2023-10-06T10:59:06.493494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.506117+0000","last_change":"2023-10-06T10:59:06.502679+0000","last_active":"2023-10-06T10:59:06.506117+0000","last_peered":"2023-10-06T10:59:06.506117+0000","last_clean":"2023-10-06T10:59:06.506117+0000","last_became_active":"2023-10-06T10:59:06.502273+0000","last_became_peered":"2023-10-06T10:59:06.502273+0000","last_unstale":"2023-10-06T10:59:06.506117+0000","last_undegraded":"2023-10-06T10:59:06.506117+0000","last_fullsized":"2023-10-06T10:59:06.506117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:14:44.651801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493821+0000","last_change":"2023-10-06T10:58:56.326189+0000","last_active":"2023-10-06T10:59:06.493821+0000","last_peered":"2023-10-06T10:59:06.493821+0000","last_clean":"2023-10-06T10:59:06.493821+0000","last_became_active":"2023-10-06T10:58:56.325852+0000","last_became_peered":"2023-10-06T10:58:56.325852+0000","last_unstale":"2023-10-06T10:59:06.493821+0000","last_undegraded":"2023-10-06T10:59:06.493821+0000","last_fullsized":"2023-10-06T10:59:06.493821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:28.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516357+0000","last_change":"2023-10-06T10:59:01.411178+0000","last_active":"2023-10-06T10:59:06.516357+0000","last_peered":"2023-10-06T10:59:06.516357+0000","last_clean":"2023-10-06T10:59:06.516357+0000","last_became_active":"2023-10-06T10:59:01.410703+0000","last_became_peered":"2023-10-06T10:59:01.410703+0000","last_unstale":"2023-10-06T10:59:06.516357+0000","last_undegraded":"2023-10-06T10:59:06.516357+0000","last_fullsized":"2023-10-06T10:59:06.516357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:50.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486551+0000","last_change":"2023-10-06T10:59:02.425180+0000","last_active":"2023-10-06T10:59:06.486551+0000","last_peered":"2023-10-06T10:59:06.486551+0000","last_clean":"2023-10-06T10:59:06.486551+0000","last_became_active":"2023-10-06T10:59:02.424767+0000","last_became_peered":"2023-10-06T10:59:02.424767+0000","last_unstale":"2023-10-06T10:59:06.486551+0000","last_undegraded":"2023-10-06T10:59:06.486551+0000","last_fullsized":"2023-10-06T10:59:06.486551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:33.795023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503741+0000","last_change":"2023-10-06T10:59:06.501263+0000","last_active":"2023-10-06T10:59:06.503741+0000","last_peered":"2023-10-06T10:59:06.503741+0000","last_clean":"2023-10-06T10:59:06.503741+0000","last_became_active":"2023-10-06T10:59:06.500784+0000","last_became_peered":"2023-10-06T10:59:06.500784+0000","last_unstale":"2023-10-06T10:59:06.503741+0000","last_undegraded":"2023-10-06T10:59:06.503741+0000","last_fullsized":"2023-10-06T10:59:06.503741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:49.205787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486205+0000","last_change":"2023-10-06T10:58:56.325363+0000","last_active":"2023-10-06T10:59:06.486205+0000","last_peered":"2023-10-06T10:59:06.486205+0000","last_clean":"2023-10-06T10:59:06.486205+0000","last_became_active":"2023-10-06T10:58:56.325095+0000","last_became_peered":"2023-10-06T10:58:56.325095+0000","last_unstale":"2023-10-06T10:59:06.486205+0000","last_undegraded":"2023-10-06T10:59:06.486205+0000","last_fullsized":"2023-10-06T10:59:06.486205+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501704+0000","last_change":"2023-10-06T10:58:57.328525+0000","last_active":"2023-10-06T10:59:06.501704+0000","last_peered":"2023-10-06T10:59:06.501704+0000","last_clean":"2023-10-06T10:59:06.501704+0000","last_became_active":"2023-10-06T10:58:57.327509+0000","last_became_peered":"2023-10-06T10:58:57.327509+0000","last_unstale":"2023-10-06T10:59:06.501704+0000","last_undegraded":"2023-10-06T10:59:06.501704+0000","last_fullsized":"2023-10-06T10:59:06.501704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_clean_scrub_stamp":"2023-10-06T10:58:56.314996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:45.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501654+0000","last_change":"2023-10-06T10:59:01.415927+0000","last_active":"2023-10-06T10:59:06.501654+0000","last_peered":"2023-10-06T10:59:06.501654+0000","last_clean":"2023-10-06T10:59:06.501654+0000","last_became_active":"2023-10-06T10:59:01.415660+0000","last_became_peered":"2023-10-06T10:59:01.415660+0000","last_unstale":"2023-10-06T10:59:06.501654+0000","last_undegraded":"2023-10-06T10:59:06.501654+0000","last_fullsized":"2023-10-06T10:59:06.501654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:07.977576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504353+0000","last_change":"2023-10-06T10:59:02.435783+0000","last_active":"2023-10-06T10:59:06.504353+0000","last_peered":"2023-10-06T10:59:06.504353+0000","last_clean":"2023-10-06T10:59:06.504353+0000","last_became_active":"2023-10-06T10:59:02.435445+0000","last_became_peered":"2023-10-06T10:59:02.435445+0000","last_unstale":"2023-10-06T10:59:06.504353+0000","last_undegraded":"2023-10-06T10:59:06.504353+0000","last_fullsized":"2023-10-06T10:59:06.504353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516018+0000","last_change":"2023-10-06T10:59:06.514112+0000","last_active":"2023-10-06T10:59:06.516018+0000","last_peered":"2023-10-06T10:59:06.516018+0000","last_clean":"2023-10-06T10:59:06.516018+0000","last_became_active":"2023-10-06T10:59:06.513425+0000","last_became_peered":"2023-10-06T10:59:06.513425+0000","last_unstale":"2023-10-06T10:59:06.516018+0000","last_undegraded":"2023-10-06T10:59:06.516018+0000","last_fullsized":"2023-10-06T10:59:06.516018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:35.463907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501411+0000","last_change":"2023-10-06T10:58:56.331567+0000","last_active":"2023-10-06T10:59:06.501411+0000","last_peered":"2023-10-06T10:59:06.501411+0000","last_clean":"2023-10-06T10:59:06.501411+0000","last_became_active":"2023-10-06T10:58:56.331244+0000","last_became_peered":"2023-10-06T10:58:56.331244+0000","last_unstale":"2023-10-06T10:59:06.501411+0000","last_undegraded":"2023-10-06T10:59:06.501411+0000","last_fullsized":"2023-10-06T10:59:06.501411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486388+0000","last_change":"2023-10-06T10:59:01.401314+0000","last_active":"2023-10-06T10:59:06.486388+0000","last_peered":"2023-10-06T10:59:06.486388+0000","last_clean":"2023-10-06T10:59:06.486388+0000","last_became_active":"2023-10-06T10:59:01.400645+0000","last_became_peered":"2023-10-06T10:59:01.400645+0000","last_unstale":"2023-10-06T10:59:06.486388+0000","last_undegraded":"2023-10-06T10:59:06.486388+0000","last_fullsized":"2023-10-06T10:59:06.486388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:02.802656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487378+0000","last_change":"2023-10-06T10:59:02.433907+0000","last_active":"2023-10-06T10:59:06.487378+0000","last_peered":"2023-10-06T10:59:06.487378+0000","last_clean":"2023-10-06T10:59:06.487378+0000","last_became_active":"2023-10-06T10:59:02.430274+0000","last_became_peered":"2023-10-06T10:59:02.430274+0000","last_unstale":"2023-10-06T10:59:06.487378+0000","last_undegraded":"2023-10-06T10:59:06.487378+0000","last_fullsized":"2023-10-06T10:59:06.487378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:17.286697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516658+0000","last_change":"2023-10-06T10:59:06.515095+0000","last_active":"2023-10-06T10:59:06.516658+0000","last_peered":"2023-10-06T10:59:06.516658+0000","last_clean":"2023-10-06T10:59:06.516658+0000","last_became_active":"2023-10-06T10:59:06.514669+0000","last_became_peered":"2023-10-06T10:59:06.514669+0000","last_unstale":"2023-10-06T10:59:06.516658+0000","last_undegraded":"2023-10-06T10:59:06.516658+0000","last_fullsized":"2023-10-06T10:59:06.516658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:49.205787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501486+0000","last_change":"2023-10-06T10:58:56.332184+0000","last_active":"2023-10-06T10:59:06.501486+0000","last_peered":"2023-10-06T10:59:06.501486+0000","last_clean":"2023-10-06T10:59:06.501486+0000","last_became_active":"2023-10-06T10:58:56.331830+0000","last_became_peered":"2023-10-06T10:58:56.331830+0000","last_unstale":"2023-10-06T10:59:06.501486+0000","last_undegraded":"2023-10-06T10:59:06.501486+0000","last_fullsized":"2023-10-06T10:59:06.501486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:54:02.320834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493508+0000","last_change":"2023-10-06T10:59:01.414711+0000","last_active":"2023-10-06T10:59:06.493508+0000","last_peered":"2023-10-06T10:59:06.493508+0000","last_clean":"2023-10-06T10:59:06.493508+0000","last_became_active":"2023-10-06T10:59:01.414409+0000","last_became_peered":"2023-10-06T10:59:01.414409+0000","last_unstale":"2023-10-06T10:59:06.493508+0000","last_undegraded":"2023-10-06T10:59:06.493508+0000","last_fullsized":"2023-10-06T10:59:06.493508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:44.340657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486245+0000","last_change":"2023-10-06T10:59:02.424669+0000","last_active":"2023-10-06T10:59:06.486245+0000","last_peered":"2023-10-06T10:59:06.486245+0000","last_clean":"2023-10-06T10:59:06.486245+0000","last_became_active":"2023-10-06T10:59:02.424353+0000","last_became_peered":"2023-10-06T10:59:02.424353+0000","last_unstale":"2023-10-06T10:59:06.486245+0000","last_undegraded":"2023-10-06T10:59:06.486245+0000","last_fullsized":"2023-10-06T10:59:06.486245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:17.558201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514130+0000","last_change":"2023-10-06T10:59:06.504921+0000","last_active":"2023-10-06T10:59:06.514130+0000","last_peered":"2023-10-06T10:59:06.514130+0000","last_clean":"2023-10-06T10:59:06.514130+0000","last_became_active":"2023-10-06T10:59:06.501375+0000","last_became_peered":"2023-10-06T10:59:06.501375+0000","last_unstale":"2023-10-06T10:59:06.514130+0000","last_undegraded":"2023-10-06T10:59:06.514130+0000","last_fullsized":"2023-10-06T10:59:06.514130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:29.878658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493427+0000","last_change":"2023-10-06T10:58:56.331654+0000","last_active":"2023-10-06T10:59:06.493427+0000","last_peered":"2023-10-06T10:59:06.493427+0000","last_clean":"2023-10-06T10:59:06.493427+0000","last_became_active":"2023-10-06T10:58:56.331345+0000","last_became_peered":"2023-10-06T10:58:56.331345+0000","last_unstale":"2023-10-06T10:59:06.493427+0000","last_undegraded":"2023-10-06T10:59:06.493427+0000","last_fullsized":"2023-10-06T10:59:06.493427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488547+0000","last_change":"2023-10-06T10:59:01.416484+0000","last_active":"2023-10-06T10:59:06.488547+0000","last_peered":"2023-10-06T10:59:06.488547+0000","last_clean":"2023-10-06T10:59:06.488547+0000","last_became_active":"2023-10-06T10:59:01.416159+0000","last_became_peered":"2023-10-06T10:59:01.416159+0000","last_unstale":"2023-10-06T10:59:06.488547+0000","last_undegraded":"2023-10-06T10:59:06.488547+0000","last_fullsized":"2023-10-06T10:59:06.488547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:19.192242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486436+0000","last_change":"2023-10-06T10:59:02.419009+0000","last_active":"2023-10-06T10:59:06.486436+0000","last_peered":"2023-10-06T10:59:06.486436+0000","last_clean":"2023-10-06T10:59:06.486436+0000","last_became_active":"2023-10-06T10:59:02.418715+0000","last_became_peered":"2023-10-06T10:59:02.418715+0000","last_unstale":"2023-10-06T10:59:06.486436+0000","last_undegraded":"2023-10-06T10:59:06.486436+0000","last_fullsized":"2023-10-06T10:59:06.486436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:20.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514101+0000","last_change":"2023-10-06T10:59:06.504749+0000","last_active":"2023-10-06T10:59:06.514101+0000","last_peered":"2023-10-06T10:59:06.514101+0000","last_clean":"2023-10-06T10:59:06.514101+0000","last_became_active":"2023-10-06T10:59:06.504360+0000","last_became_peered":"2023-10-06T10:59:06.504360+0000","last_unstale":"2023-10-06T10:59:06.514101+0000","last_undegraded":"2023-10-06T10:59:06.514101+0000","last_fullsized":"2023-10-06T10:59:06.514101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:37.882998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486520+0000","last_change":"2023-10-06T10:58:56.331650+0000","last_active":"2023-10-06T10:59:06.486520+0000","last_peered":"2023-10-06T10:59:06.486520+0000","last_clean":"2023-10-06T10:59:06.486520+0000","last_became_active":"2023-10-06T10:58:56.331344+0000","last_became_peered":"2023-10-06T10:58:56.331344+0000","last_unstale":"2023-10-06T10:59:06.486520+0000","last_undegraded":"2023-10-06T10:59:06.486520+0000","last_fullsized":"2023-10-06T10:59:06.486520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:45.584545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486640+0000","last_change":"2023-10-06T10:59:01.405750+0000","last_active":"2023-10-06T10:59:06.486640+0000","last_peered":"2023-10-06T10:59:06.486640+0000","last_clean":"2023-10-06T10:59:06.486640+0000","last_became_active":"2023-10-06T10:59:01.403128+0000","last_became_peered":"2023-10-06T10:59:01.403128+0000","last_unstale":"2023-10-06T10:59:06.486640+0000","last_undegraded":"2023-10-06T10:59:06.486640+0000","last_fullsized":"2023-10-06T10:59:06.486640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501123+0000","last_change":"2023-10-06T10:59:02.427758+0000","last_active":"2023-10-06T10:59:06.501123+0000","last_peered":"2023-10-06T10:59:06.501123+0000","last_clean":"2023-10-06T10:59:06.501123+0000","last_became_active":"2023-10-06T10:59:02.427472+0000","last_became_peered":"2023-10-06T10:59:02.427472+0000","last_unstale":"2023-10-06T10:59:06.501123+0000","last_undegraded":"2023-10-06T10:59:06.501123+0000","last_fullsized":"2023-10-06T10:59:06.501123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:23.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513991+0000","last_change":"2023-10-06T10:59:06.505716+0000","last_active":"2023-10-06T10:59:06.513991+0000","last_peered":"2023-10-06T10:59:06.513991+0000","last_clean":"2023-10-06T10:59:06.513991+0000","last_became_active":"2023-10-06T10:59:06.505243+0000","last_became_peered":"2023-10-06T10:59:06.505243+0000","last_unstale":"2023-10-06T10:59:06.513991+0000","last_undegraded":"2023-10-06T10:59:06.513991+0000","last_fullsized":"2023-10-06T10:59:06.513991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:56.480286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487451+0000","last_change":"2023-10-06T10:58:56.326315+0000","last_active":"2023-10-06T10:59:06.487451+0000","last_peered":"2023-10-06T10:59:06.487451+0000","last_clean":"2023-10-06T10:59:06.487451+0000","last_became_active":"2023-10-06T10:58:56.325897+0000","last_became_peered":"2023-10-06T10:58:56.325897+0000","last_unstale":"2023-10-06T10:59:06.487451+0000","last_undegraded":"2023-10-06T10:59:06.487451+0000","last_fullsized":"2023-10-06T10:59:06.487451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493235+0000","last_change":"2023-10-06T10:59:01.416023+0000","last_active":"2023-10-06T10:59:06.493235+0000","last_peered":"2023-10-06T10:59:06.493235+0000","last_clean":"2023-10-06T10:59:06.493235+0000","last_became_active":"2023-10-06T10:59:01.415727+0000","last_became_peered":"2023-10-06T10:59:01.415727+0000","last_unstale":"2023-10-06T10:59:06.493235+0000","last_undegraded":"2023-10-06T10:59:06.493235+0000","last_fullsized":"2023-10-06T10:59:06.493235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:40.010964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485839+0000","last_change":"2023-10-06T10:59:02.427425+0000","last_active":"2023-10-06T10:59:06.485839+0000","last_peered":"2023-10-06T10:59:06.485839+0000","last_clean":"2023-10-06T10:59:06.485839+0000","last_became_active":"2023-10-06T10:59:02.427000+0000","last_became_peered":"2023-10-06T10:59:02.427000+0000","last_unstale":"2023-10-06T10:59:06.485839+0000","last_undegraded":"2023-10-06T10:59:06.485839+0000","last_fullsized":"2023-10-06T10:59:06.485839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.512322+0000","last_change":"2023-10-06T10:59:06.505584+0000","last_active":"2023-10-06T10:59:06.512322+0000","last_peered":"2023-10-06T10:59:06.512322+0000","last_clean":"2023-10-06T10:59:06.512322+0000","last_became_active":"2023-10-06T10:59:06.505152+0000","last_became_peered":"2023-10-06T10:59:06.505152+0000","last_unstale":"2023-10-06T10:59:06.512322+0000","last_undegraded":"2023-10-06T10:59:06.512322+0000","last_fullsized":"2023-10-06T10:59:06.512322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:50.861372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501237+0000","last_change":"2023-10-06T10:59:01.420277+0000","last_active":"2023-10-06T10:59:06.501237+0000","last_peered":"2023-10-06T10:59:06.501237+0000","last_clean":"2023-10-06T10:59:06.501237+0000","last_became_active":"2023-10-06T10:59:01.419959+0000","last_became_peered":"2023-10-06T10:59:01.419959+0000","last_unstale":"2023-10-06T10:59:06.501237+0000","last_undegraded":"2023-10-06T10:59:06.501237+0000","last_fullsized":"2023-10-06T10:59:06.501237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:19.192242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.498094+0000","last_change":"2023-10-06T10:59:02.420998+0000","last_active":"2023-10-06T10:59:06.498094+0000","last_peered":"2023-10-06T10:59:06.498094+0000","last_clean":"2023-10-06T10:59:06.498094+0000","last_became_active":"2023-10-06T10:59:02.420652+0000","last_became_peered":"2023-10-06T10:59:02.420652+0000","last_unstale":"2023-10-06T10:59:06.498094+0000","last_undegraded":"2023-10-06T10:59:06.498094+0000","last_fullsized":"2023-10-06T10:59:06.498094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:20.197027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516738+0000","last_change":"2023-10-06T10:59:06.513383+0000","last_active":"2023-10-06T10:59:06.516738+0000","last_peered":"2023-10-06T10:59:06.516738+0000","last_clean":"2023-10-06T10:59:06.516738+0000","last_became_active":"2023-10-06T10:59:06.512919+0000","last_became_peered":"2023-10-06T10:59:06.512919+0000","last_unstale":"2023-10-06T10:59:06.516738+0000","last_undegraded":"2023-10-06T10:59:06.516738+0000","last_fullsized":"2023-10-06T10:59:06.516738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:56.480286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492779+0000","last_change":"2023-10-06T10:59:01.417023+0000","last_active":"2023-10-06T10:59:06.492779+0000","last_peered":"2023-10-06T10:59:06.492779+0000","last_clean":"2023-10-06T10:59:06.492779+0000","last_became_active":"2023-10-06T10:59:01.416742+0000","last_became_peered":"2023-10-06T10:59:01.416742+0000","last_unstale":"2023-10-06T10:59:06.492779+0000","last_undegraded":"2023-10-06T10:59:06.492779+0000","last_fullsized":"2023-10-06T10:59:06.492779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:50.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488089+0000","last_change":"2023-10-06T10:59:02.435269+0000","last_active":"2023-10-06T10:59:06.488089+0000","last_peered":"2023-10-06T10:59:06.488089+0000","last_clean":"2023-10-06T10:59:06.488089+0000","last_became_active":"2023-10-06T10:59:02.434615+0000","last_became_peered":"2023-10-06T10:59:02.434615+0000","last_unstale":"2023-10-06T10:59:06.488089+0000","last_undegraded":"2023-10-06T10:59:06.488089+0000","last_fullsized":"2023-10-06T10:59:06.488089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:48.645632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.512751+0000","last_change":"2023-10-06T10:59:06.511957+0000","last_active":"2023-10-06T10:59:06.512751+0000","last_peered":"2023-10-06T10:59:06.512751+0000","last_clean":"2023-10-06T10:59:06.512751+0000","last_became_active":"2023-10-06T10:59:06.511470+0000","last_became_peered":"2023-10-06T10:59:06.511470+0000","last_unstale":"2023-10-06T10:59:06.512751+0000","last_undegraded":"2023-10-06T10:59:06.512751+0000","last_fullsized":"2023-10-06T10:59:06.512751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:56.480286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493131+0000","last_change":"2023-10-06T10:59:01.418640+0000","last_active":"2023-10-06T10:59:06.493131+0000","last_peered":"2023-10-06T10:59:06.493131+0000","last_clean":"2023-10-06T10:59:06.493131+0000","last_became_active":"2023-10-06T10:59:01.418365+0000","last_became_peered":"2023-10-06T10:59:01.418365+0000","last_unstale":"2023-10-06T10:59:06.493131+0000","last_undegraded":"2023-10-06T10:59:06.493131+0000","last_fullsized":"2023-10-06T10:59:06.493131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:08.334923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486781+0000","last_change":"2023-10-06T10:59:02.431977+0000","last_active":"2023-10-06T10:59:06.486781+0000","last_peered":"2023-10-06T10:59:06.486781+0000","last_clean":"2023-10-06T10:59:06.486781+0000","last_became_active":"2023-10-06T10:59:02.431706+0000","last_became_peered":"2023-10-06T10:59:02.431706+0000","last_unstale":"2023-10-06T10:59:06.486781+0000","last_undegraded":"2023-10-06T10:59:06.486781+0000","last_fullsized":"2023-10-06T10:59:06.486781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:56.596950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511641+0000","last_change":"2023-10-06T10:59:06.507385+0000","last_active":"2023-10-06T10:59:06.511641+0000","last_peered":"2023-10-06T10:59:06.511641+0000","last_clean":"2023-10-06T10:59:06.511641+0000","last_became_active":"2023-10-06T10:59:06.506688+0000","last_became_peered":"2023-10-06T10:59:06.506688+0000","last_unstale":"2023-10-06T10:59:06.511641+0000","last_undegraded":"2023-10-06T10:59:06.511641+0000","last_fullsized":"2023-10-06T10:59:06.511641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:27.154530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493578+0000","last_change":"2023-10-06T10:59:01.416098+0000","last_active":"2023-10-06T10:59:06.493578+0000","last_peered":"2023-10-06T10:59:06.493578+0000","last_clean":"2023-10-06T10:59:06.493578+0000","last_became_active":"2023-10-06T10:59:01.415763+0000","last_became_peered":"2023-10-06T10:59:01.415763+0000","last_unstale":"2023-10-06T10:59:06.493578+0000","last_undegraded":"2023-10-06T10:59:06.493578+0000","last_fullsized":"2023-10-06T10:59:06.493578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:03.581242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492967+0000","last_change":"2023-10-06T10:59:02.440465+0000","last_active":"2023-10-06T10:59:06.492967+0000","last_peered":"2023-10-06T10:59:06.492967+0000","last_clean":"2023-10-06T10:59:06.492967+0000","last_became_active":"2023-10-06T10:59:02.439835+0000","last_became_peered":"2023-10-06T10:59:02.439835+0000","last_unstale":"2023-10-06T10:59:06.492967+0000","last_undegraded":"2023-10-06T10:59:06.492967+0000","last_fullsized":"2023-10-06T10:59:06.492967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:23.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.509823+0000","last_change":"2023-10-06T10:59:06.504483+0000","last_active":"2023-10-06T10:59:06.509823+0000","last_peered":"2023-10-06T10:59:06.509823+0000","last_clean":"2023-10-06T10:59:06.509823+0000","last_became_active":"2023-10-06T10:59:06.504086+0000","last_became_peered":"2023-10-06T10:59:06.504086+0000","last_unstale":"2023-10-06T10:59:06.509823+0000","last_undegraded":"2023-10-06T10:59:06.509823+0000","last_fullsized":"2023-10-06T10:59:06.509823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:59.889292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504114+0000","last_change":"2023-10-06T10:59:01.413820+0000","last_active":"2023-10-06T10:59:06.504114+0000","last_peered":"2023-10-06T10:59:06.504114+0000","last_clean":"2023-10-06T10:59:06.504114+0000","last_became_active":"2023-10-06T10:59:01.413502+0000","last_became_peered":"2023-10-06T10:59:01.413502+0000","last_unstale":"2023-10-06T10:59:06.504114+0000","last_undegraded":"2023-10-06T10:59:06.504114+0000","last_fullsized":"2023-10-06T10:59:06.504114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:23:07.954687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.489549+0000","last_change":"2023-10-06T10:59:02.419538+0000","last_active":"2023-10-06T10:59:06.489549+0000","last_peered":"2023-10-06T10:59:06.489549+0000","last_clean":"2023-10-06T10:59:06.489549+0000","last_became_active":"2023-10-06T10:59:02.419185+0000","last_became_peered":"2023-10-06T10:59:02.419185+0000","last_unstale":"2023-10-06T10:59:06.489549+0000","last_undegraded":"2023-10-06T10:59:06.489549+0000","last_fullsized":"2023-10-06T10:59:06.489549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:38.092745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485604+0000","last_change":"2023-10-06T10:59:02.428782+0000","last_active":"2023-10-06T10:59:06.485604+0000","last_peered":"2023-10-06T10:59:06.485604+0000","last_clean":"2023-10-06T10:59:06.485604+0000","last_became_active":"2023-10-06T10:59:02.428518+0000","last_became_peered":"2023-10-06T10:59:02.428518+0000","last_unstale":"2023-10-06T10:59:06.485604+0000","last_undegraded":"2023-10-06T10:59:06.485604+0000","last_fullsized":"2023-10-06T10:59:06.485604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:20.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493061+0000","last_change":"2023-10-06T10:59:02.444220+0000","last_active":"2023-10-06T10:59:06.493061+0000","last_peered":"2023-10-06T10:59:06.493061+0000","last_clean":"2023-10-06T10:59:06.493061+0000","last_became_active":"2023-10-06T10:59:02.443920+0000","last_became_peered":"2023-10-06T10:59:02.443920+0000","last_unstale":"2023-10-06T10:59:06.493061+0000","last_undegraded":"2023-10-06T10:59:06.493061+0000","last_fullsized":"2023-10-06T10:59:06.493061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:17.096084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486954+0000","last_change":"2023-10-06T10:59:02.420323+0000","last_active":"2023-10-06T10:59:06.486954+0000","last_peered":"2023-10-06T10:59:06.486954+0000","last_clean":"2023-10-06T10:59:06.486954+0000","last_became_active":"2023-10-06T10:59:02.419903+0000","last_became_peered":"2023-10-06T10:59:02.419903+0000","last_unstale":"2023-10-06T10:59:06.486954+0000","last_undegraded":"2023-10-06T10:59:06.486954+0000","last_fullsized":"2023-10-06T10:59:06.486954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:52.603660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493896+0000","last_change":"2023-10-06T10:59:02.435228+0000","last_active":"2023-10-06T10:59:06.493896+0000","last_peered":"2023-10-06T10:59:06.493896+0000","last_clean":"2023-10-06T10:59:06.493896+0000","last_became_active":"2023-10-06T10:59:02.434847+0000","last_became_peered":"2023-10-06T10:59:02.434847+0000","last_unstale":"2023-10-06T10:59:06.493896+0000","last_undegraded":"2023-10-06T10:59:06.493896+0000","last_fullsized":"2023-10-06T10:59:06.493896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:53.107388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486540+0000","last_change":"2023-10-06T10:59:02.431384+0000","last_active":"2023-10-06T10:59:06.486540+0000","last_peered":"2023-10-06T10:59:06.486540+0000","last_clean":"2023-10-06T10:59:06.486540+0000","last_became_active":"2023-10-06T10:59:02.431073+0000","last_became_peered":"2023-10-06T10:59:02.431073+0000","last_unstale":"2023-10-06T10:59:06.486540+0000","last_undegraded":"2023-10-06T10:59:06.486540+0000","last_fullsized":"2023-10-06T10:59:06.486540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:05:14.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298128,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073712,"statfs":{"total":96636764160,"available":96331481088,"internally_reserved":0,"allocated":860160,"data_stored":699826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":108570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T10:59:23.122 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T10:59:23.123 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T10:59:23.123 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T10:59:23.123 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T10:59:23.123 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T10:59:23.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.287+0000 7f61e9b84700 1 Processor -- start 2023-10-06T10:59:23.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.288+0000 7f61e9b84700 1 -- start start 2023-10-06T10:59:23.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.288+0000 7f61e9b84700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e40a6e20 0x7f61e40c9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:23.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.288+0000 7f61e9b84700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61e40afb40 0x7f61e40ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:23.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.288+0000 7f61e9b84700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61e40ad280 0x7f61e40ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:23.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.288+0000 7f61e9b84700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e40affb0 con 0x7f61e40ad280 2023-10-06T10:59:23.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.288+0000 7f61e9b84700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e40adc40 con 0x7f61e40afb40 2023-10-06T10:59:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.288+0000 7f61e9b84700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40670f0 con 0x7f61e40a6e20 2023-10-06T10:59:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.289+0000 7f61e3fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61e40ad280 0x7f61e40ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.289+0000 7f61e3fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61e40ad280 0x7f61e40ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43252/0 (socket says 172.21.15.7:43252) 2023-10-06T10:59:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.289+0000 7f61e3fff700 1 -- 172.21.15.7:0/3111468785 learned_addr learned my addr 172.21.15.7:0/3111468785 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.289+0000 7f61e2ffd700 1 --2- 172.21.15.7:0/3111468785 >> v2:172.21.15.50:3300/0 conn(0x7f61e40afb40 0x7f61e40ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.289+0000 7f61e37fe700 1 --2- 172.21.15.7:0/3111468785 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e40a6e20 0x7f61e40c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.289+0000 7f61e3fff700 1 -- 172.21.15.7:0/3111468785 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e40a6e20 msgr2=0x7f61e40c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.289+0000 7f61e3fff700 1 --2- 172.21.15.7:0/3111468785 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e40a6e20 0x7f61e40c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.289+0000 7f61e3fff700 1 -- 172.21.15.7:0/3111468785 >> v2:172.21.15.50:3300/0 conn(0x7f61e40afb40 msgr2=0x7f61e40ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.289+0000 7f61e3fff700 1 --2- 172.21.15.7:0/3111468785 >> v2:172.21.15.50:3300/0 conn(0x7f61e40afb40 0x7f61e40ac7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.289+0000 7f61e3fff700 1 -- 172.21.15.7:0/3111468785 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e4067c70 con 0x7f61e40ad280 2023-10-06T10:59:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.289+0000 7f61e3fff700 1 --2- 172.21.15.7:0/3111468785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61e40ad280 0x7f61e40ad700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f61e406da80 tx=0x7f61dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0f0e083c89caef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.289+0000 7f61e27fc700 1 -- 172.21.15.7:0/3111468785 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc00e070 con 0x7f61e40ad280 2023-10-06T10:59:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.289+0000 7f61e27fc700 1 -- 172.21.15.7:0/3111468785 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc00ba40 con 0x7f61e40ad280 2023-10-06T10:59:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.289+0000 7f61e27fc700 1 -- 172.21.15.7:0/3111468785 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc0092e0 con 0x7f61e40ad280 2023-10-06T10:59:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.290+0000 7f61e9b84700 1 -- 172.21.15.7:0/3111468785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61e40ad280 msgr2=0x7f61e40ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.290+0000 7f61e9b84700 1 --2- 172.21.15.7:0/3111468785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61e40ad280 0x7f61e40ad700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f61e406da80 tx=0x7f61dc009840 comp rx=0 tx=0).stop 2023-10-06T10:59:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.290+0000 7f61e9b84700 1 -- 172.21.15.7:0/3111468785 shutdown_connections 2023-10-06T10:59:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.290+0000 7f61e9b84700 1 --2- 172.21.15.7:0/3111468785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61e40ad280 0x7f61e40ad700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.290+0000 7f61e9b84700 1 --2- 172.21.15.7:0/3111468785 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e40a6e20 0x7f61e40c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.290+0000 7f61e9b84700 1 --2- 172.21.15.7:0/3111468785 >> v2:172.21.15.50:3300/0 conn(0x7f61e40afb40 0x7f61e40ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.290+0000 7f61e9b84700 1 -- 172.21.15.7:0/3111468785 >> 172.21.15.7:0/3111468785 conn(0x7f61e4095a70 msgr2=0x7f61e40af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.290+0000 7f61e9b84700 1 -- 172.21.15.7:0/3111468785 shutdown_connections 2023-10-06T10:59:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.290+0000 7f61e9b84700 1 -- 172.21.15.7:0/3111468785 wait complete. 2023-10-06T10:59:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.291+0000 7f61e9b84700 1 Processor -- start 2023-10-06T10:59:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.292+0000 7f61e9b84700 1 -- start start 2023-10-06T10:59:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.292+0000 7f61e9b84700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40a6e20 0x7f61e4099c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.292+0000 7f61e9b84700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e40ad280 0x7f61e40cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.292+0000 7f61e9b84700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61e40afb40 0x7f61e40ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.292+0000 7f61e9b84700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e4157e90 con 0x7f61e40afb40 2023-10-06T10:59:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.292+0000 7f61e9b84700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e4158ec0 con 0x7f61e40a6e20 2023-10-06T10:59:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.292+0000 7f61e9b84700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e4158be0 con 0x7f61e40ad280 2023-10-06T10:59:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.292+0000 7f61e3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61e40afb40 0x7f61e40ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.292+0000 7f61e3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61e40afb40 0x7f61e40ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43264/0 (socket says 172.21.15.7:43264) 2023-10-06T10:59:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.292+0000 7f61e3fff700 1 -- 172.21.15.7:0/501781776 learned_addr learned my addr 172.21.15.7:0/501781776 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61e37fe700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40a6e20 0x7f61e4099c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61e2ffd700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e40ad280 0x7f61e40cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61e3fff700 1 -- 172.21.15.7:0/501781776 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e40ad280 msgr2=0x7f61e40cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61e3fff700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e40ad280 0x7f61e40cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61e3fff700 1 -- 172.21.15.7:0/501781776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40a6e20 msgr2=0x7f61e4099c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61e3fff700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40a6e20 0x7f61e4099c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61e3fff700 1 -- 172.21.15.7:0/501781776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc009ae0 con 0x7f61e40afb40 2023-10-06T10:59:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61e37fe700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40a6e20 0x7f61e4099c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61e2ffd700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e40ad280 0x7f61e40cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61e3fff700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61e40afb40 0x7f61e40ccab0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f61dc009880 tx=0x7f61dc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61db7fe700 1 -- 172.21.15.7:0/501781776 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc0032f0 con 0x7f61e40afb40 2023-10-06T10:59:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61db7fe700 1 -- 172.21.15.7:0/501781776 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc008e40 con 0x7f61e40afb40 2023-10-06T10:59:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61e9b84700 1 -- 172.21.15.7:0/501781776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e4157840 con 0x7f61e40afb40 2023-10-06T10:59:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61db7fe700 1 -- 172.21.15.7:0/501781776 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc026690 con 0x7f61e40afb40 2023-10-06T10:59:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.293+0000 7f61e9b84700 1 -- 172.21.15.7:0/501781776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e409a150 con 0x7f61e40afb40 2023-10-06T10:59:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.294+0000 7f61e9b84700 1 -- 172.21.15.7:0/501781776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e40ae8c0 con 0x7f61e40afb40 2023-10-06T10:59:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.295+0000 7f61db7fe700 1 -- 172.21.15.7:0/501781776 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61dc003040 con 0x7f61e40afb40 2023-10-06T10:59:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.295+0000 7f61db7fe700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f61c4066f30 0x7f61c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.295+0000 7f61db7fe700 1 -- 172.21.15.7:0/501781776 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f61dc086980 con 0x7f61e40afb40 2023-10-06T10:59:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.295+0000 7f61e37fe700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f61c4066f30 0x7f61c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.296+0000 7f61e37fe700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f61c4066f30 0x7f61c40693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61d4006fd0 tx=0x7f61d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.300+0000 7f61db7fe700 1 -- 172.21.15.7:0/501781776 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61dc0537a0 con 0x7f61e40afb40 2023-10-06T10:59:23.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.556+0000 7f61e9b84700 1 -- 172.21.15.7:0/501781776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f61e4070480 con 0x7f61e40afb40 2023-10-06T10:59:23.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.559+0000 7f61db7fe700 1 -- 172.21.15.7:0/501781776 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163694 (secure 0 0 0) 0x7f61dc056dc0 con 0x7f61e40afb40 2023-10-06T10:59:23.562 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:23.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.562+0000 7f61e9b84700 1 -- 172.21.15.7:0/501781776 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f61c4066f30 msgr2=0x7f61c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:23.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.562+0000 7f61e9b84700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f61c4066f30 0x7f61c40693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61d4006fd0 tx=0x7f61d4008040 comp rx=0 tx=0).stop 2023-10-06T10:59:23.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.562+0000 7f61e9b84700 1 -- 172.21.15.7:0/501781776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61e40afb40 msgr2=0x7f61e40ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:23.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.562+0000 7f61e9b84700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61e40afb40 0x7f61e40ccab0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f61dc009880 tx=0x7f61dc018000 comp rx=0 tx=0).stop 2023-10-06T10:59:23.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.563+0000 7f61e9b84700 1 -- 172.21.15.7:0/501781776 shutdown_connections 2023-10-06T10:59:23.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.563+0000 7f61e9b84700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f61c4066f30 0x7f61c40693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.563+0000 7f61e9b84700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61e40afb40 0x7f61e40ccab0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.563+0000 7f61e9b84700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40a6e20 0x7f61e4099c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.563+0000 7f61e9b84700 1 --2- 172.21.15.7:0/501781776 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e40ad280 0x7f61e40cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.563+0000 7f61e9b84700 1 -- 172.21.15.7:0/501781776 >> 172.21.15.7:0/501781776 conn(0x7f61e4095a70 msgr2=0x7f61e4159c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:23.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.563+0000 7f61e9b84700 1 -- 172.21.15.7:0/501781776 shutdown_connections 2023-10-06T10:59:23.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.563+0000 7f61e9b84700 1 -- 172.21.15.7:0/501781776 wait complete. 2023-10-06T10:59:23.577 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":119417},{"type":"v1","addr":"172.21.15.7:6833","nonce":119417}]},"active_addr":"172.21.15.7:6833/119417","active_change":"2023-10-06T10:58:49.964159+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2359483022}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3330597582}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":242031418}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2494349627}]}]} 2023-10-06T10:59:23.580 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T10:59:23.580 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T10:59:23.581 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:23.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.713+0000 7f9c65848700 1 Processor -- start 2023-10-06T10:59:23.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.713+0000 7f9c65848700 1 -- start start 2023-10-06T10:59:23.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c65848700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9c600af320 0x7f9c600cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:23.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c65848700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9c600cb580 0x7f9c60068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:23.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c65848700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c600cfb50 0x7f9c60069420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:23.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c65848700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c60159c00 con 0x7f9c600af320 2023-10-06T10:59:23.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c65848700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c600cf6c0 con 0x7f9c600cb580 2023-10-06T10:59:23.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c65848700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600ceab0 con 0x7f9c600cfb50 2023-10-06T10:59:23.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c5effd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9c600af320 0x7f9c600cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:23.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c5effd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9c600af320 0x7f9c600cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43268/0 (socket says 172.21.15.7:43268) 2023-10-06T10:59:23.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c5effd700 1 -- 172.21.15.7:0/1864888039 learned_addr learned my addr 172.21.15.7:0/1864888039 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c5e7fc700 1 --2- 172.21.15.7:0/1864888039 >> v2:172.21.15.50:3300/0 conn(0x7f9c600cb580 0x7f9c60068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c5f7fe700 1 --2- 172.21.15.7:0/1864888039 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c600cfb50 0x7f9c60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c5effd700 1 -- 172.21.15.7:0/1864888039 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c600cfb50 msgr2=0x7f9c60069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c5effd700 1 --2- 172.21.15.7:0/1864888039 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c600cfb50 0x7f9c60069420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c5effd700 1 -- 172.21.15.7:0/1864888039 >> v2:172.21.15.50:3300/0 conn(0x7f9c600cb580 msgr2=0x7f9c60068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c5effd700 1 --2- 172.21.15.7:0/1864888039 >> v2:172.21.15.50:3300/0 conn(0x7f9c600cb580 0x7f9c60068ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c5effd700 1 -- 172.21.15.7:0/1864888039 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c600ced90 con 0x7f9c600af320 2023-10-06T10:59:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c5effd700 1 --2- 172.21.15.7:0/1864888039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c600af320 0x7f9c600cb040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9c600cdc00 tx=0x7f9c50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713275868abb88bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.714+0000 7f9c5dffb700 1 -- 172.21.15.7:0/1864888039 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000b8f0 con 0x7f9c600af320 2023-10-06T10:59:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.715+0000 7f9c5dffb700 1 -- 172.21.15.7:0/1864888039 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5000ba50 con 0x7f9c600af320 2023-10-06T10:59:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.715+0000 7f9c5dffb700 1 -- 172.21.15.7:0/1864888039 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000bdf0 con 0x7f9c600af320 2023-10-06T10:59:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.715+0000 7f9c65848700 1 -- 172.21.15.7:0/1864888039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c600af320 msgr2=0x7f9c600cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.715+0000 7f9c65848700 1 --2- 172.21.15.7:0/1864888039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c600af320 0x7f9c600cb040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9c600cdc00 tx=0x7f9c50009250 comp rx=0 tx=0).stop 2023-10-06T10:59:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.715+0000 7f9c65848700 1 -- 172.21.15.7:0/1864888039 shutdown_connections 2023-10-06T10:59:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.715+0000 7f9c65848700 1 --2- 172.21.15.7:0/1864888039 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c600cfb50 0x7f9c60069420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.715+0000 7f9c65848700 1 --2- 172.21.15.7:0/1864888039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c600af320 0x7f9c600cb040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.715+0000 7f9c65848700 1 --2- 172.21.15.7:0/1864888039 >> v2:172.21.15.50:3300/0 conn(0x7f9c600cb580 0x7f9c60068ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.715+0000 7f9c65848700 1 -- 172.21.15.7:0/1864888039 >> 172.21.15.7:0/1864888039 conn(0x7f9c60067b80 msgr2=0x7f9c600d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.715+0000 7f9c65848700 1 -- 172.21.15.7:0/1864888039 shutdown_connections 2023-10-06T10:59:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.715+0000 7f9c65848700 1 -- 172.21.15.7:0/1864888039 wait complete. 2023-10-06T10:59:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.717+0000 7f9c65848700 1 Processor -- start 2023-10-06T10:59:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.717+0000 7f9c65848700 1 -- start start 2023-10-06T10:59:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.717+0000 7f9c65848700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c600af320 0x7f9c60153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.717+0000 7f9c65848700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c600cb580 0x7f9c6014fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.717+0000 7f9c65848700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c600cfb50 0x7f9c6014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.717+0000 7f9c65848700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c60150530 con 0x7f9c600cb580 2023-10-06T10:59:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.717+0000 7f9c65848700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c60158560 con 0x7f9c600cfb50 2023-10-06T10:59:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.717+0000 7f9c65848700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c60158840 con 0x7f9c600af320 2023-10-06T10:59:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c5e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c600cb580 0x7f9c6014fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c5e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c600cb580 0x7f9c6014fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43272/0 (socket says 172.21.15.7:43272) 2023-10-06T10:59:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c5e7fc700 1 -- 172.21.15.7:0/70065434 learned_addr learned my addr 172.21.15.7:0/70065434 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c5f7fe700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c600cfb50 0x7f9c6014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c5effd700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c600af320 0x7f9c60153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c5e7fc700 1 -- 172.21.15.7:0/70065434 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c600af320 msgr2=0x7f9c60153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c5e7fc700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c600af320 0x7f9c60153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c5e7fc700 1 -- 172.21.15.7:0/70065434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c600cfb50 msgr2=0x7f9c6014fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c5e7fc700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c600cfb50 0x7f9c6014fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c5e7fc700 1 -- 172.21.15.7:0/70065434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c500094f0 con 0x7f9c600cb580 2023-10-06T10:59:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c5f7fe700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c600cfb50 0x7f9c6014fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c5e7fc700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c600cb580 0x7f9c6014fab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400d890 tx=0x7f9c54008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c46ffd700 1 -- 172.21.15.7:0/70065434 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400b600 con 0x7f9c600cb580 2023-10-06T10:59:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c46ffd700 1 -- 172.21.15.7:0/70065434 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5400b760 con 0x7f9c600cb580 2023-10-06T10:59:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c65848700 1 -- 172.21.15.7:0/70065434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c60159ec0 con 0x7f9c600cb580 2023-10-06T10:59:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c46ffd700 1 -- 172.21.15.7:0/70065434 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400bae0 con 0x7f9c600cb580 2023-10-06T10:59:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.718+0000 7f9c65848700 1 -- 172.21.15.7:0/70065434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6016d030 con 0x7f9c600cb580 2023-10-06T10:59:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.719+0000 7f9c65848700 1 -- 172.21.15.7:0/70065434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c60158a60 con 0x7f9c600cb580 2023-10-06T10:59:23.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.720+0000 7f9c46ffd700 1 -- 172.21.15.7:0/70065434 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c5401e460 con 0x7f9c600cb580 2023-10-06T10:59:23.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.720+0000 7f9c46ffd700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9c4c066f30 0x7f9c4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:23.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.720+0000 7f9c46ffd700 1 -- 172.21.15.7:0/70065434 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9c54085030 con 0x7f9c600cb580 2023-10-06T10:59:23.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.720+0000 7f9c5effd700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9c4c066f30 0x7f9c4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:23.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.721+0000 7f9c5effd700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9c4c066f30 0x7f9c4c0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9c600cdc00 tx=0x7f9c50017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:23.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.725+0000 7f9c46ffd700 1 -- 172.21.15.7:0/70065434 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c54051e50 con 0x7f9c600cb580 2023-10-06T10:59:23.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.932+0000 7f9c65848700 1 -- 172.21.15.7:0/70065434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c60070480 con 0x7f9c600cb580 2023-10-06T10:59:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.933+0000 7f9c46ffd700 1 -- 172.21.15.7:0/70065434 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f9c54055470 con 0x7f9c600cb580 2023-10-06T10:59:23.934 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:23.935 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:06.934264+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.935+0000 7f9c65848700 1 -- 172.21.15.7:0/70065434 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9c4c066f30 msgr2=0x7f9c4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.935+0000 7f9c65848700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9c4c066f30 0x7f9c4c0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9c600cdc00 tx=0x7f9c50017000 comp rx=0 tx=0).stop 2023-10-06T10:59:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.935+0000 7f9c65848700 1 -- 172.21.15.7:0/70065434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c600cb580 msgr2=0x7f9c6014fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.935+0000 7f9c65848700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c600cb580 0x7f9c6014fab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400d890 tx=0x7f9c54008040 comp rx=0 tx=0).stop 2023-10-06T10:59:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.935+0000 7f9c65848700 1 -- 172.21.15.7:0/70065434 shutdown_connections 2023-10-06T10:59:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.935+0000 7f9c65848700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9c4c066f30 0x7f9c4c0693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.935+0000 7f9c65848700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c600cfb50 0x7f9c6014fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.935+0000 7f9c65848700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c600af320 0x7f9c60153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.935+0000 7f9c65848700 1 --2- 172.21.15.7:0/70065434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c600cb580 0x7f9c6014fab0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.935+0000 7f9c65848700 1 -- 172.21.15.7:0/70065434 >> 172.21.15.7:0/70065434 conn(0x7f9c60067b80 msgr2=0x7f9c600aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.935+0000 7f9c65848700 1 -- 172.21.15.7:0/70065434 shutdown_connections 2023-10-06T10:59:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:23.935+0000 7f9c65848700 1 -- 172.21.15.7:0/70065434 wait complete. 2023-10-06T10:59:23.950 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T10:59:23.950 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:24.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.083+0000 7f16e4bf4700 1 Processor -- start 2023-10-06T10:59:24.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.083+0000 7f16e4bf4700 1 -- start start 2023-10-06T10:59:24.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.084+0000 7f16e4bf4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16e00ccda0 0x7f16e00cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.084+0000 7f16e4bf4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16e00aaa40 0x7f16e0155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.084+0000 7f16e4bf4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e0069110 con 0x7f16e00ac8d0 2023-10-06T10:59:24.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.085+0000 7f16e4bf4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e0068b30 con 0x7f16e00ccda0 2023-10-06T10:59:24.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.085+0000 7f16e4bf4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00aafb0 con 0x7f16e00aaa40 2023-10-06T10:59:24.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.085+0000 7f16ded9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16e00aaa40 0x7f16e0155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.085+0000 7f16de59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16e00ccda0 0x7f16e00cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.085+0000 7f16de59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16e00ccda0 0x7f16e00cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:39046/0 (socket says 172.21.15.7:39046) 2023-10-06T10:59:24.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.085+0000 7f16ded9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16e00aaa40 0x7f16e0155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:34878/0 (socket says 172.21.15.7:34878) 2023-10-06T10:59:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.085+0000 7f16de59c700 1 -- 172.21.15.7:0/2514596477 learned_addr learned my addr 172.21.15.7:0/2514596477 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.085+0000 7f16de59c700 1 -- 172.21.15.7:0/2514596477 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16e00aaa40 msgr2=0x7f16e0155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.085+0000 7f16de59c700 1 --2- 172.21.15.7:0/2514596477 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16e00aaa40 0x7f16e0155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.085+0000 7f16de59c700 1 -- 172.21.15.7:0/2514596477 >> v1:172.21.15.50:6789/0 conn(0x7f16e00ac8d0 legacy=0x7f16e00aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.085+0000 7f16de59c700 1 -- 172.21.15.7:0/2514596477 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e0068da0 con 0x7f16e00ccda0 2023-10-06T10:59:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.085+0000 7f16ded9d700 1 --2- 172.21.15.7:0/2514596477 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16e00aaa40 0x7f16e0155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:59:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.085+0000 7f16dd59a700 1 -- 172.21.15.7:0/2514596477 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964586482 0 0) 0x7f16e0069110 con 0x7f16e00ac8d0 2023-10-06T10:59:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.086+0000 7f16de59c700 1 --2- 172.21.15.7:0/2514596477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e00ccda0 0x7f16e00cd170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f16d00099b0 tx=0x7f16d0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3beac7b4f6101a14 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.086+0000 7f16dd59a700 1 -- 172.21.15.7:0/2514596477 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0009ea0 con 0x7f16e00ccda0 2023-10-06T10:59:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.086+0000 7f16dd59a700 1 -- 172.21.15.7:0/2514596477 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d000b860 con 0x7f16e00ccda0 2023-10-06T10:59:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.086+0000 7f16dd59a700 1 -- 172.21.15.7:0/2514596477 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d000bc00 con 0x7f16e00ccda0 2023-10-06T10:59:24.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.086+0000 7f16e4bf4700 1 -- 172.21.15.7:0/2514596477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e00ccda0 msgr2=0x7f16e00cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.086+0000 7f16e4bf4700 1 --2- 172.21.15.7:0/2514596477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e00ccda0 0x7f16e00cd170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f16d00099b0 tx=0x7f16d0009250 comp rx=0 tx=0).stop 2023-10-06T10:59:24.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.086+0000 7f16e4bf4700 1 -- 172.21.15.7:0/2514596477 shutdown_connections 2023-10-06T10:59:24.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.086+0000 7f16e4bf4700 1 --2- 172.21.15.7:0/2514596477 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16e00aaa40 0x7f16e0155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.086+0000 7f16e4bf4700 1 --2- 172.21.15.7:0/2514596477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e00ccda0 0x7f16e00cd170 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.086+0000 7f16e4bf4700 1 -- 172.21.15.7:0/2514596477 >> 172.21.15.7:0/2514596477 conn(0x7f16e0096160 msgr2=0x7f16e00afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.087+0000 7f16e4bf4700 1 -- 172.21.15.7:0/2514596477 shutdown_connections 2023-10-06T10:59:24.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.087+0000 7f16e4bf4700 1 -- 172.21.15.7:0/2514596477 wait complete. 2023-10-06T10:59:24.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.088+0000 7f16e4bf4700 1 Processor -- start 2023-10-06T10:59:24.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.088+0000 7f16e4bf4700 1 -- start start 2023-10-06T10:59:24.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.089+0000 7f16e4bf4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16e00aaa40 0x7f16e01671a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.089+0000 7f16e4bf4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16e00ac8d0 0x7f16e01588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.089+0000 7f16e4bf4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e00ccda0 0x7f16e0158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.089+0000 7f16e4bf4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e01678f0 con 0x7f16e00aaa40 2023-10-06T10:59:24.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.089+0000 7f16e4bf4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e01676e0 con 0x7f16e00ccda0 2023-10-06T10:59:24.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.089+0000 7f16e4bf4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e0097090 con 0x7f16e00ac8d0 2023-10-06T10:59:24.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.089+0000 7f16de59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16e00aaa40 0x7f16e01671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.089+0000 7f16de59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16e00aaa40 0x7f16e01671a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43278/0 (socket says 172.21.15.7:43278) 2023-10-06T10:59:24.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.089+0000 7f16de59c700 1 -- 172.21.15.7:0/1466451772 learned_addr learned my addr 172.21.15.7:0/1466451772 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.090+0000 7f16ded9d700 1 --2- 172.21.15.7:0/1466451772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e00ccda0 0x7f16e0158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.090+0000 7f16ddd9b700 1 --2- 172.21.15.7:0/1466451772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16e00ac8d0 0x7f16e01588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.090+0000 7f16de59c700 1 -- 172.21.15.7:0/1466451772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16e00ac8d0 msgr2=0x7f16e01588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.090+0000 7f16de59c700 1 --2- 172.21.15.7:0/1466451772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16e00ac8d0 0x7f16e01588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.090+0000 7f16de59c700 1 -- 172.21.15.7:0/1466451772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e00ccda0 msgr2=0x7f16e0158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.090+0000 7f16de59c700 1 --2- 172.21.15.7:0/1466451772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e00ccda0 0x7f16e0158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.090+0000 7f16de59c700 1 -- 172.21.15.7:0/1466451772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d8009a20 con 0x7f16e00aaa40 2023-10-06T10:59:24.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.090+0000 7f16de59c700 1 --2- 172.21.15.7:0/1466451772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16e00aaa40 0x7f16e01671a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f16e00b2e50 tx=0x7f16d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.090+0000 7f16ce7fc700 1 -- 172.21.15.7:0/1466451772 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d000bbe0 con 0x7f16e00aaa40 2023-10-06T10:59:24.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.090+0000 7f16ce7fc700 1 -- 172.21.15.7:0/1466451772 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d0011420 con 0x7f16e00aaa40 2023-10-06T10:59:24.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.090+0000 7f16e4bf4700 1 -- 172.21.15.7:0/1466451772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d00094f0 con 0x7f16e00aaa40 2023-10-06T10:59:24.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.090+0000 7f16ce7fc700 1 -- 172.21.15.7:0/1466451772 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d00117e0 con 0x7f16e00aaa40 2023-10-06T10:59:24.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.090+0000 7f16e4bf4700 1 -- 172.21.15.7:0/1466451772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e0097650 con 0x7f16e00aaa40 2023-10-06T10:59:24.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.091+0000 7f16bffff700 1 -- 172.21.15.7:0/1466451772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b80052b0 con 0x7f16e00aaa40 2023-10-06T10:59:24.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.092+0000 7f16ce7fc700 1 -- 172.21.15.7:0/1466451772 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16d0011c10 con 0x7f16e00aaa40 2023-10-06T10:59:24.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.092+0000 7f16ce7fc700 1 --2- 172.21.15.7:0/1466451772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f16c0066f30 0x7f16c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.092+0000 7f16ce7fc700 1 -- 172.21.15.7:0/1466451772 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f16d00862f0 con 0x7f16e00aaa40 2023-10-06T10:59:24.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.092+0000 7f16ddd9b700 1 --2- 172.21.15.7:0/1466451772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f16c0066f30 0x7f16c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.093+0000 7f16ddd9b700 1 --2- 172.21.15.7:0/1466451772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f16c0066f30 0x7f16c00693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f16e0159900 tx=0x7f16d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.097+0000 7f16ce7fc700 1 -- 172.21.15.7:0/1466451772 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16d0053110 con 0x7f16e00aaa40 2023-10-06T10:59:24.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.303+0000 7f16bffff700 1 -- 172.21.15.7:0/1466451772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16b8005830 con 0x7f16e00aaa40 2023-10-06T10:59:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.304+0000 7f16ce7fc700 1 -- 172.21.15.7:0/1466451772 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f16d0056730 con 0x7f16e00aaa40 2023-10-06T10:59:24.305 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:24.305 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:06.934264+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:24.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.306+0000 7f16bffff700 1 -- 172.21.15.7:0/1466451772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f16c0066f30 msgr2=0x7f16c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.306+0000 7f16bffff700 1 --2- 172.21.15.7:0/1466451772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f16c0066f30 0x7f16c00693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f16e0159900 tx=0x7f16d4009040 comp rx=0 tx=0).stop 2023-10-06T10:59:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.306+0000 7f16bffff700 1 -- 172.21.15.7:0/1466451772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16e00aaa40 msgr2=0x7f16e01671a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.306+0000 7f16bffff700 1 --2- 172.21.15.7:0/1466451772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16e00aaa40 0x7f16e01671a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f16e00b2e50 tx=0x7f16d0017000 comp rx=0 tx=0).stop 2023-10-06T10:59:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.306+0000 7f16bffff700 1 -- 172.21.15.7:0/1466451772 shutdown_connections 2023-10-06T10:59:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.306+0000 7f16bffff700 1 --2- 172.21.15.7:0/1466451772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f16c0066f30 0x7f16c00693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.306+0000 7f16bffff700 1 --2- 172.21.15.7:0/1466451772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16e00aaa40 0x7f16e01671a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.306+0000 7f16bffff700 1 --2- 172.21.15.7:0/1466451772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e00ccda0 0x7f16e0158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.306+0000 7f16bffff700 1 --2- 172.21.15.7:0/1466451772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16e00ac8d0 0x7f16e01588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.306+0000 7f16bffff700 1 -- 172.21.15.7:0/1466451772 >> 172.21.15.7:0/1466451772 conn(0x7f16e0096160 msgr2=0x7f16e00a9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.307+0000 7f16bffff700 1 -- 172.21.15.7:0/1466451772 shutdown_connections 2023-10-06T10:59:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.307+0000 7f16bffff700 1 -- 172.21.15.7:0/1466451772 wait complete. 2023-10-06T10:59:24.321 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T10:59:24.322 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T10:59:24.322 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T10:59:24.322 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T10:59:24.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T10:59:24.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T10:59:24.324 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T10:59:24.324 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T10:59:24.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.553+0000 7fb2b8028700 1 Processor -- start 2023-10-06T10:59:24.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.553+0000 7fb2b8028700 1 -- start start 2023-10-06T10:59:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.555+0000 7fb2b8028700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb2b00ca8e0 0x7fb2b00c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.555+0000 7fb2b8028700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b00c2990 con 0x7fb2b00c1440 2023-10-06T10:59:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.555+0000 7fb2b8028700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b00c6ba0 con 0x7fb2b00ca510 2023-10-06T10:59:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.555+0000 7fb2b8028700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b00cb120 con 0x7fb2b00ca8e0 2023-10-06T10:59:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.555+0000 7fb2b65c5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb2b00ca8e0 0x7fb2b00c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.555+0000 7fb2b65c5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb2b00ca8e0 0x7fb2b00c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43286/0 (socket says 172.21.15.7:43286) 2023-10-06T10:59:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.555+0000 7fb2b65c5700 1 -- 172.21.15.7:0/3560038144 learned_addr learned my addr 172.21.15.7:0/3560038144 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.556+0000 7fb2b65c5700 1 -- 172.21.15.7:0/3560038144 >> v1:172.21.15.50:6789/0 conn(0x7fb2b00ca510 legacy=0x7fb2b00c2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.556+0000 7fb2b65c5700 1 -- 172.21.15.7:0/3560038144 >> v1:172.21.15.7:6789/0 conn(0x7fb2b00c1440 legacy=0x7fb2b00670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.556+0000 7fb2b65c5700 1 -- 172.21.15.7:0/3560038144 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00c6e40 con 0x7fb2b00ca8e0 2023-10-06T10:59:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.556+0000 7f1ac7d84700 1 Processor -- start 2023-10-06T10:59:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.556+0000 7f1ac7d84700 1 -- start start 2023-10-06T10:59:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.556+0000 7fb2b65c5700 1 --2- 172.21.15.7:0/3560038144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b00ca8e0 0x7fb2b00c7bc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8009f20 tx=0x7fb2a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3943d2ff42947a65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.557+0000 7f1ac7d84700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ac00c7770 0x7f1ac015e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.557+0000 7f1ac7d84700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ac00c7b40 0x7f1ac01611b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.557+0000 7f1ac7d84700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac01616f0 con 0x7f1ac015abe0 2023-10-06T10:59:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.557+0000 7f1ac7d84700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac006b2a0 con 0x7f1ac00c7b40 2023-10-06T10:59:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.557+0000 7f1ac7d84700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac006af70 con 0x7f1ac00c7770 2023-10-06T10:59:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.558+0000 7f1ac6321700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1ac015abe0 0x7f1ac015b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:56138/0 (socket says 172.21.15.7:56138) 2023-10-06T10:59:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.558+0000 7f1ac6321700 1 -- 172.21.15.7:0/3662876909 learned_addr learned my addr 172.21.15.7:0/3662876909 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.558+0000 7f1ac5b20700 1 --2- 172.21.15.7:0/3662876909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ac00c7770 0x7f1ac015e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.558+0000 7f1ac531f700 1 --2- 172.21.15.7:0/3662876909 >> v2:172.21.15.50:3300/0 conn(0x7f1ac00c7b40 0x7f1ac01611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.559+0000 7fb2b4dc2700 1 -- 172.21.15.7:0/3560038144 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800e070 con 0x7fb2b00ca8e0 2023-10-06T10:59:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.559+0000 7fb2b4dc2700 1 -- 172.21.15.7:0/3560038144 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a800ba00 con 0x7fb2b00ca8e0 2023-10-06T10:59:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.559+0000 7fb2b4dc2700 1 -- 172.21.15.7:0/3560038144 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a80092e0 con 0x7fb2b00ca8e0 2023-10-06T10:59:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.559+0000 7fdd54a1f700 1 Processor -- start 2023-10-06T10:59:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.559+0000 7f1ac5b20700 1 -- 172.21.15.7:0/3662876909 >> v2:172.21.15.50:3300/0 conn(0x7f1ac00c7b40 msgr2=0x7f1ac01611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.559+0000 7f1ac5b20700 1 --2- 172.21.15.7:0/3662876909 >> v2:172.21.15.50:3300/0 conn(0x7f1ac00c7b40 0x7f1ac01611b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.559+0000 7f1ac5b20700 1 -- 172.21.15.7:0/3662876909 >> v1:172.21.15.50:6789/0 conn(0x7f1ac015abe0 legacy=0x7f1ac015b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.559+0000 7f1ac5b20700 1 -- 172.21.15.7:0/3662876909 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac0161920 con 0x7f1ac00c7770 2023-10-06T10:59:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.559+0000 7fdd54a1f700 1 -- start start 2023-10-06T10:59:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.559+0000 7f1ac5b20700 1 --2- 172.21.15.7:0/3662876909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ac00c7770 0x7f1ac015e6e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009e60 tx=0x7f1ab8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ccc0a543c459fb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.560+0000 7fb2b8028700 1 -- 172.21.15.7:0/3560038144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b00ca8e0 msgr2=0x7fb2b00c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.560+0000 7fb2b8028700 1 --2- 172.21.15.7:0/3560038144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b00ca8e0 0x7fb2b00c7bc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8009f20 tx=0x7fb2a8009840 comp rx=0 tx=0).stop 2023-10-06T10:59:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.561+0000 7fdd54a1f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd501593d0 0x7fdd5006be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.561+0000 7fdd54a1f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdd5006c380 0x7fdd5013b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.561+0000 7fdd54a1f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd50067290 con 0x7fdd50159000 2023-10-06T10:59:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.561+0000 7fdd54a1f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd500c6a10 con 0x7fdd5006c380 2023-10-06T10:59:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.561+0000 7fdd54a1f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50067570 con 0x7fdd501593d0 2023-10-06T10:59:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.560+0000 7f1ac4b1e700 1 -- 172.21.15.7:0/3662876909 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab800e070 con 0x7f1ac00c7770 2023-10-06T10:59:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.560+0000 7f1ac4b1e700 1 -- 172.21.15.7:0/3662876909 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab800bb60 con 0x7f1ac00c7770 2023-10-06T10:59:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.560+0000 7f1ac4b1e700 1 -- 172.21.15.7:0/3662876909 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8012430 con 0x7f1ac00c7770 2023-10-06T10:59:24.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.561+0000 7fdd4e59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdd50159000 0x7fdd500c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:56146/0 (socket says 172.21.15.7:56146) 2023-10-06T10:59:24.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.561+0000 7fdd4e59c700 1 -- 172.21.15.7:0/1034545980 learned_addr learned my addr 172.21.15.7:0/1034545980 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:24.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.561+0000 7fb2b8028700 1 -- 172.21.15.7:0/3560038144 shutdown_connections 2023-10-06T10:59:24.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.561+0000 7fb2b8028700 1 --2- 172.21.15.7:0/3560038144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b00ca8e0 0x7fb2b00c7bc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.561+0000 7fb2b8028700 1 -- 172.21.15.7:0/3560038144 >> 172.21.15.7:0/3560038144 conn(0x7fb2b00cc790 msgr2=0x7fb2b00c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.561+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3662876909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ac00c7770 msgr2=0x7f1ac015e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.561+0000 7f1ac7d84700 1 --2- 172.21.15.7:0/3662876909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ac00c7770 0x7f1ac015e6e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009e60 tx=0x7f1ab8009780 comp rx=0 tx=0).stop 2023-10-06T10:59:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7fdd4d59a700 1 -- 172.21.15.7:0/1034545980 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838303337 0 0) 0x7fdd50067290 con 0x7fdd50159000 2023-10-06T10:59:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7fdd4d59a700 1 -- 172.21.15.7:0/1034545980 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd38003570 con 0x7fdd50159000 2023-10-06T10:59:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3662876909 shutdown_connections 2023-10-06T10:59:24.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7f1ac7d84700 1 --2- 172.21.15.7:0/3662876909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ac00c7770 0x7f1ac015e6e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7f1ac7d84700 1 --2- 172.21.15.7:0/3662876909 >> v2:172.21.15.50:3300/0 conn(0x7f1ac00c7b40 0x7f1ac01611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3662876909 >> 172.21.15.7:0/3662876909 conn(0x7f1ac00c8730 msgr2=0x7f1ac00c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3662876909 shutdown_connections 2023-10-06T10:59:24.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7fdd4d59a700 1 -- 172.21.15.7:0/1034545980 <== mon.1 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1114927805 0 0) 0x7fdd38003570 con 0x7fdd50159000 2023-10-06T10:59:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7fdd4d59a700 1 -- 172.21.15.7:0/1034545980 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd501593d0 msgr2=0x7fdd5006be40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T10:59:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7fdd4d59a700 1 --2- 172.21.15.7:0/1034545980 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd501593d0 0x7fdd5006be40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7fdd4d59a700 1 -- 172.21.15.7:0/1034545980 >> v2:172.21.15.7:3300/0 conn(0x7fdd5006c380 msgr2=0x7fdd5013b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7fdd4d59a700 1 --2- 172.21.15.7:0/1034545980 >> v2:172.21.15.7:3300/0 conn(0x7fdd5006c380 0x7fdd5013b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7fdd4d59a700 1 -- 172.21.15.7:0/1034545980 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd50067850 con 0x7fdd50159000 2023-10-06T10:59:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7fdd4d59a700 1 -- 172.21.15.7:0/1034545980 <== mon.1 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7fdd480017f0 con 0x7fdd50159000 2023-10-06T10:59:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7fdd4d59a700 1 -- 172.21.15.7:0/1034545980 >> v1:172.21.15.50:6789/0 conn(0x7fdd50159000 legacy=0x7fdd500c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7fdd4d59a700 1 --2- 172.21.15.7:0/1034545980 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd38003ae0 0x7fdd38003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.563+0000 7fdd4d59a700 1 --2- 172.21.15.7:0/1034545980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd38004810 0x7fdd38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.563+0000 7fdd4d59a700 1 --2- 172.21.15.7:0/1034545980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd380053c0 0x7fdd3800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.563+0000 7fdd4d59a700 1 -- 172.21.15.7:0/1034545980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500c6a10 con 0x7fdd38004810 2023-10-06T10:59:24.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.563+0000 7fdd4d59a700 1 -- 172.21.15.7:0/1034545980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50067570 con 0x7fdd380053c0 2023-10-06T10:59:24.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.563+0000 7fdd4d59a700 1 -- 172.21.15.7:0/1034545980 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3800c2e0 con 0x7fdd38003ae0 2023-10-06T10:59:24.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.563+0000 7fdd4ed9d700 1 --2- 172.21.15.7:0/1034545980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd380053c0 0x7fdd3800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.563+0000 7fdd4e59c700 1 --2- 172.21.15.7:0/1034545980 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd38003ae0 0x7fdd38003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.563+0000 7fdd4e59c700 1 -- 172.21.15.7:0/1034545980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd380053c0 msgr2=0x7fdd3800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.563+0000 7fdd4e59c700 1 --2- 172.21.15.7:0/1034545980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd380053c0 0x7fdd3800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.563+0000 7fdd4e59c700 1 -- 172.21.15.7:0/1034545980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd38004810 msgr2=0x7fdd38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.563+0000 7fdd4e59c700 1 --2- 172.21.15.7:0/1034545980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd38004810 0x7fdd38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.563+0000 7fdd4e59c700 1 -- 172.21.15.7:0/1034545980 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd38003570 con 0x7fdd38003ae0 2023-10-06T10:59:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.564+0000 7fdd4e59c700 1 --2- 172.21.15.7:0/1034545980 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd38003ae0 0x7fdd38003ef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdd480054a0 tx=0x7fdd48002160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=748fa53db3163dbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.562+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3662876909 wait complete. 2023-10-06T10:59:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.564+0000 7f1ac7d84700 1 Processor -- start 2023-10-06T10:59:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.564+0000 7fdd4d59a700 1 -- 172.21.15.7:0/1034545980 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48008e50 con 0x7fdd38003ae0 2023-10-06T10:59:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.564+0000 7fdd4d59a700 1 -- 172.21.15.7:0/1034545980 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd48008110 con 0x7fdd38003ae0 2023-10-06T10:59:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.564+0000 7fdd4d59a700 1 -- 172.21.15.7:0/1034545980 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48006530 con 0x7fdd38003ae0 2023-10-06T10:59:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.565+0000 7fdd54a1f700 1 -- 172.21.15.7:0/1034545980 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd38003ae0 msgr2=0x7fdd38003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.565+0000 7fdd54a1f700 1 --2- 172.21.15.7:0/1034545980 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd38003ae0 0x7fdd38003ef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdd480054a0 tx=0x7fdd48002160 comp rx=0 tx=0).stop 2023-10-06T10:59:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.565+0000 7fdd4ed9d700 1 -- 172.21.15.7:0/1034545980 reap_dead start 2023-10-06T10:59:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.566+0000 7fdd54a1f700 1 -- 172.21.15.7:0/1034545980 shutdown_connections 2023-10-06T10:59:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.566+0000 7fdd54a1f700 1 -- 172.21.15.7:0/1034545980 >> 172.21.15.7:0/1034545980 conn(0x7fdd500c8730 msgr2=0x7fdd500c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.565+0000 7f1ac7d84700 1 -- start start 2023-10-06T10:59:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.566+0000 7fdd54a1f700 1 -- 172.21.15.7:0/1034545980 shutdown_connections 2023-10-06T10:59:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.566+0000 7fdd54a1f700 1 -- 172.21.15.7:0/1034545980 wait complete. 2023-10-06T10:59:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.566+0000 7f1ac7d84700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ac00c7770 0x7f1ac00b1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.566+0000 7f1ac7d84700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ac00c7b40 0x7f1ac0157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.566+0000 7f1ac7d84700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ac015abe0 0x7f1ac0159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.566+0000 7f1ac7d84700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac00b17a0 con 0x7f1ac00c7b40 2023-10-06T10:59:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.566+0000 7f1ac7d84700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac015f1b0 con 0x7f1ac015abe0 2023-10-06T10:59:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.566+0000 7f1ac7d84700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac015f490 con 0x7f1ac00c7770 2023-10-06T10:59:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.566+0000 7f1ac6321700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ac015abe0 0x7f1ac0159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.566+0000 7f1ac6321700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ac015abe0 0x7f1ac0159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:39090/0 (socket says 172.21.15.7:39090) 2023-10-06T10:59:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.566+0000 7f1ac6321700 1 -- 172.21.15.7:0/3691822855 learned_addr learned my addr 172.21.15.7:0/3691822855 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.566+0000 7f1ac531f700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ac00c7b40 0x7f1ac0157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.567+0000 7fb2b8028700 1 -- 172.21.15.7:0/3560038144 shutdown_connections 2023-10-06T10:59:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.567+0000 7f1ac5b20700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ac00c7770 0x7f1ac00b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.567+0000 7f1ac6321700 1 -- 172.21.15.7:0/3691822855 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ac00c7770 msgr2=0x7f1ac00b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.567+0000 7f1ac6321700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ac00c7770 0x7f1ac00b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.567+0000 7f1ac6321700 1 -- 172.21.15.7:0/3691822855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ac00c7b40 msgr2=0x7f1ac0157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.567+0000 7f1ac6321700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ac00c7b40 0x7f1ac0157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.567+0000 7f1ac6321700 1 -- 172.21.15.7:0/3691822855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab8009a20 con 0x7f1ac015abe0 2023-10-06T10:59:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.567+0000 7f1ac531f700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ac00c7b40 0x7f1ac0157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.567+0000 7f1ac6321700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ac015abe0 0x7f1ac0159a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000c560 tx=0x7f1ab0007f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.567+0000 7fb2b8028700 1 -- 172.21.15.7:0/3560038144 wait complete. 2023-10-06T10:59:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.567+0000 7f1ab5ffb700 1 -- 172.21.15.7:0/3691822855 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0005b30 con 0x7f1ac015abe0 2023-10-06T10:59:24.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.567+0000 7f1ab5ffb700 1 -- 172.21.15.7:0/3691822855 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab0005c90 con 0x7f1ac015abe0 2023-10-06T10:59:24.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.567+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3691822855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac015f770 con 0x7f1ac015abe0 2023-10-06T10:59:24.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.567+0000 7f1ab5ffb700 1 -- 172.21.15.7:0/3691822855 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00072e0 con 0x7f1ac015abe0 2023-10-06T10:59:24.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.568+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3691822855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac00c3e40 con 0x7f1ac015abe0 2023-10-06T10:59:24.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.569+0000 7fb2b8028700 1 Processor -- start 2023-10-06T10:59:24.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.568+0000 7fdd54a1f700 1 Processor -- start 2023-10-06T10:59:24.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.569+0000 7fa732a9c700 1 Processor -- start 2023-10-06T10:59:24.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.569+0000 7fa442936700 1 Processor -- start 2023-10-06T10:59:24.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.569+0000 7fa442936700 1 -- start start 2023-10-06T10:59:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.568+0000 7fdd54a1f700 1 -- start start 2023-10-06T10:59:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.569+0000 7fdd54a1f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd38003ae0 0x7fdd50158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.569+0000 7fdd54a1f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd500c33a0 0x7fdd50139dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.569+0000 7fdd54a1f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd500b0300 0x7fdd500b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.569+0000 7fdd54a1f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500b0cb0 con 0x7fdd500c33a0 2023-10-06T10:59:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.569+0000 7fdd54a1f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500c4540 con 0x7fdd500b0300 2023-10-06T10:59:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.569+0000 7fdd54a1f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500c3930 con 0x7fdd38003ae0 2023-10-06T10:59:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fdd4dd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd500c33a0 0x7fdd50139dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fdd4e59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd38003ae0 0x7fdd50158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fdd4dd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd500c33a0 0x7fdd50139dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43336/0 (socket says 172.21.15.7:43336) 2023-10-06T10:59:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fdd4dd9b700 1 -- 172.21.15.7:0/545974417 learned_addr learned my addr 172.21.15.7:0/545974417 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fdd4ed9d700 1 --2- 172.21.15.7:0/545974417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd500b0300 0x7fdd500b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3691822855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ac0070480 con 0x7f1ac015abe0 2023-10-06T10:59:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.569+0000 7fb2b8028700 1 -- start start 2023-10-06T10:59:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fb2b8028700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b00c1440 0x7fb2b016e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fb2b8028700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b00ca510 0x7fb2b013cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fb2b8028700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2b00ca8e0 0x7fb2b0143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fb2b8028700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b016e830 con 0x7fb2b00ca510 2023-10-06T10:59:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fb2b8028700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00b1a40 con 0x7fb2b00c1440 2023-10-06T10:59:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fb2b8028700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0171600 con 0x7fb2b00ca8e0 2023-10-06T10:59:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fb2b55c3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b00ca510 0x7fb2b013cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fb2b55c3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b00ca510 0x7fb2b013cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43338/0 (socket says 172.21.15.7:43338) 2023-10-06T10:59:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fb2b55c3700 1 -- 172.21.15.7:0/1195959701 learned_addr learned my addr 172.21.15.7:0/1195959701 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fdd4e59c700 1 -- 172.21.15.7:0/545974417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd500b0300 msgr2=0x7fdd500b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fdd4e59c700 1 --2- 172.21.15.7:0/545974417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd500b0300 0x7fdd500b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fdd4e59c700 1 -- 172.21.15.7:0/545974417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd500c33a0 msgr2=0x7fdd50139dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fdd4e59c700 1 --2- 172.21.15.7:0/545974417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd500c33a0 0x7fdd50139dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fdd4e59c700 1 -- 172.21.15.7:0/545974417 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd500c3c10 con 0x7fdd38003ae0 2023-10-06T10:59:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.570+0000 7fdd4e59c700 1 --2- 172.21.15.7:0/545974417 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd38003ae0 0x7fdd50158030 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd48005470 tx=0x7fdd48016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.569+0000 7fa732a9c700 1 -- start start 2023-10-06T10:59:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fa732a9c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa72c159000 0x7fa72c0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fa732a9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa72c13b2d0 0x7fa72c13b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fa732a9c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72c13bc50 con 0x7fa72c1593d0 2023-10-06T10:59:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fa732a9c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72c067290 con 0x7fa72c159000 2023-10-06T10:59:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fa732a9c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72c067570 con 0x7fa72c13b2d0 2023-10-06T10:59:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fdd3e7fc700 1 -- 172.21.15.7:0/545974417 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd480017f0 con 0x7fdd38003ae0 2023-10-06T10:59:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fb2b5dc4700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b00c1440 0x7fb2b016e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fb2b65c5700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2b00ca8e0 0x7fb2b0143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fb2b55c3700 1 -- 172.21.15.7:0/1195959701 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2b00ca8e0 msgr2=0x7fb2b0143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fb2b55c3700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2b00ca8e0 0x7fb2b0143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fb2b55c3700 1 -- 172.21.15.7:0/1195959701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b00c1440 msgr2=0x7fb2b016e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fb2b55c3700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b00c1440 0x7fb2b016e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fb2b55c3700 1 -- 172.21.15.7:0/1195959701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a8009ae0 con 0x7fb2b00ca510 2023-10-06T10:59:24.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fdd3e7fc700 1 -- 172.21.15.7:0/545974417 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd48000f40 con 0x7fdd38003ae0 2023-10-06T10:59:24.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fdd3e7fc700 1 -- 172.21.15.7:0/545974417 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48020420 con 0x7fdd38003ae0 2023-10-06T10:59:24.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fb2b5dc4700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b00c1440 0x7fb2b016e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:24.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fa730838700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa72c159000 0x7fa72c0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fa730838700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa72c159000 0x7fa72c0c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43344/0 (socket says 172.21.15.7:43344) 2023-10-06T10:59:24.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fa730838700 1 -- 172.21.15.7:0/3603496702 learned_addr learned my addr 172.21.15.7:0/3603496702 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.571+0000 7fdc02957700 1 Processor -- start 2023-10-06T10:59:24.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fdc02957700 1 -- start start 2023-10-06T10:59:24.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fa730838700 1 -- 172.21.15.7:0/3603496702 >> v2:172.21.15.50:3300/0 conn(0x7fa72c13b2d0 msgr2=0x7fa72c13b710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T10:59:24.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fa730838700 1 --2- 172.21.15.7:0/3603496702 >> v2:172.21.15.50:3300/0 conn(0x7fa72c13b2d0 0x7fa72c13b710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fa730838700 1 -- 172.21.15.7:0/3603496702 >> v1:172.21.15.50:6789/0 conn(0x7fa72c1593d0 legacy=0x7fa72c06be40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T10:59:24.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fa730838700 1 -- 172.21.15.7:0/3603496702 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c067850 con 0x7fa72c159000 2023-10-06T10:59:24.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fdd54a1f700 1 -- 172.21.15.7:0/545974417 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd500c3ef0 con 0x7fdd38003ae0 2023-10-06T10:59:24.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fa442936700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa43c0ac8d0 0x7fa43c0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fa442936700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa43c0cd2e0 0x7fa43c0aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fa442936700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43c069110 con 0x7fa43c0aa870 2023-10-06T10:59:24.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fa442936700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c0acca0 con 0x7fa43c0ac8d0 2023-10-06T10:59:24.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fa442936700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c068b30 con 0x7fa43c0cd2e0 2023-10-06T10:59:24.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fa43b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa43c0cd2e0 0x7fa43c0aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fa43b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa43c0cd2e0 0x7fa43c0aa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:34948/0 (socket says 172.21.15.7:34948) 2023-10-06T10:59:24.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fa43b7fe700 1 -- 172.21.15.7:0/1334351287 learned_addr learned my addr 172.21.15.7:0/1334351287 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.572+0000 7fdd54a1f700 1 -- 172.21.15.7:0/545974417 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5013a310 con 0x7fdd38003ae0 2023-10-06T10:59:24.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fa43b7fe700 1 -- 172.21.15.7:0/1334351287 >> v2:172.21.15.7:3300/0 conn(0x7fa43c0ac8d0 msgr2=0x7fa43c0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fa43b7fe700 1 --2- 172.21.15.7:0/1334351287 >> v2:172.21.15.7:3300/0 conn(0x7fa43c0ac8d0 0x7fa43c0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fa43b7fe700 1 -- 172.21.15.7:0/1334351287 >> v1:172.21.15.50:6789/0 conn(0x7fa43c0aa870 legacy=0x7fa43c155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fa43b7fe700 1 -- 172.21.15.7:0/1334351287 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c15cf50 con 0x7fa43c0cd2e0 2023-10-06T10:59:24.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fa43b7fe700 1 --2- 172.21.15.7:0/1334351287 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa43c0cd2e0 0x7fa43c0aa330 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa4300099e0 tx=0x7fa430009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bbd89f24261b82d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fdc02957700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdbfc0ac750 0x7fdbfc0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fdc02957700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdbfc0cd250 0x7fdbfc067980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fdc02957700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbfc15aa90 con 0x7fdbfc0ca350 2023-10-06T10:59:24.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fdc02957700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc0c87f0 con 0x7fdbfc0cd250 2023-10-06T10:59:24.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fdc02957700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc150b40 con 0x7fdbfc0ac750 2023-10-06T10:59:24.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fdc00ef4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdbfc0cd250 0x7fdbfc067980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fdc00ef4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdbfc0cd250 0x7fdbfc067980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43364/0 (socket says 172.21.15.7:43364) 2023-10-06T10:59:24.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fdc00ef4700 1 -- 172.21.15.7:0/1133556348 learned_addr learned my addr 172.21.15.7:0/1133556348 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fdd54a1f700 1 -- 172.21.15.7:0/545974417 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd50070480 con 0x7fdd38003ae0 2023-10-06T10:59:24.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fb2b55c3700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b00ca510 0x7fb2b013cef0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000b610 tx=0x7fb2a00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fdbfb7fe700 1 --2- 172.21.15.7:0/1133556348 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdbfc0ac750 0x7fdbfc0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fa43affd700 1 -- 172.21.15.7:0/1334351287 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43000b8b0 con 0x7fa43c0cd2e0 2023-10-06T10:59:24.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fa43affd700 1 -- 172.21.15.7:0/1334351287 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43000ba10 con 0x7fa43c0cd2e0 2023-10-06T10:59:24.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fa43affd700 1 -- 172.21.15.7:0/1334351287 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43000bdb0 con 0x7fa43c0cd2e0 2023-10-06T10:59:24.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 -- 172.21.15.7:0/1133556348 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486806761 0 0) 0x7fdbfc15aa90 con 0x7fdbfc0ca350 2023-10-06T10:59:24.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 -- 172.21.15.7:0/1133556348 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbe4003570 con 0x7fdbfc0ca350 2023-10-06T10:59:24.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 -- 172.21.15.7:0/1133556348 <== mon.1 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 961012156 0 0) 0x7fdbe4003570 con 0x7fdbfc0ca350 2023-10-06T10:59:24.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 -- 172.21.15.7:0/1133556348 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdbfc0ac750 msgr2=0x7fdbfc0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 --2- 172.21.15.7:0/1133556348 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdbfc0ac750 0x7fdbfc0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 -- 172.21.15.7:0/1133556348 >> v2:172.21.15.7:3300/0 conn(0x7fdbfc0cd250 msgr2=0x7fdbfc067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 --2- 172.21.15.7:0/1133556348 >> v2:172.21.15.7:3300/0 conn(0x7fdbfc0cd250 0x7fdbfc067980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 -- 172.21.15.7:0/1133556348 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc0cd6b0 con 0x7fdbfc0ca350 2023-10-06T10:59:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 -- 172.21.15.7:0/1133556348 <== mon.1 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7fdbf40017f0 con 0x7fdbfc0ca350 2023-10-06T10:59:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 -- 172.21.15.7:0/1133556348 >> v1:172.21.15.50:6789/0 conn(0x7fdbfc0ca350 legacy=0x7fdbfc157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fa442936700 1 -- 172.21.15.7:0/1334351287 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa43c0cd2e0 msgr2=0x7fa43c0aa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fa442936700 1 --2- 172.21.15.7:0/1334351287 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa43c0cd2e0 0x7fa43c0aa330 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa4300099e0 tx=0x7fa430009250 comp rx=0 tx=0).stop 2023-10-06T10:59:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7fa730838700 1 --2- 172.21.15.7:0/3603496702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa72c159000 0x7fa72c0c6300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0c8670 tx=0x7fa724007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449153ec2ff55326 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.575+0000 7fa442936700 1 -- 172.21.15.7:0/1334351287 shutdown_connections 2023-10-06T10:59:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.575+0000 7fa442936700 1 --2- 172.21.15.7:0/1334351287 >> v2:172.21.15.7:3300/0 conn(0x7fa43c0ac8d0 0x7fa43c0ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.575+0000 7fa442936700 1 --2- 172.21.15.7:0/1334351287 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa43c0cd2e0 0x7fa43c0aa330 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.575+0000 7fa442936700 1 -- 172.21.15.7:0/1334351287 >> 172.21.15.7:0/1334351287 conn(0x7fa43c096160 msgr2=0x7fa43c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 --2- 172.21.15.7:0/1133556348 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdbe4003a60 0x7fdbe4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 --2- 172.21.15.7:0/1133556348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbe4004810 0x7fdbe4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 --2- 172.21.15.7:0/1133556348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbe40051c0 0x7fdbe400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 -- 172.21.15.7:0/1133556348 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc150b40 con 0x7fdbe4004810 2023-10-06T10:59:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 -- 172.21.15.7:0/1133556348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe400bfa0 con 0x7fdbe40051c0 2023-10-06T10:59:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7fdbfaffd700 1 -- 172.21.15.7:0/1133556348 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe400c0e0 con 0x7fdbe4003a60 2023-10-06T10:59:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.575+0000 7fdc00ef4700 1 --2- 172.21.15.7:0/1133556348 >> v2:172.21.15.7:3300/0 conn(0x7fdbfc0cd250 0x7fdbfc067980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:59:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.575+0000 7fdc00ef4700 1 --2- 172.21.15.7:0/1133556348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbe40051c0 0x7fdbe400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.575+0000 7fa72b7fe700 1 -- 172.21.15.7:0/3603496702 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724010070 con 0x7fa72c159000 2023-10-06T10:59:24.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.575+0000 7fa72b7fe700 1 -- 172.21.15.7:0/3603496702 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72400dc40 con 0x7fa72c159000 2023-10-06T10:59:24.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.575+0000 7fdbfb7fe700 1 --2- 172.21.15.7:0/1133556348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbe4004810 0x7fdbe4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.573+0000 7f1ab5ffb700 1 -- 172.21.15.7:0/3691822855 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ab0007690 con 0x7f1ac015abe0 2023-10-06T10:59:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7f1ab5ffb700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1aa4067080 0x7f1aa4069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7f1ab5ffb700 1 -- 172.21.15.7:0/3691822855 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1ab0084550 con 0x7f1ac015abe0 2023-10-06T10:59:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7f1ac5b20700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1aa4067080 0x7f1aa4069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7f1ab5ffb700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.7:6817/119715,v1:172.21.15.7:6819/119715] conn(0x7f1aa4070d50 0x7f1aa4073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7f1ab5ffb700 1 -- 172.21.15.7:0/3691822855 --> [v2:172.21.15.7:6817/119715,v1:172.21.15.7:6819/119715] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1aa4073850 con 0x7f1aa4070d50 2023-10-06T10:59:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.574+0000 7f1ab5ffb700 1 -- 172.21.15.7:0/3691822855 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ab0084880 con 0x7f1ac015abe0 2023-10-06T10:59:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.575+0000 7f1ac5b20700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1aa4067080 0x7f1aa4069530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80097c0 tx=0x7f1ab8019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdc00ef4700 1 -- 172.21.15.7:0/1133556348 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdbe4003a60 msgr2=0x7fdbe4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdc00ef4700 1 --2- 172.21.15.7:0/1133556348 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdbe4003a60 0x7fdbe4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdc00ef4700 1 -- 172.21.15.7:0/1133556348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbe4004810 msgr2=0x7fdbe4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdc00ef4700 1 --2- 172.21.15.7:0/1133556348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbe4004810 0x7fdbe4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdc00ef4700 1 -- 172.21.15.7:0/1133556348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe4003570 con 0x7fdbe40051c0 2023-10-06T10:59:24.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdd3e7fc700 1 -- 172.21.15.7:0/545974417 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd48020790 con 0x7fdd38003ae0 2023-10-06T10:59:24.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdc00ef4700 1 --2- 172.21.15.7:0/1133556348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbe40051c0 0x7fdbe400ba60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdbec015a90 tx=0x7fdbec00fa80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=398096556c19f37f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fa442936700 1 -- 172.21.15.7:0/1334351287 shutdown_connections 2023-10-06T10:59:24.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdbfaffd700 1 -- 172.21.15.7:0/1133556348 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec01a070 con 0x7fdbe40051c0 2023-10-06T10:59:24.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdbfaffd700 1 -- 172.21.15.7:0/1133556348 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec014880 con 0x7fdbe40051c0 2023-10-06T10:59:24.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdbfaffd700 1 -- 172.21.15.7:0/1133556348 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec014c00 con 0x7fdbe40051c0 2023-10-06T10:59:24.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.575+0000 7fa72b7fe700 1 -- 172.21.15.7:0/3603496702 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724007b40 con 0x7fa72c159000 2023-10-06T10:59:24.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fa732a9c700 1 -- 172.21.15.7:0/3603496702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa72c159000 msgr2=0x7fa72c0c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fa732a9c700 1 --2- 172.21.15.7:0/3603496702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa72c159000 0x7fa72c0c6300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0c8670 tx=0x7fa724007690 comp rx=0 tx=0).stop 2023-10-06T10:59:24.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.577+0000 7fa732a9c700 1 -- 172.21.15.7:0/3603496702 shutdown_connections 2023-10-06T10:59:24.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.577+0000 7fa732a9c700 1 --2- 172.21.15.7:0/3603496702 >> v2:172.21.15.50:3300/0 conn(0x7fa72c13b2d0 0x7fa72c13b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.577+0000 7fa732a9c700 1 --2- 172.21.15.7:0/3603496702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa72c159000 0x7fa72c0c6300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.577+0000 7fa732a9c700 1 -- 172.21.15.7:0/3603496702 >> 172.21.15.7:0/3603496702 conn(0x7fa72c0c8730 msgr2=0x7fa72c0c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.577+0000 7fa732a9c700 1 -- 172.21.15.7:0/3603496702 shutdown_connections 2023-10-06T10:59:24.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fa442936700 1 -- 172.21.15.7:0/1334351287 wait complete. 2023-10-06T10:59:24.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.578+0000 7fa442936700 1 Processor -- start 2023-10-06T10:59:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.578+0000 7efc93028700 1 Processor -- start 2023-10-06T10:59:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdd3e7fc700 1 --2- 172.21.15.7:0/545974417 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdd30067080 0x7fdd30069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdd3e7fc700 1 -- 172.21.15.7:0/545974417 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdd480872d0 con 0x7fdd38003ae0 2023-10-06T10:59:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdd3e7fc700 1 --2- 172.21.15.7:0/545974417 >> [v2:172.21.15.50:6824/120011,v1:172.21.15.50:6825/120011] conn(0x7fdd30070d50 0x7fdd30073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdd3e7fc700 1 -- 172.21.15.7:0/545974417 --> [v2:172.21.15.50:6824/120011,v1:172.21.15.50:6825/120011] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd30073850 con 0x7fdd30070d50 2023-10-06T10:59:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.576+0000 7fdd3e7fc700 1 -- 172.21.15.7:0/545974417 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd48087600 con 0x7fdd38003ae0 2023-10-06T10:59:24.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.577+0000 7fa732a9c700 1 -- 172.21.15.7:0/3603496702 wait complete. 2023-10-06T10:59:24.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.578+0000 7fa732a9c700 1 Processor -- start 2023-10-06T10:59:24.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.578+0000 7f1ac531f700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.7:6817/119715,v1:172.21.15.7:6819/119715] conn(0x7f1aa4070d50 0x7f1aa4073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.579+0000 7fdd4dd9b700 1 --2- 172.21.15.7:0/545974417 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdd30067080 0x7fdd30069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.579+0000 7f1ac531f700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.7:6817/119715,v1:172.21.15.7:6819/119715] conn(0x7f1aa4070d50 0x7f1aa4073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.579+0000 7fb2a5ffb700 1 -- 172.21.15.7:0/1195959701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a000f510 con 0x7fb2b00ca510 2023-10-06T10:59:24.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.580+0000 7f1ab5ffb700 1 -- 172.21.15.7:0/3691822855 <== osd.0 v2:172.21.15.7:6817/119715 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1aa4073850 con 0x7f1aa4070d50 2023-10-06T10:59:24.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.580+0000 7fdd4dd9b700 1 --2- 172.21.15.7:0/545974417 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdd30067080 0x7fdd30069530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdd500c2e20 tx=0x7fdd44009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.579+0000 7fb2a5ffb700 1 -- 172.21.15.7:0/1195959701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a000f690 con 0x7fb2b00ca510 2023-10-06T10:59:24.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.579+0000 7fb2a5ffb700 1 -- 172.21.15.7:0/1195959701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a000fa50 con 0x7fb2b00ca510 2023-10-06T10:59:24.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.579+0000 7fb2b8028700 1 -- 172.21.15.7:0/1195959701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b013d430 con 0x7fb2b00ca510 2023-10-06T10:59:24.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.580+0000 7fb2b8028700 1 -- 172.21.15.7:0/1195959701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b0170fb0 con 0x7fb2b00ca510 2023-10-06T10:59:24.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.578+0000 7efc93028700 1 -- start start 2023-10-06T10:59:24.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.579+0000 7efc93028700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efc8c0cbfe0 0x7efc8c15d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.579+0000 7efc93028700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc8c0ae000 0x7efc8c06e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.579+0000 7efc93028700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8c1615e0 con 0x7efc8c15d240 2023-10-06T10:59:24.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.579+0000 7efc93028700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8c162180 con 0x7efc8c0cbfe0 2023-10-06T10:59:24.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.579+0000 7efc93028700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8c0cbc70 con 0x7efc8c0ae000 2023-10-06T10:59:24.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.580+0000 7efc915c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc8c0ae000 0x7efc8c06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.580+0000 7efc915c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc8c0ae000 0x7efc8c06e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:39118/0 (socket says 172.21.15.7:39118) 2023-10-06T10:59:24.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.580+0000 7efc915c5700 1 -- 172.21.15.7:0/4077036426 learned_addr learned my addr 172.21.15.7:0/4077036426 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.580+0000 7efc915c5700 1 -- 172.21.15.7:0/4077036426 >> v2:172.21.15.7:3300/0 conn(0x7efc8c0cbfe0 msgr2=0x7efc8c15d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.580+0000 7efc915c5700 1 --2- 172.21.15.7:0/4077036426 >> v2:172.21.15.7:3300/0 conn(0x7efc8c0cbfe0 0x7efc8c15d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.580+0000 7efc915c5700 1 -- 172.21.15.7:0/4077036426 >> v1:172.21.15.50:6789/0 conn(0x7efc8c15d240 legacy=0x7efc8c161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.580+0000 7efc915c5700 1 -- 172.21.15.7:0/4077036426 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c0ae790 con 0x7efc8c0ae000 2023-10-06T10:59:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.580+0000 7efc915c5700 1 --2- 172.21.15.7:0/4077036426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc8c0ae000 0x7efc8c06e910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0ccfd0 tx=0x7efc84009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dc453b0d1958d6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.581+0000 7efc837fe700 1 -- 172.21.15.7:0/4077036426 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8400b820 con 0x7efc8c0ae000 2023-10-06T10:59:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.581+0000 7efc837fe700 1 -- 172.21.15.7:0/4077036426 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8400b980 con 0x7efc8c0ae000 2023-10-06T10:59:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.581+0000 7efc837fe700 1 -- 172.21.15.7:0/4077036426 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8400bd20 con 0x7efc8c0ae000 2023-10-06T10:59:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7efc93028700 1 -- 172.21.15.7:0/4077036426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc8c0ae000 msgr2=0x7efc8c06e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7efc93028700 1 --2- 172.21.15.7:0/4077036426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc8c0ae000 0x7efc8c06e910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0ccfd0 tx=0x7efc84009250 comp rx=0 tx=0).stop 2023-10-06T10:59:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7efc93028700 1 -- 172.21.15.7:0/4077036426 shutdown_connections 2023-10-06T10:59:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7efc93028700 1 --2- 172.21.15.7:0/4077036426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc8c0ae000 0x7efc8c06e910 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7efc93028700 1 --2- 172.21.15.7:0/4077036426 >> v2:172.21.15.7:3300/0 conn(0x7efc8c0cbfe0 0x7efc8c15d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7efc93028700 1 -- 172.21.15.7:0/4077036426 >> 172.21.15.7:0/4077036426 conn(0x7efc8c095a70 msgr2=0x7efc8c0cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.581+0000 7fa732a9c700 1 -- start start 2023-10-06T10:59:24.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7fa732a9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa72c13b2d0 0x7fa72c0c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7fa732a9c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa72c159000 0x7fa72c14e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7fa732a9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa72c1593d0 0x7fa72c0acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7fa732a9c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c16de30 con 0x7fa72c159000 2023-10-06T10:59:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7fa732a9c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c16e110 con 0x7fa72c13b2d0 2023-10-06T10:59:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7fa732a9c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c16e3f0 con 0x7fa72c1593d0 2023-10-06T10:59:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7fa730838700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa72c13b2d0 0x7fa72c0c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7fa730838700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa72c13b2d0 0x7fa72c0c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:39132/0 (socket says 172.21.15.7:39132) 2023-10-06T10:59:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7fa730838700 1 -- 172.21.15.7:0/449618241 learned_addr learned my addr 172.21.15.7:0/449618241 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7fa731039700 1 --2- 172.21.15.7:0/449618241 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa72c1593d0 0x7fa72c0acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.583+0000 7efc93028700 1 -- 172.21.15.7:0/4077036426 shutdown_connections 2023-10-06T10:59:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.583+0000 7efc93028700 1 -- 172.21.15.7:0/4077036426 wait complete. 2023-10-06T10:59:24.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.583+0000 7fa72bfff700 1 --2- 172.21.15.7:0/449618241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa72c159000 0x7fa72c14e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.582+0000 7fdd4ed9d700 1 --2- 172.21.15.7:0/545974417 >> [v2:172.21.15.50:6824/120011,v1:172.21.15.50:6825/120011] conn(0x7fdd30070d50 0x7fdd30073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.583+0000 7fa730838700 1 -- 172.21.15.7:0/449618241 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa72c1593d0 msgr2=0x7fa72c0acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.583+0000 7fa730838700 1 --2- 172.21.15.7:0/449618241 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa72c1593d0 0x7fa72c0acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.583+0000 7fa730838700 1 -- 172.21.15.7:0/449618241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa72c159000 msgr2=0x7fa72c14e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.583+0000 7fa730838700 1 --2- 172.21.15.7:0/449618241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa72c159000 0x7fa72c14e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.583+0000 7fa730838700 1 -- 172.21.15.7:0/449618241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72400be70 con 0x7fa72c13b2d0 2023-10-06T10:59:24.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.583+0000 7fb2b8028700 1 -- 172.21.15.7:0/1195959701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb290000fd0 con 0x7fb2b00ca510 2023-10-06T10:59:24.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.583+0000 7fa730838700 1 --2- 172.21.15.7:0/449618241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa72c13b2d0 0x7fa72c0c6cb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7240076d0 tx=0x7fa72401a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.583+0000 7fa728ff9700 1 -- 172.21.15.7:0/449618241 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724020460 con 0x7fa72c13b2d0 2023-10-06T10:59:24.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.583+0000 7fa728ff9700 1 -- 172.21.15.7:0/449618241 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa724020600 con 0x7fa72c13b2d0 2023-10-06T10:59:24.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.583+0000 7fa728ff9700 1 -- 172.21.15.7:0/449618241 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7240209c0 con 0x7fa72c13b2d0 2023-10-06T10:59:24.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.584+0000 7fa732a9c700 1 -- 172.21.15.7:0/449618241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72c16e6d0 con 0x7fa72c13b2d0 2023-10-06T10:59:24.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.584+0000 7fa732a9c700 1 -- 172.21.15.7:0/449618241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72c16db40 con 0x7fa72c13b2d0 2023-10-06T10:59:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.583+0000 7fa442936700 1 -- start start 2023-10-06T10:59:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.584+0000 7fa442936700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa43c0aa870 0x7fa43c156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.584+0000 7fa442936700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa43c0ac8d0 0x7fa43c146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.584+0000 7fa442936700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43c0cd2e0 0x7fa43c0695a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.584+0000 7fa442936700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c146e90 con 0x7fa43c0cd2e0 2023-10-06T10:59:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.584+0000 7fa442936700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c145fd0 con 0x7fa43c0ac8d0 2023-10-06T10:59:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.584+0000 7fa442936700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c1456a0 con 0x7fa43c0aa870 2023-10-06T10:59:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7fa43b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa43c0ac8d0 0x7fa43c146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7fa43b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa43c0ac8d0 0x7fa43c146950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:39138/0 (socket says 172.21.15.7:39138) 2023-10-06T10:59:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7fa43b7fe700 1 -- 172.21.15.7:0/4101592694 learned_addr learned my addr 172.21.15.7:0/4101592694 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7efc93028700 1 Processor -- start 2023-10-06T10:59:24.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7fa440ed3700 1 --2- 172.21.15.7:0/4101592694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43c0cd2e0 0x7fa43c0695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7fa43b7fe700 1 -- 172.21.15.7:0/4101592694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa43c0aa870 msgr2=0x7fa43c156380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T10:59:24.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7fa43b7fe700 1 --2- 172.21.15.7:0/4101592694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa43c0aa870 0x7fa43c156380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7fa43b7fe700 1 -- 172.21.15.7:0/4101592694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43c0cd2e0 msgr2=0x7fa43c0695a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7fa43b7fe700 1 --2- 172.21.15.7:0/4101592694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43c0cd2e0 0x7fa43c0695a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7fa43b7fe700 1 -- 172.21.15.7:0/4101592694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4300094f0 con 0x7fa43c0ac8d0 2023-10-06T10:59:24.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.586+0000 7fa43b7fe700 1 --2- 172.21.15.7:0/4101592694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa43c0ac8d0 0x7fa43c146950 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa430009290 tx=0x7fa430017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7efc93028700 1 -- start start 2023-10-06T10:59:24.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.586+0000 7fa728ff9700 1 -- 172.21.15.7:0/449618241 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa724016440 con 0x7fa72c13b2d0 2023-10-06T10:59:24.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.586+0000 7fa728ff9700 1 --2- 172.21.15.7:0/449618241 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa718066f30 0x7fa7180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.586+0000 7fa728ff9700 1 -- 172.21.15.7:0/449618241 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa724085ea0 con 0x7fa72c13b2d0 2023-10-06T10:59:24.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.584+0000 7fb2a5ffb700 1 -- 172.21.15.7:0/1195959701 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2a001a400 con 0x7fb2b00ca510 2023-10-06T10:59:24.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7fb2a5ffb700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb294067080 0x7fb294069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7fb2a5ffb700 1 -- 172.21.15.7:0/1195959701 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb2a0084450 con 0x7fb2b00ca510 2023-10-06T10:59:24.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7fb2a5ffb700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.7:6808/119716,v1:172.21.15.7:6809/119716] conn(0x7fb294070cd0 0x7fb294073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.585+0000 7fb2a5ffb700 1 -- 172.21.15.7:0/1195959701 --> [v2:172.21.15.7:6808/119716,v1:172.21.15.7:6809/119716] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2940737d0 con 0x7fb294070cd0 2023-10-06T10:59:24.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.586+0000 7fb2b5dc4700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb294067080 0x7fb294069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7fb2b5dc4700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb294067080 0x7fb294069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac002880 tx=0x7fb2ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.586+0000 7efc93028700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efc8c0ae000 0x7efc8c15c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7efc93028700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc8c0cbfe0 0x7efc8c0aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7efc93028700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc8c15d240 0x7efc8c0a7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7efc93028700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0ab660 con 0x7efc8c15d240 2023-10-06T10:59:24.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7efc93028700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0a7640 con 0x7efc8c0cbfe0 2023-10-06T10:59:24.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7efc93028700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0ab0a0 con 0x7efc8c0ae000 2023-10-06T10:59:24.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.586+0000 7fa423fff700 1 -- 172.21.15.7:0/4101592694 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430026480 con 0x7fa43c0ac8d0 2023-10-06T10:59:24.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.586+0000 7fa423fff700 1 -- 172.21.15.7:0/4101592694 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43001f070 con 0x7fa43c0ac8d0 2023-10-06T10:59:24.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.586+0000 7fa423fff700 1 -- 172.21.15.7:0/4101592694 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430026830 con 0x7fa43c0ac8d0 2023-10-06T10:59:24.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7fdd4ed9d700 1 --2- 172.21.15.7:0/545974417 >> [v2:172.21.15.50:6824/120011,v1:172.21.15.50:6825/120011] conn(0x7fdd30070d50 0x7fdd30073180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7efc90dc4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efc8c0ae000 0x7efc8c15c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7fa72bfff700 1 --2- 172.21.15.7:0/449618241 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa718066f30 0x7fa7180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7efc90dc4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efc8c0ae000 0x7efc8c15c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:34988/0 (socket says 172.21.15.7:34988) 2023-10-06T10:59:24.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7efc90dc4700 1 -- 172.21.15.7:0/2151350801 learned_addr learned my addr 172.21.15.7:0/2151350801 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7efc83fff700 1 --2- 172.21.15.7:0/2151350801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc8c0cbfe0 0x7efc8c0aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7efc90dc4700 1 -- 172.21.15.7:0/2151350801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc8c0cbfe0 msgr2=0x7efc8c0aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7efc90dc4700 1 --2- 172.21.15.7:0/2151350801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc8c0cbfe0 0x7efc8c0aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7efc90dc4700 1 -- 172.21.15.7:0/2151350801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc8c15d240 msgr2=0x7efc8c0a7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7efc90dc4700 1 --2- 172.21.15.7:0/2151350801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc8c15d240 0x7efc8c0a7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7efc90dc4700 1 -- 172.21.15.7:0/2151350801 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc840094f0 con 0x7efc8c0ae000 2023-10-06T10:59:24.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.588+0000 7fa72bfff700 1 --2- 172.21.15.7:0/449618241 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa718066f30 0x7fa7180693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa71c006fd0 tx=0x7fa71c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.588+0000 7efc90dc4700 1 --2- 172.21.15.7:0/2151350801 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efc8c0ae000 0x7efc8c15c990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efc8800c980 tx=0x7efc88002760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.588+0000 7fdc02957700 1 -- 172.21.15.7:0/1133556348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbe40051c0 msgr2=0x7fdbe400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.588+0000 7fdc02957700 1 --2- 172.21.15.7:0/1133556348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbe40051c0 0x7fdbe400ba60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdbec015a90 tx=0x7fdbec00fa80 comp rx=0 tx=0).stop 2023-10-06T10:59:24.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.588+0000 7fdc00ef4700 1 -- 172.21.15.7:0/1133556348 reap_dead start 2023-10-06T10:59:24.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.588+0000 7fdc02957700 1 -- 172.21.15.7:0/1133556348 shutdown_connections 2023-10-06T10:59:24.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.588+0000 7fdc02957700 1 -- 172.21.15.7:0/1133556348 >> 172.21.15.7:0/1133556348 conn(0x7fdbfc0633b0 msgr2=0x7fdbfc06f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7fa442936700 1 -- 172.21.15.7:0/4101592694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c145980 con 0x7fa43c0ac8d0 2023-10-06T10:59:24.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.587+0000 7fa442936700 1 -- 172.21.15.7:0/4101592694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c146460 con 0x7fa43c0ac8d0 2023-10-06T10:59:24.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.588+0000 7fdd3e7fc700 1 -- 172.21.15.7:0/545974417 <== osd.7 v2:172.21.15.50:6824/120011 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fdd30073850 con 0x7fdd30070d50 2023-10-06T10:59:24.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.588+0000 7fa442936700 1 -- 172.21.15.7:0/4101592694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa43c070480 con 0x7fa43c0ac8d0 2023-10-06T10:59:24.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.588+0000 7fdc02957700 1 -- 172.21.15.7:0/1133556348 shutdown_connections 2023-10-06T10:59:24.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.588+0000 7efc80ff9700 1 -- 172.21.15.7:0/2151350801 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8800a7a0 con 0x7efc8c0ae000 2023-10-06T10:59:24.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.589+0000 7efc80ff9700 1 -- 172.21.15.7:0/2151350801 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8800a900 con 0x7efc8c0ae000 2023-10-06T10:59:24.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.589+0000 7efc80ff9700 1 -- 172.21.15.7:0/2151350801 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8800acc0 con 0x7efc8c0ae000 2023-10-06T10:59:24.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.590+0000 7fb2b65c5700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.7:6808/119716,v1:172.21.15.7:6809/119716] conn(0x7fb294070cd0 0x7fb294073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.588+0000 7fdc02957700 1 -- 172.21.15.7:0/1133556348 wait complete. 2023-10-06T10:59:24.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.590+0000 7fb2b65c5700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.7:6808/119716,v1:172.21.15.7:6809/119716] conn(0x7fb294070cd0 0x7fb294073100 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.590+0000 7efc93028700 1 -- 172.21.15.7:0/2151350801 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc8c0ab380 con 0x7efc8c0ae000 2023-10-06T10:59:24.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.590+0000 7efc93028700 1 -- 172.21.15.7:0/2151350801 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8c15ced0 con 0x7efc8c0ae000 2023-10-06T10:59:24.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.590+0000 7fdc02957700 1 Processor -- start 2023-10-06T10:59:24.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.591+0000 7fb2a5ffb700 1 -- 172.21.15.7:0/1195959701 <== osd.1 v2:172.21.15.7:6808/119716 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb2940737d0 con 0x7fb294070cd0 2023-10-06T10:59:24.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.592+0000 7f1a98096700 1 Processor -- start 2023-10-06T10:59:24.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.593+0000 7f1a98096700 1 -- start start 2023-10-06T10:59:24.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.592+0000 7fdc02957700 1 -- start start 2023-10-06T10:59:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.593+0000 7fdc02957700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbfc14c5d0 0x7fdbfc0c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.593+0000 7fdc02957700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdbfc14c9a0 0x7fdbfc0c0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.593+0000 7fdc02957700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbfc0c08b0 0x7fdbfc0c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.593+0000 7fdc02957700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0c6d20 con 0x7fdbfc0c08b0 2023-10-06T10:59:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.593+0000 7fdc02957700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0c5190 con 0x7fdbfc14c5d0 2023-10-06T10:59:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.593+0000 7fdc02957700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0c4860 con 0x7fdbfc14c9a0 2023-10-06T10:59:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.593+0000 7efc80ff9700 1 -- 172.21.15.7:0/2151350801 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc88012630 con 0x7efc8c0ae000 2023-10-06T10:59:24.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7fdc00ef4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbfc0c08b0 0x7fdbfc0c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7fdc00ef4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbfc0c08b0 0x7fdbfc0c0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43418/0 (socket says 172.21.15.7:43418) 2023-10-06T10:59:24.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7fdc00ef4700 1 -- 172.21.15.7:0/668192392 learned_addr learned my addr 172.21.15.7:0/668192392 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7f1a98096700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1a900aaa40 0x7f1a900cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7f1a98096700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1a900ac8d0 0x7f1a90155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7f1a98096700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a90069110 con 0x7f1a900ccda0 2023-10-06T10:59:24.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7f1a98096700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a90068b30 con 0x7f1a900ac8d0 2023-10-06T10:59:24.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7f1a98096700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a900aafb0 con 0x7f1a900aaa40 2023-10-06T10:59:24.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7efc80ff9700 1 --2- 172.21.15.7:0/2151350801 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efc78067080 0x7efc78069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7f1a96633700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1a900ac8d0 0x7f1a90155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7f1a96633700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1a900ac8d0 0x7f1a90155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43432/0 (socket says 172.21.15.7:43432) 2023-10-06T10:59:24.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7f1a96633700 1 -- 172.21.15.7:0/2724751379 learned_addr learned my addr 172.21.15.7:0/2724751379 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7fdc00ef4700 1 -- 172.21.15.7:0/668192392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdbfc14c9a0 msgr2=0x7fdbfc0c0370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T10:59:24.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7fdc00ef4700 1 --2- 172.21.15.7:0/668192392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdbfc14c9a0 0x7fdbfc0c0370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7fdc00ef4700 1 -- 172.21.15.7:0/668192392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbfc14c5d0 msgr2=0x7fdbfc0c67e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T10:59:24.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7fdc00ef4700 1 --2- 172.21.15.7:0/668192392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbfc14c5d0 0x7fdbfc0c67e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7fdc00ef4700 1 -- 172.21.15.7:0/668192392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc0c4b40 con 0x7fdbfc0c08b0 2023-10-06T10:59:24.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7efc80ff9700 1 -- 172.21.15.7:0/2151350801 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7efc88084e30 con 0x7efc8c0ae000 2023-10-06T10:59:24.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.594+0000 7fdc00ef4700 1 --2- 172.21.15.7:0/668192392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbfc0c08b0 0x7fdbfc0c0d30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdbec015600 tx=0x7fdbec021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.595+0000 7f1a96633700 1 -- 172.21.15.7:0/2724751379 >> v2:172.21.15.50:3300/0 conn(0x7f1a900aaa40 msgr2=0x7f1a900cd170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T10:59:24.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.595+0000 7f1a96633700 1 --2- 172.21.15.7:0/2724751379 >> v2:172.21.15.50:3300/0 conn(0x7f1a900aaa40 0x7f1a900cd170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.595+0000 7f1a96633700 1 -- 172.21.15.7:0/2724751379 >> v1:172.21.15.50:6789/0 conn(0x7f1a900ccda0 legacy=0x7f1a900aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.595+0000 7f1a96633700 1 -- 172.21.15.7:0/2724751379 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a90068da0 con 0x7f1a900ac8d0 2023-10-06T10:59:24.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.595+0000 7fa732a9c700 1 --2- 172.21.15.7:0/449618241 >> [v2:172.21.15.50:6800/119979,v1:172.21.15.50:6801/119979] conn(0x7fa72c13a7a0 0x7fa72c0c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.595+0000 7fa732a9c700 1 -- 172.21.15.7:0/449618241 --> [v2:172.21.15.50:6800/119979,v1:172.21.15.50:6801/119979] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa72c067b30 con 0x7fa72c13a7a0 2023-10-06T10:59:24.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.595+0000 7fa731039700 1 --2- 172.21.15.7:0/449618241 >> [v2:172.21.15.50:6800/119979,v1:172.21.15.50:6801/119979] conn(0x7fa72c13a7a0 0x7fa72c0c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.595+0000 7fdbe3fff700 1 -- 172.21.15.7:0/668192392 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00f9f0 con 0x7fdbfc0c08b0 2023-10-06T10:59:24.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.595+0000 7fdbe3fff700 1 -- 172.21.15.7:0/668192392 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec0149f0 con 0x7fdbfc0c08b0 2023-10-06T10:59:24.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.595+0000 7f1a96633700 1 --2- 172.21.15.7:0/2724751379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a900ac8d0 0x7f1a90155af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009f20 tx=0x7f1a88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19589a012a6ba496 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.595+0000 7fdbe3fff700 1 -- 172.21.15.7:0/668192392 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec028410 con 0x7fdbfc0c08b0 2023-10-06T10:59:24.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.595+0000 7fdc02957700 1 -- 172.21.15.7:0/668192392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbfc0c4e20 con 0x7fdbfc0c08b0 2023-10-06T10:59:24.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.595+0000 7fdc02957700 1 -- 172.21.15.7:0/668192392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc0c5620 con 0x7fdbfc0c08b0 2023-10-06T10:59:24.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.595+0000 7f1a94e30700 1 -- 172.21.15.7:0/2724751379 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800e070 con 0x7f1a900ac8d0 2023-10-06T10:59:24.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.596+0000 7f1a94e30700 1 -- 172.21.15.7:0/2724751379 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8800ba00 con 0x7f1a900ac8d0 2023-10-06T10:59:24.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.596+0000 7f1a94e30700 1 -- 172.21.15.7:0/2724751379 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a880092e0 con 0x7f1a900ac8d0 2023-10-06T10:59:24.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.596+0000 7fa731039700 1 --2- 172.21.15.7:0/449618241 >> [v2:172.21.15.50:6800/119979,v1:172.21.15.50:6801/119979] conn(0x7fa72c13a7a0 0x7fa72c0c1b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.596+0000 7efc93028700 1 --2- 172.21.15.7:0/2151350801 >> [v2:172.21.15.7:6800/119717,v1:172.21.15.7:6801/119717] conn(0x7efc8c099d80 0x7efc8c15dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.596+0000 7efc93028700 1 -- 172.21.15.7:0/2151350801 --> [v2:172.21.15.7:6800/119717,v1:172.21.15.7:6801/119717] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc8c070480 con 0x7efc8c099d80 2023-10-06T10:59:24.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.596+0000 7f1a98096700 1 -- 172.21.15.7:0/2724751379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a900ac8d0 msgr2=0x7f1a90155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.596+0000 7f1a98096700 1 --2- 172.21.15.7:0/2724751379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a900ac8d0 0x7f1a90155af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009f20 tx=0x7f1a88009840 comp rx=0 tx=0).stop 2023-10-06T10:59:24.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.596+0000 7fa423fff700 1 -- 172.21.15.7:0/4101592694 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa430026c20 con 0x7fa43c0ac8d0 2023-10-06T10:59:24.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.596+0000 7fa423fff700 1 --2- 172.21.15.7:0/4101592694 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa428067080 0x7fa428069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.596+0000 7fa423fff700 1 -- 172.21.15.7:0/4101592694 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa430021070 con 0x7fa43c0ac8d0 2023-10-06T10:59:24.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.597+0000 7fa423fff700 1 --2- 172.21.15.7:0/4101592694 >> [v2:172.21.15.50:6808/119980,v1:172.21.15.50:6809/119980] conn(0x7fa428070d50 0x7fa428073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.597+0000 7fa423fff700 1 -- 172.21.15.7:0/4101592694 --> [v2:172.21.15.50:6808/119980,v1:172.21.15.50:6809/119980] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa428073850 con 0x7fa428070d50 2023-10-06T10:59:24.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.597+0000 7fa423fff700 1 -- 172.21.15.7:0/4101592694 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa430087260 con 0x7fa43c0ac8d0 2023-10-06T10:59:24.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.597+0000 7efc915c5700 1 --2- 172.21.15.7:0/2151350801 >> [v2:172.21.15.7:6800/119717,v1:172.21.15.7:6801/119717] conn(0x7efc8c099d80 0x7efc8c15dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.597+0000 7efc83fff700 1 --2- 172.21.15.7:0/2151350801 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efc78067080 0x7efc78069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.597+0000 7f1a98096700 1 -- 172.21.15.7:0/2724751379 shutdown_connections 2023-10-06T10:59:24.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.597+0000 7f1a98096700 1 --2- 172.21.15.7:0/2724751379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a900ac8d0 0x7f1a90155af0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.597+0000 7f1a98096700 1 --2- 172.21.15.7:0/2724751379 >> v2:172.21.15.50:3300/0 conn(0x7f1a900aaa40 0x7f1a900cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.597+0000 7f1a98096700 1 -- 172.21.15.7:0/2724751379 >> 172.21.15.7:0/2724751379 conn(0x7f1a90096160 msgr2=0x7f1a900afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.597+0000 7fa43bfff700 1 --2- 172.21.15.7:0/4101592694 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa428067080 0x7fa428069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.597+0000 7efc915c5700 1 --2- 172.21.15.7:0/2151350801 >> [v2:172.21.15.7:6800/119717,v1:172.21.15.7:6801/119717] conn(0x7efc8c099d80 0x7efc8c15dbe0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.597+0000 7efc83fff700 1 --2- 172.21.15.7:0/2151350801 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efc78067080 0x7efc78069530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efc7c006fd0 tx=0x7efc7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.598+0000 7fa43bfff700 1 --2- 172.21.15.7:0/4101592694 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa428067080 0x7fa428069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa42c006fd0 tx=0x7fa42c006d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.598+0000 7f1a98096700 1 -- 172.21.15.7:0/2724751379 shutdown_connections 2023-10-06T10:59:24.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.598+0000 7f1a98096700 1 -- 172.21.15.7:0/2724751379 wait complete. 2023-10-06T10:59:24.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.599+0000 7efc80ff9700 1 -- 172.21.15.7:0/2151350801 <== osd.2 v2:172.21.15.7:6800/119717 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7efc8c070480 con 0x7efc8c099d80 2023-10-06T10:59:24.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.600+0000 7f1a98096700 1 Processor -- start 2023-10-06T10:59:24.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.599+0000 7fdbe3fff700 1 -- 172.21.15.7:0/668192392 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdbec025070 con 0x7fdbfc0c08b0 2023-10-06T10:59:24.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.600+0000 7fdbe3fff700 1 --2- 172.21.15.7:0/668192392 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdbe8067000 0x7fdbe80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.600+0000 7fdbe3fff700 1 -- 172.21.15.7:0/668192392 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdbec08edc0 con 0x7fdbfc0c08b0 2023-10-06T10:59:24.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.600+0000 7fdbfbfff700 1 --2- 172.21.15.7:0/668192392 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdbe8067000 0x7fdbe80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.600+0000 7f1a98096700 1 -- start start 2023-10-06T10:59:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.601+0000 7fdbfbfff700 1 --2- 172.21.15.7:0/668192392 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdbe8067000 0x7fdbe80694b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40012e0 tx=0x7fdbf40076a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.601+0000 7f1a98096700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a900ac8d0 0x7f1a901498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.601+0000 7f1a98096700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a900ccda0 0x7f1a90152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.601+0000 7f1a98096700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1a90153420 0x7f1a90151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.601+0000 7f1a98096700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90152750 con 0x7f1a900ac8d0 2023-10-06T10:59:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.601+0000 7f1a98096700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90149e00 con 0x7f1a900ccda0 2023-10-06T10:59:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.601+0000 7f1a98096700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90153890 con 0x7f1a90153420 2023-10-06T10:59:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.601+0000 7f1a95e32700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a900ac8d0 0x7f1a901498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.601+0000 7f1a95e32700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a900ac8d0 0x7f1a901498c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43446/0 (socket says 172.21.15.7:43446) 2023-10-06T10:59:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.601+0000 7f1a95e32700 1 -- 172.21.15.7:0/733191372 learned_addr learned my addr 172.21.15.7:0/733191372 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.602+0000 7f1a95e32700 1 -- 172.21.15.7:0/733191372 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1a90153420 msgr2=0x7f1a90151480 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T10:59:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.602+0000 7f1a95e32700 1 --2- 172.21.15.7:0/733191372 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1a90153420 0x7f1a90151480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.602+0000 7f1a95e32700 1 -- 172.21.15.7:0/733191372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a900ccda0 msgr2=0x7f1a90152ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T10:59:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.602+0000 7f1a95e32700 1 --2- 172.21.15.7:0/733191372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a900ccda0 0x7f1a90152ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.602+0000 7f1a95e32700 1 -- 172.21.15.7:0/733191372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88009ae0 con 0x7f1a900ac8d0 2023-10-06T10:59:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.602+0000 7f1a95e32700 1 --2- 172.21.15.7:0/733191372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a900ac8d0 0x7f1a901498c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00dad0 tx=0x7f1a8c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.602+0000 7f1a81ffb700 1 -- 172.21.15.7:0/733191372 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00ea80 con 0x7f1a900ac8d0 2023-10-06T10:59:24.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.602+0000 7f1a81ffb700 1 -- 172.21.15.7:0/733191372 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c00ec20 con 0x7f1a900ac8d0 2023-10-06T10:59:24.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.602+0000 7f1a81ffb700 1 -- 172.21.15.7:0/733191372 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c017470 con 0x7f1a900ac8d0 2023-10-06T10:59:24.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.603+0000 7fa728ff9700 1 -- 172.21.15.7:0/449618241 <== osd.4 v2:172.21.15.50:6800/119979 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa72c067b30 con 0x7fa72c13a7a0 2023-10-06T10:59:24.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.598+0000 7fb2a5ffb700 1 -- 172.21.15.7:0/1195959701 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2a00512d0 con 0x7fb2b00ca510 2023-10-06T10:59:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.602+0000 7f1a98096700 1 -- 172.21.15.7:0/733191372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9014a8a0 con 0x7f1a900ac8d0 2023-10-06T10:59:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.603+0000 7f1a98096700 1 -- 172.21.15.7:0/733191372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a90152470 con 0x7f1a900ac8d0 2023-10-06T10:59:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.604+0000 7f1a98096700 1 -- 172.21.15.7:0/733191372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a90070480 con 0x7f1a900ac8d0 2023-10-06T10:59:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.605+0000 7f1a81ffb700 1 -- 172.21.15.7:0/733191372 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a8c014070 con 0x7f1a900ac8d0 2023-10-06T10:59:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.605+0000 7f1a81ffb700 1 --2- 172.21.15.7:0/733191372 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1a7406b340 0x7f1a7406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.605+0000 7f1a81ffb700 1 -- 172.21.15.7:0/733191372 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1a8c083bc0 con 0x7f1a900ac8d0 2023-10-06T10:59:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.606+0000 7f1a81ffb700 1 --2- 172.21.15.7:0/733191372 >> [v2:172.21.15.7:6816/119718,v1:172.21.15.7:6818/119718] conn(0x7f1a74075010 0x7f1a74077440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.606+0000 7f1a81ffb700 1 -- 172.21.15.7:0/733191372 --> [v2:172.21.15.7:6816/119718,v1:172.21.15.7:6818/119718] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a74077b10 con 0x7f1a74075010 2023-10-06T10:59:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.606+0000 7f1a81ffb700 1 -- 172.21.15.7:0/733191372 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a8c088220 con 0x7f1a900ac8d0 2023-10-06T10:59:24.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.610+0000 7fa440ed3700 1 --2- 172.21.15.7:0/4101592694 >> [v2:172.21.15.50:6808/119980,v1:172.21.15.50:6809/119980] conn(0x7fa428070d50 0x7fa428073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.610+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3691822855 --> [v2:172.21.15.7:6817/119715,v1:172.21.15.7:6819/119715] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1ac0161c00 con 0x7f1aa4070d50 2023-10-06T10:59:24.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.610+0000 7fdbe27fc700 1 --2- 172.21.15.7:0/668192392 >> [v2:172.21.15.50:6816/120010,v1:172.21.15.50:6817/120010] conn(0x7fdbfc0c5de0 0x7fdbfc0c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.610+0000 7fdbe27fc700 1 -- 172.21.15.7:0/668192392 --> [v2:172.21.15.50:6816/120010,v1:172.21.15.50:6817/120010] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdbfc0c4fb0 con 0x7fdbfc0c5de0 2023-10-06T10:59:24.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.610+0000 7fdbfb7fe700 1 --2- 172.21.15.7:0/668192392 >> [v2:172.21.15.50:6816/120010,v1:172.21.15.50:6817/120010] conn(0x7fdbfc0c5de0 0x7fdbfc0c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.611+0000 7f1ab5ffb700 1 -- 172.21.15.7:0/3691822855 <== osd.0 v2:172.21.15.7:6817/119715 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1ac0161c00 con 0x7f1aa4070d50 2023-10-06T10:59:24.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.611+0000 7fdbfb7fe700 1 --2- 172.21.15.7:0/668192392 >> [v2:172.21.15.50:6816/120010,v1:172.21.15.50:6817/120010] conn(0x7fdbfc0c5de0 0x7fdbfc0c61b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.611+0000 7f1a95631700 1 --2- 172.21.15.7:0/733191372 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1a7406b340 0x7f1a7406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.611+0000 7fa440ed3700 1 --2- 172.21.15.7:0/4101592694 >> [v2:172.21.15.50:6808/119980,v1:172.21.15.50:6809/119980] conn(0x7fa428070d50 0x7fa428073180 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.612+0000 7fdbe3fff700 1 -- 172.21.15.7:0/668192392 <== osd.6 v2:172.21.15.50:6816/120010 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fdbfc0c4fb0 con 0x7fdbfc0c5de0 2023-10-06T10:59:24.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.612+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3691822855 >> [v2:172.21.15.7:6817/119715,v1:172.21.15.7:6819/119715] conn(0x7f1aa4070d50 msgr2=0x7f1aa4073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.612+0000 7f1ac7d84700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.7:6817/119715,v1:172.21.15.7:6819/119715] conn(0x7f1aa4070d50 0x7f1aa4073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.612+0000 7fa423fff700 1 -- 172.21.15.7:0/4101592694 <== osd.5 v2:172.21.15.50:6808/119980 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa428073850 con 0x7fa428070d50 2023-10-06T10:59:24.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.612+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3691822855 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1aa4067080 msgr2=0x7f1aa4069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.612+0000 7f1ac7d84700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1aa4067080 0x7f1aa4069530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80097c0 tx=0x7f1ab8019000 comp rx=0 tx=0).stop 2023-10-06T10:59:24.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.612+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3691822855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ac015abe0 msgr2=0x7f1ac0159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.612+0000 7f1ac7d84700 1 --2- 172.21.15.7:0/3691822855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ac015abe0 0x7f1ac0159a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000c560 tx=0x7f1ab0007f60 comp rx=0 tx=0).stop 2023-10-06T10:59:24.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.612+0000 7f1ac6321700 1 -- 172.21.15.7:0/3691822855 reap_dead start 2023-10-06T10:59:24.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.621+0000 7fdd54a1f700 1 -- 172.21.15.7:0/545974417 --> [v2:172.21.15.50:6824/120011,v1:172.21.15.50:6825/120011] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdd500c4390 con 0x7fdd30070d50 2023-10-06T10:59:24.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.621+0000 7fdd3e7fc700 1 -- 172.21.15.7:0/545974417 <== osd.7 v2:172.21.15.50:6824/120011 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdd500c4390 con 0x7fdd30070d50 2023-10-06T10:59:24.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.622+0000 7f1a96633700 1 --2- 172.21.15.7:0/733191372 >> [v2:172.21.15.7:6816/119718,v1:172.21.15.7:6818/119718] conn(0x7f1a74075010 0x7f1a74077440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.622+0000 7fdd54a1f700 1 -- 172.21.15.7:0/545974417 >> [v2:172.21.15.50:6824/120011,v1:172.21.15.50:6825/120011] conn(0x7fdd30070d50 msgr2=0x7fdd30073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.622+0000 7fdd54a1f700 1 --2- 172.21.15.7:0/545974417 >> [v2:172.21.15.50:6824/120011,v1:172.21.15.50:6825/120011] conn(0x7fdd30070d50 0x7fdd30073180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.622+0000 7fdd54a1f700 1 -- 172.21.15.7:0/545974417 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdd30067080 msgr2=0x7fdd30069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.622+0000 7fdd54a1f700 1 --2- 172.21.15.7:0/545974417 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdd30067080 0x7fdd30069530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdd500c2e20 tx=0x7fdd44009120 comp rx=0 tx=0).stop 2023-10-06T10:59:24.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.622+0000 7fdd54a1f700 1 -- 172.21.15.7:0/545974417 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd38003ae0 msgr2=0x7fdd50158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.622+0000 7fdd54a1f700 1 --2- 172.21.15.7:0/545974417 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd38003ae0 0x7fdd50158030 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd48005470 tx=0x7fdd48016000 comp rx=0 tx=0).stop 2023-10-06T10:59:24.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.622+0000 7fdd4ed9d700 1 -- 172.21.15.7:0/545974417 reap_dead start 2023-10-06T10:59:24.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.622+0000 7fdd54a1f700 1 -- 172.21.15.7:0/545974417 shutdown_connections 2023-10-06T10:59:24.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.622+0000 7fdd54a1f700 1 -- 172.21.15.7:0/545974417 >> 172.21.15.7:0/545974417 conn(0x7fdd500c8730 msgr2=0x7fdd500c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.622+0000 7f1a96633700 1 --2- 172.21.15.7:0/733191372 >> [v2:172.21.15.7:6816/119718,v1:172.21.15.7:6818/119718] conn(0x7f1a74075010 0x7f1a74077440 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.622+0000 7fdd54a1f700 1 -- 172.21.15.7:0/545974417 shutdown_connections 2023-10-06T10:59:24.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.623+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3691822855 shutdown_connections 2023-10-06T10:59:24.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.623+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3691822855 >> 172.21.15.7:0/3691822855 conn(0x7f1ac00c8730 msgr2=0x7f1ac015dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.622+0000 7fdd54a1f700 1 -- 172.21.15.7:0/545974417 wait complete. 2023-10-06T10:59:24.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.623+0000 7f1a95631700 1 --2- 172.21.15.7:0/733191372 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1a7406b340 0x7f1a7406d7f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a9014f670 tx=0x7f1a84006c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.622+0000 7efc93028700 1 -- 172.21.15.7:0/2151350801 --> [v2:172.21.15.7:6800/119717,v1:172.21.15.7:6801/119717] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efc8c0af530 con 0x7efc8c099d80 2023-10-06T10:59:24.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.624+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3691822855 shutdown_connections 2023-10-06T10:59:24.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.624+0000 7f1ac7d84700 1 -- 172.21.15.7:0/3691822855 wait complete. 2023-10-06T10:59:24.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.624+0000 7efc80ff9700 1 -- 172.21.15.7:0/2151350801 <== osd.2 v2:172.21.15.7:6800/119717 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efc8c0af530 con 0x7efc8c099d80 2023-10-06T10:59:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.625+0000 7efc93028700 1 -- 172.21.15.7:0/2151350801 >> [v2:172.21.15.7:6800/119717,v1:172.21.15.7:6801/119717] conn(0x7efc8c099d80 msgr2=0x7efc8c15dbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.625+0000 7efc93028700 1 --2- 172.21.15.7:0/2151350801 >> [v2:172.21.15.7:6800/119717,v1:172.21.15.7:6801/119717] conn(0x7efc8c099d80 0x7efc8c15dbe0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.625+0000 7efc93028700 1 -- 172.21.15.7:0/2151350801 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efc78067080 msgr2=0x7efc78069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.625+0000 7efc93028700 1 --2- 172.21.15.7:0/2151350801 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efc78067080 0x7efc78069530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efc7c006fd0 tx=0x7efc7c008040 comp rx=0 tx=0).stop 2023-10-06T10:59:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.625+0000 7efc93028700 1 -- 172.21.15.7:0/2151350801 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efc8c0ae000 msgr2=0x7efc8c15c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.625+0000 7efc93028700 1 --2- 172.21.15.7:0/2151350801 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efc8c0ae000 0x7efc8c15c990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efc8800c980 tx=0x7efc88002760 comp rx=0 tx=0).stop 2023-10-06T10:59:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.625+0000 7efc915c5700 1 -- 172.21.15.7:0/2151350801 reap_dead start 2023-10-06T10:59:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.625+0000 7efc93028700 1 -- 172.21.15.7:0/2151350801 shutdown_connections 2023-10-06T10:59:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.625+0000 7efc93028700 1 -- 172.21.15.7:0/2151350801 >> 172.21.15.7:0/2151350801 conn(0x7efc8c095a70 msgr2=0x7efc8c0cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.624+0000 7fa732a9c700 1 -- 172.21.15.7:0/449618241 --> [v2:172.21.15.50:6800/119979,v1:172.21.15.50:6801/119979] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa72c068a90 con 0x7fa72c13a7a0 2023-10-06T10:59:24.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.625+0000 7fb2b8028700 1 -- 172.21.15.7:0/1195959701 --> [v2:172.21.15.7:6808/119716,v1:172.21.15.7:6809/119716] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb290002cf0 con 0x7fb294070cd0 2023-10-06T10:59:24.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.626+0000 7f1a81ffb700 1 -- 172.21.15.7:0/733191372 <== osd.3 v2:172.21.15.7:6816/119718 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1a74077b10 con 0x7f1a74075010 2023-10-06T10:59:24.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.626+0000 7efc93028700 1 -- 172.21.15.7:0/2151350801 shutdown_connections 2023-10-06T10:59:24.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.626+0000 7fa728ff9700 1 -- 172.21.15.7:0/449618241 <== osd.4 v2:172.21.15.50:6800/119979 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa72c068a90 con 0x7fa72c13a7a0 2023-10-06T10:59:24.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.627+0000 7fb2a5ffb700 1 -- 172.21.15.7:0/1195959701 <== osd.1 v2:172.21.15.7:6808/119716 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb290002cf0 con 0x7fb294070cd0 2023-10-06T10:59:24.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.627+0000 7fb2b8028700 1 -- 172.21.15.7:0/1195959701 >> [v2:172.21.15.7:6808/119716,v1:172.21.15.7:6809/119716] conn(0x7fb294070cd0 msgr2=0x7fb294073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.627+0000 7fb2b8028700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.7:6808/119716,v1:172.21.15.7:6809/119716] conn(0x7fb294070cd0 0x7fb294073100 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.627+0000 7fa732a9c700 1 -- 172.21.15.7:0/449618241 >> [v2:172.21.15.50:6800/119979,v1:172.21.15.50:6801/119979] conn(0x7fa72c13a7a0 msgr2=0x7fa72c0c1b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.627+0000 7fa732a9c700 1 --2- 172.21.15.7:0/449618241 >> [v2:172.21.15.50:6800/119979,v1:172.21.15.50:6801/119979] conn(0x7fa72c13a7a0 0x7fa72c0c1b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.627+0000 7fb2b8028700 1 -- 172.21.15.7:0/1195959701 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb294067080 msgr2=0x7fb294069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.627+0000 7fb2b8028700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb294067080 0x7fb294069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac002880 tx=0x7fb2ac009040 comp rx=0 tx=0).stop 2023-10-06T10:59:24.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.627+0000 7fb2b8028700 1 -- 172.21.15.7:0/1195959701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b00ca510 msgr2=0x7fb2b013cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.627+0000 7fb2b8028700 1 --2- 172.21.15.7:0/1195959701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b00ca510 0x7fb2b013cef0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000b610 tx=0x7fb2a00090f0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.627+0000 7fb2b65c5700 1 -- 172.21.15.7:0/1195959701 reap_dead start 2023-10-06T10:59:24.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.628+0000 7fb2b8028700 1 -- 172.21.15.7:0/1195959701 shutdown_connections 2023-10-06T10:59:24.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.628+0000 7fb2b8028700 1 -- 172.21.15.7:0/1195959701 >> 172.21.15.7:0/1195959701 conn(0x7fb2b00cc790 msgr2=0x7fb2b015f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.629+0000 7fb2b8028700 1 -- 172.21.15.7:0/1195959701 shutdown_connections 2023-10-06T10:59:24.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.629+0000 7fb2b8028700 1 -- 172.21.15.7:0/1195959701 wait complete. 2023-10-06T10:59:24.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.634+0000 7efc93028700 1 -- 172.21.15.7:0/2151350801 wait complete. 2023-10-06T10:59:24.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.635+0000 7fdbe27fc700 1 -- 172.21.15.7:0/668192392 --> [v2:172.21.15.50:6816/120010,v1:172.21.15.50:6817/120010] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdbfc06a110 con 0x7fdbfc0c5de0 2023-10-06T10:59:24.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.636+0000 7fdbe3fff700 1 -- 172.21.15.7:0/668192392 <== osd.6 v2:172.21.15.50:6816/120010 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdbfc06a110 con 0x7fdbfc0c5de0 2023-10-06T10:59:24.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.637+0000 7fdbe27fc700 1 -- 172.21.15.7:0/668192392 >> [v2:172.21.15.50:6816/120010,v1:172.21.15.50:6817/120010] conn(0x7fdbfc0c5de0 msgr2=0x7fdbfc0c61b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.637+0000 7fdbe27fc700 1 --2- 172.21.15.7:0/668192392 >> [v2:172.21.15.50:6816/120010,v1:172.21.15.50:6817/120010] conn(0x7fdbfc0c5de0 0x7fdbfc0c61b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.637+0000 7fdbe27fc700 1 -- 172.21.15.7:0/668192392 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdbe8067000 msgr2=0x7fdbe80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.637+0000 7fdbe27fc700 1 --2- 172.21.15.7:0/668192392 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdbe8067000 0x7fdbe80694b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40012e0 tx=0x7fdbf40076a0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.637+0000 7fdbe27fc700 1 -- 172.21.15.7:0/668192392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbfc0c08b0 msgr2=0x7fdbfc0c0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.637+0000 7fdbe27fc700 1 --2- 172.21.15.7:0/668192392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbfc0c08b0 0x7fdbfc0c0d30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdbec015600 tx=0x7fdbec021000 comp rx=0 tx=0).stop 2023-10-06T10:59:24.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.637+0000 7fdc00ef4700 1 -- 172.21.15.7:0/668192392 reap_dead start 2023-10-06T10:59:24.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.637+0000 7fdbe27fc700 1 -- 172.21.15.7:0/668192392 shutdown_connections 2023-10-06T10:59:24.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.637+0000 7fdbe27fc700 1 -- 172.21.15.7:0/668192392 >> 172.21.15.7:0/668192392 conn(0x7fdbfc0633b0 msgr2=0x7fdbfc0ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.637+0000 7fdbe27fc700 1 -- 172.21.15.7:0/668192392 shutdown_connections 2023-10-06T10:59:24.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.637+0000 7fdbe27fc700 1 -- 172.21.15.7:0/668192392 wait complete. 2023-10-06T10:59:24.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.638+0000 7fa442936700 1 -- 172.21.15.7:0/4101592694 --> [v2:172.21.15.50:6808/119980,v1:172.21.15.50:6809/119980] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa43c0aacf0 con 0x7fa428070d50 2023-10-06T10:59:24.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.638+0000 7fa423fff700 1 -- 172.21.15.7:0/4101592694 <== osd.5 v2:172.21.15.50:6808/119980 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa43c0aacf0 con 0x7fa428070d50 2023-10-06T10:59:24.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.639+0000 7fa442936700 1 -- 172.21.15.7:0/4101592694 >> [v2:172.21.15.50:6808/119980,v1:172.21.15.50:6809/119980] conn(0x7fa428070d50 msgr2=0x7fa428073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.639+0000 7fa442936700 1 --2- 172.21.15.7:0/4101592694 >> [v2:172.21.15.50:6808/119980,v1:172.21.15.50:6809/119980] conn(0x7fa428070d50 0x7fa428073180 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.639+0000 7fa442936700 1 -- 172.21.15.7:0/4101592694 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa428067080 msgr2=0x7fa428069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.639+0000 7fa442936700 1 --2- 172.21.15.7:0/4101592694 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa428067080 0x7fa428069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa42c006fd0 tx=0x7fa42c006d30 comp rx=0 tx=0).stop 2023-10-06T10:59:24.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.639+0000 7fa442936700 1 -- 172.21.15.7:0/4101592694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa43c0ac8d0 msgr2=0x7fa43c146950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.639+0000 7fa442936700 1 --2- 172.21.15.7:0/4101592694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa43c0ac8d0 0x7fa43c146950 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa430009290 tx=0x7fa430017000 comp rx=0 tx=0).stop 2023-10-06T10:59:24.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.639+0000 7fa440ed3700 1 -- 172.21.15.7:0/4101592694 reap_dead start 2023-10-06T10:59:24.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.631+0000 7fa732a9c700 1 -- 172.21.15.7:0/449618241 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa718066f30 msgr2=0x7fa7180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.631+0000 7fa732a9c700 1 --2- 172.21.15.7:0/449618241 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa718066f30 0x7fa7180693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa71c006fd0 tx=0x7fa71c008040 comp rx=0 tx=0).stop 2023-10-06T10:59:24.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.631+0000 7fa732a9c700 1 -- 172.21.15.7:0/449618241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa72c13b2d0 msgr2=0x7fa72c0c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.631+0000 7fa732a9c700 1 --2- 172.21.15.7:0/449618241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa72c13b2d0 0x7fa72c0c6cb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7240076d0 tx=0x7fa72401a000 comp rx=0 tx=0).stop 2023-10-06T10:59:24.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.641+0000 7fa731039700 1 -- 172.21.15.7:0/449618241 reap_dead start 2023-10-06T10:59:24.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.641+0000 7fa732a9c700 1 -- 172.21.15.7:0/449618241 shutdown_connections 2023-10-06T10:59:24.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.641+0000 7fa732a9c700 1 -- 172.21.15.7:0/449618241 >> 172.21.15.7:0/449618241 conn(0x7fa72c0c8730 msgr2=0x7fa72c0c0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.665 INFO:teuthology.orchestra.run.smithi007.stdout:55834574856 2023-10-06T10:59:24.666 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T10:59:24.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.643+0000 7fa442936700 1 -- 172.21.15.7:0/4101592694 shutdown_connections 2023-10-06T10:59:24.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.643+0000 7fa442936700 1 -- 172.21.15.7:0/4101592694 >> 172.21.15.7:0/4101592694 conn(0x7fa43c096160 msgr2=0x7fa43c067940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.645+0000 7fa442936700 1 -- 172.21.15.7:0/4101592694 shutdown_connections 2023-10-06T10:59:24.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.645+0000 7fa442936700 1 -- 172.21.15.7:0/4101592694 wait complete. 2023-10-06T10:59:24.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.648+0000 7fa732a9c700 1 -- 172.21.15.7:0/449618241 shutdown_connections 2023-10-06T10:59:24.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.648+0000 7fa732a9c700 1 -- 172.21.15.7:0/449618241 wait complete. 2023-10-06T10:59:24.668 INFO:teuthology.orchestra.run.smithi007.stdout:55834574856 2023-10-06T10:59:24.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T10:59:24.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.650+0000 7f1a98096700 1 -- 172.21.15.7:0/733191372 --> [v2:172.21.15.7:6816/119718,v1:172.21.15.7:6818/119718] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a90155010 con 0x7f1a74075010 2023-10-06T10:59:24.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.651+0000 7f1a81ffb700 1 -- 172.21.15.7:0/733191372 <== osd.3 v2:172.21.15.7:6816/119718 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1a90155010 con 0x7f1a74075010 2023-10-06T10:59:24.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.651+0000 7f1a98096700 1 -- 172.21.15.7:0/733191372 >> [v2:172.21.15.7:6816/119718,v1:172.21.15.7:6818/119718] conn(0x7f1a74075010 msgr2=0x7f1a74077440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.651+0000 7f1a98096700 1 --2- 172.21.15.7:0/733191372 >> [v2:172.21.15.7:6816/119718,v1:172.21.15.7:6818/119718] conn(0x7f1a74075010 0x7f1a74077440 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.651+0000 7f1a98096700 1 -- 172.21.15.7:0/733191372 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1a7406b340 msgr2=0x7f1a7406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.651+0000 7f1a98096700 1 --2- 172.21.15.7:0/733191372 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1a7406b340 0x7f1a7406d7f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a9014f670 tx=0x7f1a84006c40 comp rx=0 tx=0).stop 2023-10-06T10:59:24.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.651+0000 7f1a98096700 1 -- 172.21.15.7:0/733191372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a900ac8d0 msgr2=0x7f1a901498c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.651+0000 7f1a98096700 1 --2- 172.21.15.7:0/733191372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a900ac8d0 0x7f1a901498c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00dad0 tx=0x7f1a8c00b3b0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.651+0000 7f1a96633700 1 -- 172.21.15.7:0/733191372 reap_dead start 2023-10-06T10:59:24.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.651+0000 7f1a98096700 1 -- 172.21.15.7:0/733191372 shutdown_connections 2023-10-06T10:59:24.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.651+0000 7f1a98096700 1 -- 172.21.15.7:0/733191372 >> 172.21.15.7:0/733191372 conn(0x7f1a90096160 msgr2=0x7f1a900aef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.651+0000 7f1a98096700 1 -- 172.21.15.7:0/733191372 shutdown_connections 2023-10-06T10:59:24.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.651+0000 7f1a98096700 1 -- 172.21.15.7:0/733191372 wait complete. 2023-10-06T10:59:24.671 INFO:teuthology.orchestra.run.smithi007.stdout:55834574856 2023-10-06T10:59:24.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T10:59:24.672 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2023-10-06T10:59:24.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T10:59:24.673 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2023-10-06T10:59:24.674 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T10:59:24.674 INFO:teuthology.orchestra.run.smithi007.stdout:55834574856 2023-10-06T10:59:24.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T10:59:24.676 INFO:teuthology.orchestra.run.smithi007.stdout:55834574858 2023-10-06T10:59:24.676 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T10:59:24.678 INFO:teuthology.orchestra.run.smithi007.stdout:55834574856 2023-10-06T10:59:24.678 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T10:59:24.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.886+0000 7fde2dd9e700 1 Processor -- start 2023-10-06T10:59:24.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.886+0000 7fde2dd9e700 1 -- start start 2023-10-06T10:59:24.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.887+0000 7f140f2ff700 1 Processor -- start 2023-10-06T10:59:24.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.887+0000 7fde2dd9e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde280af320 0x7fde280cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.887+0000 7fde2dd9e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde280cb580 0x7fde28068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.887+0000 7fde2dd9e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fde280cfb50 0x7fde28069420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.887+0000 7fde2dd9e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde28159c00 con 0x7fde280cfb50 2023-10-06T10:59:24.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.887+0000 7fde2dd9e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde280cf6c0 con 0x7fde280cb580 2023-10-06T10:59:24.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.887+0000 7fde2dd9e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde280ceab0 con 0x7fde280af320 2023-10-06T10:59:24.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.887+0000 7f140f2ff700 1 -- start start 2023-10-06T10:59:24.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.888+0000 7f140f2ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1408159000 0x7f14080c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.888+0000 7f140f2ff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f14081593d0 0x7f140806be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.888+0000 7f140f2ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1408067290 con 0x7f140806c380 2023-10-06T10:59:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.888+0000 7f140f2ff700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1408067570 con 0x7f14081593d0 2023-10-06T10:59:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.888+0000 7f140f2ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1408067850 con 0x7f1408159000 2023-10-06T10:59:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.889+0000 7fde26ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde280cb580 0x7fde28068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.889+0000 7f140c89a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f14081593d0 0x7f140806be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.889+0000 7f140c89a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f14081593d0 0x7f140806be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43470/0 (socket says 172.21.15.7:43470) 2023-10-06T10:59:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.889+0000 7f140c89a700 1 -- 172.21.15.7:0/1965293082 learned_addr learned my addr 172.21.15.7:0/1965293082 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.889+0000 7fde277fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde280af320 0x7fde280cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.889+0000 7fde277fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde280af320 0x7fde280cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:35020/0 (socket says 172.21.15.7:35020) 2023-10-06T10:59:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.889+0000 7fde277fe700 1 -- 172.21.15.7:0/2414158917 learned_addr learned my addr 172.21.15.7:0/2414158917 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.889+0000 7f140d09b700 1 --2- 172.21.15.7:0/1965293082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1408159000 0x7f14080c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.890+0000 7fde26ffd700 1 -- 172.21.15.7:0/2414158917 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde280af320 msgr2=0x7fde280cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.890+0000 7fde26ffd700 1 --2- 172.21.15.7:0/2414158917 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde280af320 0x7fde280cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.890+0000 7fde26ffd700 1 -- 172.21.15.7:0/2414158917 >> v2:172.21.15.7:3300/0 conn(0x7fde280cfb50 msgr2=0x7fde28069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.890+0000 7fde26ffd700 1 --2- 172.21.15.7:0/2414158917 >> v2:172.21.15.7:3300/0 conn(0x7fde280cfb50 0x7fde28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.890+0000 7fde26ffd700 1 -- 172.21.15.7:0/2414158917 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde280ced90 con 0x7fde280cb580 2023-10-06T10:59:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.890+0000 7f140c89a700 1 -- 172.21.15.7:0/1965293082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1408159000 msgr2=0x7f14080c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.890+0000 7f140c89a700 1 --2- 172.21.15.7:0/1965293082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1408159000 0x7f14080c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.890+0000 7f140c89a700 1 -- 172.21.15.7:0/1965293082 >> v1:172.21.15.50:6789/0 conn(0x7f140806c380 legacy=0x7f140813b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.890+0000 7f140c89a700 1 -- 172.21.15.7:0/1965293082 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1408067b30 con 0x7f14081593d0 2023-10-06T10:59:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.890+0000 7fde26ffd700 1 --2- 172.21.15.7:0/2414158917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde280cb580 0x7fde28068ee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fde28088fc0 tx=0x7fde1c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e6da93a694e4876 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.891+0000 7fde267fc700 1 -- 172.21.15.7:0/2414158917 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c009e80 con 0x7fde280cb580 2023-10-06T10:59:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.891+0000 7fde267fc700 1 -- 172.21.15.7:0/2414158917 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c00b8b0 con 0x7fde280cb580 2023-10-06T10:59:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.891+0000 7fde267fc700 1 -- 172.21.15.7:0/2414158917 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00bc50 con 0x7fde280cb580 2023-10-06T10:59:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.891+0000 7f140c89a700 1 --2- 172.21.15.7:0/1965293082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14081593d0 0x7f140806be40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1400009e10 tx=0x7f1400009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c53549b54647358 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.891+0000 7f13fffff700 1 -- 172.21.15.7:0/1965293082 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14000092e0 con 0x7f14081593d0 2023-10-06T10:59:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.891+0000 7f13fffff700 1 -- 172.21.15.7:0/1965293082 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140000ca60 con 0x7f14081593d0 2023-10-06T10:59:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.891+0000 7f13fffff700 1 -- 172.21.15.7:0/1965293082 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140000ce00 con 0x7f14081593d0 2023-10-06T10:59:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.892+0000 7fde2dd9e700 1 -- 172.21.15.7:0/2414158917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde280cb580 msgr2=0x7fde28068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.892+0000 7fde2dd9e700 1 --2- 172.21.15.7:0/2414158917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde280cb580 0x7fde28068ee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fde28088fc0 tx=0x7fde1c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.892+0000 7f140f2ff700 1 -- 172.21.15.7:0/1965293082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14081593d0 msgr2=0x7f140806be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.892+0000 7f140f2ff700 1 --2- 172.21.15.7:0/1965293082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14081593d0 0x7f140806be40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1400009e10 tx=0x7f1400009840 comp rx=0 tx=0).stop 2023-10-06T10:59:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.893+0000 7fde2dd9e700 1 -- 172.21.15.7:0/2414158917 shutdown_connections 2023-10-06T10:59:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.893+0000 7fde2dd9e700 1 --2- 172.21.15.7:0/2414158917 >> v2:172.21.15.7:3300/0 conn(0x7fde280cfb50 0x7fde28069420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.893+0000 7fde2dd9e700 1 --2- 172.21.15.7:0/2414158917 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde280af320 0x7fde280cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.893+0000 7fde2dd9e700 1 --2- 172.21.15.7:0/2414158917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde280cb580 0x7fde28068ee0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.893+0000 7fde2dd9e700 1 -- 172.21.15.7:0/2414158917 >> 172.21.15.7:0/2414158917 conn(0x7fde28067b80 msgr2=0x7fde280d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.896+0000 7f751d911700 1 Processor -- start 2023-10-06T10:59:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.896+0000 7f751d911700 1 -- start start 2023-10-06T10:59:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.897+0000 7f140f2ff700 1 -- 172.21.15.7:0/1965293082 shutdown_connections 2023-10-06T10:59:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.897+0000 7f140f2ff700 1 --2- 172.21.15.7:0/1965293082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1408159000 0x7f14080c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.897+0000 7f140f2ff700 1 --2- 172.21.15.7:0/1965293082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14081593d0 0x7f140806be40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.897+0000 7f140f2ff700 1 -- 172.21.15.7:0/1965293082 >> 172.21.15.7:0/1965293082 conn(0x7f14080c8730 msgr2=0x7f14080c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.897+0000 7f751d911700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7518068870 0x7f75180cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.897+0000 7f751d911700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75180670f0 con 0x7f7518140610 2023-10-06T10:59:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.897+0000 7f751d911700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75180673d0 con 0x7f75180c7420 2023-10-06T10:59:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.897+0000 7f751d911700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75180cb1e0 con 0x7f7518068870 2023-10-06T10:59:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.897+0000 7f7516ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7518140610 0x7f75180c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44248/0 (socket says 172.21.15.7:44248) 2023-10-06T10:59:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.897+0000 7f7516ffd700 1 -- 172.21.15.7:0/3037098272 learned_addr learned my addr 172.21.15.7:0/3037098272 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.897+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685770006 0 0) 0x7f75180673d0 con 0x7f75180c7420 2023-10-06T10:59:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.897+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7500003570 con 0x7f75180c7420 2023-10-06T10:59:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.897+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014516935 0 0) 0x7f75180670f0 con 0x7f7518140610 2023-10-06T10:59:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.897+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75180673d0 con 0x7f7518140610 2023-10-06T10:59:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 <== mon.1 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4014717887 0 0) 0x7f7500003570 con 0x7f75180c7420 2023-10-06T10:59:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 >> v2:172.21.15.50:3300/0 conn(0x7f7518068870 msgr2=0x7f75180cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7515ffb700 1 --2- 172.21.15.7:0/3037098272 >> v2:172.21.15.50:3300/0 conn(0x7f7518068870 0x7f75180cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 >> v1:172.21.15.7:6789/0 conn(0x7f7518140610 legacy=0x7f75180c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180cb4c0 con 0x7f75180c7420 2023-10-06T10:59:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 <== mon.1 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f75080013a0 con 0x7f75180c7420 2023-10-06T10:59:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 >> v1:172.21.15.50:6789/0 conn(0x7f75180c7420 legacy=0x7f75180ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7515ffb700 1 --2- 172.21.15.7:0/3037098272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500004ca0 0x7f7500005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7515ffb700 1 --2- 172.21.15.7:0/3037098272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75000037b0 0x7f7500003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7515ffb700 1 --2- 172.21.15.7:0/3037098272 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7500004360 0x7f7500014270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75180cb1e0 con 0x7f75000037b0 2023-10-06T10:59:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7500014b30 con 0x7f7500004ca0 2023-10-06T10:59:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7500014cf0 con 0x7f7500004360 2023-10-06T10:59:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7516ffd700 1 --2- 172.21.15.7:0/3037098272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500004ca0 0x7f7500005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7516ffd700 1 -- 172.21.15.7:0/3037098272 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7500004360 msgr2=0x7f7500014270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T10:59:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7516ffd700 1 --2- 172.21.15.7:0/3037098272 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7500004360 0x7f7500014270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7516ffd700 1 -- 172.21.15.7:0/3037098272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75000037b0 msgr2=0x7f7500003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7516ffd700 1 --2- 172.21.15.7:0/3037098272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75000037b0 0x7f7500003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.898+0000 7f7516ffd700 1 -- 172.21.15.7:0/3037098272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7500003570 con 0x7f7500004ca0 2023-10-06T10:59:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.899+0000 7f7516ffd700 1 --2- 172.21.15.7:0/3037098272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500004ca0 0x7f7500005090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f750c001b10 tx=0x7f750c007dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7b2f77d8e637bfc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.899+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0048f0 con 0x7f7500004ca0 2023-10-06T10:59:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.899+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c004a70 con 0x7f7500004ca0 2023-10-06T10:59:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.899+0000 7f7515ffb700 1 -- 172.21.15.7:0/3037098272 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c004e30 con 0x7f7500004ca0 2023-10-06T10:59:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.900+0000 7fde2dd9e700 1 -- 172.21.15.7:0/2414158917 shutdown_connections 2023-10-06T10:59:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.900+0000 7f751d911700 1 -- 172.21.15.7:0/3037098272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500004ca0 msgr2=0x7f7500005090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.900+0000 7f751d911700 1 --2- 172.21.15.7:0/3037098272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500004ca0 0x7f7500005090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f750c001b10 tx=0x7f750c007dc0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.900+0000 7f75177fe700 1 -- 172.21.15.7:0/3037098272 reap_dead start 2023-10-06T10:59:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.900+0000 7f751d911700 1 -- 172.21.15.7:0/3037098272 shutdown_connections 2023-10-06T10:59:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.900+0000 7f751d911700 1 -- 172.21.15.7:0/3037098272 >> 172.21.15.7:0/3037098272 conn(0x7f75180cc790 msgr2=0x7f75180c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.900+0000 7f140f2ff700 1 -- 172.21.15.7:0/1965293082 shutdown_connections 2023-10-06T10:59:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.901+0000 7f140f2ff700 1 -- 172.21.15.7:0/1965293082 wait complete. 2023-10-06T10:59:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.900+0000 7fde2dd9e700 1 -- 172.21.15.7:0/2414158917 wait complete. 2023-10-06T10:59:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.901+0000 7fde2dd9e700 1 Processor -- start 2023-10-06T10:59:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.901+0000 7f751d911700 1 -- 172.21.15.7:0/3037098272 shutdown_connections 2023-10-06T10:59:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.901+0000 7fde2dd9e700 1 -- start start 2023-10-06T10:59:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.902+0000 7fde2dd9e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde280af320 0x7fde28177940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.902+0000 7fde2dd9e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde280cb580 0x7fde280c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.902+0000 7fde2dd9e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde280cfb50 0x7fde281764d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.902+0000 7fde2dd9e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde280b2e90 con 0x7fde280cb580 2023-10-06T10:59:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.902+0000 7fde2dd9e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde280c8c10 con 0x7fde280af320 2023-10-06T10:59:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.902+0000 7fde2dd9e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde280c8ef0 con 0x7fde280cfb50 2023-10-06T10:59:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.903+0000 7fde27fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde280cfb50 0x7fde281764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.903+0000 7fde27fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde280cfb50 0x7fde281764d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:35048/0 (socket says 172.21.15.7:35048) 2023-10-06T10:59:24.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.903+0000 7fde27fff700 1 -- 172.21.15.7:0/4290970690 learned_addr learned my addr 172.21.15.7:0/4290970690 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.903+0000 7fde277fe700 1 --2- 172.21.15.7:0/4290970690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde280af320 0x7fde28177940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.903+0000 7fde26ffd700 1 --2- 172.21.15.7:0/4290970690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde280cb580 0x7fde280c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.902+0000 7f751d911700 1 -- 172.21.15.7:0/3037098272 wait complete. 2023-10-06T10:59:24.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7f751d911700 1 Processor -- start 2023-10-06T10:59:24.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.902+0000 7f140f2ff700 1 Processor -- start 2023-10-06T10:59:24.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.903+0000 7f140f2ff700 1 -- start start 2023-10-06T10:59:24.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7fde26ffd700 1 -- 172.21.15.7:0/4290970690 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde280cfb50 msgr2=0x7fde281764d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7fde26ffd700 1 --2- 172.21.15.7:0/4290970690 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde280cfb50 0x7fde281764d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7fde26ffd700 1 -- 172.21.15.7:0/4290970690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde280af320 msgr2=0x7fde28177940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7fde26ffd700 1 --2- 172.21.15.7:0/4290970690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde280af320 0x7fde28177940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7fde26ffd700 1 -- 172.21.15.7:0/4290970690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c009420 con 0x7fde280cb580 2023-10-06T10:59:24.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7f140f2ff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f140806c380 0x7f1408155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7f140f2ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1408159000 0x7f14080a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7f140f2ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14081593d0 0x7f14081525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7f140f2ff700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14080a4940 con 0x7f140806c380 2023-10-06T10:59:24.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7f140f2ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14080a4c20 con 0x7f14081593d0 2023-10-06T10:59:24.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7f140f2ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14080a4f00 con 0x7f1408159000 2023-10-06T10:59:24.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.905+0000 7f140c89a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1408159000 0x7f14080a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.905+0000 7f140c89a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1408159000 0x7f14080a6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:35078/0 (socket says 172.21.15.7:35078) 2023-10-06T10:59:24.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.905+0000 7f140c89a700 1 -- 172.21.15.7:0/3314955464 learned_addr learned my addr 172.21.15.7:0/3314955464 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.905+0000 7f140d89c700 1 --2- 172.21.15.7:0/3314955464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14081593d0 0x7f14081525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.905+0000 7f140d09b700 1 --2- 172.21.15.7:0/3314955464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f140806c380 0x7f1408155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7f751d911700 1 -- start start 2023-10-06T10:59:24.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.905+0000 7f751d911700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75180c4060 0x7f75180ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.905+0000 7f751d911700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75180acc40 0x7f75180c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.905+0000 7f751d911700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75180c4970 0x7f75180af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.905+0000 7f751d911700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75180ad720 con 0x7f75180c4060 2023-10-06T10:59:24.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.905+0000 7f751d911700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75180aef60 con 0x7f75180acc40 2023-10-06T10:59:24.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.905+0000 7f751d911700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75180ad160 con 0x7f75180c4970 2023-10-06T10:59:24.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.905+0000 7f7516ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75180c4060 0x7f75180ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7f75177fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75180c4970 0x7f75180af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7f75167fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75180acc40 0x7f75180c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7f75177fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75180c4970 0x7f75180af3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:35090/0 (socket says 172.21.15.7:35090) 2023-10-06T10:59:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7f75177fe700 1 -- 172.21.15.7:0/2331571738 learned_addr learned my addr 172.21.15.7:0/2331571738 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7f140c89a700 1 -- 172.21.15.7:0/3314955464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14081593d0 msgr2=0x7f14081525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7f140c89a700 1 --2- 172.21.15.7:0/3314955464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14081593d0 0x7f14081525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7f140c89a700 1 -- 172.21.15.7:0/3314955464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f140806c380 msgr2=0x7f1408155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7f140c89a700 1 --2- 172.21.15.7:0/3314955464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f140806c380 0x7f1408155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7f140c89a700 1 -- 172.21.15.7:0/3314955464 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140000d040 con 0x7f1408159000 2023-10-06T10:59:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7fde26ffd700 1 --2- 172.21.15.7:0/4290970690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde280cb580 0x7fde280c83c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fde1c016000 tx=0x7fde1c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.902+0000 7fa228956700 1 Processor -- start 2023-10-06T10:59:24.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.902+0000 7fa228956700 1 -- start start 2023-10-06T10:59:24.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.903+0000 7fa228956700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa2240867a0 0x7fa22416a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.903+0000 7fa228956700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa224086b70 0x7fa22406af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.903+0000 7fa228956700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa224166270 con 0x7fa2240c7520 2023-10-06T10:59:24.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.903+0000 7fa228956700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22416a9a0 con 0x7fa224086b70 2023-10-06T10:59:24.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7f7516ffd700 1 -- 172.21.15.7:0/2331571738 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75180c4970 msgr2=0x7f75180af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7f7516ffd700 1 --2- 172.21.15.7:0/2331571738 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75180c4970 0x7f75180af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7f7516ffd700 1 -- 172.21.15.7:0/2331571738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75180acc40 msgr2=0x7f75180c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7f7516ffd700 1 --2- 172.21.15.7:0/2331571738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75180acc40 0x7f75180c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.903+0000 7fa228956700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22406c380 con 0x7fa2240867a0 2023-10-06T10:59:24.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7fa22259c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa2240867a0 0x7fa22416a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7fa22259c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa2240867a0 0x7fa22416a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:35064/0 (socket says 172.21.15.7:35064) 2023-10-06T10:59:24.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7fa22259c700 1 -- 172.21.15.7:0/1078520992 learned_addr learned my addr 172.21.15.7:0/1078520992 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7f7516ffd700 1 -- 172.21.15.7:0/2331571738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180ad440 con 0x7f75180c4060 2023-10-06T10:59:24.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.904+0000 7fa221d9b700 1 --2- 172.21.15.7:0/1078520992 >> v2:172.21.15.50:3300/0 conn(0x7fa224086b70 0x7fa22406af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.905+0000 7fa22159a700 1 -- 172.21.15.7:0/1078520992 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989287708 0 0) 0x7fa21c001490 con 0x7fa2240c7520 2023-10-06T10:59:24.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.906+0000 7fa22159a700 1 -- 172.21.15.7:0/1078520992 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa20c007980 con 0x7fa2240c7520 2023-10-06T10:59:24.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7f140c89a700 1 --2- 172.21.15.7:0/3314955464 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1408159000 0x7f14080a6c50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f14080c9840 tx=0x7f1400019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7f7516ffd700 1 --2- 172.21.15.7:0/2331571738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75180c4060 0x7f75180ac700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f750c014000 tx=0x7f750c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22159a700 1 -- 172.21.15.7:0/1078520992 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4041711561 0 0) 0x7fa20c007980 con 0x7fa2240c7520 2023-10-06T10:59:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22159a700 1 -- 172.21.15.7:0/1078520992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa2240867a0 msgr2=0x7fa22416a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22159a700 1 --2- 172.21.15.7:0/1078520992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa2240867a0 0x7fa22416a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22159a700 1 -- 172.21.15.7:0/1078520992 >> v2:172.21.15.50:3300/0 conn(0x7fa224086b70 msgr2=0x7fa22406af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22159a700 1 --2- 172.21.15.7:0/1078520992 >> v2:172.21.15.50:3300/0 conn(0x7fa224086b70 0x7fa22406af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22159a700 1 -- 172.21.15.7:0/1078520992 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa224068100 con 0x7fa2240c7520 2023-10-06T10:59:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22159a700 1 -- 172.21.15.7:0/1078520992 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7fa21c001980 con 0x7fa2240c7520 2023-10-06T10:59:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22159a700 1 -- 172.21.15.7:0/1078520992 >> v1:172.21.15.7:6789/0 conn(0x7fa2240c7520 legacy=0x7fa2240c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22159a700 1 --2- 172.21.15.7:0/1078520992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa20c007ef0 0x7fa20c008300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22159a700 1 --2- 172.21.15.7:0/1078520992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa20c008c20 0x7fa20c009090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22159a700 1 --2- 172.21.15.7:0/1078520992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa2240867a0 0x7fa20c0095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22159a700 1 -- 172.21.15.7:0/1078520992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22416a9a0 con 0x7fa20c008c20 2023-10-06T10:59:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22159a700 1 -- 172.21.15.7:0/1078520992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22406c380 con 0x7fa20c007ef0 2023-10-06T10:59:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22159a700 1 -- 172.21.15.7:0/1078520992 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c007560 con 0x7fa2240867a0 2023-10-06T10:59:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fde0f7fe700 1 -- 172.21.15.7:0/4290970690 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00ba20 con 0x7fde280cb580 2023-10-06T10:59:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fde0f7fe700 1 -- 172.21.15.7:0/4290970690 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c00bb80 con 0x7fde280cb580 2023-10-06T10:59:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fde0f7fe700 1 -- 172.21.15.7:0/4290970690 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c026660 con 0x7fde280cb580 2023-10-06T10:59:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fde2dd9e700 1 -- 172.21.15.7:0/4290970690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde280c91d0 con 0x7fde280cb580 2023-10-06T10:59:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fde2dd9e700 1 -- 172.21.15.7:0/4290970690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde280c8900 con 0x7fde280cb580 2023-10-06T10:59:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa22259c700 1 --2- 172.21.15.7:0/1078520992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa20c007ef0 0x7fa20c008300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.907+0000 7fa222d9d700 1 --2- 172.21.15.7:0/1078520992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa2240867a0 0x7fa20c0095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7fa221d9b700 1 --2- 172.21.15.7:0/1078520992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa20c008c20 0x7fa20c009090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7f13fd7fa700 1 -- 172.21.15.7:0/3314955464 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400011d50 con 0x7f1408159000 2023-10-06T10:59:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7f13fd7fa700 1 -- 172.21.15.7:0/3314955464 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140001a450 con 0x7f1408159000 2023-10-06T10:59:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7f13fd7fa700 1 -- 172.21.15.7:0/3314955464 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140001a810 con 0x7f1408159000 2023-10-06T10:59:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7f140f2ff700 1 -- 172.21.15.7:0/3314955464 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14080a51e0 con 0x7f1408159000 2023-10-06T10:59:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7f140f2ff700 1 -- 172.21.15.7:0/3314955464 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14081560f0 con 0x7f1408159000 2023-10-06T10:59:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7fa22259c700 1 -- 172.21.15.7:0/1078520992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa2240867a0 msgr2=0x7fa20c0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7fa22259c700 1 --2- 172.21.15.7:0/1078520992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa2240867a0 0x7fa20c0095d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7fa22259c700 1 -- 172.21.15.7:0/1078520992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa20c008c20 msgr2=0x7fa20c009090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7fa22259c700 1 --2- 172.21.15.7:0/1078520992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa20c008c20 0x7fa20c009090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7fa22259c700 1 -- 172.21.15.7:0/1078520992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c007980 con 0x7fa20c007ef0 2023-10-06T10:59:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7fa221d9b700 1 --2- 172.21.15.7:0/1078520992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa20c008c20 0x7fa20c009090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7fa22259c700 1 --2- 172.21.15.7:0/1078520992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa20c007ef0 0x7fa20c008300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa218006fd0 tx=0x7fa21800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4368a2cc878f005b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7fa22159a700 1 -- 172.21.15.7:0/1078520992 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218009030 con 0x7fa20c007ef0 2023-10-06T10:59:24.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7fa22159a700 1 -- 172.21.15.7:0/1078520992 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21800f040 con 0x7fa20c007ef0 2023-10-06T10:59:24.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.908+0000 7fa22159a700 1 -- 172.21.15.7:0/1078520992 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21800e680 con 0x7fa20c007ef0 2023-10-06T10:59:24.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.910+0000 7fde0f7fe700 1 -- 172.21.15.7:0/4290970690 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde1c011420 con 0x7fde280cb580 2023-10-06T10:59:24.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.909+0000 7fa228956700 1 -- 172.21.15.7:0/1078520992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa20c007ef0 msgr2=0x7fa20c008300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.909+0000 7fa228956700 1 --2- 172.21.15.7:0/1078520992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa20c007ef0 0x7fa20c008300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa218006fd0 tx=0x7fa21800b040 comp rx=0 tx=0).stop 2023-10-06T10:59:24.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.909+0000 7fa222d9d700 1 -- 172.21.15.7:0/1078520992 reap_dead start 2023-10-06T10:59:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.909+0000 7fa228956700 1 -- 172.21.15.7:0/1078520992 shutdown_connections 2023-10-06T10:59:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.909+0000 7fa228956700 1 -- 172.21.15.7:0/1078520992 >> 172.21.15.7:0/1078520992 conn(0x7fa2240c8730 msgr2=0x7fa2240c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.910+0000 7f140f2ff700 1 -- 172.21.15.7:0/3314955464 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1408070480 con 0x7f1408159000 2023-10-06T10:59:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.910+0000 7fde0f7fe700 1 --2- 172.21.15.7:0/4290970690 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fde10067160 0x7fde10069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.910+0000 7fde0f7fe700 1 -- 172.21.15.7:0/4290970690 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fde1c0862f0 con 0x7fde280cb580 2023-10-06T10:59:24.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.911+0000 7fde277fe700 1 --2- 172.21.15.7:0/4290970690 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fde10067160 0x7fde10069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.911+0000 7fa228956700 1 -- 172.21.15.7:0/1078520992 shutdown_connections 2023-10-06T10:59:24.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.911+0000 7f74feffd700 1 -- 172.21.15.7:0/2331571738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0048f0 con 0x7f75180c4060 2023-10-06T10:59:24.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.911+0000 7f74feffd700 1 -- 172.21.15.7:0/2331571738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c000ed0 con 0x7f75180c4060 2023-10-06T10:59:24.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.911+0000 7f74feffd700 1 -- 172.21.15.7:0/2331571738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00c8d0 con 0x7f75180c4060 2023-10-06T10:59:24.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.911+0000 7f751d911700 1 -- 172.21.15.7:0/2331571738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75180aebf0 con 0x7f75180c4060 2023-10-06T10:59:24.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.911+0000 7f751d911700 1 -- 172.21.15.7:0/2331571738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75180ae2f0 con 0x7f75180c4060 2023-10-06T10:59:24.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.912+0000 7fde277fe700 1 --2- 172.21.15.7:0/4290970690 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fde10067160 0x7fde10069610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fde18006fd0 tx=0x7fde18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.911+0000 7f13fd7fa700 1 -- 172.21.15.7:0/3314955464 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1400003050 con 0x7f1408159000 2023-10-06T10:59:24.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.911+0000 7f13fd7fa700 1 --2- 172.21.15.7:0/3314955464 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f13ec067080 0x7f13ec069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.912+0000 7f13fd7fa700 1 -- 172.21.15.7:0/3314955464 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1400086570 con 0x7f1408159000 2023-10-06T10:59:24.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.912+0000 7fa228956700 1 -- 172.21.15.7:0/1078520992 wait complete. 2023-10-06T10:59:24.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.912+0000 7fde2dd9e700 1 -- 172.21.15.7:0/4290970690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde280af8c0 con 0x7fde280cb580 2023-10-06T10:59:24.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.913+0000 7f140d09b700 1 --2- 172.21.15.7:0/3314955464 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f13ec067080 0x7f13ec069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.913+0000 7fa228956700 1 Processor -- start 2023-10-06T10:59:24.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.912+0000 7f751d911700 1 -- 172.21.15.7:0/2331571738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f80052b0 con 0x7f75180c4060 2023-10-06T10:59:24.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.914+0000 7fa228956700 1 -- start start 2023-10-06T10:59:24.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.914+0000 7fa228956700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2241675a0 0x7fa224167970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.914+0000 7fa228956700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa2241683a0 0x7fa2240aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.914+0000 7fa228956700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa224176950 0x7fa2240c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.914+0000 7fa228956700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2240c5b40 con 0x7fa2241675a0 2023-10-06T10:59:24.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.914+0000 7fa228956700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2240c3eb0 con 0x7fa224176950 2023-10-06T10:59:24.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.914+0000 7fa228956700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2240af130 con 0x7fa2241683a0 2023-10-06T10:59:24.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.915+0000 7fa222d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa224176950 0x7fa2240c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.915+0000 7fa222d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa224176950 0x7fa2240c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:39276/0 (socket says 172.21.15.7:39276) 2023-10-06T10:59:24.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.915+0000 7fa222d9d700 1 -- 172.21.15.7:0/162762823 learned_addr learned my addr 172.21.15.7:0/162762823 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.915+0000 7fa222d9d700 1 -- 172.21.15.7:0/162762823 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa2241683a0 msgr2=0x7fa2240aeac0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T10:59:24.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.915+0000 7fa222d9d700 1 --2- 172.21.15.7:0/162762823 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa2241683a0 0x7fa2240aeac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.915+0000 7fa222d9d700 1 -- 172.21.15.7:0/162762823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2241675a0 msgr2=0x7fa224167970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.915+0000 7fa222d9d700 1 --2- 172.21.15.7:0/162762823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2241675a0 0x7fa224167970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.915+0000 7fa222d9d700 1 -- 172.21.15.7:0/162762823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2240af410 con 0x7fa224176950 2023-10-06T10:59:24.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.914+0000 7f74feffd700 1 -- 172.21.15.7:0/2331571738 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f750c00cc40 con 0x7f75180c4060 2023-10-06T10:59:24.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.915+0000 7f74feffd700 1 --2- 172.21.15.7:0/2331571738 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f75040670b0 0x7f7504069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.915+0000 7f74feffd700 1 -- 172.21.15.7:0/2331571738 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f750c0862a0 con 0x7f75180c4060 2023-10-06T10:59:24.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.915+0000 7fa222d9d700 1 --2- 172.21.15.7:0/162762823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa224176950 0x7fa2240c4650 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa22406c2f0 tx=0x7fa22406a520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.916+0000 7fa2127fc700 1 -- 172.21.15.7:0/162762823 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c001490 con 0x7fa224176950 2023-10-06T10:59:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.916+0000 7fa2127fc700 1 -- 172.21.15.7:0/162762823 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c00db00 con 0x7fa224176950 2023-10-06T10:59:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.916+0000 7fa2127fc700 1 -- 172.21.15.7:0/162762823 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c00dec0 con 0x7fa224176950 2023-10-06T10:59:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.916+0000 7f97adba5700 1 Processor -- start 2023-10-06T10:59:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.916+0000 7f13fd7fa700 1 -- 172.21.15.7:0/3314955464 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1400053370 con 0x7f1408159000 2023-10-06T10:59:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.917+0000 7f56c57fd700 1 Processor -- start 2023-10-06T10:59:24.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.917+0000 7f97adba5700 1 -- start start 2023-10-06T10:59:24.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.916+0000 7fa228956700 1 -- 172.21.15.7:0/162762823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2240c4150 con 0x7fa224176950 2023-10-06T10:59:24.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.916+0000 7fa228956700 1 -- 172.21.15.7:0/162762823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa224176db0 con 0x7fa224176950 2023-10-06T10:59:24.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.917+0000 7fa228956700 1 -- 172.21.15.7:0/162762823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa224177090 con 0x7fa224176950 2023-10-06T10:59:24.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.917+0000 7f56c57fd700 1 -- start start 2023-10-06T10:59:24.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.918+0000 7f75167fc700 1 --2- 172.21.15.7:0/2331571738 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f75040670b0 0x7f7504069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.918+0000 7f97adba5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97a806f780 0x7f97a80cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.918+0000 7f97adba5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97a81618d0 0x7f97a815cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.918+0000 7f97adba5700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a80b36b0 con 0x7f97a80cc680 2023-10-06T10:59:24.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.918+0000 7f97adba5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a80cdb70 con 0x7f97a806f780 2023-10-06T10:59:24.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.918+0000 7f97adba5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a80cd890 con 0x7f97a81618d0 2023-10-06T10:59:24.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.918+0000 7f56c57fd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56c0159000 0x7f56c00c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.918+0000 7f56c57fd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56c006efe0 0x7f56c013b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.918+0000 7f56c57fd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c0067290 con 0x7f56c01593d0 2023-10-06T10:59:24.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f97a77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97a806f780 0x7f97a80cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.918+0000 7f56c57fd700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c0067570 con 0x7f56c0159000 2023-10-06T10:59:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.918+0000 7f56c57fd700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c0067850 con 0x7f56c006efe0 2023-10-06T10:59:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f97a77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97a806f780 0x7f97a80cd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:39288/0 (socket says 172.21.15.7:39288) 2023-10-06T10:59:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f97a77fe700 1 -- 172.21.15.7:0/2518898529 learned_addr learned my addr 172.21.15.7:0/2518898529 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f56bf7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f56c01593d0 0x7f56c006be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:56220/0 (socket says 172.21.15.7:56220) 2023-10-06T10:59:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f56bf7fe700 1 -- 172.21.15.7:0/3699161828 learned_addr learned my addr 172.21.15.7:0/3699161828 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f56be7fc700 1 --2- 172.21.15.7:0/3699161828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56c006efe0 0x7f56c013b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f97a7fff700 1 --2- 172.21.15.7:0/2518898529 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97a81618d0 0x7f97a815cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f97a77fe700 1 -- 172.21.15.7:0/2518898529 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97a81618d0 msgr2=0x7f97a815cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f97a77fe700 1 --2- 172.21.15.7:0/2518898529 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97a81618d0 0x7f97a815cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f97a77fe700 1 -- 172.21.15.7:0/2518898529 >> v1:172.21.15.7:6789/0 conn(0x7f97a80cc680 legacy=0x7f97a81611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f97a77fe700 1 -- 172.21.15.7:0/2518898529 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a80b3060 con 0x7f97a806f780 2023-10-06T10:59:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f56bdffb700 1 -- 172.21.15.7:0/3699161828 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548789691 0 0) 0x7f56c0067290 con 0x7f56c01593d0 2023-10-06T10:59:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f56bdffb700 1 -- 172.21.15.7:0/3699161828 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56a8003570 con 0x7f56c01593d0 2023-10-06T10:59:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f56be7fc700 1 -- 172.21.15.7:0/3699161828 >> v2:172.21.15.7:3300/0 conn(0x7f56c0159000 msgr2=0x7f56c00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f56be7fc700 1 --2- 172.21.15.7:0/3699161828 >> v2:172.21.15.7:3300/0 conn(0x7f56c0159000 0x7f56c00c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f56be7fc700 1 -- 172.21.15.7:0/3699161828 >> v1:172.21.15.50:6789/0 conn(0x7f56c01593d0 legacy=0x7f56c006be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f56be7fc700 1 -- 172.21.15.7:0/3699161828 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c0067b30 con 0x7f56c006efe0 2023-10-06T10:59:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.919+0000 7f97a77fe700 1 --2- 172.21.15.7:0/2518898529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97a806f780 0x7f97a80cd040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f97980099b0 tx=0x7f9798009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2d9805abf911413 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.920+0000 7f75167fc700 1 --2- 172.21.15.7:0/2331571738 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f75040670b0 0x7f7504069560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f751813a500 tx=0x7f7508007570 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.920+0000 7f56be7fc700 1 --2- 172.21.15.7:0/3699161828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56c006efe0 0x7f56c013b2d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f56b00098e0 tx=0x7f56b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b99ea780d79639e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.920+0000 7f56bdffb700 1 -- 172.21.15.7:0/3699161828 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b000b640 con 0x7f56c006efe0 2023-10-06T10:59:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.920+0000 7f56bdffb700 1 -- 172.21.15.7:0/3699161828 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b000b7a0 con 0x7f56c006efe0 2023-10-06T10:59:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.920+0000 7f56bdffb700 1 -- 172.21.15.7:0/3699161828 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b000bb40 con 0x7f56c006efe0 2023-10-06T10:59:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.920+0000 7f140d09b700 1 --2- 172.21.15.7:0/3314955464 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f13ec067080 0x7f13ec069530 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009fd0 tx=0x7f13f8009a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.921+0000 7f56c57fd700 1 -- 172.21.15.7:0/3699161828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56c006efe0 msgr2=0x7f56c013b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.921+0000 7f56c57fd700 1 --2- 172.21.15.7:0/3699161828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56c006efe0 0x7f56c013b2d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f56b00098e0 tx=0x7f56b00091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.921+0000 7f56c57fd700 1 -- 172.21.15.7:0/3699161828 shutdown_connections 2023-10-06T10:59:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.921+0000 7f56c57fd700 1 --2- 172.21.15.7:0/3699161828 >> v2:172.21.15.7:3300/0 conn(0x7f56c0159000 0x7f56c00c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.921+0000 7f56c57fd700 1 --2- 172.21.15.7:0/3699161828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56c006efe0 0x7f56c013b2d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.921+0000 7f56c57fd700 1 -- 172.21.15.7:0/3699161828 >> 172.21.15.7:0/3699161828 conn(0x7f56c00c8730 msgr2=0x7f56c00c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.921+0000 7f56c57fd700 1 -- 172.21.15.7:0/3699161828 shutdown_connections 2023-10-06T10:59:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.921+0000 7f56c57fd700 1 -- 172.21.15.7:0/3699161828 wait complete. 2023-10-06T10:59:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.921+0000 7fa2127fc700 1 -- 172.21.15.7:0/162762823 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa21c014680 con 0x7fa224176950 2023-10-06T10:59:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.922+0000 7fa2127fc700 1 --2- 172.21.15.7:0/162762823 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa204066fb0 0x7fa204069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.922+0000 7fa2127fc700 1 -- 172.21.15.7:0/162762823 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa21c0859d0 con 0x7fa224176950 2023-10-06T10:59:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.923+0000 7f56c57fd700 1 Processor -- start 2023-10-06T10:59:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.924+0000 7fde0f7fe700 1 -- 172.21.15.7:0/4290970690 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde1c0531f0 con 0x7fde280cb580 2023-10-06T10:59:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.924+0000 7fa22259c700 1 --2- 172.21.15.7:0/162762823 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa204066fb0 0x7fa204069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.925+0000 7fa22259c700 1 --2- 172.21.15.7:0/162762823 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa204066fb0 0x7fa204069460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa22406f300 tx=0x7fa218019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.925+0000 7fa2127fc700 1 -- 172.21.15.7:0/162762823 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa21c0527d0 con 0x7fa224176950 2023-10-06T10:59:24.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.924+0000 7f56c57fd700 1 -- start start 2023-10-06T10:59:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.925+0000 7f56c57fd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56c006efe0 0x7f56c0156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.925+0000 7f56c57fd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c0159000 0x7f56c016e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.925+0000 7f56c57fd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56c01593d0 0x7f56c0170af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.925+0000 7f56c57fd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c0157890 con 0x7f56c0159000 2023-10-06T10:59:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.925+0000 7f56c57fd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c00b00b0 con 0x7f56c006efe0 2023-10-06T10:59:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.925+0000 7f56c57fd700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c016eca0 con 0x7f56c01593d0 2023-10-06T10:59:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.926+0000 7f56beffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56c006efe0 0x7f56c0156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.926+0000 7f56beffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56c006efe0 0x7f56c0156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:39292/0 (socket says 172.21.15.7:39292) 2023-10-06T10:59:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.926+0000 7f56beffd700 1 -- 172.21.15.7:0/1831085247 learned_addr learned my addr 172.21.15.7:0/1831085247 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.926+0000 7f56beffd700 1 -- 172.21.15.7:0/1831085247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56c01593d0 msgr2=0x7f56c0170af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T10:59:24.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.926+0000 7f56beffd700 1 --2- 172.21.15.7:0/1831085247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56c01593d0 0x7f56c0170af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.926+0000 7f56beffd700 1 -- 172.21.15.7:0/1831085247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c0159000 msgr2=0x7f56c016e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.926+0000 7f56beffd700 1 --2- 172.21.15.7:0/1831085247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c0159000 0x7f56c016e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.926+0000 7f56beffd700 1 -- 172.21.15.7:0/1831085247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b0009420 con 0x7f56c006efe0 2023-10-06T10:59:24.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.927+0000 7f56beffd700 1 --2- 172.21.15.7:0/1831085247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56c006efe0 0x7f56c0156960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f56b800bc60 tx=0x7f56b8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.927+0000 7f74feffd700 1 -- 172.21.15.7:0/2331571738 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f750c0530a0 con 0x7f75180c4060 2023-10-06T10:59:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.927+0000 7f97a67fc700 1 -- 172.21.15.7:0/2518898529 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800b820 con 0x7f97a806f780 2023-10-06T10:59:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.927+0000 7f56a6ffd700 1 -- 172.21.15.7:0/1831085247 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b80092e0 con 0x7f56c006efe0 2023-10-06T10:59:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.927+0000 7f56a6ffd700 1 -- 172.21.15.7:0/1831085247 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b800c7b0 con 0x7f56c006efe0 2023-10-06T10:59:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.927+0000 7f56a6ffd700 1 -- 172.21.15.7:0/1831085247 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b800cb90 con 0x7f56c006efe0 2023-10-06T10:59:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.927+0000 7f97a67fc700 1 -- 172.21.15.7:0/2518898529 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979800b980 con 0x7f97a806f780 2023-10-06T10:59:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.927+0000 7f97a67fc700 1 -- 172.21.15.7:0/2518898529 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800bd20 con 0x7f97a806f780 2023-10-06T10:59:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.928+0000 7f97adba5700 1 -- 172.21.15.7:0/2518898529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97a806f780 msgr2=0x7f97a80cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.928+0000 7f97adba5700 1 --2- 172.21.15.7:0/2518898529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97a806f780 0x7f97a80cd040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f97980099b0 tx=0x7f9798009250 comp rx=0 tx=0).stop 2023-10-06T10:59:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.928+0000 7f56c57fd700 1 -- 172.21.15.7:0/1831085247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c0156ff0 con 0x7f56c006efe0 2023-10-06T10:59:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.928+0000 7f56c57fd700 1 -- 172.21.15.7:0/1831085247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c01575b0 con 0x7f56c006efe0 2023-10-06T10:59:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.929+0000 7f56c57fd700 1 -- 172.21.15.7:0/1831085247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c0070480 con 0x7f56c006efe0 2023-10-06T10:59:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.930+0000 7f56a6ffd700 1 -- 172.21.15.7:0/1831085247 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f56b8012070 con 0x7f56c006efe0 2023-10-06T10:59:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.930+0000 7f56a6ffd700 1 --2- 172.21.15.7:0/1831085247 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f56ac067000 0x7f56ac0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.931+0000 7f56a6ffd700 1 -- 172.21.15.7:0/1831085247 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f56b8084590 con 0x7f56c006efe0 2023-10-06T10:59:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.931+0000 7f56be7fc700 1 --2- 172.21.15.7:0/1831085247 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f56ac067000 0x7f56ac0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.931+0000 7f56be7fc700 1 --2- 172.21.15.7:0/1831085247 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f56ac067000 0x7f56ac0694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f56c006f400 tx=0x7f56b0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.935+0000 7f56a6ffd700 1 -- 172.21.15.7:0/1831085247 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56b8051390 con 0x7f56c006efe0 2023-10-06T10:59:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.939+0000 7f97adba5700 1 -- 172.21.15.7:0/2518898529 shutdown_connections 2023-10-06T10:59:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.939+0000 7f97adba5700 1 --2- 172.21.15.7:0/2518898529 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97a81618d0 0x7f97a815cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.939+0000 7f97adba5700 1 --2- 172.21.15.7:0/2518898529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97a806f780 0x7f97a80cd040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.939+0000 7f97adba5700 1 -- 172.21.15.7:0/2518898529 >> 172.21.15.7:0/2518898529 conn(0x7f97a80670f0 msgr2=0x7f97a80674f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.939+0000 7f97adba5700 1 -- 172.21.15.7:0/2518898529 shutdown_connections 2023-10-06T10:59:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.939+0000 7f97adba5700 1 -- 172.21.15.7:0/2518898529 wait complete. 2023-10-06T10:59:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.941+0000 7f97adba5700 1 Processor -- start 2023-10-06T10:59:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.942+0000 7f97adba5700 1 -- start start 2023-10-06T10:59:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.943+0000 7f97adba5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97a806f780 0x7f97a816e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.943+0000 7f97adba5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a80cc680 0x7f97a80af020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.943+0000 7f97adba5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97a81618d0 0x7f97a80ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.943+0000 7f97adba5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a80c4ea0 con 0x7f97a80cc680 2023-10-06T10:59:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.944+0000 7f97adba5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a80cbda0 con 0x7f97a806f780 2023-10-06T10:59:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.944+0000 7f97adba5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a816e8a0 con 0x7f97a81618d0 2023-10-06T10:59:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.944+0000 7f97a6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a80cc680 0x7f97a80af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.944+0000 7f97a6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a80cc680 0x7f97a80af020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43548/0 (socket says 172.21.15.7:43548) 2023-10-06T10:59:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.944+0000 7f97a6ffd700 1 -- 172.21.15.7:0/627930645 learned_addr learned my addr 172.21.15.7:0/627930645 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.944+0000 7f97a77fe700 1 --2- 172.21.15.7:0/627930645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97a806f780 0x7f97a816e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.945+0000 7f97a7fff700 1 --2- 172.21.15.7:0/627930645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97a81618d0 0x7f97a80ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.945+0000 7f97a6ffd700 1 -- 172.21.15.7:0/627930645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97a81618d0 msgr2=0x7f97a80ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.945+0000 7f97a6ffd700 1 --2- 172.21.15.7:0/627930645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97a81618d0 0x7f97a80ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.945+0000 7f97a6ffd700 1 -- 172.21.15.7:0/627930645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97a806f780 msgr2=0x7f97a816e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.945+0000 7f97a6ffd700 1 --2- 172.21.15.7:0/627930645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97a806f780 0x7f97a816e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.945+0000 7f97a6ffd700 1 -- 172.21.15.7:0/627930645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97980094f0 con 0x7f97a80cc680 2023-10-06T10:59:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.945+0000 7f97a6ffd700 1 --2- 172.21.15.7:0/627930645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a80cc680 0x7f97a80af020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f979c00b600 tx=0x7f979c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.946+0000 7f978f7fe700 1 -- 172.21.15.7:0/627930645 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c00f510 con 0x7f97a80cc680 2023-10-06T10:59:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.946+0000 7f978f7fe700 1 -- 172.21.15.7:0/627930645 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c00f690 con 0x7f97a80cc680 2023-10-06T10:59:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.946+0000 7f978f7fe700 1 -- 172.21.15.7:0/627930645 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c00fa50 con 0x7f97a80cc680 2023-10-06T10:59:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.947+0000 7f97adba5700 1 -- 172.21.15.7:0/627930645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a80c6380 con 0x7f97a80cc680 2023-10-06T10:59:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.947+0000 7f97adba5700 1 -- 172.21.15.7:0/627930645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a8171990 con 0x7f97a80cc680 2023-10-06T10:59:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.949+0000 7f978f7fe700 1 -- 172.21.15.7:0/627930645 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f979c01a400 con 0x7f97a80cc680 2023-10-06T10:59:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.950+0000 7f978f7fe700 1 --2- 172.21.15.7:0/627930645 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f97900671e0 0x7f9790069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.950+0000 7f978f7fe700 1 -- 172.21.15.7:0/627930645 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f979c084210 con 0x7f97a80cc680 2023-10-06T10:59:24.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.951+0000 7f97a77fe700 1 --2- 172.21.15.7:0/627930645 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f97900671e0 0x7f9790069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.952+0000 7f97a77fe700 1 --2- 172.21.15.7:0/627930645 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f97900671e0 0x7f9790069690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f97980099b0 tx=0x7f9798016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.966+0000 7f97adba5700 1 -- 172.21.15.7:0/627930645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97880052b0 con 0x7f97a80cc680 2023-10-06T10:59:24.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.977+0000 7f978f7fe700 1 -- 172.21.15.7:0/627930645 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f979c051090 con 0x7f97a80cc680 2023-10-06T10:59:24.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.985+0000 7f9616efc700 1 Processor -- start 2023-10-06T10:59:24.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.985+0000 7f9616efc700 1 -- start start 2023-10-06T10:59:24.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.987+0000 7f9616efc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96100c7c30 0x7f961016a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.987+0000 7f9616efc700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9610166270 con 0x7f96100867a0 2023-10-06T10:59:24.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.987+0000 7f9616efc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961006c380 con 0x7f9610086b70 2023-10-06T10:59:24.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.987+0000 7f9616efc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961016a9a0 con 0x7f96100c7c30 2023-10-06T10:59:24.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.987+0000 7f9615499700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96100c7c30 0x7f961016a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.987+0000 7f9615499700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96100c7c30 0x7f961016a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:39310/0 (socket says 172.21.15.7:39310) 2023-10-06T10:59:24.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.987+0000 7f9615499700 1 -- 172.21.15.7:0/1714349801 learned_addr learned my addr 172.21.15.7:0/1714349801 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.991+0000 7f960f7fe700 1 -- 172.21.15.7:0/1714349801 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568123838 0 0) 0x7f961006c380 con 0x7f9610086b70 2023-10-06T10:59:24.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.991+0000 7f960f7fe700 1 -- 172.21.15.7:0/1714349801 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f80039c0 con 0x7f9610086b70 2023-10-06T10:59:24.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.991+0000 7f9615499700 1 -- 172.21.15.7:0/1714349801 >> v1:172.21.15.50:6789/0 conn(0x7f9610086b70 legacy=0x7f96100c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.991+0000 7f9615499700 1 -- 172.21.15.7:0/1714349801 >> v1:172.21.15.7:6789/0 conn(0x7f96100867a0 legacy=0x7f961006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.992+0000 7f9615499700 1 -- 172.21.15.7:0/1714349801 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610068100 con 0x7f96100c7c30 2023-10-06T10:59:24.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.992+0000 7f9615499700 1 --2- 172.21.15.7:0/1714349801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100c7c30 0x7f961016a460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f960000ba70 tx=0x7f9600009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=241c2dc6db927737 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:24.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.992+0000 7f960f7fe700 1 -- 172.21.15.7:0/1714349801 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600009e20 con 0x7f96100c7c30 2023-10-06T10:59:24.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.992+0000 7f960f7fe700 1 -- 172.21.15.7:0/1714349801 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960000b360 con 0x7f96100c7c30 2023-10-06T10:59:24.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.992+0000 7f960f7fe700 1 -- 172.21.15.7:0/1714349801 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000b700 con 0x7f96100c7c30 2023-10-06T10:59:24.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.993+0000 7f9616efc700 1 -- 172.21.15.7:0/1714349801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100c7c30 msgr2=0x7f961016a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.993+0000 7f9616efc700 1 --2- 172.21.15.7:0/1714349801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100c7c30 0x7f961016a460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f960000ba70 tx=0x7f9600009250 comp rx=0 tx=0).stop 2023-10-06T10:59:24.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.993+0000 7f9616efc700 1 -- 172.21.15.7:0/1714349801 shutdown_connections 2023-10-06T10:59:24.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.993+0000 7f9616efc700 1 --2- 172.21.15.7:0/1714349801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100c7c30 0x7f961016a460 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.993+0000 7f9616efc700 1 -- 172.21.15.7:0/1714349801 >> 172.21.15.7:0/1714349801 conn(0x7f96100c8730 msgr2=0x7f96100c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:24.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.993+0000 7f9616efc700 1 -- 172.21.15.7:0/1714349801 shutdown_connections 2023-10-06T10:59:24.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.993+0000 7f9616efc700 1 -- 172.21.15.7:0/1714349801 wait complete. 2023-10-06T10:59:24.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.995+0000 7f9616efc700 1 Processor -- start 2023-10-06T10:59:24.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.996+0000 7f9616efc700 1 -- start start 2023-10-06T10:59:24.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.997+0000 7f9616efc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f96100867a0 0x7f961017e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.997+0000 7f9616efc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9610086b70 0x7f961015c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.997+0000 7f9616efc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100c7c30 0x7f961015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:24.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.997+0000 7f9616efc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96100c4c60 con 0x7f9610086b70 2023-10-06T10:59:24.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.997+0000 7f9616efc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9610182a00 con 0x7f96100c7c30 2023-10-06T10:59:24.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.997+0000 7f9616efc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9610182ce0 con 0x7f96100867a0 2023-10-06T10:59:24.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.997+0000 7f960ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9610086b70 0x7f961015c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.997+0000 7f960ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9610086b70 0x7f961015c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43554/0 (socket says 172.21.15.7:43554) 2023-10-06T10:59:24.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.997+0000 7f960ffff700 1 -- 172.21.15.7:0/394155326 learned_addr learned my addr 172.21.15.7:0/394155326 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:24.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.998+0000 7f9615499700 1 --2- 172.21.15.7:0/394155326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100c7c30 0x7f961015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:24.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.998+0000 7f960ffff700 1 -- 172.21.15.7:0/394155326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f96100867a0 msgr2=0x7f961017e3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T10:59:24.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.998+0000 7f960ffff700 1 --2- 172.21.15.7:0/394155326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f96100867a0 0x7f961017e3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:24.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.998+0000 7f960ffff700 1 -- 172.21.15.7:0/394155326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100c7c30 msgr2=0x7f961015cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:24.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.998+0000 7f960ffff700 1 --2- 172.21.15.7:0/394155326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100c7c30 0x7f961015cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.998+0000 7f960ffff700 1 -- 172.21.15.7:0/394155326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000094f0 con 0x7f9610086b70 2023-10-06T10:59:25.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:24.998+0000 7f960ffff700 1 --2- 172.21.15.7:0/394155326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9610086b70 0x7f961015c600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f960800cb10 tx=0x7f9608002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:25.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.000+0000 7f960cff9700 1 -- 172.21.15.7:0/394155326 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800a7e0 con 0x7f9610086b70 2023-10-06T10:59:25.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.000+0000 7f960cff9700 1 -- 172.21.15.7:0/394155326 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960800a940 con 0x7f9610086b70 2023-10-06T10:59:25.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.000+0000 7f960cff9700 1 -- 172.21.15.7:0/394155326 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800ad00 con 0x7f9610086b70 2023-10-06T10:59:25.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.000+0000 7f9616efc700 1 -- 172.21.15.7:0/394155326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96100c48f0 con 0x7f9610086b70 2023-10-06T10:59:25.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.000+0000 7f9616efc700 1 -- 172.21.15.7:0/394155326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96100c4510 con 0x7f9610086b70 2023-10-06T10:59:25.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.002+0000 7f9616efc700 1 -- 172.21.15.7:0/394155326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f00052b0 con 0x7f9610086b70 2023-10-06T10:59:25.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.003+0000 7f960cff9700 1 -- 172.21.15.7:0/394155326 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9608012630 con 0x7f9610086b70 2023-10-06T10:59:25.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.004+0000 7f960cff9700 1 --2- 172.21.15.7:0/394155326 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f95fc067080 0x7f95fc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:25.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.004+0000 7f960cff9700 1 -- 172.21.15.7:0/394155326 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f96080852d0 con 0x7f9610086b70 2023-10-06T10:59:25.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.006+0000 7f9614c98700 1 --2- 172.21.15.7:0/394155326 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f95fc067080 0x7f95fc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:25.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.007+0000 7f9614c98700 1 --2- 172.21.15.7:0/394155326 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f95fc067080 0x7f95fc069530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9610158f90 tx=0x7f9604007b40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:25.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.012+0000 7f960cff9700 1 -- 172.21.15.7:0/394155326 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9608052150 con 0x7f9610086b70 2023-10-06T10:59:25.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.027+0000 7f813181a700 1 Processor -- start 2023-10-06T10:59:25.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.027+0000 7f813181a700 1 -- start start 2023-10-06T10:59:25.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.028+0000 7f813181a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c15b2f0 0x7f812c15e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:25.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.029+0000 7f813181a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812c06b2a0 con 0x7f812c0c7b40 2023-10-06T10:59:25.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.029+0000 7f813181a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812c06af70 con 0x7f812c0c7770 2023-10-06T10:59:25.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.029+0000 7f813181a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c161920 con 0x7f812c15b2f0 2023-10-06T10:59:25.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.030+0000 7f812affd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f812c0c7770 0x7f812c15abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:56232/0 (socket says 172.21.15.7:56232) 2023-10-06T10:59:25.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.030+0000 7f812affd700 1 -- 172.21.15.7:0/1115997517 learned_addr learned my addr 172.21.15.7:0/1115997517 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:25.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.030+0000 7f812a7fc700 1 --2- 172.21.15.7:0/1115997517 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c15b2f0 0x7f812c15e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:25.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.031+0000 7f8129ffb700 1 -- 172.21.15.7:0/1115997517 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113245033 0 0) 0x7f812c06af70 con 0x7f812c0c7770 2023-10-06T10:59:25.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.031+0000 7f8129ffb700 1 -- 172.21.15.7:0/1115997517 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8114003570 con 0x7f812c0c7770 2023-10-06T10:59:25.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.031+0000 7f812a7fc700 1 -- 172.21.15.7:0/1115997517 >> v1:172.21.15.50:6789/0 conn(0x7f812c0c7770 legacy=0x7f812c15abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.031+0000 7f812a7fc700 1 -- 172.21.15.7:0/1115997517 >> v1:172.21.15.7:6789/0 conn(0x7f812c0c7b40 legacy=0x7f812c06b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:25.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.031+0000 7f812a7fc700 1 -- 172.21.15.7:0/1115997517 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c161c00 con 0x7f812c15b2f0 2023-10-06T10:59:25.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.031+0000 7f812a7fc700 1 --2- 172.21.15.7:0/1115997517 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c15b2f0 0x7f812c15e6e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8120009910 tx=0x7f81200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ae185992c909549 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:25.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.032+0000 7f8129ffb700 1 -- 172.21.15.7:0/1115997517 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812000b640 con 0x7f812c15b2f0 2023-10-06T10:59:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.035+0000 7f8129ffb700 1 -- 172.21.15.7:0/1115997517 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812000b7a0 con 0x7f812c15b2f0 2023-10-06T10:59:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.035+0000 7f8129ffb700 1 -- 172.21.15.7:0/1115997517 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812000bb20 con 0x7f812c15b2f0 2023-10-06T10:59:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.036+0000 7f813181a700 1 -- 172.21.15.7:0/1115997517 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c15b2f0 msgr2=0x7f812c15e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.036+0000 7f813181a700 1 --2- 172.21.15.7:0/1115997517 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c15b2f0 0x7f812c15e6e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8120009910 tx=0x7f81200091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.036+0000 7f813181a700 1 -- 172.21.15.7:0/1115997517 shutdown_connections 2023-10-06T10:59:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.036+0000 7f813181a700 1 --2- 172.21.15.7:0/1115997517 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c15b2f0 0x7f812c15e6e0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8120009910 tx=0x7f81200091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.036+0000 7f813181a700 1 -- 172.21.15.7:0/1115997517 >> 172.21.15.7:0/1115997517 conn(0x7f812c0c8730 msgr2=0x7f812c0c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:25.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.036+0000 7f813181a700 1 -- 172.21.15.7:0/1115997517 shutdown_connections 2023-10-06T10:59:25.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.036+0000 7f813181a700 1 -- 172.21.15.7:0/1115997517 wait complete. 2023-10-06T10:59:25.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.039+0000 7f813181a700 1 Processor -- start 2023-10-06T10:59:25.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.040+0000 7f813181a700 1 -- start start 2023-10-06T10:59:25.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.041+0000 7f813181a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f812c0c7770 0x7f812c15b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:25.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.041+0000 7f813181a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f812c0c7b40 0x7f812c15f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:25.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.041+0000 7f813181a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c149f00 0x7f812c144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:25.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.041+0000 7f813181a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c1602f0 con 0x7f812c0c7770 2023-10-06T10:59:25.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.041+0000 7f813181a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c06ca40 con 0x7f812c0c7b40 2023-10-06T10:59:25.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.041+0000 7f813181a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c15fd30 con 0x7f812c149f00 2023-10-06T10:59:25.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.043+0000 7f812b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c149f00 0x7f812c144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:25.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.045+0000 7f812affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f812c0c7770 0x7f812c15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:25.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.045+0000 7f812affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f812c0c7770 0x7f812c15b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43564/0 (socket says 172.21.15.7:43564) 2023-10-06T10:59:25.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.045+0000 7f812affd700 1 -- 172.21.15.7:0/2388871166 learned_addr learned my addr 172.21.15.7:0/2388871166 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:25.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.046+0000 7f812affd700 1 -- 172.21.15.7:0/2388871166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c149f00 msgr2=0x7f812c144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.046+0000 7f812affd700 1 --2- 172.21.15.7:0/2388871166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c149f00 0x7f812c144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.046+0000 7f812affd700 1 -- 172.21.15.7:0/2388871166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f812c0c7b40 msgr2=0x7f812c15f660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T10:59:25.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.046+0000 7f812affd700 1 --2- 172.21.15.7:0/2388871166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f812c0c7b40 0x7f812c15f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.046+0000 7f812affd700 1 -- 172.21.15.7:0/2388871166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120009420 con 0x7f812c0c7770 2023-10-06T10:59:25.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.046+0000 7f812affd700 1 --2- 172.21.15.7:0/2388871166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f812c0c7770 0x7f812c15b790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f811c00c7c0 tx=0x7f811c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:25.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.047+0000 7f8112ffd700 1 -- 172.21.15.7:0/2388871166 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c005b30 con 0x7f812c0c7770 2023-10-06T10:59:25.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.047+0000 7f8112ffd700 1 -- 172.21.15.7:0/2388871166 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c005c90 con 0x7f812c0c7770 2023-10-06T10:59:25.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.047+0000 7f8112ffd700 1 -- 172.21.15.7:0/2388871166 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c007320 con 0x7f812c0c7770 2023-10-06T10:59:25.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.047+0000 7f813181a700 1 -- 172.21.15.7:0/2388871166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812c160010 con 0x7f812c0c7770 2023-10-06T10:59:25.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.047+0000 7f813181a700 1 -- 172.21.15.7:0/2388871166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812c1594b0 con 0x7f812c0c7770 2023-10-06T10:59:25.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.052+0000 7f8112ffd700 1 -- 172.21.15.7:0/2388871166 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f811c01b400 con 0x7f812c0c7770 2023-10-06T10:59:25.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.053+0000 7f8112ffd700 1 --2- 172.21.15.7:0/2388871166 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8118067080 0x7f8118069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:25.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.053+0000 7f8112ffd700 1 -- 172.21.15.7:0/2388871166 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f811c084560 con 0x7f812c0c7770 2023-10-06T10:59:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.056+0000 7f813181a700 1 -- 172.21.15.7:0/2388871166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c0052b0 con 0x7f812c0c7770 2023-10-06T10:59:25.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.059+0000 7f812a7fc700 1 --2- 172.21.15.7:0/2388871166 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8118067080 0x7f8118069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:25.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.060+0000 7f812a7fc700 1 --2- 172.21.15.7:0/2388871166 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8118067080 0x7f8118069530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f812c0c8690 tx=0x7f8120016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:25.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.066+0000 7f8112ffd700 1 -- 172.21.15.7:0/2388871166 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f811c0513e0 con 0x7f812c0c7770 2023-10-06T10:59:25.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.331+0000 7f751d911700 1 -- 172.21.15.7:0/2331571738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f74f8005560 con 0x7f75180c4060 2023-10-06T10:59:25.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.331+0000 7f140f2ff700 1 -- 172.21.15.7:0/3314955464 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f14080c6840 con 0x7f1408159000 2023-10-06T10:59:25.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.332+0000 7f74feffd700 1 -- 172.21.15.7:0/2331571738 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f750c0566c0 con 0x7f75180c4060 2023-10-06T10:59:25.333 INFO:teuthology.orchestra.run.smithi007.stdout:55834574855 2023-10-06T10:59:25.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.333+0000 7f13fd7fa700 1 -- 172.21.15.7:0/3314955464 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1400056990 con 0x7f1408159000 2023-10-06T10:59:25.336 INFO:teuthology.orchestra.run.smithi007.stdout:55834574855 2023-10-06T10:59:25.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.336+0000 7f140f2ff700 1 -- 172.21.15.7:0/3314955464 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f13ec067080 msgr2=0x7f13ec069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.336+0000 7f140f2ff700 1 --2- 172.21.15.7:0/3314955464 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f13ec067080 0x7f13ec069530 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009fd0 tx=0x7f13f8009a30 comp rx=0 tx=0).stop 2023-10-06T10:59:25.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.336+0000 7f140f2ff700 1 -- 172.21.15.7:0/3314955464 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1408159000 msgr2=0x7f14080a6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.336+0000 7f140f2ff700 1 --2- 172.21.15.7:0/3314955464 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1408159000 0x7f14080a6c50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f14080c9840 tx=0x7f1400019000 comp rx=0 tx=0).stop 2023-10-06T10:59:25.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.336+0000 7f751d911700 1 -- 172.21.15.7:0/2331571738 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f75040670b0 msgr2=0x7f7504069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.336+0000 7f751d911700 1 --2- 172.21.15.7:0/2331571738 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f75040670b0 0x7f7504069560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f751813a500 tx=0x7f7508007570 comp rx=0 tx=0).stop 2023-10-06T10:59:25.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.336+0000 7f751d911700 1 -- 172.21.15.7:0/2331571738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75180c4060 msgr2=0x7f75180ac700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.336+0000 7f751d911700 1 --2- 172.21.15.7:0/2331571738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75180c4060 0x7f75180ac700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f750c014000 tx=0x7f750c015000 comp rx=0 tx=0).stop 2023-10-06T10:59:25.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.337+0000 7f140f2ff700 1 -- 172.21.15.7:0/3314955464 shutdown_connections 2023-10-06T10:59:25.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.337+0000 7f140f2ff700 1 --2- 172.21.15.7:0/3314955464 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f13ec067080 0x7f13ec069530 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.337+0000 7f140f2ff700 1 --2- 172.21.15.7:0/3314955464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f140806c380 0x7f1408155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.337+0000 7f140f2ff700 1 --2- 172.21.15.7:0/3314955464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14081593d0 0x7f14081525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.337+0000 7f140f2ff700 1 --2- 172.21.15.7:0/3314955464 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1408159000 0x7f14080a6c50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.337+0000 7f140f2ff700 1 -- 172.21.15.7:0/3314955464 >> 172.21.15.7:0/3314955464 conn(0x7f14080c8730 msgr2=0x7f14080c1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:25.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.337+0000 7f751d911700 1 -- 172.21.15.7:0/2331571738 shutdown_connections 2023-10-06T10:59:25.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.337+0000 7f751d911700 1 --2- 172.21.15.7:0/2331571738 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f75040670b0 0x7f7504069560 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.337+0000 7f751d911700 1 --2- 172.21.15.7:0/2331571738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75180c4060 0x7f75180ac700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.337+0000 7f751d911700 1 --2- 172.21.15.7:0/2331571738 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75180c4970 0x7f75180af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.337+0000 7f751d911700 1 --2- 172.21.15.7:0/2331571738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75180acc40 0x7f75180c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.337+0000 7f751d911700 1 -- 172.21.15.7:0/2331571738 >> 172.21.15.7:0/2331571738 conn(0x7f75180cc790 msgr2=0x7f7518158870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:25.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.338+0000 7f751d911700 1 -- 172.21.15.7:0/2331571738 shutdown_connections 2023-10-06T10:59:25.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.338+0000 7f751d911700 1 -- 172.21.15.7:0/2331571738 wait complete. 2023-10-06T10:59:25.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.339+0000 7f140f2ff700 1 -- 172.21.15.7:0/3314955464 shutdown_connections 2023-10-06T10:59:25.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.339+0000 7f140f2ff700 1 -- 172.21.15.7:0/3314955464 wait complete. 2023-10-06T10:59:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.356+0000 7fde2dd9e700 1 -- 172.21.15.7:0/4290970690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fde280b3000 con 0x7fde280cb580 2023-10-06T10:59:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.358+0000 7fa228956700 1 -- 172.21.15.7:0/162762823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa224166270 con 0x7fa224176950 2023-10-06T10:59:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.358+0000 7fa2127fc700 1 -- 172.21.15.7:0/162762823 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa224166270 con 0x7fa224176950 2023-10-06T10:59:25.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.358+0000 7fde0f7fe700 1 -- 172.21.15.7:0/4290970690 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde1c015090 con 0x7fde280cb580 2023-10-06T10:59:25.359 INFO:teuthology.orchestra.run.smithi007.stdout:55834574856 2023-10-06T10:59:25.360 INFO:teuthology.orchestra.run.smithi007.stdout:55834574855 2023-10-06T10:59:25.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-10-06T10:59:25.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2023-10-06T10:59:25.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.362+0000 7fde2dd9e700 1 -- 172.21.15.7:0/4290970690 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fde10067160 msgr2=0x7fde10069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.362+0000 7fde2dd9e700 1 --2- 172.21.15.7:0/4290970690 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fde10067160 0x7fde10069610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fde18006fd0 tx=0x7fde18008040 comp rx=0 tx=0).stop 2023-10-06T10:59:25.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.362+0000 7fde2dd9e700 1 -- 172.21.15.7:0/4290970690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde280cb580 msgr2=0x7fde280c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.362+0000 7fde2dd9e700 1 --2- 172.21.15.7:0/4290970690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde280cb580 0x7fde280c83c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fde1c016000 tx=0x7fde1c017000 comp rx=0 tx=0).stop 2023-10-06T10:59:25.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.362+0000 7fde2dd9e700 1 -- 172.21.15.7:0/4290970690 shutdown_connections 2023-10-06T10:59:25.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.362+0000 7fde2dd9e700 1 --2- 172.21.15.7:0/4290970690 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fde10067160 0x7fde10069610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.362+0000 7fde2dd9e700 1 --2- 172.21.15.7:0/4290970690 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde280cfb50 0x7fde281764d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.362+0000 7fde2dd9e700 1 --2- 172.21.15.7:0/4290970690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde280af320 0x7fde28177940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.362+0000 7fde2dd9e700 1 --2- 172.21.15.7:0/4290970690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde280cb580 0x7fde280c83c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.362+0000 7fde2dd9e700 1 -- 172.21.15.7:0/4290970690 >> 172.21.15.7:0/4290970690 conn(0x7fde28067b80 msgr2=0x7fde2815d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:25.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.362+0000 7fde2dd9e700 1 -- 172.21.15.7:0/4290970690 shutdown_connections 2023-10-06T10:59:25.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.362+0000 7fde2dd9e700 1 -- 172.21.15.7:0/4290970690 wait complete. 2023-10-06T10:59:25.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.366+0000 7f56c57fd700 1 -- 172.21.15.7:0/1831085247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f56c006c550 con 0x7f56c006efe0 2023-10-06T10:59:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.366+0000 7fa228956700 1 -- 172.21.15.7:0/162762823 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa204066fb0 msgr2=0x7fa204069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.366+0000 7fa228956700 1 --2- 172.21.15.7:0/162762823 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa204066fb0 0x7fa204069460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa22406f300 tx=0x7fa218019000 comp rx=0 tx=0).stop 2023-10-06T10:59:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.366+0000 7fa228956700 1 -- 172.21.15.7:0/162762823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa224176950 msgr2=0x7fa2240c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.366+0000 7fa228956700 1 --2- 172.21.15.7:0/162762823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa224176950 0x7fa2240c4650 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa22406c2f0 tx=0x7fa22406a520 comp rx=0 tx=0).stop 2023-10-06T10:59:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.366+0000 7fa228956700 1 -- 172.21.15.7:0/162762823 shutdown_connections 2023-10-06T10:59:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.366+0000 7fa228956700 1 --2- 172.21.15.7:0/162762823 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa204066fb0 0x7fa204069460 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.366+0000 7fa228956700 1 --2- 172.21.15.7:0/162762823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2241675a0 0x7fa224167970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.366+0000 7fa228956700 1 --2- 172.21.15.7:0/162762823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa224176950 0x7fa2240c4650 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.366+0000 7fa228956700 1 --2- 172.21.15.7:0/162762823 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa2241683a0 0x7fa2240aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.366+0000 7fa228956700 1 -- 172.21.15.7:0/162762823 >> 172.21.15.7:0/162762823 conn(0x7fa2240c8730 msgr2=0x7fa2240c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:25.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.366+0000 7f56a6ffd700 1 -- 172.21.15.7:0/1831085247 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56b80549b0 con 0x7f56c006efe0 2023-10-06T10:59:25.368 INFO:teuthology.orchestra.run.smithi007.stdout:55834574855 2023-10-06T10:59:25.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.370+0000 7fa228956700 1 -- 172.21.15.7:0/162762823 shutdown_connections 2023-10-06T10:59:25.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.370+0000 7fa228956700 1 -- 172.21.15.7:0/162762823 wait complete. 2023-10-06T10:59:25.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.370+0000 7f56c57fd700 1 -- 172.21.15.7:0/1831085247 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f56ac067000 msgr2=0x7f56ac0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.370+0000 7f56c57fd700 1 --2- 172.21.15.7:0/1831085247 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f56ac067000 0x7f56ac0694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f56c006f400 tx=0x7f56b0017000 comp rx=0 tx=0).stop 2023-10-06T10:59:25.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.370+0000 7f56c57fd700 1 -- 172.21.15.7:0/1831085247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56c006efe0 msgr2=0x7f56c0156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.370+0000 7f56c57fd700 1 --2- 172.21.15.7:0/1831085247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56c006efe0 0x7f56c0156960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f56b800bc60 tx=0x7f56b8009840 comp rx=0 tx=0).stop 2023-10-06T10:59:25.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.370+0000 7f56c57fd700 1 -- 172.21.15.7:0/1831085247 shutdown_connections 2023-10-06T10:59:25.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.370+0000 7f56c57fd700 1 --2- 172.21.15.7:0/1831085247 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f56ac067000 0x7f56ac0694b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.370+0000 7f56c57fd700 1 --2- 172.21.15.7:0/1831085247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56c01593d0 0x7f56c0170af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.370+0000 7f56c57fd700 1 --2- 172.21.15.7:0/1831085247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56c006efe0 0x7f56c0156960 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.370+0000 7f56c57fd700 1 --2- 172.21.15.7:0/1831085247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c0159000 0x7f56c016e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.370+0000 7f56c57fd700 1 -- 172.21.15.7:0/1831085247 >> 172.21.15.7:0/1831085247 conn(0x7f56c00c8730 msgr2=0x7f56c00c1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:25.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.370+0000 7f56c57fd700 1 -- 172.21.15.7:0/1831085247 shutdown_connections 2023-10-06T10:59:25.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.370+0000 7f56c57fd700 1 -- 172.21.15.7:0/1831085247 wait complete. 2023-10-06T10:59:25.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-10-06T10:59:25.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2023-10-06T10:59:25.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2023-10-06T10:59:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.392+0000 7f97adba5700 1 -- 172.21.15.7:0/627930645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9788005560 con 0x7f97a80cc680 2023-10-06T10:59:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.393+0000 7f978f7fe700 1 -- 172.21.15.7:0/627930645 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f979c0546b0 con 0x7f97a80cc680 2023-10-06T10:59:25.393 INFO:teuthology.orchestra.run.smithi007.stdout:55834574856 2023-10-06T10:59:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.395+0000 7f97adba5700 1 -- 172.21.15.7:0/627930645 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f97900671e0 msgr2=0x7f9790069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.395+0000 7f97adba5700 1 --2- 172.21.15.7:0/627930645 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f97900671e0 0x7f9790069690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f97980099b0 tx=0x7f9798016000 comp rx=0 tx=0).stop 2023-10-06T10:59:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.395+0000 7f97adba5700 1 -- 172.21.15.7:0/627930645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a80cc680 msgr2=0x7f97a80af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.395+0000 7f97adba5700 1 --2- 172.21.15.7:0/627930645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a80cc680 0x7f97a80af020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f979c00b600 tx=0x7f979c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.395+0000 7f97adba5700 1 -- 172.21.15.7:0/627930645 shutdown_connections 2023-10-06T10:59:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.395+0000 7f97adba5700 1 --2- 172.21.15.7:0/627930645 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f97900671e0 0x7f9790069690 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.395+0000 7f97adba5700 1 --2- 172.21.15.7:0/627930645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97a81618d0 0x7f97a80ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.395+0000 7f97adba5700 1 --2- 172.21.15.7:0/627930645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97a806f780 0x7f97a816e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.395+0000 7f97adba5700 1 --2- 172.21.15.7:0/627930645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a80cc680 0x7f97a80af020 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.395+0000 7f97adba5700 1 -- 172.21.15.7:0/627930645 >> 172.21.15.7:0/627930645 conn(0x7f97a80670f0 msgr2=0x7f97a8160270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:25.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.395+0000 7f97adba5700 1 -- 172.21.15.7:0/627930645 shutdown_connections 2023-10-06T10:59:25.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.395+0000 7f97adba5700 1 -- 172.21.15.7:0/627930645 wait complete. 2023-10-06T10:59:25.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2023-10-06T10:59:25.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.435+0000 7f9616efc700 1 -- 172.21.15.7:0/394155326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f95f0005830 con 0x7f9610086b70 2023-10-06T10:59:25.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.436+0000 7f960cff9700 1 -- 172.21.15.7:0/394155326 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f960800ae60 con 0x7f9610086b70 2023-10-06T10:59:25.437 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2023-10-06T10:59:25.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.438+0000 7f9616efc700 1 -- 172.21.15.7:0/394155326 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f95fc067080 msgr2=0x7f95fc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.438+0000 7f9616efc700 1 --2- 172.21.15.7:0/394155326 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f95fc067080 0x7f95fc069530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9610158f90 tx=0x7f9604007b40 comp rx=0 tx=0).stop 2023-10-06T10:59:25.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.438+0000 7f9616efc700 1 -- 172.21.15.7:0/394155326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9610086b70 msgr2=0x7f961015c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.438+0000 7f9616efc700 1 --2- 172.21.15.7:0/394155326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9610086b70 0x7f961015c600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f960800cb10 tx=0x7f9608002820 comp rx=0 tx=0).stop 2023-10-06T10:59:25.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.438+0000 7f9616efc700 1 -- 172.21.15.7:0/394155326 shutdown_connections 2023-10-06T10:59:25.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.438+0000 7f9616efc700 1 --2- 172.21.15.7:0/394155326 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f95fc067080 0x7f95fc069530 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.438+0000 7f9616efc700 1 --2- 172.21.15.7:0/394155326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100c7c30 0x7f961015cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.438+0000 7f9616efc700 1 --2- 172.21.15.7:0/394155326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f96100867a0 0x7f961017e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.438+0000 7f9616efc700 1 --2- 172.21.15.7:0/394155326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9610086b70 0x7f961015c600 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.438+0000 7f9616efc700 1 -- 172.21.15.7:0/394155326 >> 172.21.15.7:0/394155326 conn(0x7f96100c8730 msgr2=0x7f96100c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:25.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.438+0000 7f9616efc700 1 -- 172.21.15.7:0/394155326 shutdown_connections 2023-10-06T10:59:25.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.438+0000 7f9616efc700 1 -- 172.21.15.7:0/394155326 wait complete. 2023-10-06T10:59:25.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2023-10-06T10:59:25.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.461+0000 7f813181a700 1 -- 172.21.15.7:0/2388871166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f810c005560 con 0x7f812c0c7770 2023-10-06T10:59:25.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.461+0000 7f8112ffd700 1 -- 172.21.15.7:0/2388871166 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f811c054a00 con 0x7f812c0c7770 2023-10-06T10:59:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:55834574855 2023-10-06T10:59:25.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.464+0000 7f813181a700 1 -- 172.21.15.7:0/2388871166 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8118067080 msgr2=0x7f8118069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.464+0000 7f813181a700 1 --2- 172.21.15.7:0/2388871166 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8118067080 0x7f8118069530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f812c0c8690 tx=0x7f8120016000 comp rx=0 tx=0).stop 2023-10-06T10:59:25.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.464+0000 7f813181a700 1 -- 172.21.15.7:0/2388871166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f812c0c7770 msgr2=0x7f812c15b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:25.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.464+0000 7f813181a700 1 --2- 172.21.15.7:0/2388871166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f812c0c7770 0x7f812c15b790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f811c00c7c0 tx=0x7f811c007e00 comp rx=0 tx=0).stop 2023-10-06T10:59:25.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.464+0000 7f813181a700 1 -- 172.21.15.7:0/2388871166 shutdown_connections 2023-10-06T10:59:25.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.464+0000 7f813181a700 1 --2- 172.21.15.7:0/2388871166 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8118067080 0x7f8118069530 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.464+0000 7f813181a700 1 --2- 172.21.15.7:0/2388871166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f812c0c7770 0x7f812c15b790 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.464+0000 7f813181a700 1 --2- 172.21.15.7:0/2388871166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f812c149f00 0x7f812c144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.464+0000 7f813181a700 1 --2- 172.21.15.7:0/2388871166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f812c0c7b40 0x7f812c15f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:25.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.464+0000 7f813181a700 1 -- 172.21.15.7:0/2388871166 >> 172.21.15.7:0/2388871166 conn(0x7f812c0c8730 msgr2=0x7f812c14a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:25.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.464+0000 7f813181a700 1 -- 172.21.15.7:0/2388871166 shutdown_connections 2023-10-06T10:59:25.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:25.464+0000 7f813181a700 1 -- 172.21.15.7:0/2388871166 wait complete. 2023-10-06T10:59:25.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-10-06T10:59:26.362 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T10:59:26.363 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T10:59:26.384 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T10:59:26.391 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T10:59:26.391 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T10:59:26.411 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T10:59:26.453 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T10:59:26.478 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T10:59:26.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.572+0000 7f44a735f700 1 Processor -- start 2023-10-06T10:59:26.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.573+0000 7f44a735f700 1 -- start start 2023-10-06T10:59:26.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.573+0000 7f25066d9700 1 Processor -- start 2023-10-06T10:59:26.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.574+0000 7f44a735f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44a00c7770 0x7f44a015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.574+0000 7f44a735f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44a00c7b40 0x7f44a015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.574+0000 7f44a735f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f44a00add70 0x7f44a00ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.574+0000 7f44a735f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a015a820 con 0x7f44a00add70 2023-10-06T10:59:26.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.574+0000 7f44a735f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a00ae730 con 0x7f44a00c7770 2023-10-06T10:59:26.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.574+0000 7f44a735f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a006af00 con 0x7f44a00c7b40 2023-10-06T10:59:26.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.573+0000 7f25066d9700 1 -- start start 2023-10-06T10:59:26.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.574+0000 7f25066d9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f250013b2d0 0x7f250013b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.574+0000 7f25066d9700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250013bc70 con 0x7f25001593d0 2023-10-06T10:59:26.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.574+0000 7f25066d9700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2500067290 con 0x7f2500159000 2023-10-06T10:59:26.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.574+0000 7f25066d9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25000c6a10 con 0x7f250013b2d0 2023-10-06T10:59:26.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.575+0000 7f44a58fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f44a00add70 0x7f44a00ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.575+0000 7f44a58fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f44a00add70 0x7f44a00ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43570/0 (socket says 172.21.15.7:43570) 2023-10-06T10:59:26.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.575+0000 7f44a58fc700 1 -- 172.21.15.7:0/483415742 learned_addr learned my addr 172.21.15.7:0/483415742 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:26.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.575+0000 7f24fffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2500159000 0x7f25000c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:56248/0 (socket says 172.21.15.7:56248) 2023-10-06T10:59:26.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.575+0000 7f24fffff700 1 -- 172.21.15.7:0/41233367 learned_addr learned my addr 172.21.15.7:0/41233367 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:26.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.575+0000 7f2504c76700 1 --2- 172.21.15.7:0/41233367 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f250013b2d0 0x7f250013b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.576+0000 7f44a58fc700 1 -- 172.21.15.7:0/483415742 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44a00c7b40 msgr2=0x7f44a015a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T10:59:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.576+0000 7f44a58fc700 1 --2- 172.21.15.7:0/483415742 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44a00c7b40 0x7f44a015a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.576+0000 7f44a58fc700 1 -- 172.21.15.7:0/483415742 >> v2:172.21.15.50:3300/0 conn(0x7f44a00c7770 msgr2=0x7f44a015cdb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T10:59:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.576+0000 7f44a58fc700 1 --2- 172.21.15.7:0/483415742 >> v2:172.21.15.50:3300/0 conn(0x7f44a00c7770 0x7f44a015cdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.576+0000 7f44a58fc700 1 -- 172.21.15.7:0/483415742 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a015dd30 con 0x7f44a00add70 2023-10-06T10:59:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.576+0000 7f24feffd700 1 -- 172.21.15.7:0/41233367 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192543920 0 0) 0x7f2500067290 con 0x7f2500159000 2023-10-06T10:59:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.576+0000 7f24feffd700 1 -- 172.21.15.7:0/41233367 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24e8003570 con 0x7f2500159000 2023-10-06T10:59:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.576+0000 7f2504c76700 1 -- 172.21.15.7:0/41233367 >> v1:172.21.15.50:6789/0 conn(0x7f2500159000 legacy=0x7f25000c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.576+0000 7f2504c76700 1 -- 172.21.15.7:0/41233367 >> v1:172.21.15.7:6789/0 conn(0x7f25001593d0 legacy=0x7f250006be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.576+0000 7f2504c76700 1 -- 172.21.15.7:0/41233367 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2500067570 con 0x7f250013b2d0 2023-10-06T10:59:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.576+0000 7f44a58fc700 1 --2- 172.21.15.7:0/483415742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44a00add70 0x7f44a00ae1f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f44a00c9d50 tx=0x7f4498009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44923e2f28195385 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.577+0000 7f4497fff700 1 -- 172.21.15.7:0/483415742 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449800e070 con 0x7f44a00add70 2023-10-06T10:59:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.577+0000 7f4497fff700 1 -- 172.21.15.7:0/483415742 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449800ba40 con 0x7f44a00add70 2023-10-06T10:59:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.577+0000 7f4497fff700 1 -- 172.21.15.7:0/483415742 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44980092e0 con 0x7f44a00add70 2023-10-06T10:59:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.577+0000 7f2504c76700 1 --2- 172.21.15.7:0/41233367 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f250013b2d0 0x7f250013b730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009910 tx=0x7f24f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70e9ac9336dcd78e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.578+0000 7f44a735f700 1 -- 172.21.15.7:0/483415742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44a00add70 msgr2=0x7f44a00ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.578+0000 7f44a735f700 1 --2- 172.21.15.7:0/483415742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44a00add70 0x7f44a00ae1f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f44a00c9d50 tx=0x7f4498009840 comp rx=0 tx=0).stop 2023-10-06T10:59:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.577+0000 7f24feffd700 1 -- 172.21.15.7:0/41233367 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f400f750 con 0x7f250013b2d0 2023-10-06T10:59:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.577+0000 7f24feffd700 1 -- 172.21.15.7:0/41233367 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f400f8b0 con 0x7f250013b2d0 2023-10-06T10:59:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.577+0000 7f24feffd700 1 -- 172.21.15.7:0/41233367 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f400fc70 con 0x7f250013b2d0 2023-10-06T10:59:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.578+0000 7f25066d9700 1 -- 172.21.15.7:0/41233367 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f250013b2d0 msgr2=0x7f250013b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.578+0000 7f25066d9700 1 --2- 172.21.15.7:0/41233367 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f250013b2d0 0x7f250013b730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009910 tx=0x7f24f40091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.579+0000 7f25066d9700 1 -- 172.21.15.7:0/41233367 shutdown_connections 2023-10-06T10:59:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.579+0000 7f25066d9700 1 --2- 172.21.15.7:0/41233367 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f250013b2d0 0x7f250013b730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.579+0000 7f25066d9700 1 -- 172.21.15.7:0/41233367 >> 172.21.15.7:0/41233367 conn(0x7f25000c8730 msgr2=0x7f25000c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.579+0000 7f44a735f700 1 -- 172.21.15.7:0/483415742 shutdown_connections 2023-10-06T10:59:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.579+0000 7f44a735f700 1 --2- 172.21.15.7:0/483415742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44a00add70 0x7f44a00ae1f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.579+0000 7f44a735f700 1 --2- 172.21.15.7:0/483415742 >> v2:172.21.15.50:3300/0 conn(0x7f44a00c7770 0x7f44a015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.579+0000 7f44a735f700 1 --2- 172.21.15.7:0/483415742 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44a00c7b40 0x7f44a015a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.579+0000 7f44a735f700 1 -- 172.21.15.7:0/483415742 >> 172.21.15.7:0/483415742 conn(0x7f44a00c8730 msgr2=0x7f44a00c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.579+0000 7f25066d9700 1 -- 172.21.15.7:0/41233367 shutdown_connections 2023-10-06T10:59:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.580+0000 7f44a735f700 1 -- 172.21.15.7:0/483415742 shutdown_connections 2023-10-06T10:59:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.580+0000 7f44a735f700 1 -- 172.21.15.7:0/483415742 wait complete. 2023-10-06T10:59:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.582+0000 7f44a735f700 1 Processor -- start 2023-10-06T10:59:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.579+0000 7f25066d9700 1 -- 172.21.15.7:0/41233367 wait complete. 2023-10-06T10:59:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.581+0000 7f25066d9700 1 Processor -- start 2023-10-06T10:59:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.583+0000 7f44a735f700 1 -- start start 2023-10-06T10:59:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.585+0000 7f44a735f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44a00add70 0x7f44a0175f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.585+0000 7f44a735f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44a00c7770 0x7f44a00c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.585+0000 7f44a735f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44a00c7b40 0x7f44a00c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.585+0000 7f44a735f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a0155040 con 0x7f44a00c7770 2023-10-06T10:59:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.585+0000 7f44a735f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00aeeb0 con 0x7f44a00add70 2023-10-06T10:59:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.585+0000 7f44a735f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a0176890 con 0x7f44a00c7b40 2023-10-06T10:59:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.585+0000 7f44a48fa700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44a00c7770 0x7f44a00c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.585+0000 7f44a48fa700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44a00c7770 0x7f44a00c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43596/0 (socket says 172.21.15.7:43596) 2023-10-06T10:59:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.585+0000 7f44a48fa700 1 -- 172.21.15.7:0/3720420369 learned_addr learned my addr 172.21.15.7:0/3720420369 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.581+0000 7f25066d9700 1 -- start start 2023-10-06T10:59:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.582+0000 7f25066d9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f250013b2d0 0x7f25000c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.582+0000 7f25066d9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2500159000 0x7f2500153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.582+0000 7f25066d9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25001593d0 0x7f25000aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.582+0000 7f25066d9700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000afdb0 con 0x7f250013b2d0 2023-10-06T10:59:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.582+0000 7f25066d9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000b0650 con 0x7f25001593d0 2023-10-06T10:59:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.582+0000 7f25066d9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2500153ea0 con 0x7f2500159000 2023-10-06T10:59:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.583+0000 7f2504c76700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25001593d0 0x7f25000aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.583+0000 7f24ff7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2500159000 0x7f2500153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.583+0000 7f24ff7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2500159000 0x7f2500153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:35180/0 (socket says 172.21.15.7:35180) 2023-10-06T10:59:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.583+0000 7f24ff7fe700 1 -- 172.21.15.7:0/3724492270 learned_addr learned my addr 172.21.15.7:0/3724492270 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.584+0000 7f24ff7fe700 1 -- 172.21.15.7:0/3724492270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25001593d0 msgr2=0x7f25000aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.584+0000 7f24ff7fe700 1 --2- 172.21.15.7:0/3724492270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25001593d0 0x7f25000aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.584+0000 7f24ff7fe700 1 -- 172.21.15.7:0/3724492270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f250013b2d0 msgr2=0x7f25000c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.584+0000 7f24ff7fe700 1 --2- 172.21.15.7:0/3724492270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f250013b2d0 0x7f25000c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.584+0000 7f24ff7fe700 1 -- 172.21.15.7:0/3724492270 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f4009420 con 0x7f2500159000 2023-10-06T10:59:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.585+0000 7f24ff7fe700 1 --2- 172.21.15.7:0/3724492270 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2500159000 0x7f2500153960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24f000b5e0 tx=0x7f24f00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.586+0000 7f44a50fb700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44a00add70 0x7f44a0175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.586+0000 7f44a58fc700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44a00c7b40 0x7f44a00c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.586+0000 7f44a48fa700 1 -- 172.21.15.7:0/3720420369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44a00c7b40 msgr2=0x7f44a00c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.586+0000 7f44a48fa700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44a00c7b40 0x7f44a00c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.586+0000 7f44a48fa700 1 -- 172.21.15.7:0/3720420369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44a00add70 msgr2=0x7f44a0175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.586+0000 7f44a48fa700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44a00add70 0x7f44a0175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.586+0000 7f44a48fa700 1 -- 172.21.15.7:0/3720420369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4498009ae0 con 0x7f44a00c7770 2023-10-06T10:59:26.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.586+0000 7f44a58fc700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44a00c7b40 0x7f44a00c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:26.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.586+0000 7f44a48fa700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44a00c7770 0x7f44a00c5400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f449000b5e0 tx=0x7f44900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.587+0000 7f24e7fff700 1 -- 172.21.15.7:0/3724492270 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f000f510 con 0x7f2500159000 2023-10-06T10:59:26.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.587+0000 7f24e7fff700 1 -- 172.21.15.7:0/3724492270 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f000f670 con 0x7f2500159000 2023-10-06T10:59:26.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.587+0000 7f24e7fff700 1 -- 172.21.15.7:0/3724492270 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f000fa30 con 0x7f2500159000 2023-10-06T10:59:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.587+0000 7f44957fa700 1 -- 172.21.15.7:0/3720420369 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449000f510 con 0x7f44a00c7770 2023-10-06T10:59:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.587+0000 7f44957fa700 1 -- 172.21.15.7:0/3720420369 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449000f690 con 0x7f44a00c7770 2023-10-06T10:59:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.587+0000 7f44957fa700 1 -- 172.21.15.7:0/3720420369 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449000fa50 con 0x7f44a00c7770 2023-10-06T10:59:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.587+0000 7f25066d9700 1 -- 172.21.15.7:0/3724492270 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25000af510 con 0x7f2500159000 2023-10-06T10:59:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.587+0000 7f25066d9700 1 -- 172.21.15.7:0/3724492270 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25000afad0 con 0x7f2500159000 2023-10-06T10:59:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.588+0000 7f25066d9700 1 -- 172.21.15.7:0/3724492270 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2500070480 con 0x7f2500159000 2023-10-06T10:59:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.588+0000 7f44a735f700 1 -- 172.21.15.7:0/3720420369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a0176b70 con 0x7f44a00c7770 2023-10-06T10:59:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.589+0000 7f44a735f700 1 -- 172.21.15.7:0/3720420369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a0177130 con 0x7f44a00c7770 2023-10-06T10:59:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.591+0000 7f44a735f700 1 -- 172.21.15.7:0/3720420369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a00af020 con 0x7f44a00c7770 2023-10-06T10:59:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.592+0000 7f44957fa700 1 -- 172.21.15.7:0/3720420369 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f449001a400 con 0x7f44a00c7770 2023-10-06T10:59:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.592+0000 7f44957fa700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4484067080 0x7f4484069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.592+0000 7f44957fa700 1 -- 172.21.15.7:0/3720420369 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f44900843e0 con 0x7f44a00c7770 2023-10-06T10:59:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.591+0000 7f24e7fff700 1 -- 172.21.15.7:0/3724492270 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24f0024430 con 0x7f2500159000 2023-10-06T10:59:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.592+0000 7f24e7fff700 1 --2- 172.21.15.7:0/3724492270 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f24ec066fb0 0x7f24ec069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.592+0000 7f24e7fff700 1 -- 172.21.15.7:0/3724492270 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f24f0084f40 con 0x7f2500159000 2023-10-06T10:59:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.592+0000 7f24fffff700 1 --2- 172.21.15.7:0/3724492270 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f24ec066fb0 0x7f24ec069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.594+0000 7f24fffff700 1 --2- 172.21.15.7:0/3724492270 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f24ec066fb0 0x7f24ec069460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f24f8008a60 tx=0x7f24f8005fd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.593+0000 7f44a50fb700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4484067080 0x7f4484069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.593+0000 7f44a50fb700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4484067080 0x7f4484069530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f449c006fd0 tx=0x7f449c0090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.602+0000 7f44957fa700 1 -- 172.21.15.7:0/3720420369 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4490054cf0 con 0x7f44a00c7770 2023-10-06T10:59:26.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.602+0000 7f24e7fff700 1 -- 172.21.15.7:0/3724492270 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24f0051e70 con 0x7f2500159000 2023-10-06T10:59:26.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.607+0000 7fb41a5f4700 1 Processor -- start 2023-10-06T10:59:26.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.607+0000 7fb41a5f4700 1 -- start start 2023-10-06T10:59:26.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.608+0000 7fb41a5f4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb4140867a0 0x7fb41416a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.608+0000 7fb41a5f4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb414086b70 0x7fb41406af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.608+0000 7fb41a5f4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4140c7520 0x7fb4140c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.608+0000 7fb41a5f4700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41416a9a0 con 0x7fb4140867a0 2023-10-06T10:59:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.608+0000 7fb41a5f4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4140c7f00 con 0x7fb414086b70 2023-10-06T10:59:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.608+0000 7fb41a5f4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb414166270 con 0x7fb4140c7520 2023-10-06T10:59:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.609+0000 7fb418b91700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4140c7520 0x7fb4140c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.609+0000 7fb4137fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb414086b70 0x7fb41406af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.609+0000 7fb418b91700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4140c7520 0x7fb4140c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:35200/0 (socket says 172.21.15.7:35200) 2023-10-06T10:59:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.609+0000 7fb418b91700 1 -- 172.21.15.7:0/495662629 learned_addr learned my addr 172.21.15.7:0/495662629 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.610+0000 7fb418b91700 1 -- 172.21.15.7:0/495662629 >> v2:172.21.15.50:3300/0 conn(0x7fb414086b70 msgr2=0x7fb41406af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.610+0000 7fb418b91700 1 --2- 172.21.15.7:0/495662629 >> v2:172.21.15.50:3300/0 conn(0x7fb414086b70 0x7fb41406af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.610+0000 7fb418b91700 1 -- 172.21.15.7:0/495662629 >> v2:172.21.15.7:3300/0 conn(0x7fb4140867a0 msgr2=0x7fb41416a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.611+0000 7fb418b91700 1 --2- 172.21.15.7:0/495662629 >> v2:172.21.15.7:3300/0 conn(0x7fb4140867a0 0x7fb41416a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.611+0000 7fb418b91700 1 -- 172.21.15.7:0/495662629 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41406c380 con 0x7fb4140c7520 2023-10-06T10:59:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.611+0000 7fb418b91700 1 --2- 172.21.15.7:0/495662629 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4140c7520 0x7fb4140c79c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb4140cb260 tx=0x7fb4040072c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1339dd8a2b17fd43 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.611+0000 7fb412ffd700 1 -- 172.21.15.7:0/495662629 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404007d10 con 0x7fb4140c7520 2023-10-06T10:59:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.611+0000 7fb412ffd700 1 -- 172.21.15.7:0/495662629 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb404007e70 con 0x7fb4140c7520 2023-10-06T10:59:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.611+0000 7fb412ffd700 1 -- 172.21.15.7:0/495662629 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40400cbd0 con 0x7fb4140c7520 2023-10-06T10:59:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.612+0000 7fb41a5f4700 1 -- 172.21.15.7:0/495662629 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4140c7520 msgr2=0x7fb4140c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.612+0000 7fb41a5f4700 1 --2- 172.21.15.7:0/495662629 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4140c7520 0x7fb4140c79c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb4140cb260 tx=0x7fb4040072c0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.612+0000 7fb41a5f4700 1 -- 172.21.15.7:0/495662629 shutdown_connections 2023-10-06T10:59:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.612+0000 7fb41a5f4700 1 --2- 172.21.15.7:0/495662629 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4140c7520 0x7fb4140c79c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.612+0000 7fb41a5f4700 1 --2- 172.21.15.7:0/495662629 >> v2:172.21.15.7:3300/0 conn(0x7fb4140867a0 0x7fb41416a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.612+0000 7fb41a5f4700 1 --2- 172.21.15.7:0/495662629 >> v2:172.21.15.50:3300/0 conn(0x7fb414086b70 0x7fb41406af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.612+0000 7fb41a5f4700 1 -- 172.21.15.7:0/495662629 >> 172.21.15.7:0/495662629 conn(0x7fb4140c8730 msgr2=0x7fb4140c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:26.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.618+0000 7fb41a5f4700 1 -- 172.21.15.7:0/495662629 shutdown_connections 2023-10-06T10:59:26.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.618+0000 7fb41a5f4700 1 -- 172.21.15.7:0/495662629 wait complete. 2023-10-06T10:59:26.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.620+0000 7fb41a5f4700 1 Processor -- start 2023-10-06T10:59:26.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.620+0000 7fb41a5f4700 1 -- start start 2023-10-06T10:59:26.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.621+0000 7fb41a5f4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4140867a0 0x7fb414085ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.621+0000 7fb41a5f4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414086b70 0x7fb414168640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.621+0000 7fb41a5f4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4140c7520 0x7fb414168b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.621+0000 7fb41a5f4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4140c3740 con 0x7fb414086b70 2023-10-06T10:59:26.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.621+0000 7fb41a5f4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4141691b0 con 0x7fb4140867a0 2023-10-06T10:59:26.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.621+0000 7fb41a5f4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4140c2e10 con 0x7fb4140c7520 2023-10-06T10:59:26.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.622+0000 7fb4137fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414086b70 0x7fb414168640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.622+0000 7fb4137fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414086b70 0x7fb414168640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43608/0 (socket says 172.21.15.7:43608) 2023-10-06T10:59:26.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.622+0000 7fb4137fe700 1 -- 172.21.15.7:0/1466134460 learned_addr learned my addr 172.21.15.7:0/1466134460 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:26.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.623+0000 7fb4137fe700 1 -- 172.21.15.7:0/1466134460 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4140c7520 msgr2=0x7fb414168b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.623+0000 7fb4137fe700 1 --2- 172.21.15.7:0/1466134460 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4140c7520 0x7fb414168b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.623+0000 7fb4137fe700 1 -- 172.21.15.7:0/1466134460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4140867a0 msgr2=0x7fb414085ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T10:59:26.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.623+0000 7fb4137fe700 1 --2- 172.21.15.7:0/1466134460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4140867a0 0x7fb414085ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.623+0000 7fb4137fe700 1 -- 172.21.15.7:0/1466134460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb404007560 con 0x7fb414086b70 2023-10-06T10:59:26.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.623+0000 7fb4137fe700 1 --2- 172.21.15.7:0/1466134460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414086b70 0x7fb414168640 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb40800c7d0 tx=0x7fb408008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.625+0000 7fb3fbfff700 1 -- 172.21.15.7:0/1466134460 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408011600 con 0x7fb414086b70 2023-10-06T10:59:26.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.625+0000 7fb3fbfff700 1 -- 172.21.15.7:0/1466134460 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb408011760 con 0x7fb414086b70 2023-10-06T10:59:26.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.625+0000 7fb3fbfff700 1 -- 172.21.15.7:0/1466134460 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408011b00 con 0x7fb414086b70 2023-10-06T10:59:26.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.625+0000 7fb41a5f4700 1 -- 172.21.15.7:0/1466134460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4140c30f0 con 0x7fb414086b70 2023-10-06T10:59:26.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.625+0000 7fb41a5f4700 1 -- 172.21.15.7:0/1466134460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb414167f00 con 0x7fb414086b70 2023-10-06T10:59:26.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.629+0000 7fb3fbfff700 1 -- 172.21.15.7:0/1466134460 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4080193f0 con 0x7fb414086b70 2023-10-06T10:59:26.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.629+0000 7fb3fbfff700 1 --2- 172.21.15.7:0/1466134460 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb400067080 0x7fb400069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.629+0000 7fb3fbfff700 1 -- 172.21.15.7:0/1466134460 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb408084db0 con 0x7fb414086b70 2023-10-06T10:59:26.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.630+0000 7fb413fff700 1 --2- 172.21.15.7:0/1466134460 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb400067080 0x7fb400069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.631+0000 7fb413fff700 1 --2- 172.21.15.7:0/1466134460 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb400067080 0x7fb400069530 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00acf0 tx=0x7fb40c009370 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.632+0000 7fb41a5f4700 1 -- 172.21.15.7:0/1466134460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f40052b0 con 0x7fb414086b70 2023-10-06T10:59:26.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.635+0000 7ff0c1f0f700 1 Processor -- start 2023-10-06T10:59:26.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.636+0000 7ff0c1f0f700 1 -- start start 2023-10-06T10:59:26.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.637+0000 7ff0c1f0f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff0bc13b670 0x7ff0bc156440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.637+0000 7ff0c1f0f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0bc0c7740 con 0x7ff0bc0ca7d0 2023-10-06T10:59:26.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.637+0000 7ff0c1f0f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0bc0c7a20 con 0x7ff0bc13ba40 2023-10-06T10:59:26.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.637+0000 7ff0c1f0f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0bc0c7d00 con 0x7ff0bc13b670 2023-10-06T10:59:26.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.638+0000 7ff0bbfff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff0bc0ca7d0 0x7ff0bc0c1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44300/0 (socket says 172.21.15.7:44300) 2023-10-06T10:59:26.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.638+0000 7ff0bbfff700 1 -- 172.21.15.7:0/4127033290 learned_addr learned my addr 172.21.15.7:0/4127033290 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:26.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.638+0000 7ff0bb7fe700 1 --2- 172.21.15.7:0/4127033290 >> v2:172.21.15.7:3300/0 conn(0x7ff0bc13b670 0x7ff0bc156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.638+0000 7ff0bb7fe700 1 -- 172.21.15.7:0/4127033290 >> v1:172.21.15.50:6789/0 conn(0x7ff0bc13ba40 legacy=0x7ff0bc0c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.638+0000 7ff0bb7fe700 1 -- 172.21.15.7:0/4127033290 >> v1:172.21.15.7:6789/0 conn(0x7ff0bc0ca7d0 legacy=0x7ff0bc0c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.639+0000 7ff0bb7fe700 1 -- 172.21.15.7:0/4127033290 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc0c7fe0 con 0x7ff0bc13b670 2023-10-06T10:59:26.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.639+0000 7ff0bb7fe700 1 --2- 172.21.15.7:0/4127033290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc13b670 0x7ff0bc156440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4009d50 tx=0x7ff0b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b124491e45ea8136 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.641+0000 7fb3fbfff700 1 -- 172.21.15.7:0/1466134460 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb408055640 con 0x7fb414086b70 2023-10-06T10:59:26.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.645+0000 7ff0ba7fc700 1 -- 172.21.15.7:0/4127033290 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b400cc70 con 0x7ff0bc13b670 2023-10-06T10:59:26.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.645+0000 7ff0ba7fc700 1 -- 172.21.15.7:0/4127033290 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b400cdd0 con 0x7ff0bc13b670 2023-10-06T10:59:26.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.645+0000 7ff0ba7fc700 1 -- 172.21.15.7:0/4127033290 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4011650 con 0x7ff0bc13b670 2023-10-06T10:59:26.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.646+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/4127033290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc13b670 msgr2=0x7ff0bc156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.646+0000 7ff0c1f0f700 1 --2- 172.21.15.7:0/4127033290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc13b670 0x7ff0bc156440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4009d50 tx=0x7ff0b4009780 comp rx=0 tx=0).stop 2023-10-06T10:59:26.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.654+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/4127033290 shutdown_connections 2023-10-06T10:59:26.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.654+0000 7ff0c1f0f700 1 --2- 172.21.15.7:0/4127033290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc13b670 0x7ff0bc156440 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.654+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/4127033290 >> 172.21.15.7:0/4127033290 conn(0x7ff0bc0cc790 msgr2=0x7ff0bc0c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:26.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.654+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/4127033290 shutdown_connections 2023-10-06T10:59:26.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.654+0000 7f2db1ebf700 1 Processor -- start 2023-10-06T10:59:26.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.654+0000 7f2db1ebf700 1 -- start start 2023-10-06T10:59:26.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.655+0000 7f2db1ebf700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2dac15c490 0x7f2dac0c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.655+0000 7f2db1ebf700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2dac0c12d0 0x7f2dac0c1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.656+0000 7f2db1ebf700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dac068a10 con 0x7f2dac15c860 2023-10-06T10:59:26.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.656+0000 7f2db1ebf700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dac0cbb70 con 0x7f2dac15c490 2023-10-06T10:59:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.656+0000 7f2db1ebf700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0c8940 con 0x7f2dac0c12d0 2023-10-06T10:59:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.654+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/4127033290 wait complete. 2023-10-06T10:59:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.656+0000 7ff0c1f0f700 1 Processor -- start 2023-10-06T10:59:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.656+0000 7ff0c1f0f700 1 -- start start 2023-10-06T10:59:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.656+0000 7f2daaffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2dac15c860 0x7f2dac068300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44310/0 (socket says 172.21.15.7:44310) 2023-10-06T10:59:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.656+0000 7f2daaffd700 1 -- 172.21.15.7:0/2788361244 learned_addr learned my addr 172.21.15.7:0/2788361244 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.658+0000 7ff0c1f0f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0bc0ca7d0 0x7ff0bc13cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.658+0000 7ff0c1f0f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0bc13b670 0x7ff0bc176300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.658+0000 7ff0c1f0f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc13ba40 0x7ff0bc0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.658+0000 7ff0c1f0f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc13be10 con 0x7ff0bc13ba40 2023-10-06T10:59:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.658+0000 7ff0c1f0f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc13c670 con 0x7ff0bc13b670 2023-10-06T10:59:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.658+0000 7ff0c1f0f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc0c5910 con 0x7ff0bc0ca7d0 2023-10-06T10:59:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.658+0000 7ff0bbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc13ba40 0x7ff0bc0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.658+0000 7ff0bbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc13ba40 0x7ff0bc0c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43624/0 (socket says 172.21.15.7:43624) 2023-10-06T10:59:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.658+0000 7ff0bbfff700 1 -- 172.21.15.7:0/1048872799 learned_addr learned my addr 172.21.15.7:0/1048872799 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.659+0000 7ff0bbfff700 1 -- 172.21.15.7:0/1048872799 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0bc0ca7d0 msgr2=0x7ff0bc13cb00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T10:59:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.659+0000 7ff0bbfff700 1 --2- 172.21.15.7:0/1048872799 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0bc0ca7d0 0x7ff0bc13cb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.659+0000 7ff0bbfff700 1 -- 172.21.15.7:0/1048872799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0bc13b670 msgr2=0x7ff0bc176300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T10:59:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.659+0000 7ff0bbfff700 1 --2- 172.21.15.7:0/1048872799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0bc13b670 0x7ff0bc176300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.659+0000 7ff0bbfff700 1 -- 172.21.15.7:0/1048872799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b400d040 con 0x7ff0bc13ba40 2023-10-06T10:59:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.659+0000 7ff0bbfff700 1 --2- 172.21.15.7:0/1048872799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc13ba40 0x7ff0bc0c4e70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000b740 tx=0x7ff0b0006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.660+0000 7ff0a37fe700 1 -- 172.21.15.7:0/1048872799 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b000f6a0 con 0x7ff0bc13ba40 2023-10-06T10:59:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.660+0000 7ff0a37fe700 1 -- 172.21.15.7:0/1048872799 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b000f820 con 0x7ff0bc13ba40 2023-10-06T10:59:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.660+0000 7ff0a37fe700 1 -- 172.21.15.7:0/1048872799 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b000fbe0 con 0x7ff0bc13ba40 2023-10-06T10:59:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.660+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/1048872799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0bc13c020 con 0x7ff0bc13ba40 2023-10-06T10:59:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.660+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/1048872799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0bc0ad9a0 con 0x7ff0bc13ba40 2023-10-06T10:59:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.662+0000 7f2dabfff700 1 --2- 172.21.15.7:0/2788361244 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2dac0c12d0 0x7f2dac0c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.662+0000 7f2dab7fe700 1 --2- 172.21.15.7:0/2788361244 >> v2:172.21.15.50:3300/0 conn(0x7f2dac15c490 0x7f2dac0c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.662+0000 7f2daa7fc700 1 -- 172.21.15.7:0/2788361244 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562689118 0 0) 0x7f2dac068a10 con 0x7f2dac15c860 2023-10-06T10:59:26.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.662+0000 7f2daa7fc700 1 -- 172.21.15.7:0/2788361244 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d94003570 con 0x7f2dac15c860 2023-10-06T10:59:26.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.662+0000 7f2dabfff700 1 -- 172.21.15.7:0/2788361244 >> v2:172.21.15.50:3300/0 conn(0x7f2dac15c490 msgr2=0x7f2dac0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:26.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.662+0000 7f2dabfff700 1 --2- 172.21.15.7:0/2788361244 >> v2:172.21.15.50:3300/0 conn(0x7f2dac15c490 0x7f2dac0c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.662+0000 7f2dabfff700 1 -- 172.21.15.7:0/2788361244 >> v1:172.21.15.7:6789/0 conn(0x7f2dac15c860 legacy=0x7f2dac068300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.662+0000 7f2dabfff700 1 -- 172.21.15.7:0/2788361244 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac0ca770 con 0x7f2dac0c12d0 2023-10-06T10:59:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.663+0000 7ff0a37fe700 1 -- 172.21.15.7:0/1048872799 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0b0010460 con 0x7ff0bc13ba40 2023-10-06T10:59:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.663+0000 7ff0a37fe700 1 --2- 172.21.15.7:0/1048872799 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0a4067120 0x7ff0a40695d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.664+0000 7ff0a37fe700 1 -- 172.21.15.7:0/1048872799 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff0b0085180 con 0x7ff0bc13ba40 2023-10-06T10:59:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.664+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/1048872799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a80052e0 con 0x7ff0bc13ba40 2023-10-06T10:59:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.664+0000 7ff0bb7fe700 1 --2- 172.21.15.7:0/1048872799 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0a4067120 0x7ff0a40695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.665+0000 7ff0bb7fe700 1 --2- 172.21.15.7:0/1048872799 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0a4067120 0x7ff0a40695d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc159080 tx=0x7ff0b401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.664+0000 7f2dabfff700 1 --2- 172.21.15.7:0/2788361244 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2dac0c12d0 0x7f2dac0c1730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009e60 tx=0x7f2da4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db667bb8dcf2e004 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.665+0000 7f2daa7fc700 1 -- 172.21.15.7:0/2788361244 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400e070 con 0x7f2dac0c12d0 2023-10-06T10:59:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.665+0000 7f2daa7fc700 1 -- 172.21.15.7:0/2788361244 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da400bab0 con 0x7f2dac0c12d0 2023-10-06T10:59:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.665+0000 7f2daa7fc700 1 -- 172.21.15.7:0/2788361244 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400be70 con 0x7f2dac0c12d0 2023-10-06T10:59:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.671+0000 7f2db1ebf700 1 -- 172.21.15.7:0/2788361244 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2dac0c12d0 msgr2=0x7f2dac0c1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.671+0000 7f2db1ebf700 1 --2- 172.21.15.7:0/2788361244 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2dac0c12d0 0x7f2dac0c1730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009e60 tx=0x7f2da4009780 comp rx=0 tx=0).stop 2023-10-06T10:59:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.671+0000 7f2db1ebf700 1 -- 172.21.15.7:0/2788361244 shutdown_connections 2023-10-06T10:59:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.671+0000 7f2db1ebf700 1 --2- 172.21.15.7:0/2788361244 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2dac0c12d0 0x7f2dac0c1730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.671+0000 7f2db1ebf700 1 --2- 172.21.15.7:0/2788361244 >> v2:172.21.15.50:3300/0 conn(0x7f2dac15c490 0x7f2dac0c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.671+0000 7f2db1ebf700 1 -- 172.21.15.7:0/2788361244 >> 172.21.15.7:0/2788361244 conn(0x7f2dac0c8b60 msgr2=0x7f2dac0c8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.674+0000 7f2db1ebf700 1 -- 172.21.15.7:0/2788361244 shutdown_connections 2023-10-06T10:59:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.676+0000 7f2db1ebf700 1 -- 172.21.15.7:0/2788361244 wait complete. 2023-10-06T10:59:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.678+0000 7f2db1ebf700 1 Processor -- start 2023-10-06T10:59:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.678+0000 7ff5bb41f700 1 Processor -- start 2023-10-06T10:59:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.678+0000 7f2db1ebf700 1 -- start start 2023-10-06T10:59:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.679+0000 7f2db1ebf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dac0c12d0 0x7f2dac150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.679+0000 7f2db1ebf700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2dac15c490 0x7f2dac0c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.679+0000 7f2db1ebf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dac15c860 0x7f2dac0c1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.679+0000 7f2db1ebf700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0aee90 con 0x7f2dac0c12d0 2023-10-06T10:59:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.679+0000 7f2db1ebf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac150d50 con 0x7f2dac15c860 2023-10-06T10:59:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.679+0000 7f2db1ebf700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0c3c20 con 0x7f2dac15c490 2023-10-06T10:59:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.679+0000 7f2dab7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dac0c12d0 0x7f2dac150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.679+0000 7f2dabfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dac15c860 0x7f2dac0c1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.679+0000 7f2dab7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dac0c12d0 0x7f2dac150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43636/0 (socket says 172.21.15.7:43636) 2023-10-06T10:59:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.679+0000 7f2dab7fe700 1 -- 172.21.15.7:0/3511418646 learned_addr learned my addr 172.21.15.7:0/3511418646 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.678+0000 7ff5bb41f700 1 -- start start 2023-10-06T10:59:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.680+0000 7ff0a37fe700 1 -- 172.21.15.7:0/1048872799 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0b0055780 con 0x7ff0bc13ba40 2023-10-06T10:59:26.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.680+0000 7f2dabfff700 1 -- 172.21.15.7:0/3511418646 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2dac15c490 msgr2=0x7f2dac0c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.680+0000 7f2dabfff700 1 --2- 172.21.15.7:0/3511418646 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2dac15c490 0x7f2dac0c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.680+0000 7f2dabfff700 1 -- 172.21.15.7:0/3511418646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dac0c12d0 msgr2=0x7f2dac150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.680+0000 7f2dabfff700 1 --2- 172.21.15.7:0/3511418646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dac0c12d0 0x7f2dac150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.680+0000 7f2dabfff700 1 -- 172.21.15.7:0/3511418646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da4009a20 con 0x7f2dac15c860 2023-10-06T10:59:26.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.680+0000 7f2dabfff700 1 --2- 172.21.15.7:0/3511418646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dac15c860 0x7f2dac0c1e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2da4016000 tx=0x7f2da4019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.680+0000 7ff5bb41f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff5b406efe0 0x7ff5b40c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.680+0000 7ff5bb41f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff5b406be40 0x7ff5b4158f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.680+0000 7ff5bb41f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b4067290 con 0x7ff5b41594b0 2023-10-06T10:59:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.680+0000 7ff5bb41f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b4067570 con 0x7ff5b406efe0 2023-10-06T10:59:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.680+0000 7ff5bb41f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b4067850 con 0x7ff5b406be40 2023-10-06T10:59:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.680+0000 7ff5b91bb700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff5b406efe0 0x7ff5b40c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.681+0000 7ff5b91bb700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff5b406efe0 0x7ff5b40c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43648/0 (socket says 172.21.15.7:43648) 2023-10-06T10:59:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.681+0000 7ff5b91bb700 1 -- 172.21.15.7:0/930340212 learned_addr learned my addr 172.21.15.7:0/930340212 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.681+0000 7ff5b91bb700 1 -- 172.21.15.7:0/930340212 >> v2:172.21.15.50:3300/0 conn(0x7ff5b406be40 msgr2=0x7ff5b4158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.681+0000 7ff5b91bb700 1 --2- 172.21.15.7:0/930340212 >> v2:172.21.15.50:3300/0 conn(0x7ff5b406be40 0x7ff5b4158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.681+0000 7ff5b91bb700 1 -- 172.21.15.7:0/930340212 >> v1:172.21.15.7:6789/0 conn(0x7ff5b41594b0 legacy=0x7ff5b413b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.681+0000 7ff5b91bb700 1 -- 172.21.15.7:0/930340212 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b4067b30 con 0x7ff5b406efe0 2023-10-06T10:59:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.681+0000 7ff5b91bb700 1 --2- 172.21.15.7:0/930340212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b406efe0 0x7ff5b40c6300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40c8640 tx=0x7ff5b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f4c17cebc5af04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.682+0000 7ff5abfff700 1 -- 172.21.15.7:0/930340212 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b000b8f0 con 0x7ff5b406efe0 2023-10-06T10:59:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.682+0000 7ff5abfff700 1 -- 172.21.15.7:0/930340212 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b000ba50 con 0x7ff5b406efe0 2023-10-06T10:59:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.682+0000 7ff5abfff700 1 -- 172.21.15.7:0/930340212 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b000bdf0 con 0x7ff5b406efe0 2023-10-06T10:59:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.682+0000 7fd5bcfc7700 1 Processor -- start 2023-10-06T10:59:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.683+0000 7ff5bb41f700 1 -- 172.21.15.7:0/930340212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b406efe0 msgr2=0x7ff5b40c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.683+0000 7ff5bb41f700 1 --2- 172.21.15.7:0/930340212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b406efe0 0x7ff5b40c6300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40c8640 tx=0x7ff5b0009250 comp rx=0 tx=0).stop 2023-10-06T10:59:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.683+0000 7ff5bb41f700 1 -- 172.21.15.7:0/930340212 shutdown_connections 2023-10-06T10:59:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.683+0000 7ff5bb41f700 1 --2- 172.21.15.7:0/930340212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b406efe0 0x7ff5b40c6300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.683+0000 7ff5bb41f700 1 --2- 172.21.15.7:0/930340212 >> v2:172.21.15.50:3300/0 conn(0x7ff5b406be40 0x7ff5b4158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.683+0000 7ff5bb41f700 1 -- 172.21.15.7:0/930340212 >> 172.21.15.7:0/930340212 conn(0x7ff5b40c8730 msgr2=0x7ff5b40c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.683+0000 7ff5bb41f700 1 -- 172.21.15.7:0/930340212 shutdown_connections 2023-10-06T10:59:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.682+0000 7fd5bcfc7700 1 -- start start 2023-10-06T10:59:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.684+0000 7fd5bcfc7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5b8159000 0x7fd5b80c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.684+0000 7fd5bcfc7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b8067290 con 0x7fd5b81593d0 2023-10-06T10:59:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.684+0000 7fd5bcfc7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b8067570 con 0x7fd5b806efe0 2023-10-06T10:59:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.684+0000 7fd5bcfc7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b8067850 con 0x7fd5b8159000 2023-10-06T10:59:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.684+0000 7ff5bb41f700 1 -- 172.21.15.7:0/930340212 wait complete. 2023-10-06T10:59:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.684+0000 7fd5b6d9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd5b81593d0 0x7fd5b813b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44328/0 (socket says 172.21.15.7:44328) 2023-10-06T10:59:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.684+0000 7fd5b6d9d700 1 -- 172.21.15.7:0/2121993586 learned_addr learned my addr 172.21.15.7:0/2121993586 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.686+0000 7ff5bb41f700 1 Processor -- start 2023-10-06T10:59:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.686+0000 7ff5bb41f700 1 -- start start 2023-10-06T10:59:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.687+0000 7ff5bb41f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b406be40 0x7ff5b40c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.687+0000 7ff5bb41f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff5b406efe0 0x7ff5b414eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.687+0000 7ff5bb41f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b41594b0 0x7ff5b40afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.687+0000 7ff5bb41f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b4156790 con 0x7ff5b406be40 2023-10-06T10:59:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.687+0000 7ff5bb41f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b40c40b0 con 0x7ff5b41594b0 2023-10-06T10:59:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.687+0000 7ff5bb41f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b40c3c70 con 0x7ff5b406efe0 2023-10-06T10:59:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.688+0000 7ff5b91bb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b406be40 0x7ff5b40c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.688+0000 7ff5b91bb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b406be40 0x7ff5b40c3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43652/0 (socket says 172.21.15.7:43652) 2023-10-06T10:59:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.688+0000 7ff5b91bb700 1 -- 172.21.15.7:0/2947291508 learned_addr learned my addr 172.21.15.7:0/2947291508 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.688+0000 7ff5b99bc700 1 --2- 172.21.15.7:0/2947291508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b41594b0 0x7ff5b40afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.688+0000 7ff5b91bb700 1 -- 172.21.15.7:0/2947291508 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff5b406efe0 msgr2=0x7ff5b414eab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T10:59:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.688+0000 7ff5b91bb700 1 --2- 172.21.15.7:0/2947291508 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff5b406efe0 0x7ff5b414eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.688+0000 7ff5b91bb700 1 -- 172.21.15.7:0/2947291508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b41594b0 msgr2=0x7ff5b40afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.688+0000 7ff5b91bb700 1 --2- 172.21.15.7:0/2947291508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b41594b0 0x7ff5b40afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.688+0000 7ff5b91bb700 1 -- 172.21.15.7:0/2947291508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b00094f0 con 0x7ff5b406be40 2023-10-06T10:59:26.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.689+0000 7ff5b91bb700 1 --2- 172.21.15.7:0/2947291508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b406be40 0x7ff5b40c3730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00090b0 tx=0x7ff5b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.689+0000 7f2d937fe700 1 -- 172.21.15.7:0/3511418646 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4027470 con 0x7f2dac15c860 2023-10-06T10:59:26.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.689+0000 7f2d937fe700 1 -- 172.21.15.7:0/3511418646 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da40275f0 con 0x7f2dac15c860 2023-10-06T10:59:26.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.689+0000 7f2db1ebf700 1 -- 172.21.15.7:0/3511418646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dac0c3f00 con 0x7f2dac15c860 2023-10-06T10:59:26.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.689+0000 7f2db1ebf700 1 -- 172.21.15.7:0/3511418646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dac150550 con 0x7f2dac15c860 2023-10-06T10:59:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.689+0000 7ff5a97fa700 1 -- 172.21.15.7:0/2947291508 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b000bd60 con 0x7ff5b406be40 2023-10-06T10:59:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.689+0000 7ff5a97fa700 1 -- 172.21.15.7:0/2947291508 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b001f070 con 0x7ff5b406be40 2023-10-06T10:59:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.689+0000 7ff5bb41f700 1 -- 172.21.15.7:0/2947291508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b41561d0 con 0x7ff5b406be40 2023-10-06T10:59:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.689+0000 7ff5a97fa700 1 -- 172.21.15.7:0/2947291508 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b001a890 con 0x7ff5b406be40 2023-10-06T10:59:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.689+0000 7ff5bb41f700 1 -- 172.21.15.7:0/2947291508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b40c4350 con 0x7ff5b406be40 2023-10-06T10:59:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.691+0000 7f2db1ebf700 1 -- 172.21.15.7:0/3511418646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dac0c4140 con 0x7f2dac15c860 2023-10-06T10:59:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.692+0000 7f2d937fe700 1 -- 172.21.15.7:0/3511418646 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da40279b0 con 0x7f2dac15c860 2023-10-06T10:59:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.692+0000 7f2d937fe700 1 -- 172.21.15.7:0/3511418646 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2da4024070 con 0x7f2dac15c860 2023-10-06T10:59:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.692+0000 7f2d937fe700 1 --2- 172.21.15.7:0/3511418646 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2d98067100 0x7f2d980695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.692+0000 7f2d937fe700 1 -- 172.21.15.7:0/3511418646 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2da4086f10 con 0x7f2dac15c860 2023-10-06T10:59:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.690+0000 7ff5bb41f700 1 -- 172.21.15.7:0/2947291508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5940052b0 con 0x7ff5b406be40 2023-10-06T10:59:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.692+0000 7ff5a97fa700 1 -- 172.21.15.7:0/2947291508 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5b001ac00 con 0x7ff5b406be40 2023-10-06T10:59:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.692+0000 7ff5a97fa700 1 --2- 172.21.15.7:0/2947291508 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff598066fb0 0x7ff598069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.693+0000 7ff5a97fa700 1 -- 172.21.15.7:0/2947291508 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff5b0021070 con 0x7ff5b406be40 2023-10-06T10:59:26.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.694+0000 7f2dab7fe700 1 --2- 172.21.15.7:0/3511418646 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2d98067100 0x7f2d980695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.695+0000 7f2dab7fe700 1 --2- 172.21.15.7:0/3511418646 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2d98067100 0x7f2d980695b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009e70 tx=0x7f2d9c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.695+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529822526 0 0) 0x7fd5b8067290 con 0x7fd5b81593d0 2023-10-06T10:59:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.695+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5a0003570 con 0x7fd5b81593d0 2023-10-06T10:59:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.695+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984996916 0 0) 0x7fd5b8067570 con 0x7fd5b806efe0 2023-10-06T10:59:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.695+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b8067290 con 0x7fd5b806efe0 2023-10-06T10:59:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7ff5a97fa700 1 -- 172.21.15.7:0/2947291508 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5b0053d70 con 0x7ff5b406be40 2023-10-06T10:59:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 968963125 0 0) 0x7fd5a0003570 con 0x7fd5b81593d0 2023-10-06T10:59:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5b8159000 msgr2=0x7fd5b80c6300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T10:59:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7fd5b559a700 1 --2- 172.21.15.7:0/2121993586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5b8159000 0x7fd5b80c6300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 >> v1:172.21.15.50:6789/0 conn(0x7fd5b806efe0 legacy=0x7fd5b806be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b8067b30 con 0x7fd5b81593d0 2023-10-06T10:59:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7fd5b00017f0 con 0x7fd5b81593d0 2023-10-06T10:59:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 >> v1:172.21.15.7:6789/0 conn(0x7fd5b81593d0 legacy=0x7fd5b813b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7fd5b559a700 1 --2- 172.21.15.7:0/2121993586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5a0004d30 0x7fd5a0005100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7fd5b559a700 1 --2- 172.21.15.7:0/2121993586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5a00037b0 0x7fd5a0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7fd5b559a700 1 --2- 172.21.15.7:0/2121993586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5a0004160 0x7fd5a0010070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac001120 con 0x7fd5a00037b0 2023-10-06T10:59:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b8067850 con 0x7fd5a0004160 2023-10-06T10:59:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a0010710 con 0x7fd5a0004d30 2023-10-06T10:59:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.698+0000 7fd5b6d9d700 1 --2- 172.21.15.7:0/2121993586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5a0004160 0x7fd5a0010070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.697+0000 7ff5b89ba700 1 --2- 172.21.15.7:0/2947291508 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff598066fb0 0x7ff598069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.698+0000 7ff5b89ba700 1 --2- 172.21.15.7:0/2947291508 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff598066fb0 0x7ff598069460 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff5b414f640 tx=0x7ff5a4006d20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.698+0000 7fd5b6d9d700 1 -- 172.21.15.7:0/2121993586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5a0004d30 msgr2=0x7fd5a0005100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.698+0000 7fd5b6d9d700 1 --2- 172.21.15.7:0/2121993586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5a0004d30 0x7fd5a0005100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.698+0000 7fd5b6d9d700 1 -- 172.21.15.7:0/2121993586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5a00037b0 msgr2=0x7fd5a0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.698+0000 7fd5b6d9d700 1 --2- 172.21.15.7:0/2121993586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5a00037b0 0x7fd5a0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.698+0000 7fd5b6d9d700 1 -- 172.21.15.7:0/2121993586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a0003570 con 0x7fd5a0004160 2023-10-06T10:59:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.698+0000 7fd5b6d9d700 1 --2- 172.21.15.7:0/2121993586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5a0004160 0x7fd5a0010070 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000a820 tx=0x7fd5b00020c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6e2ebd9fc4c8a65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.699+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00070f0 con 0x7fd5a0004160 2023-10-06T10:59:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.699+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b0007250 con 0x7fd5a0004160 2023-10-06T10:59:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.699+0000 7fd5b559a700 1 -- 172.21.15.7:0/2121993586 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0007610 con 0x7fd5a0004160 2023-10-06T10:59:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.700+0000 7f2d937fe700 1 -- 172.21.15.7:0/3511418646 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2dac0c4140 con 0x7f2dac15c860 2023-10-06T10:59:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.700+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2121993586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5a0004160 msgr2=0x7fd5a0010070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.700+0000 7fd5bcfc7700 1 --2- 172.21.15.7:0/2121993586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5a0004160 0x7fd5a0010070 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000a820 tx=0x7fd5b00020c0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.700+0000 7fd5b6d9d700 1 -- 172.21.15.7:0/2121993586 reap_dead start 2023-10-06T10:59:26.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.709+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2121993586 shutdown_connections 2023-10-06T10:59:26.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.709+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2121993586 >> 172.21.15.7:0/2121993586 conn(0x7fd5b80c8730 msgr2=0x7fd5b80c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:26.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.709+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2121993586 shutdown_connections 2023-10-06T10:59:26.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.709+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2121993586 wait complete. 2023-10-06T10:59:26.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.711+0000 7fd5bcfc7700 1 Processor -- start 2023-10-06T10:59:26.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.711+0000 7fd5bcfc7700 1 -- start start 2023-10-06T10:59:26.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.712+0000 7fd5bcfc7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5a0004160 0x7fd5b8130630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.712+0000 7fd5bcfc7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5b81536a0 0x7fd5b80c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.712+0000 7fd5bcfc7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5b80c7960 0x7fd5b8136e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.712+0000 7fd5bcfc7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b80b0490 con 0x7fd5a0004160 2023-10-06T10:59:26.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.712+0000 7fd5bcfc7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b80c7db0 con 0x7fd5b80c7960 2023-10-06T10:59:26.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.712+0000 7fd5bcfc7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b8130b70 con 0x7fd5b81536a0 2023-10-06T10:59:26.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.713+0000 7fd5b5d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5b81536a0 0x7fd5b80c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.713+0000 7fd5b5d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5b81536a0 0x7fd5b80c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:35268/0 (socket says 172.21.15.7:35268) 2023-10-06T10:59:26.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.713+0000 7fd5b5d9b700 1 -- 172.21.15.7:0/2101329901 learned_addr learned my addr 172.21.15.7:0/2101329901 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:26.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.713+0000 7fd5b6d9d700 1 --2- 172.21.15.7:0/2101329901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5b80c7960 0x7fd5b8136e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.715+0000 7fd5b5d9b700 1 -- 172.21.15.7:0/2101329901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5b80c7960 msgr2=0x7fd5b8136e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.715+0000 7fd5b5d9b700 1 --2- 172.21.15.7:0/2101329901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5b80c7960 0x7fd5b8136e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.715+0000 7fd5b5d9b700 1 -- 172.21.15.7:0/2101329901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5a0004160 msgr2=0x7fd5b8130630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.715+0000 7fd5b5d9b700 1 --2- 172.21.15.7:0/2101329901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5a0004160 0x7fd5b8130630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.715+0000 7fd5b5d9b700 1 -- 172.21.15.7:0/2101329901 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b81521b0 con 0x7fd5b81536a0 2023-10-06T10:59:26.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.716+0000 7fd5b5d9b700 1 --2- 172.21.15.7:0/2101329901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5b81536a0 0x7fd5b80c7420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00cb80 tx=0x7fd5ac007660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.716+0000 7fd5a67fc700 1 -- 172.21.15.7:0/2101329901 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac009030 con 0x7fd5b81536a0 2023-10-06T10:59:26.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.716+0000 7fd5a67fc700 1 -- 172.21.15.7:0/2101329901 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac003300 con 0x7fd5b81536a0 2023-10-06T10:59:26.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.716+0000 7fd5a67fc700 1 -- 172.21.15.7:0/2101329901 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac0017b0 con 0x7fd5b81536a0 2023-10-06T10:59:26.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.716+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2101329901 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b8152490 con 0x7fd5b81536a0 2023-10-06T10:59:26.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.716+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2101329901 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b8152a50 con 0x7fd5b81536a0 2023-10-06T10:59:26.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.719+0000 7fd5a67fc700 1 -- 172.21.15.7:0/2101329901 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5ac001ba0 con 0x7fd5b81536a0 2023-10-06T10:59:26.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.719+0000 7fd5a67fc700 1 --2- 172.21.15.7:0/2101329901 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd598067080 0x7fd598069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.719+0000 7fd5a67fc700 1 -- 172.21.15.7:0/2101329901 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd5ac084c80 con 0x7fd5b81536a0 2023-10-06T10:59:26.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.720+0000 7fd5b659c700 1 --2- 172.21.15.7:0/2101329901 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd598067080 0x7fd598069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.721+0000 7fd5b659c700 1 --2- 172.21.15.7:0/2101329901 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd598067080 0x7fd598069530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80c2c80 tx=0x7fd5a8006c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.722+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2101329901 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59c0052b0 con 0x7fd5b81536a0 2023-10-06T10:59:26.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.727+0000 7fd5a67fc700 1 -- 172.21.15.7:0/2101329901 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5ac051b00 con 0x7fd5b81536a0 2023-10-06T10:59:26.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.792+0000 7fd8ec44d700 1 Processor -- start 2023-10-06T10:59:26.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.792+0000 7fd8ec44d700 1 -- start start 2023-10-06T10:59:26.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.794+0000 7fd8ec44d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8e413b2d0 0x7fd8e413b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.794+0000 7fd8ec44d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e413bc50 con 0x7fd8e4159000 2023-10-06T10:59:26.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.794+0000 7fd8ec44d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e4067290 con 0x7fd8e41593d0 2023-10-06T10:59:26.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.794+0000 7fd8ec44d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e40c6a10 con 0x7fd8e413b2d0 2023-10-06T10:59:26.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.795+0000 7fd8ea9ea700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8e413b2d0 0x7fd8e413b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.795+0000 7fd8e99e8700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd8e41593d0 0x7fd8e406be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:56288/0 (socket says 172.21.15.7:56288) 2023-10-06T10:59:26.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.795+0000 7fd8e99e8700 1 -- 172.21.15.7:0/1387613297 learned_addr learned my addr 172.21.15.7:0/1387613297 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:26.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.796+0000 7fd8ea9ea700 1 -- 172.21.15.7:0/1387613297 >> v1:172.21.15.50:6789/0 conn(0x7fd8e41593d0 legacy=0x7fd8e406be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.796+0000 7fd8ea9ea700 1 -- 172.21.15.7:0/1387613297 >> v1:172.21.15.7:6789/0 conn(0x7fd8e4159000 legacy=0x7fd8e40c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.796+0000 7fd8ea9ea700 1 -- 172.21.15.7:0/1387613297 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e4067570 con 0x7fd8e413b2d0 2023-10-06T10:59:26.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.797+0000 7fd8ea9ea700 1 --2- 172.21.15.7:0/1387613297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e413b2d0 0x7fd8e413b710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00072f0 tx=0x7fd8e000abc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6a6565d0a49ea23 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.797+0000 7fd8e91e7700 1 -- 172.21.15.7:0/1387613297 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0007de0 con 0x7fd8e413b2d0 2023-10-06T10:59:26.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.797+0000 7fd8e91e7700 1 -- 172.21.15.7:0/1387613297 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e000a150 con 0x7fd8e413b2d0 2023-10-06T10:59:26.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.797+0000 7fd8e91e7700 1 -- 172.21.15.7:0/1387613297 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e000a4f0 con 0x7fd8e413b2d0 2023-10-06T10:59:26.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.798+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1387613297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e413b2d0 msgr2=0x7fd8e413b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.798+0000 7fd8ec44d700 1 --2- 172.21.15.7:0/1387613297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e413b2d0 0x7fd8e413b710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00072f0 tx=0x7fd8e000abc0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.799+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1387613297 shutdown_connections 2023-10-06T10:59:26.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.799+0000 7fd8ec44d700 1 --2- 172.21.15.7:0/1387613297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e413b2d0 0x7fd8e413b710 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.799+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1387613297 >> 172.21.15.7:0/1387613297 conn(0x7fd8e40c8730 msgr2=0x7fd8e40c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:26.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.799+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1387613297 shutdown_connections 2023-10-06T10:59:26.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.799+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1387613297 wait complete. 2023-10-06T10:59:26.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.801+0000 7fd8ec44d700 1 Processor -- start 2023-10-06T10:59:26.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.802+0000 7fd8ec44d700 1 -- start start 2023-10-06T10:59:26.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.803+0000 7fd8ec44d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd8e413b2d0 0x7fd8e4136ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.803+0000 7fd8ec44d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8e4159000 0x7fd8e40c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.803+0000 7fd8ec44d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e41593d0 0x7fd8e4157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.803+0000 7fd8ec44d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e4137430 con 0x7fd8e4159000 2023-10-06T10:59:26.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.803+0000 7fd8ec44d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e40c3670 con 0x7fd8e41593d0 2023-10-06T10:59:26.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.803+0000 7fd8ec44d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e40c3950 con 0x7fd8e413b2d0 2023-10-06T10:59:26.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.803+0000 7fd8e99e8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8e4159000 0x7fd8e40c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.803+0000 7fd8e99e8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8e4159000 0x7fd8e40c2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43682/0 (socket says 172.21.15.7:43682) 2023-10-06T10:59:26.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.803+0000 7fd8e99e8700 1 -- 172.21.15.7:0/1730322309 learned_addr learned my addr 172.21.15.7:0/1730322309 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:26.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.804+0000 7fd8e99e8700 1 -- 172.21.15.7:0/1730322309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd8e413b2d0 msgr2=0x7fd8e4136ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:26.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.804+0000 7fd8e99e8700 1 --2- 172.21.15.7:0/1730322309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd8e413b2d0 0x7fd8e4136ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.804+0000 7fd8e99e8700 1 -- 172.21.15.7:0/1730322309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e41593d0 msgr2=0x7fd8e4157d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T10:59:26.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.804+0000 7fd8e99e8700 1 --2- 172.21.15.7:0/1730322309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e41593d0 0x7fd8e4157d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:26.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.804+0000 7fd8e99e8700 1 -- 172.21.15.7:0/1730322309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e40c3c30 con 0x7fd8e4159000 2023-10-06T10:59:26.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.804+0000 7fd8e99e8700 1 --2- 172.21.15.7:0/1730322309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8e4159000 0x7fd8e40c2d70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400c810 tx=0x7fd8d4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.806+0000 7fd8da7fc700 1 -- 172.21.15.7:0/1730322309 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4005b30 con 0x7fd8e4159000 2023-10-06T10:59:26.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.807+0000 7fd8da7fc700 1 -- 172.21.15.7:0/1730322309 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d4005cb0 con 0x7fd8e4159000 2023-10-06T10:59:26.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.807+0000 7fd8da7fc700 1 -- 172.21.15.7:0/1730322309 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4007340 con 0x7fd8e4159000 2023-10-06T10:59:26.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.807+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1730322309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e40c4b00 con 0x7fd8e4159000 2023-10-06T10:59:26.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.807+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1730322309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e4158250 con 0x7fd8e4159000 2023-10-06T10:59:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.812+0000 7fd8da7fc700 1 -- 172.21.15.7:0/1730322309 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8d401b400 con 0x7fd8e4159000 2023-10-06T10:59:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.813+0000 7fd8da7fc700 1 --2- 172.21.15.7:0/1730322309 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd8d00671a0 0x7fd8d0069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.813+0000 7fd8da7fc700 1 -- 172.21.15.7:0/1730322309 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd8d4084450 con 0x7fd8e4159000 2023-10-06T10:59:26.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.813+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1730322309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8cc0052b0 con 0x7fd8e4159000 2023-10-06T10:59:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.822+0000 7fd8ea1e9700 1 --2- 172.21.15.7:0/1730322309 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd8d00671a0 0x7fd8d0069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.823+0000 7fd8ea1e9700 1 --2- 172.21.15.7:0/1730322309 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd8d00671a0 0x7fd8d0069650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8e413af40 tx=0x7fd8dc007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:26.824+0000 7fd8da7fc700 1 -- 172.21.15.7:0/1730322309 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8d40512d0 con 0x7fd8e4159000 2023-10-06T10:59:27.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.015+0000 7f25066d9700 1 -- 172.21.15.7:0/3724492270 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f25000b07c0 con 0x7f2500159000 2023-10-06T10:59:27.023 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2023-10-06T10:59:27.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.020+0000 7f24e7fff700 1 -- 172.21.15.7:0/3724492270 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24f0055490 con 0x7f2500159000 2023-10-06T10:59:27.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.023+0000 7f44a735f700 1 -- 172.21.15.7:0/3720420369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f44a0070480 con 0x7f44a00c7770 2023-10-06T10:59:27.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.023+0000 7f25066d9700 1 -- 172.21.15.7:0/3724492270 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f24ec066fb0 msgr2=0x7f24ec069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.023+0000 7f25066d9700 1 --2- 172.21.15.7:0/3724492270 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f24ec066fb0 0x7f24ec069460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f24f8008a60 tx=0x7f24f8005fd0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.023+0000 7f25066d9700 1 -- 172.21.15.7:0/3724492270 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2500159000 msgr2=0x7f2500153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.023+0000 7f25066d9700 1 --2- 172.21.15.7:0/3724492270 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2500159000 0x7f2500153960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24f000b5e0 tx=0x7f24f00090f0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.024+0000 7f25066d9700 1 -- 172.21.15.7:0/3724492270 shutdown_connections 2023-10-06T10:59:27.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.024+0000 7f25066d9700 1 --2- 172.21.15.7:0/3724492270 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f24ec066fb0 0x7f24ec069460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.024+0000 7f25066d9700 1 --2- 172.21.15.7:0/3724492270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f250013b2d0 0x7f25000c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.024+0000 7f25066d9700 1 --2- 172.21.15.7:0/3724492270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25001593d0 0x7f25000aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.024+0000 7f25066d9700 1 --2- 172.21.15.7:0/3724492270 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2500159000 0x7f2500153960 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24f000b5e0 tx=0x7f24f00090f0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.024+0000 7f25066d9700 1 -- 172.21.15.7:0/3724492270 >> 172.21.15.7:0/3724492270 conn(0x7f25000c8730 msgr2=0x7f25000c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:27.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.024+0000 7f25066d9700 1 -- 172.21.15.7:0/3724492270 shutdown_connections 2023-10-06T10:59:27.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.024+0000 7f25066d9700 1 -- 172.21.15.7:0/3724492270 wait complete. 2023-10-06T10:59:27.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.025+0000 7f44957fa700 1 -- 172.21.15.7:0/3720420369 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4490054880 con 0x7f44a00c7770 2023-10-06T10:59:27.027 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2023-10-06T10:59:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.029+0000 7f44a735f700 1 -- 172.21.15.7:0/3720420369 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4484067080 msgr2=0x7f4484069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.029+0000 7f44a735f700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4484067080 0x7f4484069530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f449c006fd0 tx=0x7f449c0090f0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.029+0000 7f44a735f700 1 -- 172.21.15.7:0/3720420369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44a00c7770 msgr2=0x7f44a00c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.029+0000 7f44a735f700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44a00c7770 0x7f44a00c5400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f449000b5e0 tx=0x7f44900090f0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.029+0000 7f44a735f700 1 -- 172.21.15.7:0/3720420369 shutdown_connections 2023-10-06T10:59:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.029+0000 7f44a735f700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4484067080 0x7f4484069530 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.029+0000 7f44a735f700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44a00c7b40 0x7f44a00c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.029+0000 7f44a735f700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44a00add70 0x7f44a0175f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.029+0000 7f44a735f700 1 --2- 172.21.15.7:0/3720420369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44a00c7770 0x7f44a00c5400 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.029+0000 7f44a735f700 1 -- 172.21.15.7:0/3720420369 >> 172.21.15.7:0/3720420369 conn(0x7f44a00c8730 msgr2=0x7f44a015c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.030+0000 7f44a735f700 1 -- 172.21.15.7:0/3720420369 shutdown_connections 2023-10-06T10:59:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.030+0000 7f44a735f700 1 -- 172.21.15.7:0/3720420369 wait complete. 2023-10-06T10:59:27.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.047+0000 7fb41a5f4700 1 -- 172.21.15.7:0/1466134460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb3f4005560 con 0x7fb414086b70 2023-10-06T10:59:27.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.050+0000 7fb3fbfff700 1 -- 172.21.15.7:0/1466134460 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb4080551d0 con 0x7fb414086b70 2023-10-06T10:59:27.051 INFO:teuthology.orchestra.run.smithi007.stdout:55834574858 2023-10-06T10:59:27.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.7 2023-10-06T10:59:27.052 DEBUG:teuthology.parallel:result is None 2023-10-06T10:59:27.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.053+0000 7fb41a5f4700 1 -- 172.21.15.7:0/1466134460 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb400067080 msgr2=0x7fb400069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.053+0000 7fb41a5f4700 1 --2- 172.21.15.7:0/1466134460 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb400067080 0x7fb400069530 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00acf0 tx=0x7fb40c009370 comp rx=0 tx=0).stop 2023-10-06T10:59:27.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.053+0000 7fb41a5f4700 1 -- 172.21.15.7:0/1466134460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414086b70 msgr2=0x7fb414168640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.053+0000 7fb41a5f4700 1 --2- 172.21.15.7:0/1466134460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414086b70 0x7fb414168640 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb40800c7d0 tx=0x7fb408008040 comp rx=0 tx=0).stop 2023-10-06T10:59:27.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.054+0000 7fb41a5f4700 1 -- 172.21.15.7:0/1466134460 shutdown_connections 2023-10-06T10:59:27.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.054+0000 7fb41a5f4700 1 --2- 172.21.15.7:0/1466134460 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb400067080 0x7fb400069530 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.054+0000 7fb41a5f4700 1 --2- 172.21.15.7:0/1466134460 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4140c7520 0x7fb414168b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.054+0000 7fb41a5f4700 1 --2- 172.21.15.7:0/1466134460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4140867a0 0x7fb414085ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.054+0000 7fb41a5f4700 1 --2- 172.21.15.7:0/1466134460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414086b70 0x7fb414168640 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.054+0000 7fb41a5f4700 1 -- 172.21.15.7:0/1466134460 >> 172.21.15.7:0/1466134460 conn(0x7fb4140c8730 msgr2=0x7fb414161480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:27.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.054+0000 7fb41a5f4700 1 -- 172.21.15.7:0/1466134460 shutdown_connections 2023-10-06T10:59:27.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.054+0000 7fb41a5f4700 1 -- 172.21.15.7:0/1466134460 wait complete. 2023-10-06T10:59:27.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.1 2023-10-06T10:59:27.057 DEBUG:teuthology.parallel:result is None 2023-10-06T10:59:27.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.2 2023-10-06T10:59:27.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.076+0000 7ff5bb41f700 1 -- 172.21.15.7:0/2947291508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff594005830 con 0x7ff5b406be40 2023-10-06T10:59:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.077+0000 7ff5a97fa700 1 -- 172.21.15.7:0/2947291508 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff5b0015020 con 0x7ff5b406be40 2023-10-06T10:59:27.079 DEBUG:teuthology.parallel:result is None 2023-10-06T10:59:27.079 INFO:teuthology.orchestra.run.smithi007.stdout:55834574859 2023-10-06T10:59:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.079+0000 7ff5bb41f700 1 -- 172.21.15.7:0/2947291508 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff598066fb0 msgr2=0x7ff598069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.079+0000 7ff5bb41f700 1 --2- 172.21.15.7:0/2947291508 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff598066fb0 0x7ff598069460 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff5b414f640 tx=0x7ff5a4006d20 comp rx=0 tx=0).stop 2023-10-06T10:59:27.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.079+0000 7ff5bb41f700 1 -- 172.21.15.7:0/2947291508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b406be40 msgr2=0x7ff5b40c3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.079+0000 7ff5bb41f700 1 --2- 172.21.15.7:0/2947291508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b406be40 0x7ff5b40c3730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00090b0 tx=0x7ff5b0017000 comp rx=0 tx=0).stop 2023-10-06T10:59:27.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.079+0000 7ff5bb41f700 1 -- 172.21.15.7:0/2947291508 shutdown_connections 2023-10-06T10:59:27.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.080+0000 7ff5bb41f700 1 --2- 172.21.15.7:0/2947291508 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff598066fb0 0x7ff598069460 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff5b414f640 tx=0x7ff5a4006d20 comp rx=0 tx=0).stop 2023-10-06T10:59:27.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.080+0000 7ff5bb41f700 1 --2- 172.21.15.7:0/2947291508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b406be40 0x7ff5b40c3730 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.080+0000 7ff5bb41f700 1 --2- 172.21.15.7:0/2947291508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b41594b0 0x7ff5b40afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.080+0000 7ff5bb41f700 1 --2- 172.21.15.7:0/2947291508 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff5b406efe0 0x7ff5b414eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.080+0000 7ff5bb41f700 1 -- 172.21.15.7:0/2947291508 >> 172.21.15.7:0/2947291508 conn(0x7ff5b40c8730 msgr2=0x7ff5b4067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:27.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.081+0000 7ff5bb41f700 1 -- 172.21.15.7:0/2947291508 shutdown_connections 2023-10-06T10:59:27.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.081+0000 7ff5bb41f700 1 -- 172.21.15.7:0/2947291508 wait complete. 2023-10-06T10:59:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.088+0000 7f2db1ebf700 1 -- 172.21.15.7:0/3511418646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2dac150840 con 0x7f2dac15c860 2023-10-06T10:59:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.089+0000 7f2d937fe700 1 -- 172.21.15.7:0/3511418646 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2dac150840 con 0x7f2dac15c860 2023-10-06T10:59:27.090 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2023-10-06T10:59:27.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.091+0000 7f2db1ebf700 1 -- 172.21.15.7:0/3511418646 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2d98067100 msgr2=0x7f2d980695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.091+0000 7f2db1ebf700 1 --2- 172.21.15.7:0/3511418646 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2d98067100 0x7f2d980695b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009e70 tx=0x7f2d9c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.091+0000 7f2db1ebf700 1 -- 172.21.15.7:0/3511418646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dac15c860 msgr2=0x7f2dac0c1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.091+0000 7f2db1ebf700 1 --2- 172.21.15.7:0/3511418646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dac15c860 0x7f2dac0c1e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2da4016000 tx=0x7f2da4019000 comp rx=0 tx=0).stop 2023-10-06T10:59:27.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.092+0000 7f2db1ebf700 1 -- 172.21.15.7:0/3511418646 shutdown_connections 2023-10-06T10:59:27.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.092+0000 7f2db1ebf700 1 --2- 172.21.15.7:0/3511418646 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2d98067100 0x7f2d980695b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.092+0000 7f2db1ebf700 1 --2- 172.21.15.7:0/3511418646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dac0c12d0 0x7f2dac150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.092+0000 7f2db1ebf700 1 --2- 172.21.15.7:0/3511418646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dac15c860 0x7f2dac0c1e60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.092+0000 7f2db1ebf700 1 --2- 172.21.15.7:0/3511418646 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2dac15c490 0x7f2dac0c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.092+0000 7f2db1ebf700 1 -- 172.21.15.7:0/3511418646 >> 172.21.15.7:0/3511418646 conn(0x7f2dac0c8b60 msgr2=0x7f2dac154540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:27.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.092+0000 7f2db1ebf700 1 -- 172.21.15.7:0/3511418646 shutdown_connections 2023-10-06T10:59:27.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.092+0000 7f2db1ebf700 1 -- 172.21.15.7:0/3511418646 wait complete. 2023-10-06T10:59:27.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.5 2023-10-06T10:59:27.101 DEBUG:teuthology.parallel:result is None 2023-10-06T10:59:27.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.104+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/1048872799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff0a8005590 con 0x7ff0bc13ba40 2023-10-06T10:59:27.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.104+0000 7ff0a37fe700 1 -- 172.21.15.7:0/1048872799 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff0b001d020 con 0x7ff0bc13ba40 2023-10-06T10:59:27.105 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2023-10-06T10:59:27.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.0 2023-10-06T10:59:27.107 DEBUG:teuthology.parallel:result is None 2023-10-06T10:59:27.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.108+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/1048872799 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0a4067120 msgr2=0x7ff0a40695d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.108+0000 7ff0c1f0f700 1 --2- 172.21.15.7:0/1048872799 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0a4067120 0x7ff0a40695d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc159080 tx=0x7ff0b401a000 comp rx=0 tx=0).stop 2023-10-06T10:59:27.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.108+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/1048872799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc13ba40 msgr2=0x7ff0bc0c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.108+0000 7ff0c1f0f700 1 --2- 172.21.15.7:0/1048872799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc13ba40 0x7ff0bc0c4e70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000b740 tx=0x7ff0b0006040 comp rx=0 tx=0).stop 2023-10-06T10:59:27.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.108+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/1048872799 shutdown_connections 2023-10-06T10:59:27.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.108+0000 7ff0c1f0f700 1 --2- 172.21.15.7:0/1048872799 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0a4067120 0x7ff0a40695d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.108+0000 7ff0c1f0f700 1 --2- 172.21.15.7:0/1048872799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc13ba40 0x7ff0bc0c4e70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.108+0000 7ff0c1f0f700 1 --2- 172.21.15.7:0/1048872799 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0bc0ca7d0 0x7ff0bc13cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.108+0000 7ff0c1f0f700 1 --2- 172.21.15.7:0/1048872799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0bc13b670 0x7ff0bc176300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.108+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/1048872799 >> 172.21.15.7:0/1048872799 conn(0x7ff0bc0cc790 msgr2=0x7ff0bc0673b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:27.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.108+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/1048872799 shutdown_connections 2023-10-06T10:59:27.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.108+0000 7ff0c1f0f700 1 -- 172.21.15.7:0/1048872799 wait complete. 2023-10-06T10:59:27.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.4 2023-10-06T10:59:27.126 DEBUG:teuthology.parallel:result is None 2023-10-06T10:59:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.138+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2101329901 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd59c005560 con 0x7fd5b81536a0 2023-10-06T10:59:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.138+0000 7fd5a67fc700 1 -- 172.21.15.7:0/2101329901 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd5ac014070 con 0x7fd5b81536a0 2023-10-06T10:59:27.139 INFO:teuthology.orchestra.run.smithi007.stdout:55834574858 2023-10-06T10:59:27.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.141+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2101329901 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd598067080 msgr2=0x7fd598069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.141+0000 7fd5bcfc7700 1 --2- 172.21.15.7:0/2101329901 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd598067080 0x7fd598069530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80c2c80 tx=0x7fd5a8006c90 comp rx=0 tx=0).stop 2023-10-06T10:59:27.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.141+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2101329901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5b81536a0 msgr2=0x7fd5b80c7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.141+0000 7fd5bcfc7700 1 --2- 172.21.15.7:0/2101329901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5b81536a0 0x7fd5b80c7420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00cb80 tx=0x7fd5ac007660 comp rx=0 tx=0).stop 2023-10-06T10:59:27.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.141+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2101329901 shutdown_connections 2023-10-06T10:59:27.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.141+0000 7fd5bcfc7700 1 --2- 172.21.15.7:0/2101329901 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd598067080 0x7fd598069530 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.141+0000 7fd5bcfc7700 1 --2- 172.21.15.7:0/2101329901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5a0004160 0x7fd5b8130630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.141+0000 7fd5bcfc7700 1 --2- 172.21.15.7:0/2101329901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5b80c7960 0x7fd5b8136e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.141+0000 7fd5bcfc7700 1 --2- 172.21.15.7:0/2101329901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5b81536a0 0x7fd5b80c7420 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.141+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2101329901 >> 172.21.15.7:0/2101329901 conn(0x7fd5b80c8730 msgr2=0x7fd5b81547a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.141+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2101329901 shutdown_connections 2023-10-06T10:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.141+0000 7fd5bcfc7700 1 -- 172.21.15.7:0/2101329901 wait complete. 2023-10-06T10:59:27.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.6 2023-10-06T10:59:27.155 DEBUG:teuthology.parallel:result is None 2023-10-06T10:59:27.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.168+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1730322309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd8cc005560 con 0x7fd8e4159000 2023-10-06T10:59:27.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.169+0000 7fd8da7fc700 1 -- 172.21.15.7:0/1730322309 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8d40548f0 con 0x7fd8e4159000 2023-10-06T10:59:27.170 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2023-10-06T10:59:27.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.171+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1730322309 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd8d00671a0 msgr2=0x7fd8d0069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.171+0000 7fd8ec44d700 1 --2- 172.21.15.7:0/1730322309 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd8d00671a0 0x7fd8d0069650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8e413af40 tx=0x7fd8dc007de0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.171+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1730322309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8e4159000 msgr2=0x7fd8e40c2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.171+0000 7fd8ec44d700 1 --2- 172.21.15.7:0/1730322309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8e4159000 0x7fd8e40c2d70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400c810 tx=0x7fd8d4007ef0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.171+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1730322309 shutdown_connections 2023-10-06T10:59:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.171+0000 7fd8ec44d700 1 --2- 172.21.15.7:0/1730322309 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd8d00671a0 0x7fd8d0069650 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.171+0000 7fd8ec44d700 1 --2- 172.21.15.7:0/1730322309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e41593d0 0x7fd8e4157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.171+0000 7fd8ec44d700 1 --2- 172.21.15.7:0/1730322309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd8e413b2d0 0x7fd8e4136ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.171+0000 7fd8ec44d700 1 --2- 172.21.15.7:0/1730322309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8e4159000 0x7fd8e40c2d70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.171+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1730322309 >> 172.21.15.7:0/1730322309 conn(0x7fd8e40c8730 msgr2=0x7fd8e406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.171+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1730322309 shutdown_connections 2023-10-06T10:59:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.171+0000 7fd8ec44d700 1 -- 172.21.15.7:0/1730322309 wait complete. 2023-10-06T10:59:27.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.3 2023-10-06T10:59:27.185 DEBUG:teuthology.parallel:result is None 2023-10-06T10:59:27.185 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T10:59:27.185 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T10:59:27.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.357+0000 7f0921c3f700 1 Processor -- start 2023-10-06T10:59:27.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.357+0000 7f0921c3f700 1 -- start start 2023-10-06T10:59:27.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.358+0000 7f0921c3f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f091c0cd1b0 0x7f091c161fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:27.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.358+0000 7f0921c3f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091c0cbd10 con 0x7f091c0c8d70 2023-10-06T10:59:27.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.358+0000 7f0921c3f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091c0cb9e0 con 0x7f091c158120 2023-10-06T10:59:27.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.358+0000 7f0921c3f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f091c0c9300 con 0x7f091c0cd1b0 2023-10-06T10:59:27.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.358+0000 7f091bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f091c0cd1b0 0x7f091c161fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:27.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.358+0000 7f091bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f091c0cd1b0 0x7f091c161fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43698/0 (socket says 172.21.15.7:43698) 2023-10-06T10:59:27.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.358+0000 7f091affd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f091c0c8d70 0x7f091c0ca720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44352/0 (socket says 172.21.15.7:44352) 2023-10-06T10:59:27.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.358+0000 7f091bfff700 1 -- 172.21.15.7:0/237374349 learned_addr learned my addr 172.21.15.7:0/237374349 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:27.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.358+0000 7f091bfff700 1 -- 172.21.15.7:0/237374349 >> v1:172.21.15.50:6789/0 conn(0x7f091c158120 legacy=0x7f091c0c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:27.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.358+0000 7f091bfff700 1 -- 172.21.15.7:0/237374349 >> v1:172.21.15.7:6789/0 conn(0x7f091c0c8d70 legacy=0x7f091c0ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.358+0000 7f091bfff700 1 -- 172.21.15.7:0/237374349 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c0c95e0 con 0x7f091c0cd1b0 2023-10-06T10:59:27.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.359+0000 7f091bfff700 1 --2- 172.21.15.7:0/237374349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f091c0cd1b0 0x7f091c161fc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0914009f20 tx=0x7f0914009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347403f707914380 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:27.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.359+0000 7f091a7fc700 1 -- 172.21.15.7:0/237374349 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091400e070 con 0x7f091c0cd1b0 2023-10-06T10:59:27.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.359+0000 7f091a7fc700 1 -- 172.21.15.7:0/237374349 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091400ba80 con 0x7f091c0cd1b0 2023-10-06T10:59:27.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.359+0000 7f091a7fc700 1 -- 172.21.15.7:0/237374349 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09140092e0 con 0x7f091c0cd1b0 2023-10-06T10:59:27.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.359+0000 7f0921c3f700 1 -- 172.21.15.7:0/237374349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f091c0cd1b0 msgr2=0x7f091c161fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.359+0000 7f0921c3f700 1 --2- 172.21.15.7:0/237374349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f091c0cd1b0 0x7f091c161fc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0914009f20 tx=0x7f0914009840 comp rx=0 tx=0).stop 2023-10-06T10:59:27.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.359+0000 7f0921c3f700 1 -- 172.21.15.7:0/237374349 shutdown_connections 2023-10-06T10:59:27.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.360+0000 7f0921c3f700 1 --2- 172.21.15.7:0/237374349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f091c0cd1b0 0x7f091c161fc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.360+0000 7f0921c3f700 1 -- 172.21.15.7:0/237374349 >> 172.21.15.7:0/237374349 conn(0x7f091c087920 msgr2=0x7f091c097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:27.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.360+0000 7f0921c3f700 1 -- 172.21.15.7:0/237374349 shutdown_connections 2023-10-06T10:59:27.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.360+0000 7f0921c3f700 1 -- 172.21.15.7:0/237374349 wait complete. 2023-10-06T10:59:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.361+0000 7f0921c3f700 1 Processor -- start 2023-10-06T10:59:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.361+0000 7f0921c3f700 1 -- start start 2023-10-06T10:59:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.362+0000 7f0921c3f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f091c0c8d70 0x7f091c1500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.362+0000 7f0921c3f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091c0cd1b0 0x7f091c0c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.362+0000 7f0921c3f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f091c158120 0x7f091c156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.362+0000 7f0921c3f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c1509f0 con 0x7f091c0c8d70 2023-10-06T10:59:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.362+0000 7f0921c3f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c0c7ec0 con 0x7f091c0cd1b0 2023-10-06T10:59:27.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.362+0000 7f0921c3f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091c0c7900 con 0x7f091c158120 2023-10-06T10:59:27.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f091b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f091c0c8d70 0x7f091c1500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:27.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f091b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f091c0c8d70 0x7f091c1500c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43702/0 (socket says 172.21.15.7:43702) 2023-10-06T10:59:27.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f091b7fe700 1 -- 172.21.15.7:0/4178510601 learned_addr learned my addr 172.21.15.7:0/4178510601 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:27.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f091affd700 1 --2- 172.21.15.7:0/4178510601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091c0cd1b0 0x7f091c0c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:27.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f091bfff700 1 --2- 172.21.15.7:0/4178510601 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f091c158120 0x7f091c156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:27.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f091b7fe700 1 -- 172.21.15.7:0/4178510601 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f091c158120 msgr2=0x7f091c156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f091b7fe700 1 --2- 172.21.15.7:0/4178510601 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f091c158120 0x7f091c156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f091b7fe700 1 -- 172.21.15.7:0/4178510601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091c0cd1b0 msgr2=0x7f091c0c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f091b7fe700 1 --2- 172.21.15.7:0/4178510601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091c0cd1b0 0x7f091c0c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f091b7fe700 1 -- 172.21.15.7:0/4178510601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0914009ae0 con 0x7f091c0c8d70 2023-10-06T10:59:27.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f091b7fe700 1 --2- 172.21.15.7:0/4178510601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f091c0c8d70 0x7f091c1500c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f090c00c7c0 tx=0x7f090c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f09137fe700 1 -- 172.21.15.7:0/4178510601 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c011590 con 0x7f091c0c8d70 2023-10-06T10:59:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f09137fe700 1 -- 172.21.15.7:0/4178510601 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c011710 con 0x7f091c0c8d70 2023-10-06T10:59:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f09137fe700 1 -- 172.21.15.7:0/4178510601 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c011ad0 con 0x7f091c0c8d70 2023-10-06T10:59:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f0921c3f700 1 -- 172.21.15.7:0/4178510601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091c0c7be0 con 0x7f091c0c8d70 2023-10-06T10:59:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.363+0000 7f0921c3f700 1 -- 172.21.15.7:0/4178510601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091c068f10 con 0x7f091c0c8d70 2023-10-06T10:59:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.364+0000 7f0921c3f700 1 -- 172.21.15.7:0/4178510601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091c068a90 con 0x7f091c0c8d70 2023-10-06T10:59:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.365+0000 7f09137fe700 1 -- 172.21.15.7:0/4178510601 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f090c01b3b0 con 0x7f091c0c8d70 2023-10-06T10:59:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.365+0000 7f09137fe700 1 --2- 172.21.15.7:0/4178510601 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f08fc066f30 0x7f08fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.365+0000 7f09137fe700 1 -- 172.21.15.7:0/4178510601 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f090c083e60 con 0x7f091c0c8d70 2023-10-06T10:59:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.365+0000 7f091affd700 1 --2- 172.21.15.7:0/4178510601 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f08fc066f30 0x7f08fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.366+0000 7f091affd700 1 --2- 172.21.15.7:0/4178510601 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f08fc066f30 0x7f08fc0693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0904007fd0 tx=0x7f0904007d70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.370+0000 7f09137fe700 1 -- 172.21.15.7:0/4178510601 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f091c068a90 con 0x7f091c0c8d70 2023-10-06T10:59:27.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.571+0000 7f0921c3f700 1 -- 172.21.15.7:0/4178510601 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f091c068a90 con 0x7f08fc066f30 2023-10-06T10:59:27.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.582+0000 7f09137fe700 1 -- 172.21.15.7:0/4178510601 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367579 (secure 0 0 0) 0x7f091c068a90 con 0x7f08fc066f30 2023-10-06T10:59:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:27.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.586+0000 7f0921c3f700 1 -- 172.21.15.7:0/4178510601 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f08fc066f30 msgr2=0x7f08fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.586+0000 7f0921c3f700 1 --2- 172.21.15.7:0/4178510601 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f08fc066f30 0x7f08fc0693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0904007fd0 tx=0x7f0904007d70 comp rx=0 tx=0).stop 2023-10-06T10:59:27.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.586+0000 7f0921c3f700 1 -- 172.21.15.7:0/4178510601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f091c0c8d70 msgr2=0x7f091c1500c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.586+0000 7f0921c3f700 1 --2- 172.21.15.7:0/4178510601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f091c0c8d70 0x7f091c1500c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f090c00c7c0 tx=0x7f090c007f70 comp rx=0 tx=0).stop 2023-10-06T10:59:27.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.586+0000 7f0921c3f700 1 -- 172.21.15.7:0/4178510601 shutdown_connections 2023-10-06T10:59:27.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.586+0000 7f0921c3f700 1 --2- 172.21.15.7:0/4178510601 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f08fc066f30 0x7f08fc0693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.586+0000 7f0921c3f700 1 --2- 172.21.15.7:0/4178510601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f091c0c8d70 0x7f091c1500c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.586+0000 7f0921c3f700 1 --2- 172.21.15.7:0/4178510601 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f091c158120 0x7f091c156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.586+0000 7f0921c3f700 1 --2- 172.21.15.7:0/4178510601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091c0cd1b0 0x7f091c0c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.586+0000 7f0921c3f700 1 -- 172.21.15.7:0/4178510601 >> 172.21.15.7:0/4178510601 conn(0x7f091c087920 msgr2=0x7f091c0ab960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:27.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.586+0000 7f0921c3f700 1 -- 172.21.15.7:0/4178510601 shutdown_connections 2023-10-06T10:59:27.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.586+0000 7f0921c3f700 1 -- 172.21.15.7:0/4178510601 wait complete. 2023-10-06T10:59:27.592 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-06T10:59:27.601 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-10-06T10:59:25.977821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594853,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381592,"kb_used_data":3288,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593128,"statfs":{"total":773094113280,"available":770655363072,"internally_reserved":0,"allocated":3366912,"data_stored":2061458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003084"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492562+0000","last_change":"2023-10-06T10:59:02.436169+0000","last_active":"2023-10-06T10:59:06.492562+0000","last_peered":"2023-10-06T10:59:06.492562+0000","last_clean":"2023-10-06T10:59:06.492562+0000","last_became_active":"2023-10-06T10:59:02.435876+0000","last_became_peered":"2023-10-06T10:59:02.435876+0000","last_unstale":"2023-10-06T10:59:06.492562+0000","last_undegraded":"2023-10-06T10:59:06.492562+0000","last_fullsized":"2023-10-06T10:59:06.492562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:41.015749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493906+0000","last_change":"2023-10-06T10:59:02.436149+0000","last_active":"2023-10-06T10:59:06.493906+0000","last_peered":"2023-10-06T10:59:06.493906+0000","last_clean":"2023-10-06T10:59:06.493906+0000","last_became_active":"2023-10-06T10:59:02.435828+0000","last_became_peered":"2023-10-06T10:59:02.435828+0000","last_unstale":"2023-10-06T10:59:06.493906+0000","last_undegraded":"2023-10-06T10:59:06.493906+0000","last_fullsized":"2023-10-06T10:59:06.493906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:28:49.922872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488695+0000","last_change":"2023-10-06T10:59:02.431176+0000","last_active":"2023-10-06T10:59:06.488695+0000","last_peered":"2023-10-06T10:59:06.488695+0000","last_clean":"2023-10-06T10:59:06.488695+0000","last_became_active":"2023-10-06T10:59:02.430717+0000","last_became_peered":"2023-10-06T10:59:02.430717+0000","last_unstale":"2023-10-06T10:59:06.488695+0000","last_undegraded":"2023-10-06T10:59:06.488695+0000","last_fullsized":"2023-10-06T10:59:06.488695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:50:46.657726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486050+0000","last_change":"2023-10-06T10:59:02.431021+0000","last_active":"2023-10-06T10:59:06.486050+0000","last_peered":"2023-10-06T10:59:06.486050+0000","last_clean":"2023-10-06T10:59:06.486050+0000","last_became_active":"2023-10-06T10:59:02.430698+0000","last_became_peered":"2023-10-06T10:59:02.430698+0000","last_unstale":"2023-10-06T10:59:06.486050+0000","last_undegraded":"2023-10-06T10:59:06.486050+0000","last_fullsized":"2023-10-06T10:59:06.486050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:40.405676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501016+0000","last_change":"2023-10-06T10:59:02.437710+0000","last_active":"2023-10-06T10:59:06.501016+0000","last_peered":"2023-10-06T10:59:06.501016+0000","last_clean":"2023-10-06T10:59:06.501016+0000","last_became_active":"2023-10-06T10:59:02.437363+0000","last_became_peered":"2023-10-06T10:59:02.437363+0000","last_unstale":"2023-10-06T10:59:06.501016+0000","last_undegraded":"2023-10-06T10:59:06.501016+0000","last_fullsized":"2023-10-06T10:59:06.501016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:17.096084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487005+0000","last_change":"2023-10-06T10:59:02.431827+0000","last_active":"2023-10-06T10:59:06.487005+0000","last_peered":"2023-10-06T10:59:06.487005+0000","last_clean":"2023-10-06T10:59:06.487005+0000","last_became_active":"2023-10-06T10:59:02.431489+0000","last_became_peered":"2023-10-06T10:59:02.431489+0000","last_unstale":"2023-10-06T10:59:06.487005+0000","last_undegraded":"2023-10-06T10:59:06.487005+0000","last_fullsized":"2023-10-06T10:59:06.487005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:08:38.269689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.502047+0000","last_change":"2023-10-06T10:59:02.444025+0000","last_active":"2023-10-06T10:59:06.502047+0000","last_peered":"2023-10-06T10:59:06.502047+0000","last_clean":"2023-10-06T10:59:06.502047+0000","last_became_active":"2023-10-06T10:59:02.443754+0000","last_became_peered":"2023-10-06T10:59:02.443754+0000","last_unstale":"2023-10-06T10:59:06.502047+0000","last_undegraded":"2023-10-06T10:59:06.502047+0000","last_fullsized":"2023-10-06T10:59:06.502047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492806+0000","last_change":"2023-10-06T10:59:02.421077+0000","last_active":"2023-10-06T10:59:06.492806+0000","last_peered":"2023-10-06T10:59:06.492806+0000","last_clean":"2023-10-06T10:59:06.492806+0000","last_became_active":"2023-10-06T10:59:02.420781+0000","last_became_peered":"2023-10-06T10:59:02.420781+0000","last_unstale":"2023-10-06T10:59:06.492806+0000","last_undegraded":"2023-10-06T10:59:06.492806+0000","last_fullsized":"2023-10-06T10:59:06.492806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:20.715518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503818+0000","last_change":"2023-10-06T10:59:02.438976+0000","last_active":"2023-10-06T10:59:06.503818+0000","last_peered":"2023-10-06T10:59:06.503818+0000","last_clean":"2023-10-06T10:59:06.503818+0000","last_became_active":"2023-10-06T10:59:02.437626+0000","last_became_peered":"2023-10-06T10:59:02.437626+0000","last_unstale":"2023-10-06T10:59:06.503818+0000","last_undegraded":"2023-10-06T10:59:06.503818+0000","last_fullsized":"2023-10-06T10:59:06.503818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:38.092745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494111+0000","last_change":"2023-10-06T10:59:02.430066+0000","last_active":"2023-10-06T10:59:06.494111+0000","last_peered":"2023-10-06T10:59:06.494111+0000","last_clean":"2023-10-06T10:59:06.494111+0000","last_became_active":"2023-10-06T10:59:02.429786+0000","last_became_peered":"2023-10-06T10:59:02.429786+0000","last_unstale":"2023-10-06T10:59:06.494111+0000","last_undegraded":"2023-10-06T10:59:06.494111+0000","last_fullsized":"2023-10-06T10:59:06.494111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488572+0000","last_change":"2023-10-06T10:59:02.429174+0000","last_active":"2023-10-06T10:59:06.488572+0000","last_peered":"2023-10-06T10:59:06.488572+0000","last_clean":"2023-10-06T10:59:06.488572+0000","last_became_active":"2023-10-06T10:59:02.428460+0000","last_became_peered":"2023-10-06T10:59:02.428460+0000","last_unstale":"2023-10-06T10:59:06.488572+0000","last_undegraded":"2023-10-06T10:59:06.488572+0000","last_fullsized":"2023-10-06T10:59:06.488572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.497917+0000","last_change":"2023-10-06T10:59:02.417958+0000","last_active":"2023-10-06T10:59:06.497917+0000","last_peered":"2023-10-06T10:59:06.497917+0000","last_clean":"2023-10-06T10:59:06.497917+0000","last_became_active":"2023-10-06T10:59:02.417612+0000","last_became_peered":"2023-10-06T10:59:02.417612+0000","last_unstale":"2023-10-06T10:59:06.497917+0000","last_undegraded":"2023-10-06T10:59:06.497917+0000","last_fullsized":"2023-10-06T10:59:06.497917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:51.449145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.495493+0000","last_change":"2023-10-06T10:59:02.436783+0000","last_active":"2023-10-06T10:59:06.495493+0000","last_peered":"2023-10-06T10:59:06.495493+0000","last_clean":"2023-10-06T10:59:06.495493+0000","last_became_active":"2023-10-06T10:59:02.436507+0000","last_became_peered":"2023-10-06T10:59:02.436507+0000","last_unstale":"2023-10-06T10:59:06.495493+0000","last_undegraded":"2023-10-06T10:59:06.495493+0000","last_fullsized":"2023-10-06T10:59:06.495493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:04.586026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493130+0000","last_change":"2023-10-06T10:59:02.425873+0000","last_active":"2023-10-06T10:59:06.493130+0000","last_peered":"2023-10-06T10:59:06.493130+0000","last_clean":"2023-10-06T10:59:06.493130+0000","last_became_active":"2023-10-06T10:59:02.425566+0000","last_became_peered":"2023-10-06T10:59:02.425566+0000","last_unstale":"2023-10-06T10:59:06.493130+0000","last_undegraded":"2023-10-06T10:59:06.493130+0000","last_fullsized":"2023-10-06T10:59:06.493130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:23.772944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501838+0000","last_change":"2023-10-06T10:59:02.444199+0000","last_active":"2023-10-06T10:59:06.501838+0000","last_peered":"2023-10-06T10:59:06.501838+0000","last_clean":"2023-10-06T10:59:06.501838+0000","last_became_active":"2023-10-06T10:59:02.443956+0000","last_became_peered":"2023-10-06T10:59:02.443956+0000","last_unstale":"2023-10-06T10:59:06.501838+0000","last_undegraded":"2023-10-06T10:59:06.501838+0000","last_fullsized":"2023-10-06T10:59:06.501838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:56.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.489640+0000","last_change":"2023-10-06T10:59:02.426577+0000","last_active":"2023-10-06T10:59:06.489640+0000","last_peered":"2023-10-06T10:59:06.489640+0000","last_clean":"2023-10-06T10:59:06.489640+0000","last_became_active":"2023-10-06T10:59:02.426242+0000","last_became_peered":"2023-10-06T10:59:02.426242+0000","last_unstale":"2023-10-06T10:59:06.489640+0000","last_undegraded":"2023-10-06T10:59:06.489640+0000","last_fullsized":"2023-10-06T10:59:06.489640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:31.375932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503914+0000","last_change":"2023-10-06T10:59:02.438604+0000","last_active":"2023-10-06T10:59:06.503914+0000","last_peered":"2023-10-06T10:59:06.503914+0000","last_clean":"2023-10-06T10:59:06.503914+0000","last_became_active":"2023-10-06T10:59:02.438014+0000","last_became_peered":"2023-10-06T10:59:02.438014+0000","last_unstale":"2023-10-06T10:59:06.503914+0000","last_undegraded":"2023-10-06T10:59:06.503914+0000","last_fullsized":"2023-10-06T10:59:06.503914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487888+0000","last_change":"2023-10-06T10:59:02.426707+0000","last_active":"2023-10-06T10:59:06.487888+0000","last_peered":"2023-10-06T10:59:06.487888+0000","last_clean":"2023-10-06T10:59:06.487888+0000","last_became_active":"2023-10-06T10:59:02.426263+0000","last_became_peered":"2023-10-06T10:59:02.426263+0000","last_unstale":"2023-10-06T10:59:06.487888+0000","last_undegraded":"2023-10-06T10:59:06.487888+0000","last_fullsized":"2023-10-06T10:59:06.487888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:58.642289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.496996+0000","last_change":"2023-10-06T10:59:02.419676+0000","last_active":"2023-10-06T10:59:06.496996+0000","last_peered":"2023-10-06T10:59:06.496996+0000","last_clean":"2023-10-06T10:59:06.496996+0000","last_became_active":"2023-10-06T10:59:02.419356+0000","last_became_peered":"2023-10-06T10:59:02.419356+0000","last_unstale":"2023-10-06T10:59:06.496996+0000","last_undegraded":"2023-10-06T10:59:06.496996+0000","last_fullsized":"2023-10-06T10:59:06.496996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:42.646222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486894+0000","last_change":"2023-10-06T10:59:02.420221+0000","last_active":"2023-10-06T10:59:06.486894+0000","last_peered":"2023-10-06T10:59:06.486894+0000","last_clean":"2023-10-06T10:59:06.486894+0000","last_became_active":"2023-10-06T10:59:02.419881+0000","last_became_peered":"2023-10-06T10:59:02.419881+0000","last_unstale":"2023-10-06T10:59:06.486894+0000","last_undegraded":"2023-10-06T10:59:06.486894+0000","last_fullsized":"2023-10-06T10:59:06.486894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:17.096084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503250+0000","last_change":"2023-10-06T10:59:02.436623+0000","last_active":"2023-10-06T10:59:06.503250+0000","last_peered":"2023-10-06T10:59:06.503250+0000","last_clean":"2023-10-06T10:59:06.503250+0000","last_became_active":"2023-10-06T10:59:02.436288+0000","last_became_peered":"2023-10-06T10:59:02.436288+0000","last_unstale":"2023-10-06T10:59:06.503250+0000","last_undegraded":"2023-10-06T10:59:06.503250+0000","last_fullsized":"2023-10-06T10:59:06.503250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:31.081513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.500640+0000","last_change":"2023-10-06T10:59:02.436300+0000","last_active":"2023-10-06T10:59:06.500640+0000","last_peered":"2023-10-06T10:59:06.500640+0000","last_clean":"2023-10-06T10:59:06.500640+0000","last_became_active":"2023-10-06T10:59:02.435769+0000","last_became_peered":"2023-10-06T10:59:02.435769+0000","last_unstale":"2023-10-06T10:59:06.500640+0000","last_undegraded":"2023-10-06T10:59:06.500640+0000","last_fullsized":"2023-10-06T10:59:06.500640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493156+0000","last_change":"2023-10-06T10:59:02.440684+0000","last_active":"2023-10-06T10:59:06.493156+0000","last_peered":"2023-10-06T10:59:06.493156+0000","last_clean":"2023-10-06T10:59:06.493156+0000","last_became_active":"2023-10-06T10:59:02.440157+0000","last_became_peered":"2023-10-06T10:59:02.440157+0000","last_unstale":"2023-10-06T10:59:06.493156+0000","last_undegraded":"2023-10-06T10:59:06.493156+0000","last_fullsized":"2023-10-06T10:59:06.493156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:17.384456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501602+0000","last_change":"2023-10-06T10:59:02.439323+0000","last_active":"2023-10-06T10:59:06.501602+0000","last_peered":"2023-10-06T10:59:06.501602+0000","last_clean":"2023-10-06T10:59:06.501602+0000","last_became_active":"2023-10-06T10:59:02.439038+0000","last_became_peered":"2023-10-06T10:59:02.439038+0000","last_unstale":"2023-10-06T10:59:06.501602+0000","last_undegraded":"2023-10-06T10:59:06.501602+0000","last_fullsized":"2023-10-06T10:59:06.501602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487277+0000","last_change":"2023-10-06T10:59:02.422230+0000","last_active":"2023-10-06T10:59:06.487277+0000","last_peered":"2023-10-06T10:59:06.487277+0000","last_clean":"2023-10-06T10:59:06.487277+0000","last_became_active":"2023-10-06T10:59:02.421846+0000","last_became_peered":"2023-10-06T10:59:02.421846+0000","last_unstale":"2023-10-06T10:59:06.487277+0000","last_undegraded":"2023-10-06T10:59:06.487277+0000","last_fullsized":"2023-10-06T10:59:06.487277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:20.715518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487304+0000","last_change":"2023-10-06T10:59:02.419258+0000","last_active":"2023-10-06T10:59:06.487304+0000","last_peered":"2023-10-06T10:59:06.487304+0000","last_clean":"2023-10-06T10:59:06.487304+0000","last_became_active":"2023-10-06T10:59:02.418921+0000","last_became_peered":"2023-10-06T10:59:02.418921+0000","last_unstale":"2023-10-06T10:59:06.487304+0000","last_undegraded":"2023-10-06T10:59:06.487304+0000","last_fullsized":"2023-10-06T10:59:06.487304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:17.558201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493500+0000","last_change":"2023-10-06T10:59:02.429047+0000","last_active":"2023-10-06T10:59:06.493500+0000","last_peered":"2023-10-06T10:59:06.493500+0000","last_clean":"2023-10-06T10:59:06.493500+0000","last_became_active":"2023-10-06T10:59:02.428070+0000","last_became_peered":"2023-10-06T10:59:02.428070+0000","last_unstale":"2023-10-06T10:59:06.493500+0000","last_undegraded":"2023-10-06T10:59:06.493500+0000","last_fullsized":"2023-10-06T10:59:06.493500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:17.286697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511536+0000","last_change":"2023-10-06T10:59:06.505906+0000","last_active":"2023-10-06T10:59:06.511536+0000","last_peered":"2023-10-06T10:59:06.511536+0000","last_clean":"2023-10-06T10:59:06.511536+0000","last_became_active":"2023-10-06T10:59:06.505502+0000","last_became_peered":"2023-10-06T10:59:06.505502+0000","last_unstale":"2023-10-06T10:59:06.511536+0000","last_undegraded":"2023-10-06T10:59:06.511536+0000","last_fullsized":"2023-10-06T10:59:06.511536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:58:13.075195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486926+0000","last_change":"2023-10-06T10:59:01.410556+0000","last_active":"2023-10-06T10:59:06.486926+0000","last_peered":"2023-10-06T10:59:06.486926+0000","last_clean":"2023-10-06T10:59:06.486926+0000","last_became_active":"2023-10-06T10:59:01.410304+0000","last_became_peered":"2023-10-06T10:59:01.410304+0000","last_unstale":"2023-10-06T10:59:06.486926+0000","last_undegraded":"2023-10-06T10:59:06.486926+0000","last_fullsized":"2023-10-06T10:59:06.486926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494194+0000","last_change":"2023-10-06T10:59:02.446346+0000","last_active":"2023-10-06T10:59:06.494194+0000","last_peered":"2023-10-06T10:59:06.494194+0000","last_clean":"2023-10-06T10:59:06.494194+0000","last_became_active":"2023-10-06T10:59:02.446029+0000","last_became_peered":"2023-10-06T10:59:02.446029+0000","last_unstale":"2023-10-06T10:59:06.494194+0000","last_undegraded":"2023-10-06T10:59:06.494194+0000","last_fullsized":"2023-10-06T10:59:06.494194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:48.645632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516676+0000","last_change":"2023-10-06T10:59:06.508187+0000","last_active":"2023-10-06T10:59:06.516676+0000","last_peered":"2023-10-06T10:59:06.516676+0000","last_clean":"2023-10-06T10:59:06.516676+0000","last_became_active":"2023-10-06T10:59:06.507722+0000","last_became_peered":"2023-10-06T10:59:06.507722+0000","last_unstale":"2023-10-06T10:59:06.516676+0000","last_undegraded":"2023-10-06T10:59:06.516676+0000","last_fullsized":"2023-10-06T10:59:06.516676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:52.733607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485843+0000","last_change":"2023-10-06T10:59:01.406095+0000","last_active":"2023-10-06T10:59:06.485843+0000","last_peered":"2023-10-06T10:59:06.485843+0000","last_clean":"2023-10-06T10:59:06.485843+0000","last_became_active":"2023-10-06T10:59:01.405687+0000","last_became_peered":"2023-10-06T10:59:01.405687+0000","last_unstale":"2023-10-06T10:59:06.485843+0000","last_undegraded":"2023-10-06T10:59:06.485843+0000","last_fullsized":"2023-10-06T10:59:06.485843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:55.921829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504174+0000","last_change":"2023-10-06T10:59:02.427693+0000","last_active":"2023-10-06T10:59:06.504174+0000","last_peered":"2023-10-06T10:59:06.504174+0000","last_clean":"2023-10-06T10:59:06.504174+0000","last_became_active":"2023-10-06T10:59:02.427352+0000","last_became_peered":"2023-10-06T10:59:02.427352+0000","last_unstale":"2023-10-06T10:59:06.504174+0000","last_undegraded":"2023-10-06T10:59:06.504174+0000","last_fullsized":"2023-10-06T10:59:06.504174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:28:49.922872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514081+0000","last_change":"2023-10-06T10:59:06.507380+0000","last_active":"2023-10-06T10:59:06.514081+0000","last_peered":"2023-10-06T10:59:06.514081+0000","last_clean":"2023-10-06T10:59:06.514081+0000","last_became_active":"2023-10-06T10:59:06.506977+0000","last_became_peered":"2023-10-06T10:59:06.506977+0000","last_unstale":"2023-10-06T10:59:06.514081+0000","last_undegraded":"2023-10-06T10:59:06.514081+0000","last_fullsized":"2023-10-06T10:59:06.514081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:50.861372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493785+0000","last_change":"2023-10-06T10:59:01.411985+0000","last_active":"2023-10-06T10:59:06.493785+0000","last_peered":"2023-10-06T10:59:06.493785+0000","last_clean":"2023-10-06T10:59:06.493785+0000","last_became_active":"2023-10-06T10:59:01.411513+0000","last_became_peered":"2023-10-06T10:59:01.411513+0000","last_unstale":"2023-10-06T10:59:06.493785+0000","last_undegraded":"2023-10-06T10:59:06.493785+0000","last_fullsized":"2023-10-06T10:59:06.493785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:50.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487360+0000","last_change":"2023-10-06T10:59:02.422860+0000","last_active":"2023-10-06T10:59:06.487360+0000","last_peered":"2023-10-06T10:59:06.487360+0000","last_clean":"2023-10-06T10:59:06.487360+0000","last_became_active":"2023-10-06T10:59:02.422552+0000","last_became_peered":"2023-10-06T10:59:02.422552+0000","last_unstale":"2023-10-06T10:59:06.487360+0000","last_undegraded":"2023-10-06T10:59:06.487360+0000","last_fullsized":"2023-10-06T10:59:06.487360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:20.715518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516565+0000","last_change":"2023-10-06T10:59:06.508111+0000","last_active":"2023-10-06T10:59:06.516565+0000","last_peered":"2023-10-06T10:59:06.516565+0000","last_clean":"2023-10-06T10:59:06.516565+0000","last_became_active":"2023-10-06T10:59:06.507685+0000","last_became_peered":"2023-10-06T10:59:06.507685+0000","last_unstale":"2023-10-06T10:59:06.516565+0000","last_undegraded":"2023-10-06T10:59:06.516565+0000","last_fullsized":"2023-10-06T10:59:06.516565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:21.184059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504004+0000","last_change":"2023-10-06T10:59:01.415316+0000","last_active":"2023-10-06T10:59:06.504004+0000","last_peered":"2023-10-06T10:59:06.504004+0000","last_clean":"2023-10-06T10:59:06.504004+0000","last_became_active":"2023-10-06T10:59:01.415052+0000","last_became_peered":"2023-10-06T10:59:01.415052+0000","last_unstale":"2023-10-06T10:59:06.504004+0000","last_undegraded":"2023-10-06T10:59:06.504004+0000","last_fullsized":"2023-10-06T10:59:06.504004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:03.581242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493689+0000","last_change":"2023-10-06T10:59:02.445937+0000","last_active":"2023-10-06T10:59:06.493689+0000","last_peered":"2023-10-06T10:59:06.493689+0000","last_clean":"2023-10-06T10:59:06.493689+0000","last_became_active":"2023-10-06T10:59:02.444001+0000","last_became_peered":"2023-10-06T10:59:02.444001+0000","last_unstale":"2023-10-06T10:59:06.493689+0000","last_undegraded":"2023-10-06T10:59:06.493689+0000","last_fullsized":"2023-10-06T10:59:06.493689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:31.375932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516837+0000","last_change":"2023-10-06T10:59:06.515426+0000","last_active":"2023-10-06T10:59:06.516837+0000","last_peered":"2023-10-06T10:59:06.516837+0000","last_clean":"2023-10-06T10:59:06.516837+0000","last_became_active":"2023-10-06T10:59:06.514929+0000","last_became_peered":"2023-10-06T10:59:06.514929+0000","last_unstale":"2023-10-06T10:59:06.516837+0000","last_undegraded":"2023-10-06T10:59:06.516837+0000","last_fullsized":"2023-10-06T10:59:06.516837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:29.878658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494014+0000","last_change":"2023-10-06T10:59:01.413409+0000","last_active":"2023-10-06T10:59:06.494014+0000","last_peered":"2023-10-06T10:59:06.494014+0000","last_clean":"2023-10-06T10:59:06.494014+0000","last_became_active":"2023-10-06T10:59:01.413132+0000","last_became_peered":"2023-10-06T10:59:01.413132+0000","last_unstale":"2023-10-06T10:59:06.494014+0000","last_undegraded":"2023-10-06T10:59:06.494014+0000","last_fullsized":"2023-10-06T10:59:06.494014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:19.192242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492779+0000","last_change":"2023-10-06T10:59:02.433507+0000","last_active":"2023-10-06T10:59:06.492779+0000","last_peered":"2023-10-06T10:59:06.492779+0000","last_clean":"2023-10-06T10:59:06.492779+0000","last_became_active":"2023-10-06T10:59:02.433196+0000","last_became_peered":"2023-10-06T10:59:02.433196+0000","last_unstale":"2023-10-06T10:59:06.492779+0000","last_undegraded":"2023-10-06T10:59:06.492779+0000","last_fullsized":"2023-10-06T10:59:06.492779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.506197+0000","last_change":"2023-10-06T10:59:06.502951+0000","last_active":"2023-10-06T10:59:06.506197+0000","last_peered":"2023-10-06T10:59:06.506197+0000","last_clean":"2023-10-06T10:59:06.506197+0000","last_became_active":"2023-10-06T10:59:06.502527+0000","last_became_peered":"2023-10-06T10:59:06.502527+0000","last_unstale":"2023-10-06T10:59:06.506197+0000","last_undegraded":"2023-10-06T10:59:06.506197+0000","last_fullsized":"2023-10-06T10:59:06.506197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:18.864841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503418+0000","last_change":"2023-10-06T10:59:01.415005+0000","last_active":"2023-10-06T10:59:06.503418+0000","last_peered":"2023-10-06T10:59:06.503418+0000","last_clean":"2023-10-06T10:59:06.503418+0000","last_became_active":"2023-10-06T10:59:01.414705+0000","last_became_peered":"2023-10-06T10:59:01.414705+0000","last_unstale":"2023-10-06T10:59:06.503418+0000","last_undegraded":"2023-10-06T10:59:06.503418+0000","last_fullsized":"2023-10-06T10:59:06.503418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:16.553416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485948+0000","last_change":"2023-10-06T10:59:02.423861+0000","last_active":"2023-10-06T10:59:06.485948+0000","last_peered":"2023-10-06T10:59:06.485948+0000","last_clean":"2023-10-06T10:59:06.485948+0000","last_became_active":"2023-10-06T10:59:02.419690+0000","last_became_peered":"2023-10-06T10:59:02.419690+0000","last_unstale":"2023-10-06T10:59:06.485948+0000","last_undegraded":"2023-10-06T10:59:06.485948+0000","last_fullsized":"2023-10-06T10:59:06.485948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:36.050017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513155+0000","last_change":"2023-10-06T10:59:06.506470+0000","last_active":"2023-10-06T10:59:06.513155+0000","last_peered":"2023-10-06T10:59:06.513155+0000","last_clean":"2023-10-06T10:59:06.513155+0000","last_became_active":"2023-10-06T10:59:06.506061+0000","last_became_peered":"2023-10-06T10:59:06.506061+0000","last_unstale":"2023-10-06T10:59:06.513155+0000","last_undegraded":"2023-10-06T10:59:06.513155+0000","last_fullsized":"2023-10-06T10:59:06.513155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:49.928746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T10:59:12.825833+0000","last_change":"2023-10-06T10:59:01.409923+0000","last_active":"2023-10-06T10:59:12.825833+0000","last_peered":"2023-10-06T10:59:12.825833+0000","last_clean":"2023-10-06T10:59:12.825833+0000","last_became_active":"2023-10-06T10:59:01.409615+0000","last_became_peered":"2023-10-06T10:59:01.409615+0000","last_unstale":"2023-10-06T10:59:12.825833+0000","last_undegraded":"2023-10-06T10:59:12.825833+0000","last_fullsized":"2023-10-06T10:59:12.825833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:02.802656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488353+0000","last_change":"2023-10-06T10:59:02.420107+0000","last_active":"2023-10-06T10:59:06.488353+0000","last_peered":"2023-10-06T10:59:06.488353+0000","last_clean":"2023-10-06T10:59:06.488353+0000","last_became_active":"2023-10-06T10:59:02.419814+0000","last_became_peered":"2023-10-06T10:59:02.419814+0000","last_unstale":"2023-10-06T10:59:06.488353+0000","last_undegraded":"2023-10-06T10:59:06.488353+0000","last_fullsized":"2023-10-06T10:59:06.488353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:53.107388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511474+0000","last_change":"2023-10-06T10:59:06.504882+0000","last_active":"2023-10-06T10:59:06.511474+0000","last_peered":"2023-10-06T10:59:06.511474+0000","last_clean":"2023-10-06T10:59:06.511474+0000","last_became_active":"2023-10-06T10:59:06.504478+0000","last_became_peered":"2023-10-06T10:59:06.504478+0000","last_unstale":"2023-10-06T10:59:06.511474+0000","last_undegraded":"2023-10-06T10:59:06.511474+0000","last_fullsized":"2023-10-06T10:59:06.511474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:25.148933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503121+0000","last_change":"2023-10-06T10:59:01.418211+0000","last_active":"2023-10-06T10:59:06.503121+0000","last_peered":"2023-10-06T10:59:06.503121+0000","last_clean":"2023-10-06T10:59:06.503121+0000","last_became_active":"2023-10-06T10:59:01.417924+0000","last_became_peered":"2023-10-06T10:59:01.417924+0000","last_unstale":"2023-10-06T10:59:06.503121+0000","last_undegraded":"2023-10-06T10:59:06.503121+0000","last_fullsized":"2023-10-06T10:59:06.503121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:44.340657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493921+0000","last_change":"2023-10-06T10:59:02.446135+0000","last_active":"2023-10-06T10:59:06.493921+0000","last_peered":"2023-10-06T10:59:06.493921+0000","last_clean":"2023-10-06T10:59:06.493921+0000","last_became_active":"2023-10-06T10:59:02.445893+0000","last_became_peered":"2023-10-06T10:59:02.445893+0000","last_unstale":"2023-10-06T10:59:06.493921+0000","last_undegraded":"2023-10-06T10:59:06.493921+0000","last_fullsized":"2023-10-06T10:59:06.493921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:38.092745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513350+0000","last_change":"2023-10-06T10:59:06.508048+0000","last_active":"2023-10-06T10:59:06.513350+0000","last_peered":"2023-10-06T10:59:06.513350+0000","last_clean":"2023-10-06T10:59:06.513350+0000","last_became_active":"2023-10-06T10:59:06.507619+0000","last_became_peered":"2023-10-06T10:59:06.507619+0000","last_unstale":"2023-10-06T10:59:06.513350+0000","last_undegraded":"2023-10-06T10:59:06.513350+0000","last_fullsized":"2023-10-06T10:59:06.513350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:26:48.345083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.500810+0000","last_change":"2023-10-06T10:59:01.407912+0000","last_active":"2023-10-06T10:59:06.500810+0000","last_peered":"2023-10-06T10:59:06.500810+0000","last_clean":"2023-10-06T10:59:06.500810+0000","last_became_active":"2023-10-06T10:59:01.407345+0000","last_became_peered":"2023-10-06T10:59:01.407345+0000","last_unstale":"2023-10-06T10:59:06.500810+0000","last_undegraded":"2023-10-06T10:59:06.500810+0000","last_fullsized":"2023-10-06T10:59:06.500810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:40.010964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493409+0000","last_change":"2023-10-06T10:59:02.429169+0000","last_active":"2023-10-06T10:59:06.493409+0000","last_peered":"2023-10-06T10:59:06.493409+0000","last_clean":"2023-10-06T10:59:06.493409+0000","last_became_active":"2023-10-06T10:59:02.428497+0000","last_became_peered":"2023-10-06T10:59:02.428497+0000","last_unstale":"2023-10-06T10:59:06.493409+0000","last_undegraded":"2023-10-06T10:59:06.493409+0000","last_fullsized":"2023-10-06T10:59:06.493409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:36.050017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514019+0000","last_change":"2023-10-06T10:59:06.509198+0000","last_active":"2023-10-06T10:59:06.514019+0000","last_peered":"2023-10-06T10:59:06.514019+0000","last_clean":"2023-10-06T10:59:06.514019+0000","last_became_active":"2023-10-06T10:59:06.508723+0000","last_became_peered":"2023-10-06T10:59:06.508723+0000","last_unstale":"2023-10-06T10:59:06.514019+0000","last_undegraded":"2023-10-06T10:59:06.514019+0000","last_fullsized":"2023-10-06T10:59:06.514019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:00.501898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501932+0000","last_change":"2023-10-06T10:59:01.417026+0000","last_active":"2023-10-06T10:59:06.501932+0000","last_peered":"2023-10-06T10:59:06.501932+0000","last_clean":"2023-10-06T10:59:06.501932+0000","last_became_active":"2023-10-06T10:59:01.416734+0000","last_became_peered":"2023-10-06T10:59:01.416734+0000","last_unstale":"2023-10-06T10:59:06.501932+0000","last_undegraded":"2023-10-06T10:59:06.501932+0000","last_fullsized":"2023-10-06T10:59:06.501932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:05:13.017527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504438+0000","last_change":"2023-10-06T10:59:02.437995+0000","last_active":"2023-10-06T10:59:06.504438+0000","last_peered":"2023-10-06T10:59:06.504438+0000","last_clean":"2023-10-06T10:59:06.504438+0000","last_became_active":"2023-10-06T10:59:02.437537+0000","last_became_peered":"2023-10-06T10:59:02.437537+0000","last_unstale":"2023-10-06T10:59:06.504438+0000","last_undegraded":"2023-10-06T10:59:06.504438+0000","last_fullsized":"2023-10-06T10:59:06.504438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:53.107388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.510983+0000","last_change":"2023-10-06T10:59:06.505596+0000","last_active":"2023-10-06T10:59:06.510983+0000","last_peered":"2023-10-06T10:59:06.510983+0000","last_clean":"2023-10-06T10:59:06.510983+0000","last_became_active":"2023-10-06T10:59:06.505171+0000","last_became_peered":"2023-10-06T10:59:06.505171+0000","last_unstale":"2023-10-06T10:59:06.510983+0000","last_undegraded":"2023-10-06T10:59:06.510983+0000","last_fullsized":"2023-10-06T10:59:06.510983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:43.846344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485606+0000","last_change":"2023-10-06T10:59:01.407896+0000","last_active":"2023-10-06T10:59:06.485606+0000","last_peered":"2023-10-06T10:59:06.485606+0000","last_clean":"2023-10-06T10:59:06.485606+0000","last_became_active":"2023-10-06T10:59:01.407443+0000","last_became_peered":"2023-10-06T10:59:01.407443+0000","last_unstale":"2023-10-06T10:59:06.485606+0000","last_undegraded":"2023-10-06T10:59:06.485606+0000","last_fullsized":"2023-10-06T10:59:06.485606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:08.334923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494412+0000","last_change":"2023-10-06T10:59:02.434282+0000","last_active":"2023-10-06T10:59:06.494412+0000","last_peered":"2023-10-06T10:59:06.494412+0000","last_clean":"2023-10-06T10:59:06.494412+0000","last_became_active":"2023-10-06T10:59:02.433977+0000","last_became_peered":"2023-10-06T10:59:02.433977+0000","last_unstale":"2023-10-06T10:59:06.494412+0000","last_undegraded":"2023-10-06T10:59:06.494412+0000","last_fullsized":"2023-10-06T10:59:06.494412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.517644+0000","last_change":"2023-10-06T10:59:06.516059+0000","last_active":"2023-10-06T10:59:06.517644+0000","last_peered":"2023-10-06T10:59:06.517644+0000","last_clean":"2023-10-06T10:59:06.517644+0000","last_became_active":"2023-10-06T10:59:06.515669+0000","last_became_peered":"2023-10-06T10:59:06.515669+0000","last_unstale":"2023-10-06T10:59:06.517644+0000","last_undegraded":"2023-10-06T10:59:06.517644+0000","last_fullsized":"2023-10-06T10:59:06.517644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:52:08.979101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.505660+0000","last_change":"2023-10-06T10:59:01.417634+0000","last_active":"2023-10-06T10:59:06.505660+0000","last_peered":"2023-10-06T10:59:06.505660+0000","last_clean":"2023-10-06T10:59:06.505660+0000","last_became_active":"2023-10-06T10:59:01.417355+0000","last_became_peered":"2023-10-06T10:59:01.417355+0000","last_unstale":"2023-10-06T10:59:06.505660+0000","last_undegraded":"2023-10-06T10:59:06.505660+0000","last_fullsized":"2023-10-06T10:59:06.505660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:19.433940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492678+0000","last_change":"2023-10-06T10:59:02.428141+0000","last_active":"2023-10-06T10:59:06.492678+0000","last_peered":"2023-10-06T10:59:06.492678+0000","last_clean":"2023-10-06T10:59:06.492678+0000","last_became_active":"2023-10-06T10:59:02.427848+0000","last_became_peered":"2023-10-06T10:59:02.427848+0000","last_unstale":"2023-10-06T10:59:06.492678+0000","last_undegraded":"2023-10-06T10:59:06.492678+0000","last_fullsized":"2023-10-06T10:59:06.492678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:56.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513719+0000","last_change":"2023-10-06T10:59:06.510996+0000","last_active":"2023-10-06T10:59:06.513719+0000","last_peered":"2023-10-06T10:59:06.513719+0000","last_clean":"2023-10-06T10:59:06.513719+0000","last_became_active":"2023-10-06T10:59:06.510585+0000","last_became_peered":"2023-10-06T10:59:06.510585+0000","last_unstale":"2023-10-06T10:59:06.513719+0000","last_undegraded":"2023-10-06T10:59:06.513719+0000","last_fullsized":"2023-10-06T10:59:06.513719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:21.184059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503478+0000","last_change":"2023-10-06T10:59:01.411248+0000","last_active":"2023-10-06T10:59:06.503478+0000","last_peered":"2023-10-06T10:59:06.503478+0000","last_clean":"2023-10-06T10:59:06.503478+0000","last_became_active":"2023-10-06T10:59:01.410969+0000","last_became_peered":"2023-10-06T10:59:01.410969+0000","last_unstale":"2023-10-06T10:59:06.503478+0000","last_undegraded":"2023-10-06T10:59:06.503478+0000","last_fullsized":"2023-10-06T10:59:06.503478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:39.400891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486641+0000","last_change":"2023-10-06T10:59:02.419362+0000","last_active":"2023-10-06T10:59:06.486641+0000","last_peered":"2023-10-06T10:59:06.486641+0000","last_clean":"2023-10-06T10:59:06.486641+0000","last_became_active":"2023-10-06T10:59:02.419038+0000","last_became_peered":"2023-10-06T10:59:02.419038+0000","last_unstale":"2023-10-06T10:59:06.486641+0000","last_undegraded":"2023-10-06T10:59:06.486641+0000","last_fullsized":"2023-10-06T10:59:06.486641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:31.081513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516460+0000","last_change":"2023-10-06T10:59:06.515261+0000","last_active":"2023-10-06T10:59:06.516460+0000","last_peered":"2023-10-06T10:59:06.516460+0000","last_clean":"2023-10-06T10:59:06.516460+0000","last_became_active":"2023-10-06T10:59:06.514809+0000","last_became_peered":"2023-10-06T10:59:06.514809+0000","last_unstale":"2023-10-06T10:59:06.516460+0000","last_undegraded":"2023-10-06T10:59:06.516460+0000","last_fullsized":"2023-10-06T10:59:06.516460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:57.195363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503300+0000","last_change":"2023-10-06T10:59:01.411278+0000","last_active":"2023-10-06T10:59:06.503300+0000","last_peered":"2023-10-06T10:59:06.503300+0000","last_clean":"2023-10-06T10:59:06.503300+0000","last_became_active":"2023-10-06T10:59:01.410987+0000","last_became_peered":"2023-10-06T10:59:01.410987+0000","last_unstale":"2023-10-06T10:59:06.503300+0000","last_undegraded":"2023-10-06T10:59:06.503300+0000","last_fullsized":"2023-10-06T10:59:06.503300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:19.710733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485812+0000","last_change":"2023-10-06T10:59:02.435246+0000","last_active":"2023-10-06T10:59:06.485812+0000","last_peered":"2023-10-06T10:59:06.485812+0000","last_clean":"2023-10-06T10:59:06.485812+0000","last_became_active":"2023-10-06T10:59:02.434939+0000","last_became_peered":"2023-10-06T10:59:02.434939+0000","last_unstale":"2023-10-06T10:59:06.485812+0000","last_undegraded":"2023-10-06T10:59:06.485812+0000","last_fullsized":"2023-10-06T10:59:06.485812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:05:14.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513726+0000","last_change":"2023-10-06T10:59:06.511803+0000","last_active":"2023-10-06T10:59:06.513726+0000","last_peered":"2023-10-06T10:59:06.513726+0000","last_clean":"2023-10-06T10:59:06.513726+0000","last_became_active":"2023-10-06T10:59:06.511080+0000","last_became_peered":"2023-10-06T10:59:06.511080+0000","last_unstale":"2023-10-06T10:59:06.513726+0000","last_undegraded":"2023-10-06T10:59:06.513726+0000","last_fullsized":"2023-10-06T10:59:06.513726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:27.869916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492883+0000","last_change":"2023-10-06T10:59:01.414476+0000","last_active":"2023-10-06T10:59:06.492883+0000","last_peered":"2023-10-06T10:59:06.492883+0000","last_clean":"2023-10-06T10:59:06.492883+0000","last_became_active":"2023-10-06T10:59:01.414242+0000","last_became_peered":"2023-10-06T10:59:01.414242+0000","last_unstale":"2023-10-06T10:59:06.492883+0000","last_undegraded":"2023-10-06T10:59:06.492883+0000","last_fullsized":"2023-10-06T10:59:06.492883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501421+0000","last_change":"2023-10-06T10:59:02.436874+0000","last_active":"2023-10-06T10:59:06.501421+0000","last_peered":"2023-10-06T10:59:06.501421+0000","last_clean":"2023-10-06T10:59:06.501421+0000","last_became_active":"2023-10-06T10:59:02.435358+0000","last_became_peered":"2023-10-06T10:59:02.435358+0000","last_unstale":"2023-10-06T10:59:06.501421+0000","last_undegraded":"2023-10-06T10:59:06.501421+0000","last_fullsized":"2023-10-06T10:59:06.501421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:31.081513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514473+0000","last_change":"2023-10-06T10:59:06.513646+0000","last_active":"2023-10-06T10:59:06.514473+0000","last_peered":"2023-10-06T10:59:06.514473+0000","last_clean":"2023-10-06T10:59:06.514473+0000","last_became_active":"2023-10-06T10:59:06.511423+0000","last_became_peered":"2023-10-06T10:59:06.511423+0000","last_unstale":"2023-10-06T10:59:06.514473+0000","last_undegraded":"2023-10-06T10:59:06.514473+0000","last_fullsized":"2023-10-06T10:59:06.514473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:37.882998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493353+0000","last_change":"2023-10-06T10:59:01.411242+0000","last_active":"2023-10-06T10:59:06.493353+0000","last_peered":"2023-10-06T10:59:06.493353+0000","last_clean":"2023-10-06T10:59:06.493353+0000","last_became_active":"2023-10-06T10:59:01.410924+0000","last_became_peered":"2023-10-06T10:59:01.410924+0000","last_unstale":"2023-10-06T10:59:06.493353+0000","last_undegraded":"2023-10-06T10:59:06.493353+0000","last_fullsized":"2023-10-06T10:59:06.493353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:00.499256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486649+0000","last_change":"2023-10-06T10:59:02.435108+0000","last_active":"2023-10-06T10:59:06.486649+0000","last_peered":"2023-10-06T10:59:06.486649+0000","last_clean":"2023-10-06T10:59:06.486649+0000","last_became_active":"2023-10-06T10:59:02.434852+0000","last_became_peered":"2023-10-06T10:59:02.434852+0000","last_unstale":"2023-10-06T10:59:06.486649+0000","last_undegraded":"2023-10-06T10:59:06.486649+0000","last_fullsized":"2023-10-06T10:59:06.486649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:17.384456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.506844+0000","last_change":"2023-10-06T10:59:06.502413+0000","last_active":"2023-10-06T10:59:06.506844+0000","last_peered":"2023-10-06T10:59:06.506844+0000","last_clean":"2023-10-06T10:59:06.506844+0000","last_became_active":"2023-10-06T10:59:06.501975+0000","last_became_peered":"2023-10-06T10:59:06.501975+0000","last_unstale":"2023-10-06T10:59:06.506844+0000","last_undegraded":"2023-10-06T10:59:06.506844+0000","last_fullsized":"2023-10-06T10:59:06.506844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:43.846344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485900+0000","last_change":"2023-10-06T10:59:01.419087+0000","last_active":"2023-10-06T10:59:06.485900+0000","last_peered":"2023-10-06T10:59:06.485900+0000","last_clean":"2023-10-06T10:59:06.485900+0000","last_became_active":"2023-10-06T10:59:01.418650+0000","last_became_peered":"2023-10-06T10:59:01.418650+0000","last_unstale":"2023-10-06T10:59:06.485900+0000","last_undegraded":"2023-10-06T10:59:06.485900+0000","last_fullsized":"2023-10-06T10:59:06.485900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488263+0000","last_change":"2023-10-06T10:59:02.418122+0000","last_active":"2023-10-06T10:59:06.488263+0000","last_peered":"2023-10-06T10:59:06.488263+0000","last_clean":"2023-10-06T10:59:06.488263+0000","last_became_active":"2023-10-06T10:59:02.417375+0000","last_became_peered":"2023-10-06T10:59:02.417375+0000","last_unstale":"2023-10-06T10:59:06.488263+0000","last_undegraded":"2023-10-06T10:59:06.488263+0000","last_fullsized":"2023-10-06T10:59:06.488263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513139+0000","last_change":"2023-10-06T10:59:06.507077+0000","last_active":"2023-10-06T10:59:06.513139+0000","last_peered":"2023-10-06T10:59:06.513139+0000","last_clean":"2023-10-06T10:59:06.513139+0000","last_became_active":"2023-10-06T10:59:06.506613+0000","last_became_peered":"2023-10-06T10:59:06.506613+0000","last_unstale":"2023-10-06T10:59:06.513139+0000","last_undegraded":"2023-10-06T10:59:06.513139+0000","last_fullsized":"2023-10-06T10:59:06.513139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:18.864841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486454+0000","last_change":"2023-10-06T10:59:01.407028+0000","last_active":"2023-10-06T10:59:06.486454+0000","last_peered":"2023-10-06T10:59:06.486454+0000","last_clean":"2023-10-06T10:59:06.486454+0000","last_became_active":"2023-10-06T10:59:01.406571+0000","last_became_peered":"2023-10-06T10:59:01.406571+0000","last_unstale":"2023-10-06T10:59:06.486454+0000","last_undegraded":"2023-10-06T10:59:06.486454+0000","last_fullsized":"2023-10-06T10:59:06.486454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:08.334923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487914+0000","last_change":"2023-10-06T10:59:02.419692+0000","last_active":"2023-10-06T10:59:06.487914+0000","last_peered":"2023-10-06T10:59:06.487914+0000","last_clean":"2023-10-06T10:59:06.487914+0000","last_became_active":"2023-10-06T10:59:02.419394+0000","last_became_peered":"2023-10-06T10:59:02.419394+0000","last_unstale":"2023-10-06T10:59:06.487914+0000","last_undegraded":"2023-10-06T10:59:06.487914+0000","last_fullsized":"2023-10-06T10:59:06.487914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:23.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511521+0000","last_change":"2023-10-06T10:59:06.506565+0000","last_active":"2023-10-06T10:59:06.511521+0000","last_peered":"2023-10-06T10:59:06.511521+0000","last_clean":"2023-10-06T10:59:06.511521+0000","last_became_active":"2023-10-06T10:59:06.506131+0000","last_became_peered":"2023-10-06T10:59:06.506131+0000","last_unstale":"2023-10-06T10:59:06.511521+0000","last_undegraded":"2023-10-06T10:59:06.511521+0000","last_fullsized":"2023-10-06T10:59:06.511521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:15:42.861403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493594+0000","last_change":"2023-10-06T10:59:01.417797+0000","last_active":"2023-10-06T10:59:06.493594+0000","last_peered":"2023-10-06T10:59:06.493594+0000","last_clean":"2023-10-06T10:59:06.493594+0000","last_became_active":"2023-10-06T10:59:01.416920+0000","last_became_peered":"2023-10-06T10:59:01.416920+0000","last_unstale":"2023-10-06T10:59:06.493594+0000","last_undegraded":"2023-10-06T10:59:06.493594+0000","last_fullsized":"2023-10-06T10:59:06.493594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:40.010964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487484+0000","last_change":"2023-10-06T10:59:02.435810+0000","last_active":"2023-10-06T10:59:06.487484+0000","last_peered":"2023-10-06T10:59:06.487484+0000","last_clean":"2023-10-06T10:59:06.487484+0000","last_became_active":"2023-10-06T10:59:02.435540+0000","last_became_peered":"2023-10-06T10:59:02.435540+0000","last_unstale":"2023-10-06T10:59:06.487484+0000","last_undegraded":"2023-10-06T10:59:06.487484+0000","last_fullsized":"2023-10-06T10:59:06.487484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:23.772944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513384+0000","last_change":"2023-10-06T10:59:06.509833+0000","last_active":"2023-10-06T10:59:06.513384+0000","last_peered":"2023-10-06T10:59:06.513384+0000","last_clean":"2023-10-06T10:59:06.513384+0000","last_became_active":"2023-10-06T10:59:06.508637+0000","last_became_peered":"2023-10-06T10:59:06.508637+0000","last_unstale":"2023-10-06T10:59:06.513384+0000","last_undegraded":"2023-10-06T10:59:06.513384+0000","last_fullsized":"2023-10-06T10:59:06.513384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:46:49.548101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494181+0000","last_change":"2023-10-06T10:59:01.415343+0000","last_active":"2023-10-06T10:59:06.494181+0000","last_peered":"2023-10-06T10:59:06.494181+0000","last_clean":"2023-10-06T10:59:06.494181+0000","last_became_active":"2023-10-06T10:59:01.414933+0000","last_became_peered":"2023-10-06T10:59:01.414933+0000","last_unstale":"2023-10-06T10:59:06.494181+0000","last_undegraded":"2023-10-06T10:59:06.494181+0000","last_fullsized":"2023-10-06T10:59:06.494181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:23:07.954687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488471+0000","last_change":"2023-10-06T10:58:56.328381+0000","last_active":"2023-10-06T10:59:06.488471+0000","last_peered":"2023-10-06T10:59:06.488471+0000","last_clean":"2023-10-06T10:59:06.488471+0000","last_became_active":"2023-10-06T10:58:56.328054+0000","last_became_peered":"2023-10-06T10:58:56.328054+0000","last_unstale":"2023-10-06T10:59:06.488471+0000","last_undegraded":"2023-10-06T10:59:06.488471+0000","last_fullsized":"2023-10-06T10:59:06.488471+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493494+0000","last_change":"2023-10-06T10:59:02.429942+0000","last_active":"2023-10-06T10:59:06.493494+0000","last_peered":"2023-10-06T10:59:06.493494+0000","last_clean":"2023-10-06T10:59:06.493494+0000","last_became_active":"2023-10-06T10:59:02.429646+0000","last_became_peered":"2023-10-06T10:59:02.429646+0000","last_unstale":"2023-10-06T10:59:06.493494+0000","last_undegraded":"2023-10-06T10:59:06.493494+0000","last_fullsized":"2023-10-06T10:59:06.493494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.506117+0000","last_change":"2023-10-06T10:59:06.502679+0000","last_active":"2023-10-06T10:59:06.506117+0000","last_peered":"2023-10-06T10:59:06.506117+0000","last_clean":"2023-10-06T10:59:06.506117+0000","last_became_active":"2023-10-06T10:59:06.502273+0000","last_became_peered":"2023-10-06T10:59:06.502273+0000","last_unstale":"2023-10-06T10:59:06.506117+0000","last_undegraded":"2023-10-06T10:59:06.506117+0000","last_fullsized":"2023-10-06T10:59:06.506117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:14:44.651801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493821+0000","last_change":"2023-10-06T10:58:56.326189+0000","last_active":"2023-10-06T10:59:06.493821+0000","last_peered":"2023-10-06T10:59:06.493821+0000","last_clean":"2023-10-06T10:59:06.493821+0000","last_became_active":"2023-10-06T10:58:56.325852+0000","last_became_peered":"2023-10-06T10:58:56.325852+0000","last_unstale":"2023-10-06T10:59:06.493821+0000","last_undegraded":"2023-10-06T10:59:06.493821+0000","last_fullsized":"2023-10-06T10:59:06.493821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:28.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516357+0000","last_change":"2023-10-06T10:59:01.411178+0000","last_active":"2023-10-06T10:59:06.516357+0000","last_peered":"2023-10-06T10:59:06.516357+0000","last_clean":"2023-10-06T10:59:06.516357+0000","last_became_active":"2023-10-06T10:59:01.410703+0000","last_became_peered":"2023-10-06T10:59:01.410703+0000","last_unstale":"2023-10-06T10:59:06.516357+0000","last_undegraded":"2023-10-06T10:59:06.516357+0000","last_fullsized":"2023-10-06T10:59:06.516357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:50.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486551+0000","last_change":"2023-10-06T10:59:02.425180+0000","last_active":"2023-10-06T10:59:06.486551+0000","last_peered":"2023-10-06T10:59:06.486551+0000","last_clean":"2023-10-06T10:59:06.486551+0000","last_became_active":"2023-10-06T10:59:02.424767+0000","last_became_peered":"2023-10-06T10:59:02.424767+0000","last_unstale":"2023-10-06T10:59:06.486551+0000","last_undegraded":"2023-10-06T10:59:06.486551+0000","last_fullsized":"2023-10-06T10:59:06.486551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:33.795023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503741+0000","last_change":"2023-10-06T10:59:06.501263+0000","last_active":"2023-10-06T10:59:06.503741+0000","last_peered":"2023-10-06T10:59:06.503741+0000","last_clean":"2023-10-06T10:59:06.503741+0000","last_became_active":"2023-10-06T10:59:06.500784+0000","last_became_peered":"2023-10-06T10:59:06.500784+0000","last_unstale":"2023-10-06T10:59:06.503741+0000","last_undegraded":"2023-10-06T10:59:06.503741+0000","last_fullsized":"2023-10-06T10:59:06.503741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:49.205787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486205+0000","last_change":"2023-10-06T10:58:56.325363+0000","last_active":"2023-10-06T10:59:06.486205+0000","last_peered":"2023-10-06T10:59:06.486205+0000","last_clean":"2023-10-06T10:59:06.486205+0000","last_became_active":"2023-10-06T10:58:56.325095+0000","last_became_peered":"2023-10-06T10:58:56.325095+0000","last_unstale":"2023-10-06T10:59:06.486205+0000","last_undegraded":"2023-10-06T10:59:06.486205+0000","last_fullsized":"2023-10-06T10:59:06.486205+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501704+0000","last_change":"2023-10-06T10:58:57.328525+0000","last_active":"2023-10-06T10:59:06.501704+0000","last_peered":"2023-10-06T10:59:06.501704+0000","last_clean":"2023-10-06T10:59:06.501704+0000","last_became_active":"2023-10-06T10:58:57.327509+0000","last_became_peered":"2023-10-06T10:58:57.327509+0000","last_unstale":"2023-10-06T10:59:06.501704+0000","last_undegraded":"2023-10-06T10:59:06.501704+0000","last_fullsized":"2023-10-06T10:59:06.501704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_clean_scrub_stamp":"2023-10-06T10:58:56.314996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:45.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501654+0000","last_change":"2023-10-06T10:59:01.415927+0000","last_active":"2023-10-06T10:59:06.501654+0000","last_peered":"2023-10-06T10:59:06.501654+0000","last_clean":"2023-10-06T10:59:06.501654+0000","last_became_active":"2023-10-06T10:59:01.415660+0000","last_became_peered":"2023-10-06T10:59:01.415660+0000","last_unstale":"2023-10-06T10:59:06.501654+0000","last_undegraded":"2023-10-06T10:59:06.501654+0000","last_fullsized":"2023-10-06T10:59:06.501654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:07.977576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504353+0000","last_change":"2023-10-06T10:59:02.435783+0000","last_active":"2023-10-06T10:59:06.504353+0000","last_peered":"2023-10-06T10:59:06.504353+0000","last_clean":"2023-10-06T10:59:06.504353+0000","last_became_active":"2023-10-06T10:59:02.435445+0000","last_became_peered":"2023-10-06T10:59:02.435445+0000","last_unstale":"2023-10-06T10:59:06.504353+0000","last_undegraded":"2023-10-06T10:59:06.504353+0000","last_fullsized":"2023-10-06T10:59:06.504353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516018+0000","last_change":"2023-10-06T10:59:06.514112+0000","last_active":"2023-10-06T10:59:06.516018+0000","last_peered":"2023-10-06T10:59:06.516018+0000","last_clean":"2023-10-06T10:59:06.516018+0000","last_became_active":"2023-10-06T10:59:06.513425+0000","last_became_peered":"2023-10-06T10:59:06.513425+0000","last_unstale":"2023-10-06T10:59:06.516018+0000","last_undegraded":"2023-10-06T10:59:06.516018+0000","last_fullsized":"2023-10-06T10:59:06.516018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:35.463907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501411+0000","last_change":"2023-10-06T10:58:56.331567+0000","last_active":"2023-10-06T10:59:06.501411+0000","last_peered":"2023-10-06T10:59:06.501411+0000","last_clean":"2023-10-06T10:59:06.501411+0000","last_became_active":"2023-10-06T10:58:56.331244+0000","last_became_peered":"2023-10-06T10:58:56.331244+0000","last_unstale":"2023-10-06T10:59:06.501411+0000","last_undegraded":"2023-10-06T10:59:06.501411+0000","last_fullsized":"2023-10-06T10:59:06.501411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486388+0000","last_change":"2023-10-06T10:59:01.401314+0000","last_active":"2023-10-06T10:59:06.486388+0000","last_peered":"2023-10-06T10:59:06.486388+0000","last_clean":"2023-10-06T10:59:06.486388+0000","last_became_active":"2023-10-06T10:59:01.400645+0000","last_became_peered":"2023-10-06T10:59:01.400645+0000","last_unstale":"2023-10-06T10:59:06.486388+0000","last_undegraded":"2023-10-06T10:59:06.486388+0000","last_fullsized":"2023-10-06T10:59:06.486388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:02.802656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487378+0000","last_change":"2023-10-06T10:59:02.433907+0000","last_active":"2023-10-06T10:59:06.487378+0000","last_peered":"2023-10-06T10:59:06.487378+0000","last_clean":"2023-10-06T10:59:06.487378+0000","last_became_active":"2023-10-06T10:59:02.430274+0000","last_became_peered":"2023-10-06T10:59:02.430274+0000","last_unstale":"2023-10-06T10:59:06.487378+0000","last_undegraded":"2023-10-06T10:59:06.487378+0000","last_fullsized":"2023-10-06T10:59:06.487378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:17.286697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516658+0000","last_change":"2023-10-06T10:59:06.515095+0000","last_active":"2023-10-06T10:59:06.516658+0000","last_peered":"2023-10-06T10:59:06.516658+0000","last_clean":"2023-10-06T10:59:06.516658+0000","last_became_active":"2023-10-06T10:59:06.514669+0000","last_became_peered":"2023-10-06T10:59:06.514669+0000","last_unstale":"2023-10-06T10:59:06.516658+0000","last_undegraded":"2023-10-06T10:59:06.516658+0000","last_fullsized":"2023-10-06T10:59:06.516658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:49.205787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501486+0000","last_change":"2023-10-06T10:58:56.332184+0000","last_active":"2023-10-06T10:59:06.501486+0000","last_peered":"2023-10-06T10:59:06.501486+0000","last_clean":"2023-10-06T10:59:06.501486+0000","last_became_active":"2023-10-06T10:58:56.331830+0000","last_became_peered":"2023-10-06T10:58:56.331830+0000","last_unstale":"2023-10-06T10:59:06.501486+0000","last_undegraded":"2023-10-06T10:59:06.501486+0000","last_fullsized":"2023-10-06T10:59:06.501486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:54:02.320834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493508+0000","last_change":"2023-10-06T10:59:01.414711+0000","last_active":"2023-10-06T10:59:06.493508+0000","last_peered":"2023-10-06T10:59:06.493508+0000","last_clean":"2023-10-06T10:59:06.493508+0000","last_became_active":"2023-10-06T10:59:01.414409+0000","last_became_peered":"2023-10-06T10:59:01.414409+0000","last_unstale":"2023-10-06T10:59:06.493508+0000","last_undegraded":"2023-10-06T10:59:06.493508+0000","last_fullsized":"2023-10-06T10:59:06.493508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:44.340657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486245+0000","last_change":"2023-10-06T10:59:02.424669+0000","last_active":"2023-10-06T10:59:06.486245+0000","last_peered":"2023-10-06T10:59:06.486245+0000","last_clean":"2023-10-06T10:59:06.486245+0000","last_became_active":"2023-10-06T10:59:02.424353+0000","last_became_peered":"2023-10-06T10:59:02.424353+0000","last_unstale":"2023-10-06T10:59:06.486245+0000","last_undegraded":"2023-10-06T10:59:06.486245+0000","last_fullsized":"2023-10-06T10:59:06.486245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:17.558201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514130+0000","last_change":"2023-10-06T10:59:06.504921+0000","last_active":"2023-10-06T10:59:06.514130+0000","last_peered":"2023-10-06T10:59:06.514130+0000","last_clean":"2023-10-06T10:59:06.514130+0000","last_became_active":"2023-10-06T10:59:06.501375+0000","last_became_peered":"2023-10-06T10:59:06.501375+0000","last_unstale":"2023-10-06T10:59:06.514130+0000","last_undegraded":"2023-10-06T10:59:06.514130+0000","last_fullsized":"2023-10-06T10:59:06.514130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:29.878658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493427+0000","last_change":"2023-10-06T10:58:56.331654+0000","last_active":"2023-10-06T10:59:06.493427+0000","last_peered":"2023-10-06T10:59:06.493427+0000","last_clean":"2023-10-06T10:59:06.493427+0000","last_became_active":"2023-10-06T10:58:56.331345+0000","last_became_peered":"2023-10-06T10:58:56.331345+0000","last_unstale":"2023-10-06T10:59:06.493427+0000","last_undegraded":"2023-10-06T10:59:06.493427+0000","last_fullsized":"2023-10-06T10:59:06.493427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488547+0000","last_change":"2023-10-06T10:59:01.416484+0000","last_active":"2023-10-06T10:59:06.488547+0000","last_peered":"2023-10-06T10:59:06.488547+0000","last_clean":"2023-10-06T10:59:06.488547+0000","last_became_active":"2023-10-06T10:59:01.416159+0000","last_became_peered":"2023-10-06T10:59:01.416159+0000","last_unstale":"2023-10-06T10:59:06.488547+0000","last_undegraded":"2023-10-06T10:59:06.488547+0000","last_fullsized":"2023-10-06T10:59:06.488547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:19.192242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486436+0000","last_change":"2023-10-06T10:59:02.419009+0000","last_active":"2023-10-06T10:59:06.486436+0000","last_peered":"2023-10-06T10:59:06.486436+0000","last_clean":"2023-10-06T10:59:06.486436+0000","last_became_active":"2023-10-06T10:59:02.418715+0000","last_became_peered":"2023-10-06T10:59:02.418715+0000","last_unstale":"2023-10-06T10:59:06.486436+0000","last_undegraded":"2023-10-06T10:59:06.486436+0000","last_fullsized":"2023-10-06T10:59:06.486436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:20.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514101+0000","last_change":"2023-10-06T10:59:06.504749+0000","last_active":"2023-10-06T10:59:06.514101+0000","last_peered":"2023-10-06T10:59:06.514101+0000","last_clean":"2023-10-06T10:59:06.514101+0000","last_became_active":"2023-10-06T10:59:06.504360+0000","last_became_peered":"2023-10-06T10:59:06.504360+0000","last_unstale":"2023-10-06T10:59:06.514101+0000","last_undegraded":"2023-10-06T10:59:06.514101+0000","last_fullsized":"2023-10-06T10:59:06.514101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:37.882998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486520+0000","last_change":"2023-10-06T10:58:56.331650+0000","last_active":"2023-10-06T10:59:06.486520+0000","last_peered":"2023-10-06T10:59:06.486520+0000","last_clean":"2023-10-06T10:59:06.486520+0000","last_became_active":"2023-10-06T10:58:56.331344+0000","last_became_peered":"2023-10-06T10:58:56.331344+0000","last_unstale":"2023-10-06T10:59:06.486520+0000","last_undegraded":"2023-10-06T10:59:06.486520+0000","last_fullsized":"2023-10-06T10:59:06.486520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:45.584545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486640+0000","last_change":"2023-10-06T10:59:01.405750+0000","last_active":"2023-10-06T10:59:06.486640+0000","last_peered":"2023-10-06T10:59:06.486640+0000","last_clean":"2023-10-06T10:59:06.486640+0000","last_became_active":"2023-10-06T10:59:01.403128+0000","last_became_peered":"2023-10-06T10:59:01.403128+0000","last_unstale":"2023-10-06T10:59:06.486640+0000","last_undegraded":"2023-10-06T10:59:06.486640+0000","last_fullsized":"2023-10-06T10:59:06.486640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501123+0000","last_change":"2023-10-06T10:59:02.427758+0000","last_active":"2023-10-06T10:59:06.501123+0000","last_peered":"2023-10-06T10:59:06.501123+0000","last_clean":"2023-10-06T10:59:06.501123+0000","last_became_active":"2023-10-06T10:59:02.427472+0000","last_became_peered":"2023-10-06T10:59:02.427472+0000","last_unstale":"2023-10-06T10:59:06.501123+0000","last_undegraded":"2023-10-06T10:59:06.501123+0000","last_fullsized":"2023-10-06T10:59:06.501123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:23.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513991+0000","last_change":"2023-10-06T10:59:06.505716+0000","last_active":"2023-10-06T10:59:06.513991+0000","last_peered":"2023-10-06T10:59:06.513991+0000","last_clean":"2023-10-06T10:59:06.513991+0000","last_became_active":"2023-10-06T10:59:06.505243+0000","last_became_peered":"2023-10-06T10:59:06.505243+0000","last_unstale":"2023-10-06T10:59:06.513991+0000","last_undegraded":"2023-10-06T10:59:06.513991+0000","last_fullsized":"2023-10-06T10:59:06.513991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:56.480286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487451+0000","last_change":"2023-10-06T10:58:56.326315+0000","last_active":"2023-10-06T10:59:06.487451+0000","last_peered":"2023-10-06T10:59:06.487451+0000","last_clean":"2023-10-06T10:59:06.487451+0000","last_became_active":"2023-10-06T10:58:56.325897+0000","last_became_peered":"2023-10-06T10:58:56.325897+0000","last_unstale":"2023-10-06T10:59:06.487451+0000","last_undegraded":"2023-10-06T10:59:06.487451+0000","last_fullsized":"2023-10-06T10:59:06.487451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493235+0000","last_change":"2023-10-06T10:59:01.416023+0000","last_active":"2023-10-06T10:59:06.493235+0000","last_peered":"2023-10-06T10:59:06.493235+0000","last_clean":"2023-10-06T10:59:06.493235+0000","last_became_active":"2023-10-06T10:59:01.415727+0000","last_became_peered":"2023-10-06T10:59:01.415727+0000","last_unstale":"2023-10-06T10:59:06.493235+0000","last_undegraded":"2023-10-06T10:59:06.493235+0000","last_fullsized":"2023-10-06T10:59:06.493235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:40.010964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485839+0000","last_change":"2023-10-06T10:59:02.427425+0000","last_active":"2023-10-06T10:59:06.485839+0000","last_peered":"2023-10-06T10:59:06.485839+0000","last_clean":"2023-10-06T10:59:06.485839+0000","last_became_active":"2023-10-06T10:59:02.427000+0000","last_became_peered":"2023-10-06T10:59:02.427000+0000","last_unstale":"2023-10-06T10:59:06.485839+0000","last_undegraded":"2023-10-06T10:59:06.485839+0000","last_fullsized":"2023-10-06T10:59:06.485839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.512322+0000","last_change":"2023-10-06T10:59:06.505584+0000","last_active":"2023-10-06T10:59:06.512322+0000","last_peered":"2023-10-06T10:59:06.512322+0000","last_clean":"2023-10-06T10:59:06.512322+0000","last_became_active":"2023-10-06T10:59:06.505152+0000","last_became_peered":"2023-10-06T10:59:06.505152+0000","last_unstale":"2023-10-06T10:59:06.512322+0000","last_undegraded":"2023-10-06T10:59:06.512322+0000","last_fullsized":"2023-10-06T10:59:06.512322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:50.861372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501237+0000","last_change":"2023-10-06T10:59:01.420277+0000","last_active":"2023-10-06T10:59:06.501237+0000","last_peered":"2023-10-06T10:59:06.501237+0000","last_clean":"2023-10-06T10:59:06.501237+0000","last_became_active":"2023-10-06T10:59:01.419959+0000","last_became_peered":"2023-10-06T10:59:01.419959+0000","last_unstale":"2023-10-06T10:59:06.501237+0000","last_undegraded":"2023-10-06T10:59:06.501237+0000","last_fullsized":"2023-10-06T10:59:06.501237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:19.192242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.498094+0000","last_change":"2023-10-06T10:59:02.420998+0000","last_active":"2023-10-06T10:59:06.498094+0000","last_peered":"2023-10-06T10:59:06.498094+0000","last_clean":"2023-10-06T10:59:06.498094+0000","last_became_active":"2023-10-06T10:59:02.420652+0000","last_became_peered":"2023-10-06T10:59:02.420652+0000","last_unstale":"2023-10-06T10:59:06.498094+0000","last_undegraded":"2023-10-06T10:59:06.498094+0000","last_fullsized":"2023-10-06T10:59:06.498094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:20.197027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516738+0000","last_change":"2023-10-06T10:59:06.513383+0000","last_active":"2023-10-06T10:59:06.516738+0000","last_peered":"2023-10-06T10:59:06.516738+0000","last_clean":"2023-10-06T10:59:06.516738+0000","last_became_active":"2023-10-06T10:59:06.512919+0000","last_became_peered":"2023-10-06T10:59:06.512919+0000","last_unstale":"2023-10-06T10:59:06.516738+0000","last_undegraded":"2023-10-06T10:59:06.516738+0000","last_fullsized":"2023-10-06T10:59:06.516738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:56.480286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492779+0000","last_change":"2023-10-06T10:59:01.417023+0000","last_active":"2023-10-06T10:59:06.492779+0000","last_peered":"2023-10-06T10:59:06.492779+0000","last_clean":"2023-10-06T10:59:06.492779+0000","last_became_active":"2023-10-06T10:59:01.416742+0000","last_became_peered":"2023-10-06T10:59:01.416742+0000","last_unstale":"2023-10-06T10:59:06.492779+0000","last_undegraded":"2023-10-06T10:59:06.492779+0000","last_fullsized":"2023-10-06T10:59:06.492779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:50.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488089+0000","last_change":"2023-10-06T10:59:02.435269+0000","last_active":"2023-10-06T10:59:06.488089+0000","last_peered":"2023-10-06T10:59:06.488089+0000","last_clean":"2023-10-06T10:59:06.488089+0000","last_became_active":"2023-10-06T10:59:02.434615+0000","last_became_peered":"2023-10-06T10:59:02.434615+0000","last_unstale":"2023-10-06T10:59:06.488089+0000","last_undegraded":"2023-10-06T10:59:06.488089+0000","last_fullsized":"2023-10-06T10:59:06.488089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:48.645632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.512751+0000","last_change":"2023-10-06T10:59:06.511957+0000","last_active":"2023-10-06T10:59:06.512751+0000","last_peered":"2023-10-06T10:59:06.512751+0000","last_clean":"2023-10-06T10:59:06.512751+0000","last_became_active":"2023-10-06T10:59:06.511470+0000","last_became_peered":"2023-10-06T10:59:06.511470+0000","last_unstale":"2023-10-06T10:59:06.512751+0000","last_undegraded":"2023-10-06T10:59:06.512751+0000","last_fullsized":"2023-10-06T10:59:06.512751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:56.480286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493131+0000","last_change":"2023-10-06T10:59:01.418640+0000","last_active":"2023-10-06T10:59:06.493131+0000","last_peered":"2023-10-06T10:59:06.493131+0000","last_clean":"2023-10-06T10:59:06.493131+0000","last_became_active":"2023-10-06T10:59:01.418365+0000","last_became_peered":"2023-10-06T10:59:01.418365+0000","last_unstale":"2023-10-06T10:59:06.493131+0000","last_undegraded":"2023-10-06T10:59:06.493131+0000","last_fullsized":"2023-10-06T10:59:06.493131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:08.334923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486781+0000","last_change":"2023-10-06T10:59:02.431977+0000","last_active":"2023-10-06T10:59:06.486781+0000","last_peered":"2023-10-06T10:59:06.486781+0000","last_clean":"2023-10-06T10:59:06.486781+0000","last_became_active":"2023-10-06T10:59:02.431706+0000","last_became_peered":"2023-10-06T10:59:02.431706+0000","last_unstale":"2023-10-06T10:59:06.486781+0000","last_undegraded":"2023-10-06T10:59:06.486781+0000","last_fullsized":"2023-10-06T10:59:06.486781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:56.596950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511641+0000","last_change":"2023-10-06T10:59:06.507385+0000","last_active":"2023-10-06T10:59:06.511641+0000","last_peered":"2023-10-06T10:59:06.511641+0000","last_clean":"2023-10-06T10:59:06.511641+0000","last_became_active":"2023-10-06T10:59:06.506688+0000","last_became_peered":"2023-10-06T10:59:06.506688+0000","last_unstale":"2023-10-06T10:59:06.511641+0000","last_undegraded":"2023-10-06T10:59:06.511641+0000","last_fullsized":"2023-10-06T10:59:06.511641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:27.154530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493578+0000","last_change":"2023-10-06T10:59:01.416098+0000","last_active":"2023-10-06T10:59:06.493578+0000","last_peered":"2023-10-06T10:59:06.493578+0000","last_clean":"2023-10-06T10:59:06.493578+0000","last_became_active":"2023-10-06T10:59:01.415763+0000","last_became_peered":"2023-10-06T10:59:01.415763+0000","last_unstale":"2023-10-06T10:59:06.493578+0000","last_undegraded":"2023-10-06T10:59:06.493578+0000","last_fullsized":"2023-10-06T10:59:06.493578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:03.581242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492967+0000","last_change":"2023-10-06T10:59:02.440465+0000","last_active":"2023-10-06T10:59:06.492967+0000","last_peered":"2023-10-06T10:59:06.492967+0000","last_clean":"2023-10-06T10:59:06.492967+0000","last_became_active":"2023-10-06T10:59:02.439835+0000","last_became_peered":"2023-10-06T10:59:02.439835+0000","last_unstale":"2023-10-06T10:59:06.492967+0000","last_undegraded":"2023-10-06T10:59:06.492967+0000","last_fullsized":"2023-10-06T10:59:06.492967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:23.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.509823+0000","last_change":"2023-10-06T10:59:06.504483+0000","last_active":"2023-10-06T10:59:06.509823+0000","last_peered":"2023-10-06T10:59:06.509823+0000","last_clean":"2023-10-06T10:59:06.509823+0000","last_became_active":"2023-10-06T10:59:06.504086+0000","last_became_peered":"2023-10-06T10:59:06.504086+0000","last_unstale":"2023-10-06T10:59:06.509823+0000","last_undegraded":"2023-10-06T10:59:06.509823+0000","last_fullsized":"2023-10-06T10:59:06.509823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:59.889292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504114+0000","last_change":"2023-10-06T10:59:01.413820+0000","last_active":"2023-10-06T10:59:06.504114+0000","last_peered":"2023-10-06T10:59:06.504114+0000","last_clean":"2023-10-06T10:59:06.504114+0000","last_became_active":"2023-10-06T10:59:01.413502+0000","last_became_peered":"2023-10-06T10:59:01.413502+0000","last_unstale":"2023-10-06T10:59:06.504114+0000","last_undegraded":"2023-10-06T10:59:06.504114+0000","last_fullsized":"2023-10-06T10:59:06.504114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:23:07.954687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.489549+0000","last_change":"2023-10-06T10:59:02.419538+0000","last_active":"2023-10-06T10:59:06.489549+0000","last_peered":"2023-10-06T10:59:06.489549+0000","last_clean":"2023-10-06T10:59:06.489549+0000","last_became_active":"2023-10-06T10:59:02.419185+0000","last_became_peered":"2023-10-06T10:59:02.419185+0000","last_unstale":"2023-10-06T10:59:06.489549+0000","last_undegraded":"2023-10-06T10:59:06.489549+0000","last_fullsized":"2023-10-06T10:59:06.489549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:38.092745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485604+0000","last_change":"2023-10-06T10:59:02.428782+0000","last_active":"2023-10-06T10:59:06.485604+0000","last_peered":"2023-10-06T10:59:06.485604+0000","last_clean":"2023-10-06T10:59:06.485604+0000","last_became_active":"2023-10-06T10:59:02.428518+0000","last_became_peered":"2023-10-06T10:59:02.428518+0000","last_unstale":"2023-10-06T10:59:06.485604+0000","last_undegraded":"2023-10-06T10:59:06.485604+0000","last_fullsized":"2023-10-06T10:59:06.485604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:20.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493061+0000","last_change":"2023-10-06T10:59:02.444220+0000","last_active":"2023-10-06T10:59:06.493061+0000","last_peered":"2023-10-06T10:59:06.493061+0000","last_clean":"2023-10-06T10:59:06.493061+0000","last_became_active":"2023-10-06T10:59:02.443920+0000","last_became_peered":"2023-10-06T10:59:02.443920+0000","last_unstale":"2023-10-06T10:59:06.493061+0000","last_undegraded":"2023-10-06T10:59:06.493061+0000","last_fullsized":"2023-10-06T10:59:06.493061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:17.096084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486954+0000","last_change":"2023-10-06T10:59:02.420323+0000","last_active":"2023-10-06T10:59:06.486954+0000","last_peered":"2023-10-06T10:59:06.486954+0000","last_clean":"2023-10-06T10:59:06.486954+0000","last_became_active":"2023-10-06T10:59:02.419903+0000","last_became_peered":"2023-10-06T10:59:02.419903+0000","last_unstale":"2023-10-06T10:59:06.486954+0000","last_undegraded":"2023-10-06T10:59:06.486954+0000","last_fullsized":"2023-10-06T10:59:06.486954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:52.603660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493896+0000","last_change":"2023-10-06T10:59:02.435228+0000","last_active":"2023-10-06T10:59:06.493896+0000","last_peered":"2023-10-06T10:59:06.493896+0000","last_clean":"2023-10-06T10:59:06.493896+0000","last_became_active":"2023-10-06T10:59:02.434847+0000","last_became_peered":"2023-10-06T10:59:02.434847+0000","last_unstale":"2023-10-06T10:59:06.493896+0000","last_undegraded":"2023-10-06T10:59:06.493896+0000","last_fullsized":"2023-10-06T10:59:06.493896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:53.107388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486540+0000","last_change":"2023-10-06T10:59:02.431384+0000","last_active":"2023-10-06T10:59:06.486540+0000","last_peered":"2023-10-06T10:59:06.486540+0000","last_clean":"2023-10-06T10:59:06.486540+0000","last_became_active":"2023-10-06T10:59:02.431073+0000","last_became_peered":"2023-10-06T10:59:02.431073+0000","last_unstale":"2023-10-06T10:59:06.486540+0000","last_undegraded":"2023-10-06T10:59:06.486540+0000","last_fullsized":"2023-10-06T10:59:06.486540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:05:14.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298128,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073712,"statfs":{"total":96636764160,"available":96331481088,"internally_reserved":0,"allocated":860160,"data_stored":699826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":108570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.978}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T10:59:27.609 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T10:59:27.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.775+0000 7efeb6d0e700 1 Processor -- start 2023-10-06T10:59:27.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.775+0000 7efeb6d0e700 1 -- start start 2023-10-06T10:59:27.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.775+0000 7efeb6d0e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efeb00ccda0 0x7efeb00cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:27.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.775+0000 7efeb6d0e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efeb00ac8d0 0x7efeb00aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:27.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.776+0000 7efeb6d0e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb0069110 con 0x7efeb00aa870 2023-10-06T10:59:27.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.776+0000 7efeb6d0e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb0068b30 con 0x7efeb00ac8d0 2023-10-06T10:59:27.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.776+0000 7efeb6d0e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00aacf0 con 0x7efeb00ccda0 2023-10-06T10:59:27.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.776+0000 7efeaffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efeb00ac8d0 0x7efeb00aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:27.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.776+0000 7efeaffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efeb00ac8d0 0x7efeb00aa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43718/0 (socket says 172.21.15.7:43718) 2023-10-06T10:59:27.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.776+0000 7efeaffff700 1 -- 172.21.15.7:0/1546259588 learned_addr learned my addr 172.21.15.7:0/1546259588 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:27.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.776+0000 7efeb4aaa700 1 --2- 172.21.15.7:0/1546259588 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efeb00ccda0 0x7efeb00cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:27.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.776+0000 7efeaffff700 1 -- 172.21.15.7:0/1546259588 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efeb00ccda0 msgr2=0x7efeb00cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:27.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.776+0000 7efeaffff700 1 --2- 172.21.15.7:0/1546259588 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efeb00ccda0 0x7efeb00cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.776+0000 7efeaffff700 1 -- 172.21.15.7:0/1546259588 >> v1:172.21.15.50:6789/0 conn(0x7efeb00aa870 legacy=0x7efeb0155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.776+0000 7efeaffff700 1 -- 172.21.15.7:0/1546259588 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb00aafb0 con 0x7efeb00ac8d0 2023-10-06T10:59:27.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.776+0000 7efeaffff700 1 --2- 172.21.15.7:0/1546259588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efeb00ac8d0 0x7efeb00aa330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efea40099b0 tx=0x7efea4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0b6e399eb7a557 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:27.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.776+0000 7efeaf7fe700 1 -- 172.21.15.7:0/1546259588 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4009ea0 con 0x7efeb00ac8d0 2023-10-06T10:59:27.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.777+0000 7efeaf7fe700 1 -- 172.21.15.7:0/1546259588 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea400b8f0 con 0x7efeb00ac8d0 2023-10-06T10:59:27.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.777+0000 7efeaf7fe700 1 -- 172.21.15.7:0/1546259588 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea400bc90 con 0x7efeb00ac8d0 2023-10-06T10:59:27.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.777+0000 7efeb6d0e700 1 -- 172.21.15.7:0/1546259588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efeb00ac8d0 msgr2=0x7efeb00aa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.777+0000 7efeb6d0e700 1 --2- 172.21.15.7:0/1546259588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efeb00ac8d0 0x7efeb00aa330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efea40099b0 tx=0x7efea4009250 comp rx=0 tx=0).stop 2023-10-06T10:59:27.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.777+0000 7efeb6d0e700 1 -- 172.21.15.7:0/1546259588 shutdown_connections 2023-10-06T10:59:27.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.777+0000 7efeb6d0e700 1 --2- 172.21.15.7:0/1546259588 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efeb00ccda0 0x7efeb00cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.777+0000 7efeb6d0e700 1 --2- 172.21.15.7:0/1546259588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efeb00ac8d0 0x7efeb00aa330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.777+0000 7efeb6d0e700 1 -- 172.21.15.7:0/1546259588 >> 172.21.15.7:0/1546259588 conn(0x7efeb0096160 msgr2=0x7efeb00afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.777+0000 7efeb6d0e700 1 -- 172.21.15.7:0/1546259588 shutdown_connections 2023-10-06T10:59:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.777+0000 7efeb6d0e700 1 -- 172.21.15.7:0/1546259588 wait complete. 2023-10-06T10:59:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.778+0000 7efeb6d0e700 1 Processor -- start 2023-10-06T10:59:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.779+0000 7efeb6d0e700 1 -- start start 2023-10-06T10:59:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.779+0000 7efeb6d0e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efeb00aa870 0x7efeb0143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.779+0000 7efeb6d0e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efeb00ac8d0 0x7efeb0159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.779+0000 7efeb6d0e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb00ccda0 0x7efeb015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.779+0000 7efeb6d0e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb016d4f0 con 0x7efeb00ac8d0 2023-10-06T10:59:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.779+0000 7efeb6d0e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb016a3c0 con 0x7efeb00ccda0 2023-10-06T10:59:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.779+0000 7efeb6d0e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb016cbc0 con 0x7efeb00aa870 2023-10-06T10:59:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeaffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efeb00ac8d0 0x7efeb0159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeaffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efeb00ac8d0 0x7efeb0159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43726/0 (socket says 172.21.15.7:43726) 2023-10-06T10:59:27.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeaffff700 1 -- 172.21.15.7:0/4125495119 learned_addr learned my addr 172.21.15.7:0/4125495119 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:27.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeb4aaa700 1 --2- 172.21.15.7:0/4125495119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efeb00aa870 0x7efeb0143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:27.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeb52ab700 1 --2- 172.21.15.7:0/4125495119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb00ccda0 0x7efeb015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:27.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeaffff700 1 -- 172.21.15.7:0/4125495119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efeb00aa870 msgr2=0x7efeb0143a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeaffff700 1 --2- 172.21.15.7:0/4125495119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efeb00aa870 0x7efeb0143a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeaffff700 1 -- 172.21.15.7:0/4125495119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb00ccda0 msgr2=0x7efeb015a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:27.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeaffff700 1 --2- 172.21.15.7:0/4125495119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb00ccda0 0x7efeb015a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:27.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeaffff700 1 -- 172.21.15.7:0/4125495119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea40094f0 con 0x7efeb00ac8d0 2023-10-06T10:59:27.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeaffff700 1 --2- 172.21.15.7:0/4125495119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efeb00ac8d0 0x7efeb0159cd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efeb00b2e50 tx=0x7efea4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:27.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeacff9700 1 -- 172.21.15.7:0/4125495119 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea400ba60 con 0x7efeb00ac8d0 2023-10-06T10:59:27.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeacff9700 1 -- 172.21.15.7:0/4125495119 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea400bbe0 con 0x7efeb00ac8d0 2023-10-06T10:59:27.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeb6d0e700 1 -- 172.21.15.7:0/4125495119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb016cea0 con 0x7efeb00ac8d0 2023-10-06T10:59:27.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeacff9700 1 -- 172.21.15.7:0/4125495119 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4026680 con 0x7efeb00ac8d0 2023-10-06T10:59:27.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.780+0000 7efeb6d0e700 1 -- 172.21.15.7:0/4125495119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb0169670 con 0x7efeb00ac8d0 2023-10-06T10:59:27.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.781+0000 7efeb6d0e700 1 -- 172.21.15.7:0/4125495119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb016d6a0 con 0x7efeb00ac8d0 2023-10-06T10:59:27.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.782+0000 7efeacff9700 1 -- 172.21.15.7:0/4125495119 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efea4023030 con 0x7efeb00ac8d0 2023-10-06T10:59:27.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.782+0000 7efeacff9700 1 --2- 172.21.15.7:0/4125495119 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efe9c066f30 0x7efe9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:27.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.783+0000 7efeb4aaa700 1 --2- 172.21.15.7:0/4125495119 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efe9c066f30 0x7efe9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:27.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.783+0000 7efeacff9700 1 -- 172.21.15.7:0/4125495119 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7efea40860f0 con 0x7efeb00ac8d0 2023-10-06T10:59:27.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.783+0000 7efeb4aaa700 1 --2- 172.21.15.7:0/4125495119 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efe9c066f30 0x7efe9c0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efeb00ade30 tx=0x7efea00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:27.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.787+0000 7efeacff9700 1 -- 172.21.15.7:0/4125495119 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efeb016d6a0 con 0x7efeb00ac8d0 2023-10-06T10:59:27.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.987+0000 7efeb6d0e700 1 -- 172.21.15.7:0/4125495119 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efeb0070480 con 0x7efe9c066f30 2023-10-06T10:59:27.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:27.997+0000 7efeacff9700 1 -- 172.21.15.7:0/4125495119 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367576 (secure 0 0 0) 0x7efeb0070480 con 0x7efe9c066f30 2023-10-06T10:59:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:28.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.001+0000 7efeb6d0e700 1 -- 172.21.15.7:0/4125495119 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efe9c066f30 msgr2=0x7efe9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.001+0000 7efeb6d0e700 1 --2- 172.21.15.7:0/4125495119 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efe9c066f30 0x7efe9c0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efeb00ade30 tx=0x7efea00091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.001+0000 7efeb6d0e700 1 -- 172.21.15.7:0/4125495119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efeb00ac8d0 msgr2=0x7efeb0159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.001+0000 7efeb6d0e700 1 --2- 172.21.15.7:0/4125495119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efeb00ac8d0 0x7efeb0159cd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efeb00b2e50 tx=0x7efea4017000 comp rx=0 tx=0).stop 2023-10-06T10:59:28.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.001+0000 7efeb6d0e700 1 -- 172.21.15.7:0/4125495119 shutdown_connections 2023-10-06T10:59:28.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.001+0000 7efeb6d0e700 1 --2- 172.21.15.7:0/4125495119 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efe9c066f30 0x7efe9c0693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.001+0000 7efeb6d0e700 1 --2- 172.21.15.7:0/4125495119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb00ccda0 0x7efeb015a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.001+0000 7efeb6d0e700 1 --2- 172.21.15.7:0/4125495119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efeb00aa870 0x7efeb0143a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.001+0000 7efeb6d0e700 1 --2- 172.21.15.7:0/4125495119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efeb00ac8d0 0x7efeb0159cd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.001+0000 7efeb6d0e700 1 -- 172.21.15.7:0/4125495119 >> 172.21.15.7:0/4125495119 conn(0x7efeb0096160 msgr2=0x7efeb0154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:28.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.002+0000 7efeb6d0e700 1 -- 172.21.15.7:0/4125495119 shutdown_connections 2023-10-06T10:59:28.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.002+0000 7efeb6d0e700 1 -- 172.21.15.7:0/4125495119 wait complete. 2023-10-06T10:59:28.007 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-06T10:59:28.017 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-10-06T10:59:27.978615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594853,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381592,"kb_used_data":3288,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593128,"statfs":{"total":773094113280,"available":770655363072,"internally_reserved":0,"allocated":3366912,"data_stored":2061458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003331"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492562+0000","last_change":"2023-10-06T10:59:02.436169+0000","last_active":"2023-10-06T10:59:06.492562+0000","last_peered":"2023-10-06T10:59:06.492562+0000","last_clean":"2023-10-06T10:59:06.492562+0000","last_became_active":"2023-10-06T10:59:02.435876+0000","last_became_peered":"2023-10-06T10:59:02.435876+0000","last_unstale":"2023-10-06T10:59:06.492562+0000","last_undegraded":"2023-10-06T10:59:06.492562+0000","last_fullsized":"2023-10-06T10:59:06.492562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:41.015749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493906+0000","last_change":"2023-10-06T10:59:02.436149+0000","last_active":"2023-10-06T10:59:06.493906+0000","last_peered":"2023-10-06T10:59:06.493906+0000","last_clean":"2023-10-06T10:59:06.493906+0000","last_became_active":"2023-10-06T10:59:02.435828+0000","last_became_peered":"2023-10-06T10:59:02.435828+0000","last_unstale":"2023-10-06T10:59:06.493906+0000","last_undegraded":"2023-10-06T10:59:06.493906+0000","last_fullsized":"2023-10-06T10:59:06.493906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:28:49.922872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488695+0000","last_change":"2023-10-06T10:59:02.431176+0000","last_active":"2023-10-06T10:59:06.488695+0000","last_peered":"2023-10-06T10:59:06.488695+0000","last_clean":"2023-10-06T10:59:06.488695+0000","last_became_active":"2023-10-06T10:59:02.430717+0000","last_became_peered":"2023-10-06T10:59:02.430717+0000","last_unstale":"2023-10-06T10:59:06.488695+0000","last_undegraded":"2023-10-06T10:59:06.488695+0000","last_fullsized":"2023-10-06T10:59:06.488695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:50:46.657726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486050+0000","last_change":"2023-10-06T10:59:02.431021+0000","last_active":"2023-10-06T10:59:06.486050+0000","last_peered":"2023-10-06T10:59:06.486050+0000","last_clean":"2023-10-06T10:59:06.486050+0000","last_became_active":"2023-10-06T10:59:02.430698+0000","last_became_peered":"2023-10-06T10:59:02.430698+0000","last_unstale":"2023-10-06T10:59:06.486050+0000","last_undegraded":"2023-10-06T10:59:06.486050+0000","last_fullsized":"2023-10-06T10:59:06.486050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:40.405676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501016+0000","last_change":"2023-10-06T10:59:02.437710+0000","last_active":"2023-10-06T10:59:06.501016+0000","last_peered":"2023-10-06T10:59:06.501016+0000","last_clean":"2023-10-06T10:59:06.501016+0000","last_became_active":"2023-10-06T10:59:02.437363+0000","last_became_peered":"2023-10-06T10:59:02.437363+0000","last_unstale":"2023-10-06T10:59:06.501016+0000","last_undegraded":"2023-10-06T10:59:06.501016+0000","last_fullsized":"2023-10-06T10:59:06.501016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:17.096084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487005+0000","last_change":"2023-10-06T10:59:02.431827+0000","last_active":"2023-10-06T10:59:06.487005+0000","last_peered":"2023-10-06T10:59:06.487005+0000","last_clean":"2023-10-06T10:59:06.487005+0000","last_became_active":"2023-10-06T10:59:02.431489+0000","last_became_peered":"2023-10-06T10:59:02.431489+0000","last_unstale":"2023-10-06T10:59:06.487005+0000","last_undegraded":"2023-10-06T10:59:06.487005+0000","last_fullsized":"2023-10-06T10:59:06.487005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:08:38.269689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.502047+0000","last_change":"2023-10-06T10:59:02.444025+0000","last_active":"2023-10-06T10:59:06.502047+0000","last_peered":"2023-10-06T10:59:06.502047+0000","last_clean":"2023-10-06T10:59:06.502047+0000","last_became_active":"2023-10-06T10:59:02.443754+0000","last_became_peered":"2023-10-06T10:59:02.443754+0000","last_unstale":"2023-10-06T10:59:06.502047+0000","last_undegraded":"2023-10-06T10:59:06.502047+0000","last_fullsized":"2023-10-06T10:59:06.502047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492806+0000","last_change":"2023-10-06T10:59:02.421077+0000","last_active":"2023-10-06T10:59:06.492806+0000","last_peered":"2023-10-06T10:59:06.492806+0000","last_clean":"2023-10-06T10:59:06.492806+0000","last_became_active":"2023-10-06T10:59:02.420781+0000","last_became_peered":"2023-10-06T10:59:02.420781+0000","last_unstale":"2023-10-06T10:59:06.492806+0000","last_undegraded":"2023-10-06T10:59:06.492806+0000","last_fullsized":"2023-10-06T10:59:06.492806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:20.715518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503818+0000","last_change":"2023-10-06T10:59:02.438976+0000","last_active":"2023-10-06T10:59:06.503818+0000","last_peered":"2023-10-06T10:59:06.503818+0000","last_clean":"2023-10-06T10:59:06.503818+0000","last_became_active":"2023-10-06T10:59:02.437626+0000","last_became_peered":"2023-10-06T10:59:02.437626+0000","last_unstale":"2023-10-06T10:59:06.503818+0000","last_undegraded":"2023-10-06T10:59:06.503818+0000","last_fullsized":"2023-10-06T10:59:06.503818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:38.092745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494111+0000","last_change":"2023-10-06T10:59:02.430066+0000","last_active":"2023-10-06T10:59:06.494111+0000","last_peered":"2023-10-06T10:59:06.494111+0000","last_clean":"2023-10-06T10:59:06.494111+0000","last_became_active":"2023-10-06T10:59:02.429786+0000","last_became_peered":"2023-10-06T10:59:02.429786+0000","last_unstale":"2023-10-06T10:59:06.494111+0000","last_undegraded":"2023-10-06T10:59:06.494111+0000","last_fullsized":"2023-10-06T10:59:06.494111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488572+0000","last_change":"2023-10-06T10:59:02.429174+0000","last_active":"2023-10-06T10:59:06.488572+0000","last_peered":"2023-10-06T10:59:06.488572+0000","last_clean":"2023-10-06T10:59:06.488572+0000","last_became_active":"2023-10-06T10:59:02.428460+0000","last_became_peered":"2023-10-06T10:59:02.428460+0000","last_unstale":"2023-10-06T10:59:06.488572+0000","last_undegraded":"2023-10-06T10:59:06.488572+0000","last_fullsized":"2023-10-06T10:59:06.488572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.497917+0000","last_change":"2023-10-06T10:59:02.417958+0000","last_active":"2023-10-06T10:59:06.497917+0000","last_peered":"2023-10-06T10:59:06.497917+0000","last_clean":"2023-10-06T10:59:06.497917+0000","last_became_active":"2023-10-06T10:59:02.417612+0000","last_became_peered":"2023-10-06T10:59:02.417612+0000","last_unstale":"2023-10-06T10:59:06.497917+0000","last_undegraded":"2023-10-06T10:59:06.497917+0000","last_fullsized":"2023-10-06T10:59:06.497917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:51.449145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.495493+0000","last_change":"2023-10-06T10:59:02.436783+0000","last_active":"2023-10-06T10:59:06.495493+0000","last_peered":"2023-10-06T10:59:06.495493+0000","last_clean":"2023-10-06T10:59:06.495493+0000","last_became_active":"2023-10-06T10:59:02.436507+0000","last_became_peered":"2023-10-06T10:59:02.436507+0000","last_unstale":"2023-10-06T10:59:06.495493+0000","last_undegraded":"2023-10-06T10:59:06.495493+0000","last_fullsized":"2023-10-06T10:59:06.495493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:04.586026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493130+0000","last_change":"2023-10-06T10:59:02.425873+0000","last_active":"2023-10-06T10:59:06.493130+0000","last_peered":"2023-10-06T10:59:06.493130+0000","last_clean":"2023-10-06T10:59:06.493130+0000","last_became_active":"2023-10-06T10:59:02.425566+0000","last_became_peered":"2023-10-06T10:59:02.425566+0000","last_unstale":"2023-10-06T10:59:06.493130+0000","last_undegraded":"2023-10-06T10:59:06.493130+0000","last_fullsized":"2023-10-06T10:59:06.493130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:23.772944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501838+0000","last_change":"2023-10-06T10:59:02.444199+0000","last_active":"2023-10-06T10:59:06.501838+0000","last_peered":"2023-10-06T10:59:06.501838+0000","last_clean":"2023-10-06T10:59:06.501838+0000","last_became_active":"2023-10-06T10:59:02.443956+0000","last_became_peered":"2023-10-06T10:59:02.443956+0000","last_unstale":"2023-10-06T10:59:06.501838+0000","last_undegraded":"2023-10-06T10:59:06.501838+0000","last_fullsized":"2023-10-06T10:59:06.501838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:56.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.489640+0000","last_change":"2023-10-06T10:59:02.426577+0000","last_active":"2023-10-06T10:59:06.489640+0000","last_peered":"2023-10-06T10:59:06.489640+0000","last_clean":"2023-10-06T10:59:06.489640+0000","last_became_active":"2023-10-06T10:59:02.426242+0000","last_became_peered":"2023-10-06T10:59:02.426242+0000","last_unstale":"2023-10-06T10:59:06.489640+0000","last_undegraded":"2023-10-06T10:59:06.489640+0000","last_fullsized":"2023-10-06T10:59:06.489640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:31.375932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503914+0000","last_change":"2023-10-06T10:59:02.438604+0000","last_active":"2023-10-06T10:59:06.503914+0000","last_peered":"2023-10-06T10:59:06.503914+0000","last_clean":"2023-10-06T10:59:06.503914+0000","last_became_active":"2023-10-06T10:59:02.438014+0000","last_became_peered":"2023-10-06T10:59:02.438014+0000","last_unstale":"2023-10-06T10:59:06.503914+0000","last_undegraded":"2023-10-06T10:59:06.503914+0000","last_fullsized":"2023-10-06T10:59:06.503914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487888+0000","last_change":"2023-10-06T10:59:02.426707+0000","last_active":"2023-10-06T10:59:06.487888+0000","last_peered":"2023-10-06T10:59:06.487888+0000","last_clean":"2023-10-06T10:59:06.487888+0000","last_became_active":"2023-10-06T10:59:02.426263+0000","last_became_peered":"2023-10-06T10:59:02.426263+0000","last_unstale":"2023-10-06T10:59:06.487888+0000","last_undegraded":"2023-10-06T10:59:06.487888+0000","last_fullsized":"2023-10-06T10:59:06.487888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:58.642289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.496996+0000","last_change":"2023-10-06T10:59:02.419676+0000","last_active":"2023-10-06T10:59:06.496996+0000","last_peered":"2023-10-06T10:59:06.496996+0000","last_clean":"2023-10-06T10:59:06.496996+0000","last_became_active":"2023-10-06T10:59:02.419356+0000","last_became_peered":"2023-10-06T10:59:02.419356+0000","last_unstale":"2023-10-06T10:59:06.496996+0000","last_undegraded":"2023-10-06T10:59:06.496996+0000","last_fullsized":"2023-10-06T10:59:06.496996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:42.646222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486894+0000","last_change":"2023-10-06T10:59:02.420221+0000","last_active":"2023-10-06T10:59:06.486894+0000","last_peered":"2023-10-06T10:59:06.486894+0000","last_clean":"2023-10-06T10:59:06.486894+0000","last_became_active":"2023-10-06T10:59:02.419881+0000","last_became_peered":"2023-10-06T10:59:02.419881+0000","last_unstale":"2023-10-06T10:59:06.486894+0000","last_undegraded":"2023-10-06T10:59:06.486894+0000","last_fullsized":"2023-10-06T10:59:06.486894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:17.096084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503250+0000","last_change":"2023-10-06T10:59:02.436623+0000","last_active":"2023-10-06T10:59:06.503250+0000","last_peered":"2023-10-06T10:59:06.503250+0000","last_clean":"2023-10-06T10:59:06.503250+0000","last_became_active":"2023-10-06T10:59:02.436288+0000","last_became_peered":"2023-10-06T10:59:02.436288+0000","last_unstale":"2023-10-06T10:59:06.503250+0000","last_undegraded":"2023-10-06T10:59:06.503250+0000","last_fullsized":"2023-10-06T10:59:06.503250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:31.081513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.500640+0000","last_change":"2023-10-06T10:59:02.436300+0000","last_active":"2023-10-06T10:59:06.500640+0000","last_peered":"2023-10-06T10:59:06.500640+0000","last_clean":"2023-10-06T10:59:06.500640+0000","last_became_active":"2023-10-06T10:59:02.435769+0000","last_became_peered":"2023-10-06T10:59:02.435769+0000","last_unstale":"2023-10-06T10:59:06.500640+0000","last_undegraded":"2023-10-06T10:59:06.500640+0000","last_fullsized":"2023-10-06T10:59:06.500640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493156+0000","last_change":"2023-10-06T10:59:02.440684+0000","last_active":"2023-10-06T10:59:06.493156+0000","last_peered":"2023-10-06T10:59:06.493156+0000","last_clean":"2023-10-06T10:59:06.493156+0000","last_became_active":"2023-10-06T10:59:02.440157+0000","last_became_peered":"2023-10-06T10:59:02.440157+0000","last_unstale":"2023-10-06T10:59:06.493156+0000","last_undegraded":"2023-10-06T10:59:06.493156+0000","last_fullsized":"2023-10-06T10:59:06.493156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:17.384456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501602+0000","last_change":"2023-10-06T10:59:02.439323+0000","last_active":"2023-10-06T10:59:06.501602+0000","last_peered":"2023-10-06T10:59:06.501602+0000","last_clean":"2023-10-06T10:59:06.501602+0000","last_became_active":"2023-10-06T10:59:02.439038+0000","last_became_peered":"2023-10-06T10:59:02.439038+0000","last_unstale":"2023-10-06T10:59:06.501602+0000","last_undegraded":"2023-10-06T10:59:06.501602+0000","last_fullsized":"2023-10-06T10:59:06.501602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487277+0000","last_change":"2023-10-06T10:59:02.422230+0000","last_active":"2023-10-06T10:59:06.487277+0000","last_peered":"2023-10-06T10:59:06.487277+0000","last_clean":"2023-10-06T10:59:06.487277+0000","last_became_active":"2023-10-06T10:59:02.421846+0000","last_became_peered":"2023-10-06T10:59:02.421846+0000","last_unstale":"2023-10-06T10:59:06.487277+0000","last_undegraded":"2023-10-06T10:59:06.487277+0000","last_fullsized":"2023-10-06T10:59:06.487277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:20.715518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487304+0000","last_change":"2023-10-06T10:59:02.419258+0000","last_active":"2023-10-06T10:59:06.487304+0000","last_peered":"2023-10-06T10:59:06.487304+0000","last_clean":"2023-10-06T10:59:06.487304+0000","last_became_active":"2023-10-06T10:59:02.418921+0000","last_became_peered":"2023-10-06T10:59:02.418921+0000","last_unstale":"2023-10-06T10:59:06.487304+0000","last_undegraded":"2023-10-06T10:59:06.487304+0000","last_fullsized":"2023-10-06T10:59:06.487304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:17.558201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493500+0000","last_change":"2023-10-06T10:59:02.429047+0000","last_active":"2023-10-06T10:59:06.493500+0000","last_peered":"2023-10-06T10:59:06.493500+0000","last_clean":"2023-10-06T10:59:06.493500+0000","last_became_active":"2023-10-06T10:59:02.428070+0000","last_became_peered":"2023-10-06T10:59:02.428070+0000","last_unstale":"2023-10-06T10:59:06.493500+0000","last_undegraded":"2023-10-06T10:59:06.493500+0000","last_fullsized":"2023-10-06T10:59:06.493500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:17.286697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511536+0000","last_change":"2023-10-06T10:59:06.505906+0000","last_active":"2023-10-06T10:59:06.511536+0000","last_peered":"2023-10-06T10:59:06.511536+0000","last_clean":"2023-10-06T10:59:06.511536+0000","last_became_active":"2023-10-06T10:59:06.505502+0000","last_became_peered":"2023-10-06T10:59:06.505502+0000","last_unstale":"2023-10-06T10:59:06.511536+0000","last_undegraded":"2023-10-06T10:59:06.511536+0000","last_fullsized":"2023-10-06T10:59:06.511536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:58:13.075195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486926+0000","last_change":"2023-10-06T10:59:01.410556+0000","last_active":"2023-10-06T10:59:06.486926+0000","last_peered":"2023-10-06T10:59:06.486926+0000","last_clean":"2023-10-06T10:59:06.486926+0000","last_became_active":"2023-10-06T10:59:01.410304+0000","last_became_peered":"2023-10-06T10:59:01.410304+0000","last_unstale":"2023-10-06T10:59:06.486926+0000","last_undegraded":"2023-10-06T10:59:06.486926+0000","last_fullsized":"2023-10-06T10:59:06.486926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494194+0000","last_change":"2023-10-06T10:59:02.446346+0000","last_active":"2023-10-06T10:59:06.494194+0000","last_peered":"2023-10-06T10:59:06.494194+0000","last_clean":"2023-10-06T10:59:06.494194+0000","last_became_active":"2023-10-06T10:59:02.446029+0000","last_became_peered":"2023-10-06T10:59:02.446029+0000","last_unstale":"2023-10-06T10:59:06.494194+0000","last_undegraded":"2023-10-06T10:59:06.494194+0000","last_fullsized":"2023-10-06T10:59:06.494194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:48.645632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516676+0000","last_change":"2023-10-06T10:59:06.508187+0000","last_active":"2023-10-06T10:59:06.516676+0000","last_peered":"2023-10-06T10:59:06.516676+0000","last_clean":"2023-10-06T10:59:06.516676+0000","last_became_active":"2023-10-06T10:59:06.507722+0000","last_became_peered":"2023-10-06T10:59:06.507722+0000","last_unstale":"2023-10-06T10:59:06.516676+0000","last_undegraded":"2023-10-06T10:59:06.516676+0000","last_fullsized":"2023-10-06T10:59:06.516676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:52.733607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485843+0000","last_change":"2023-10-06T10:59:01.406095+0000","last_active":"2023-10-06T10:59:06.485843+0000","last_peered":"2023-10-06T10:59:06.485843+0000","last_clean":"2023-10-06T10:59:06.485843+0000","last_became_active":"2023-10-06T10:59:01.405687+0000","last_became_peered":"2023-10-06T10:59:01.405687+0000","last_unstale":"2023-10-06T10:59:06.485843+0000","last_undegraded":"2023-10-06T10:59:06.485843+0000","last_fullsized":"2023-10-06T10:59:06.485843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:55.921829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504174+0000","last_change":"2023-10-06T10:59:02.427693+0000","last_active":"2023-10-06T10:59:06.504174+0000","last_peered":"2023-10-06T10:59:06.504174+0000","last_clean":"2023-10-06T10:59:06.504174+0000","last_became_active":"2023-10-06T10:59:02.427352+0000","last_became_peered":"2023-10-06T10:59:02.427352+0000","last_unstale":"2023-10-06T10:59:06.504174+0000","last_undegraded":"2023-10-06T10:59:06.504174+0000","last_fullsized":"2023-10-06T10:59:06.504174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:28:49.922872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514081+0000","last_change":"2023-10-06T10:59:06.507380+0000","last_active":"2023-10-06T10:59:06.514081+0000","last_peered":"2023-10-06T10:59:06.514081+0000","last_clean":"2023-10-06T10:59:06.514081+0000","last_became_active":"2023-10-06T10:59:06.506977+0000","last_became_peered":"2023-10-06T10:59:06.506977+0000","last_unstale":"2023-10-06T10:59:06.514081+0000","last_undegraded":"2023-10-06T10:59:06.514081+0000","last_fullsized":"2023-10-06T10:59:06.514081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:50.861372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493785+0000","last_change":"2023-10-06T10:59:01.411985+0000","last_active":"2023-10-06T10:59:06.493785+0000","last_peered":"2023-10-06T10:59:06.493785+0000","last_clean":"2023-10-06T10:59:06.493785+0000","last_became_active":"2023-10-06T10:59:01.411513+0000","last_became_peered":"2023-10-06T10:59:01.411513+0000","last_unstale":"2023-10-06T10:59:06.493785+0000","last_undegraded":"2023-10-06T10:59:06.493785+0000","last_fullsized":"2023-10-06T10:59:06.493785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:50.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487360+0000","last_change":"2023-10-06T10:59:02.422860+0000","last_active":"2023-10-06T10:59:06.487360+0000","last_peered":"2023-10-06T10:59:06.487360+0000","last_clean":"2023-10-06T10:59:06.487360+0000","last_became_active":"2023-10-06T10:59:02.422552+0000","last_became_peered":"2023-10-06T10:59:02.422552+0000","last_unstale":"2023-10-06T10:59:06.487360+0000","last_undegraded":"2023-10-06T10:59:06.487360+0000","last_fullsized":"2023-10-06T10:59:06.487360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:20.715518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516565+0000","last_change":"2023-10-06T10:59:06.508111+0000","last_active":"2023-10-06T10:59:06.516565+0000","last_peered":"2023-10-06T10:59:06.516565+0000","last_clean":"2023-10-06T10:59:06.516565+0000","last_became_active":"2023-10-06T10:59:06.507685+0000","last_became_peered":"2023-10-06T10:59:06.507685+0000","last_unstale":"2023-10-06T10:59:06.516565+0000","last_undegraded":"2023-10-06T10:59:06.516565+0000","last_fullsized":"2023-10-06T10:59:06.516565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:21.184059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504004+0000","last_change":"2023-10-06T10:59:01.415316+0000","last_active":"2023-10-06T10:59:06.504004+0000","last_peered":"2023-10-06T10:59:06.504004+0000","last_clean":"2023-10-06T10:59:06.504004+0000","last_became_active":"2023-10-06T10:59:01.415052+0000","last_became_peered":"2023-10-06T10:59:01.415052+0000","last_unstale":"2023-10-06T10:59:06.504004+0000","last_undegraded":"2023-10-06T10:59:06.504004+0000","last_fullsized":"2023-10-06T10:59:06.504004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:03.581242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493689+0000","last_change":"2023-10-06T10:59:02.445937+0000","last_active":"2023-10-06T10:59:06.493689+0000","last_peered":"2023-10-06T10:59:06.493689+0000","last_clean":"2023-10-06T10:59:06.493689+0000","last_became_active":"2023-10-06T10:59:02.444001+0000","last_became_peered":"2023-10-06T10:59:02.444001+0000","last_unstale":"2023-10-06T10:59:06.493689+0000","last_undegraded":"2023-10-06T10:59:06.493689+0000","last_fullsized":"2023-10-06T10:59:06.493689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:31.375932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516837+0000","last_change":"2023-10-06T10:59:06.515426+0000","last_active":"2023-10-06T10:59:06.516837+0000","last_peered":"2023-10-06T10:59:06.516837+0000","last_clean":"2023-10-06T10:59:06.516837+0000","last_became_active":"2023-10-06T10:59:06.514929+0000","last_became_peered":"2023-10-06T10:59:06.514929+0000","last_unstale":"2023-10-06T10:59:06.516837+0000","last_undegraded":"2023-10-06T10:59:06.516837+0000","last_fullsized":"2023-10-06T10:59:06.516837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:29.878658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494014+0000","last_change":"2023-10-06T10:59:01.413409+0000","last_active":"2023-10-06T10:59:06.494014+0000","last_peered":"2023-10-06T10:59:06.494014+0000","last_clean":"2023-10-06T10:59:06.494014+0000","last_became_active":"2023-10-06T10:59:01.413132+0000","last_became_peered":"2023-10-06T10:59:01.413132+0000","last_unstale":"2023-10-06T10:59:06.494014+0000","last_undegraded":"2023-10-06T10:59:06.494014+0000","last_fullsized":"2023-10-06T10:59:06.494014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:19.192242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492779+0000","last_change":"2023-10-06T10:59:02.433507+0000","last_active":"2023-10-06T10:59:06.492779+0000","last_peered":"2023-10-06T10:59:06.492779+0000","last_clean":"2023-10-06T10:59:06.492779+0000","last_became_active":"2023-10-06T10:59:02.433196+0000","last_became_peered":"2023-10-06T10:59:02.433196+0000","last_unstale":"2023-10-06T10:59:06.492779+0000","last_undegraded":"2023-10-06T10:59:06.492779+0000","last_fullsized":"2023-10-06T10:59:06.492779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.506197+0000","last_change":"2023-10-06T10:59:06.502951+0000","last_active":"2023-10-06T10:59:06.506197+0000","last_peered":"2023-10-06T10:59:06.506197+0000","last_clean":"2023-10-06T10:59:06.506197+0000","last_became_active":"2023-10-06T10:59:06.502527+0000","last_became_peered":"2023-10-06T10:59:06.502527+0000","last_unstale":"2023-10-06T10:59:06.506197+0000","last_undegraded":"2023-10-06T10:59:06.506197+0000","last_fullsized":"2023-10-06T10:59:06.506197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:18.864841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503418+0000","last_change":"2023-10-06T10:59:01.415005+0000","last_active":"2023-10-06T10:59:06.503418+0000","last_peered":"2023-10-06T10:59:06.503418+0000","last_clean":"2023-10-06T10:59:06.503418+0000","last_became_active":"2023-10-06T10:59:01.414705+0000","last_became_peered":"2023-10-06T10:59:01.414705+0000","last_unstale":"2023-10-06T10:59:06.503418+0000","last_undegraded":"2023-10-06T10:59:06.503418+0000","last_fullsized":"2023-10-06T10:59:06.503418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:16.553416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485948+0000","last_change":"2023-10-06T10:59:02.423861+0000","last_active":"2023-10-06T10:59:06.485948+0000","last_peered":"2023-10-06T10:59:06.485948+0000","last_clean":"2023-10-06T10:59:06.485948+0000","last_became_active":"2023-10-06T10:59:02.419690+0000","last_became_peered":"2023-10-06T10:59:02.419690+0000","last_unstale":"2023-10-06T10:59:06.485948+0000","last_undegraded":"2023-10-06T10:59:06.485948+0000","last_fullsized":"2023-10-06T10:59:06.485948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:36.050017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513155+0000","last_change":"2023-10-06T10:59:06.506470+0000","last_active":"2023-10-06T10:59:06.513155+0000","last_peered":"2023-10-06T10:59:06.513155+0000","last_clean":"2023-10-06T10:59:06.513155+0000","last_became_active":"2023-10-06T10:59:06.506061+0000","last_became_peered":"2023-10-06T10:59:06.506061+0000","last_unstale":"2023-10-06T10:59:06.513155+0000","last_undegraded":"2023-10-06T10:59:06.513155+0000","last_fullsized":"2023-10-06T10:59:06.513155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:49.928746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T10:59:12.825833+0000","last_change":"2023-10-06T10:59:01.409923+0000","last_active":"2023-10-06T10:59:12.825833+0000","last_peered":"2023-10-06T10:59:12.825833+0000","last_clean":"2023-10-06T10:59:12.825833+0000","last_became_active":"2023-10-06T10:59:01.409615+0000","last_became_peered":"2023-10-06T10:59:01.409615+0000","last_unstale":"2023-10-06T10:59:12.825833+0000","last_undegraded":"2023-10-06T10:59:12.825833+0000","last_fullsized":"2023-10-06T10:59:12.825833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:02.802656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488353+0000","last_change":"2023-10-06T10:59:02.420107+0000","last_active":"2023-10-06T10:59:06.488353+0000","last_peered":"2023-10-06T10:59:06.488353+0000","last_clean":"2023-10-06T10:59:06.488353+0000","last_became_active":"2023-10-06T10:59:02.419814+0000","last_became_peered":"2023-10-06T10:59:02.419814+0000","last_unstale":"2023-10-06T10:59:06.488353+0000","last_undegraded":"2023-10-06T10:59:06.488353+0000","last_fullsized":"2023-10-06T10:59:06.488353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:53.107388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511474+0000","last_change":"2023-10-06T10:59:06.504882+0000","last_active":"2023-10-06T10:59:06.511474+0000","last_peered":"2023-10-06T10:59:06.511474+0000","last_clean":"2023-10-06T10:59:06.511474+0000","last_became_active":"2023-10-06T10:59:06.504478+0000","last_became_peered":"2023-10-06T10:59:06.504478+0000","last_unstale":"2023-10-06T10:59:06.511474+0000","last_undegraded":"2023-10-06T10:59:06.511474+0000","last_fullsized":"2023-10-06T10:59:06.511474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:25.148933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503121+0000","last_change":"2023-10-06T10:59:01.418211+0000","last_active":"2023-10-06T10:59:06.503121+0000","last_peered":"2023-10-06T10:59:06.503121+0000","last_clean":"2023-10-06T10:59:06.503121+0000","last_became_active":"2023-10-06T10:59:01.417924+0000","last_became_peered":"2023-10-06T10:59:01.417924+0000","last_unstale":"2023-10-06T10:59:06.503121+0000","last_undegraded":"2023-10-06T10:59:06.503121+0000","last_fullsized":"2023-10-06T10:59:06.503121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:44.340657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493921+0000","last_change":"2023-10-06T10:59:02.446135+0000","last_active":"2023-10-06T10:59:06.493921+0000","last_peered":"2023-10-06T10:59:06.493921+0000","last_clean":"2023-10-06T10:59:06.493921+0000","last_became_active":"2023-10-06T10:59:02.445893+0000","last_became_peered":"2023-10-06T10:59:02.445893+0000","last_unstale":"2023-10-06T10:59:06.493921+0000","last_undegraded":"2023-10-06T10:59:06.493921+0000","last_fullsized":"2023-10-06T10:59:06.493921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:38.092745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513350+0000","last_change":"2023-10-06T10:59:06.508048+0000","last_active":"2023-10-06T10:59:06.513350+0000","last_peered":"2023-10-06T10:59:06.513350+0000","last_clean":"2023-10-06T10:59:06.513350+0000","last_became_active":"2023-10-06T10:59:06.507619+0000","last_became_peered":"2023-10-06T10:59:06.507619+0000","last_unstale":"2023-10-06T10:59:06.513350+0000","last_undegraded":"2023-10-06T10:59:06.513350+0000","last_fullsized":"2023-10-06T10:59:06.513350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:26:48.345083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.500810+0000","last_change":"2023-10-06T10:59:01.407912+0000","last_active":"2023-10-06T10:59:06.500810+0000","last_peered":"2023-10-06T10:59:06.500810+0000","last_clean":"2023-10-06T10:59:06.500810+0000","last_became_active":"2023-10-06T10:59:01.407345+0000","last_became_peered":"2023-10-06T10:59:01.407345+0000","last_unstale":"2023-10-06T10:59:06.500810+0000","last_undegraded":"2023-10-06T10:59:06.500810+0000","last_fullsized":"2023-10-06T10:59:06.500810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:40.010964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493409+0000","last_change":"2023-10-06T10:59:02.429169+0000","last_active":"2023-10-06T10:59:06.493409+0000","last_peered":"2023-10-06T10:59:06.493409+0000","last_clean":"2023-10-06T10:59:06.493409+0000","last_became_active":"2023-10-06T10:59:02.428497+0000","last_became_peered":"2023-10-06T10:59:02.428497+0000","last_unstale":"2023-10-06T10:59:06.493409+0000","last_undegraded":"2023-10-06T10:59:06.493409+0000","last_fullsized":"2023-10-06T10:59:06.493409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:36.050017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514019+0000","last_change":"2023-10-06T10:59:06.509198+0000","last_active":"2023-10-06T10:59:06.514019+0000","last_peered":"2023-10-06T10:59:06.514019+0000","last_clean":"2023-10-06T10:59:06.514019+0000","last_became_active":"2023-10-06T10:59:06.508723+0000","last_became_peered":"2023-10-06T10:59:06.508723+0000","last_unstale":"2023-10-06T10:59:06.514019+0000","last_undegraded":"2023-10-06T10:59:06.514019+0000","last_fullsized":"2023-10-06T10:59:06.514019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:00.501898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501932+0000","last_change":"2023-10-06T10:59:01.417026+0000","last_active":"2023-10-06T10:59:06.501932+0000","last_peered":"2023-10-06T10:59:06.501932+0000","last_clean":"2023-10-06T10:59:06.501932+0000","last_became_active":"2023-10-06T10:59:01.416734+0000","last_became_peered":"2023-10-06T10:59:01.416734+0000","last_unstale":"2023-10-06T10:59:06.501932+0000","last_undegraded":"2023-10-06T10:59:06.501932+0000","last_fullsized":"2023-10-06T10:59:06.501932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:05:13.017527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504438+0000","last_change":"2023-10-06T10:59:02.437995+0000","last_active":"2023-10-06T10:59:06.504438+0000","last_peered":"2023-10-06T10:59:06.504438+0000","last_clean":"2023-10-06T10:59:06.504438+0000","last_became_active":"2023-10-06T10:59:02.437537+0000","last_became_peered":"2023-10-06T10:59:02.437537+0000","last_unstale":"2023-10-06T10:59:06.504438+0000","last_undegraded":"2023-10-06T10:59:06.504438+0000","last_fullsized":"2023-10-06T10:59:06.504438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:53.107388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.510983+0000","last_change":"2023-10-06T10:59:06.505596+0000","last_active":"2023-10-06T10:59:06.510983+0000","last_peered":"2023-10-06T10:59:06.510983+0000","last_clean":"2023-10-06T10:59:06.510983+0000","last_became_active":"2023-10-06T10:59:06.505171+0000","last_became_peered":"2023-10-06T10:59:06.505171+0000","last_unstale":"2023-10-06T10:59:06.510983+0000","last_undegraded":"2023-10-06T10:59:06.510983+0000","last_fullsized":"2023-10-06T10:59:06.510983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:43.846344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485606+0000","last_change":"2023-10-06T10:59:01.407896+0000","last_active":"2023-10-06T10:59:06.485606+0000","last_peered":"2023-10-06T10:59:06.485606+0000","last_clean":"2023-10-06T10:59:06.485606+0000","last_became_active":"2023-10-06T10:59:01.407443+0000","last_became_peered":"2023-10-06T10:59:01.407443+0000","last_unstale":"2023-10-06T10:59:06.485606+0000","last_undegraded":"2023-10-06T10:59:06.485606+0000","last_fullsized":"2023-10-06T10:59:06.485606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:08.334923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494412+0000","last_change":"2023-10-06T10:59:02.434282+0000","last_active":"2023-10-06T10:59:06.494412+0000","last_peered":"2023-10-06T10:59:06.494412+0000","last_clean":"2023-10-06T10:59:06.494412+0000","last_became_active":"2023-10-06T10:59:02.433977+0000","last_became_peered":"2023-10-06T10:59:02.433977+0000","last_unstale":"2023-10-06T10:59:06.494412+0000","last_undegraded":"2023-10-06T10:59:06.494412+0000","last_fullsized":"2023-10-06T10:59:06.494412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.517644+0000","last_change":"2023-10-06T10:59:06.516059+0000","last_active":"2023-10-06T10:59:06.517644+0000","last_peered":"2023-10-06T10:59:06.517644+0000","last_clean":"2023-10-06T10:59:06.517644+0000","last_became_active":"2023-10-06T10:59:06.515669+0000","last_became_peered":"2023-10-06T10:59:06.515669+0000","last_unstale":"2023-10-06T10:59:06.517644+0000","last_undegraded":"2023-10-06T10:59:06.517644+0000","last_fullsized":"2023-10-06T10:59:06.517644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:52:08.979101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.505660+0000","last_change":"2023-10-06T10:59:01.417634+0000","last_active":"2023-10-06T10:59:06.505660+0000","last_peered":"2023-10-06T10:59:06.505660+0000","last_clean":"2023-10-06T10:59:06.505660+0000","last_became_active":"2023-10-06T10:59:01.417355+0000","last_became_peered":"2023-10-06T10:59:01.417355+0000","last_unstale":"2023-10-06T10:59:06.505660+0000","last_undegraded":"2023-10-06T10:59:06.505660+0000","last_fullsized":"2023-10-06T10:59:06.505660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:19.433940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492678+0000","last_change":"2023-10-06T10:59:02.428141+0000","last_active":"2023-10-06T10:59:06.492678+0000","last_peered":"2023-10-06T10:59:06.492678+0000","last_clean":"2023-10-06T10:59:06.492678+0000","last_became_active":"2023-10-06T10:59:02.427848+0000","last_became_peered":"2023-10-06T10:59:02.427848+0000","last_unstale":"2023-10-06T10:59:06.492678+0000","last_undegraded":"2023-10-06T10:59:06.492678+0000","last_fullsized":"2023-10-06T10:59:06.492678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:56.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513719+0000","last_change":"2023-10-06T10:59:06.510996+0000","last_active":"2023-10-06T10:59:06.513719+0000","last_peered":"2023-10-06T10:59:06.513719+0000","last_clean":"2023-10-06T10:59:06.513719+0000","last_became_active":"2023-10-06T10:59:06.510585+0000","last_became_peered":"2023-10-06T10:59:06.510585+0000","last_unstale":"2023-10-06T10:59:06.513719+0000","last_undegraded":"2023-10-06T10:59:06.513719+0000","last_fullsized":"2023-10-06T10:59:06.513719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:21.184059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503478+0000","last_change":"2023-10-06T10:59:01.411248+0000","last_active":"2023-10-06T10:59:06.503478+0000","last_peered":"2023-10-06T10:59:06.503478+0000","last_clean":"2023-10-06T10:59:06.503478+0000","last_became_active":"2023-10-06T10:59:01.410969+0000","last_became_peered":"2023-10-06T10:59:01.410969+0000","last_unstale":"2023-10-06T10:59:06.503478+0000","last_undegraded":"2023-10-06T10:59:06.503478+0000","last_fullsized":"2023-10-06T10:59:06.503478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:39.400891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486641+0000","last_change":"2023-10-06T10:59:02.419362+0000","last_active":"2023-10-06T10:59:06.486641+0000","last_peered":"2023-10-06T10:59:06.486641+0000","last_clean":"2023-10-06T10:59:06.486641+0000","last_became_active":"2023-10-06T10:59:02.419038+0000","last_became_peered":"2023-10-06T10:59:02.419038+0000","last_unstale":"2023-10-06T10:59:06.486641+0000","last_undegraded":"2023-10-06T10:59:06.486641+0000","last_fullsized":"2023-10-06T10:59:06.486641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:31.081513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516460+0000","last_change":"2023-10-06T10:59:06.515261+0000","last_active":"2023-10-06T10:59:06.516460+0000","last_peered":"2023-10-06T10:59:06.516460+0000","last_clean":"2023-10-06T10:59:06.516460+0000","last_became_active":"2023-10-06T10:59:06.514809+0000","last_became_peered":"2023-10-06T10:59:06.514809+0000","last_unstale":"2023-10-06T10:59:06.516460+0000","last_undegraded":"2023-10-06T10:59:06.516460+0000","last_fullsized":"2023-10-06T10:59:06.516460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:57.195363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503300+0000","last_change":"2023-10-06T10:59:01.411278+0000","last_active":"2023-10-06T10:59:06.503300+0000","last_peered":"2023-10-06T10:59:06.503300+0000","last_clean":"2023-10-06T10:59:06.503300+0000","last_became_active":"2023-10-06T10:59:01.410987+0000","last_became_peered":"2023-10-06T10:59:01.410987+0000","last_unstale":"2023-10-06T10:59:06.503300+0000","last_undegraded":"2023-10-06T10:59:06.503300+0000","last_fullsized":"2023-10-06T10:59:06.503300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:32:19.710733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485812+0000","last_change":"2023-10-06T10:59:02.435246+0000","last_active":"2023-10-06T10:59:06.485812+0000","last_peered":"2023-10-06T10:59:06.485812+0000","last_clean":"2023-10-06T10:59:06.485812+0000","last_became_active":"2023-10-06T10:59:02.434939+0000","last_became_peered":"2023-10-06T10:59:02.434939+0000","last_unstale":"2023-10-06T10:59:06.485812+0000","last_undegraded":"2023-10-06T10:59:06.485812+0000","last_fullsized":"2023-10-06T10:59:06.485812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:05:14.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513726+0000","last_change":"2023-10-06T10:59:06.511803+0000","last_active":"2023-10-06T10:59:06.513726+0000","last_peered":"2023-10-06T10:59:06.513726+0000","last_clean":"2023-10-06T10:59:06.513726+0000","last_became_active":"2023-10-06T10:59:06.511080+0000","last_became_peered":"2023-10-06T10:59:06.511080+0000","last_unstale":"2023-10-06T10:59:06.513726+0000","last_undegraded":"2023-10-06T10:59:06.513726+0000","last_fullsized":"2023-10-06T10:59:06.513726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:27.869916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492883+0000","last_change":"2023-10-06T10:59:01.414476+0000","last_active":"2023-10-06T10:59:06.492883+0000","last_peered":"2023-10-06T10:59:06.492883+0000","last_clean":"2023-10-06T10:59:06.492883+0000","last_became_active":"2023-10-06T10:59:01.414242+0000","last_became_peered":"2023-10-06T10:59:01.414242+0000","last_unstale":"2023-10-06T10:59:06.492883+0000","last_undegraded":"2023-10-06T10:59:06.492883+0000","last_fullsized":"2023-10-06T10:59:06.492883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501421+0000","last_change":"2023-10-06T10:59:02.436874+0000","last_active":"2023-10-06T10:59:06.501421+0000","last_peered":"2023-10-06T10:59:06.501421+0000","last_clean":"2023-10-06T10:59:06.501421+0000","last_became_active":"2023-10-06T10:59:02.435358+0000","last_became_peered":"2023-10-06T10:59:02.435358+0000","last_unstale":"2023-10-06T10:59:06.501421+0000","last_undegraded":"2023-10-06T10:59:06.501421+0000","last_fullsized":"2023-10-06T10:59:06.501421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:31.081513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514473+0000","last_change":"2023-10-06T10:59:06.513646+0000","last_active":"2023-10-06T10:59:06.514473+0000","last_peered":"2023-10-06T10:59:06.514473+0000","last_clean":"2023-10-06T10:59:06.514473+0000","last_became_active":"2023-10-06T10:59:06.511423+0000","last_became_peered":"2023-10-06T10:59:06.511423+0000","last_unstale":"2023-10-06T10:59:06.514473+0000","last_undegraded":"2023-10-06T10:59:06.514473+0000","last_fullsized":"2023-10-06T10:59:06.514473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:37.882998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493353+0000","last_change":"2023-10-06T10:59:01.411242+0000","last_active":"2023-10-06T10:59:06.493353+0000","last_peered":"2023-10-06T10:59:06.493353+0000","last_clean":"2023-10-06T10:59:06.493353+0000","last_became_active":"2023-10-06T10:59:01.410924+0000","last_became_peered":"2023-10-06T10:59:01.410924+0000","last_unstale":"2023-10-06T10:59:06.493353+0000","last_undegraded":"2023-10-06T10:59:06.493353+0000","last_fullsized":"2023-10-06T10:59:06.493353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:00.499256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486649+0000","last_change":"2023-10-06T10:59:02.435108+0000","last_active":"2023-10-06T10:59:06.486649+0000","last_peered":"2023-10-06T10:59:06.486649+0000","last_clean":"2023-10-06T10:59:06.486649+0000","last_became_active":"2023-10-06T10:59:02.434852+0000","last_became_peered":"2023-10-06T10:59:02.434852+0000","last_unstale":"2023-10-06T10:59:06.486649+0000","last_undegraded":"2023-10-06T10:59:06.486649+0000","last_fullsized":"2023-10-06T10:59:06.486649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:17.384456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.506844+0000","last_change":"2023-10-06T10:59:06.502413+0000","last_active":"2023-10-06T10:59:06.506844+0000","last_peered":"2023-10-06T10:59:06.506844+0000","last_clean":"2023-10-06T10:59:06.506844+0000","last_became_active":"2023-10-06T10:59:06.501975+0000","last_became_peered":"2023-10-06T10:59:06.501975+0000","last_unstale":"2023-10-06T10:59:06.506844+0000","last_undegraded":"2023-10-06T10:59:06.506844+0000","last_fullsized":"2023-10-06T10:59:06.506844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:43.846344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485900+0000","last_change":"2023-10-06T10:59:01.419087+0000","last_active":"2023-10-06T10:59:06.485900+0000","last_peered":"2023-10-06T10:59:06.485900+0000","last_clean":"2023-10-06T10:59:06.485900+0000","last_became_active":"2023-10-06T10:59:01.418650+0000","last_became_peered":"2023-10-06T10:59:01.418650+0000","last_unstale":"2023-10-06T10:59:06.485900+0000","last_undegraded":"2023-10-06T10:59:06.485900+0000","last_fullsized":"2023-10-06T10:59:06.485900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488263+0000","last_change":"2023-10-06T10:59:02.418122+0000","last_active":"2023-10-06T10:59:06.488263+0000","last_peered":"2023-10-06T10:59:06.488263+0000","last_clean":"2023-10-06T10:59:06.488263+0000","last_became_active":"2023-10-06T10:59:02.417375+0000","last_became_peered":"2023-10-06T10:59:02.417375+0000","last_unstale":"2023-10-06T10:59:06.488263+0000","last_undegraded":"2023-10-06T10:59:06.488263+0000","last_fullsized":"2023-10-06T10:59:06.488263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513139+0000","last_change":"2023-10-06T10:59:06.507077+0000","last_active":"2023-10-06T10:59:06.513139+0000","last_peered":"2023-10-06T10:59:06.513139+0000","last_clean":"2023-10-06T10:59:06.513139+0000","last_became_active":"2023-10-06T10:59:06.506613+0000","last_became_peered":"2023-10-06T10:59:06.506613+0000","last_unstale":"2023-10-06T10:59:06.513139+0000","last_undegraded":"2023-10-06T10:59:06.513139+0000","last_fullsized":"2023-10-06T10:59:06.513139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:18.864841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486454+0000","last_change":"2023-10-06T10:59:01.407028+0000","last_active":"2023-10-06T10:59:06.486454+0000","last_peered":"2023-10-06T10:59:06.486454+0000","last_clean":"2023-10-06T10:59:06.486454+0000","last_became_active":"2023-10-06T10:59:01.406571+0000","last_became_peered":"2023-10-06T10:59:01.406571+0000","last_unstale":"2023-10-06T10:59:06.486454+0000","last_undegraded":"2023-10-06T10:59:06.486454+0000","last_fullsized":"2023-10-06T10:59:06.486454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:08.334923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487914+0000","last_change":"2023-10-06T10:59:02.419692+0000","last_active":"2023-10-06T10:59:06.487914+0000","last_peered":"2023-10-06T10:59:06.487914+0000","last_clean":"2023-10-06T10:59:06.487914+0000","last_became_active":"2023-10-06T10:59:02.419394+0000","last_became_peered":"2023-10-06T10:59:02.419394+0000","last_unstale":"2023-10-06T10:59:06.487914+0000","last_undegraded":"2023-10-06T10:59:06.487914+0000","last_fullsized":"2023-10-06T10:59:06.487914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:23.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511521+0000","last_change":"2023-10-06T10:59:06.506565+0000","last_active":"2023-10-06T10:59:06.511521+0000","last_peered":"2023-10-06T10:59:06.511521+0000","last_clean":"2023-10-06T10:59:06.511521+0000","last_became_active":"2023-10-06T10:59:06.506131+0000","last_became_peered":"2023-10-06T10:59:06.506131+0000","last_unstale":"2023-10-06T10:59:06.511521+0000","last_undegraded":"2023-10-06T10:59:06.511521+0000","last_fullsized":"2023-10-06T10:59:06.511521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:15:42.861403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493594+0000","last_change":"2023-10-06T10:59:01.417797+0000","last_active":"2023-10-06T10:59:06.493594+0000","last_peered":"2023-10-06T10:59:06.493594+0000","last_clean":"2023-10-06T10:59:06.493594+0000","last_became_active":"2023-10-06T10:59:01.416920+0000","last_became_peered":"2023-10-06T10:59:01.416920+0000","last_unstale":"2023-10-06T10:59:06.493594+0000","last_undegraded":"2023-10-06T10:59:06.493594+0000","last_fullsized":"2023-10-06T10:59:06.493594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:40.010964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487484+0000","last_change":"2023-10-06T10:59:02.435810+0000","last_active":"2023-10-06T10:59:06.487484+0000","last_peered":"2023-10-06T10:59:06.487484+0000","last_clean":"2023-10-06T10:59:06.487484+0000","last_became_active":"2023-10-06T10:59:02.435540+0000","last_became_peered":"2023-10-06T10:59:02.435540+0000","last_unstale":"2023-10-06T10:59:06.487484+0000","last_undegraded":"2023-10-06T10:59:06.487484+0000","last_fullsized":"2023-10-06T10:59:06.487484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:23.772944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513384+0000","last_change":"2023-10-06T10:59:06.509833+0000","last_active":"2023-10-06T10:59:06.513384+0000","last_peered":"2023-10-06T10:59:06.513384+0000","last_clean":"2023-10-06T10:59:06.513384+0000","last_became_active":"2023-10-06T10:59:06.508637+0000","last_became_peered":"2023-10-06T10:59:06.508637+0000","last_unstale":"2023-10-06T10:59:06.513384+0000","last_undegraded":"2023-10-06T10:59:06.513384+0000","last_fullsized":"2023-10-06T10:59:06.513384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:46:49.548101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.494181+0000","last_change":"2023-10-06T10:59:01.415343+0000","last_active":"2023-10-06T10:59:06.494181+0000","last_peered":"2023-10-06T10:59:06.494181+0000","last_clean":"2023-10-06T10:59:06.494181+0000","last_became_active":"2023-10-06T10:59:01.414933+0000","last_became_peered":"2023-10-06T10:59:01.414933+0000","last_unstale":"2023-10-06T10:59:06.494181+0000","last_undegraded":"2023-10-06T10:59:06.494181+0000","last_fullsized":"2023-10-06T10:59:06.494181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:23:07.954687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488471+0000","last_change":"2023-10-06T10:58:56.328381+0000","last_active":"2023-10-06T10:59:06.488471+0000","last_peered":"2023-10-06T10:59:06.488471+0000","last_clean":"2023-10-06T10:59:06.488471+0000","last_became_active":"2023-10-06T10:58:56.328054+0000","last_became_peered":"2023-10-06T10:58:56.328054+0000","last_unstale":"2023-10-06T10:59:06.488471+0000","last_undegraded":"2023-10-06T10:59:06.488471+0000","last_fullsized":"2023-10-06T10:59:06.488471+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493494+0000","last_change":"2023-10-06T10:59:02.429942+0000","last_active":"2023-10-06T10:59:06.493494+0000","last_peered":"2023-10-06T10:59:06.493494+0000","last_clean":"2023-10-06T10:59:06.493494+0000","last_became_active":"2023-10-06T10:59:02.429646+0000","last_became_peered":"2023-10-06T10:59:02.429646+0000","last_unstale":"2023-10-06T10:59:06.493494+0000","last_undegraded":"2023-10-06T10:59:06.493494+0000","last_fullsized":"2023-10-06T10:59:06.493494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:28.040180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.506117+0000","last_change":"2023-10-06T10:59:06.502679+0000","last_active":"2023-10-06T10:59:06.506117+0000","last_peered":"2023-10-06T10:59:06.506117+0000","last_clean":"2023-10-06T10:59:06.506117+0000","last_became_active":"2023-10-06T10:59:06.502273+0000","last_became_peered":"2023-10-06T10:59:06.502273+0000","last_unstale":"2023-10-06T10:59:06.506117+0000","last_undegraded":"2023-10-06T10:59:06.506117+0000","last_fullsized":"2023-10-06T10:59:06.506117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:14:44.651801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493821+0000","last_change":"2023-10-06T10:58:56.326189+0000","last_active":"2023-10-06T10:59:06.493821+0000","last_peered":"2023-10-06T10:59:06.493821+0000","last_clean":"2023-10-06T10:59:06.493821+0000","last_became_active":"2023-10-06T10:58:56.325852+0000","last_became_peered":"2023-10-06T10:58:56.325852+0000","last_unstale":"2023-10-06T10:59:06.493821+0000","last_undegraded":"2023-10-06T10:59:06.493821+0000","last_fullsized":"2023-10-06T10:59:06.493821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:28.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516357+0000","last_change":"2023-10-06T10:59:01.411178+0000","last_active":"2023-10-06T10:59:06.516357+0000","last_peered":"2023-10-06T10:59:06.516357+0000","last_clean":"2023-10-06T10:59:06.516357+0000","last_became_active":"2023-10-06T10:59:01.410703+0000","last_became_peered":"2023-10-06T10:59:01.410703+0000","last_unstale":"2023-10-06T10:59:06.516357+0000","last_undegraded":"2023-10-06T10:59:06.516357+0000","last_fullsized":"2023-10-06T10:59:06.516357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:50.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486551+0000","last_change":"2023-10-06T10:59:02.425180+0000","last_active":"2023-10-06T10:59:06.486551+0000","last_peered":"2023-10-06T10:59:06.486551+0000","last_clean":"2023-10-06T10:59:06.486551+0000","last_became_active":"2023-10-06T10:59:02.424767+0000","last_became_peered":"2023-10-06T10:59:02.424767+0000","last_unstale":"2023-10-06T10:59:06.486551+0000","last_undegraded":"2023-10-06T10:59:06.486551+0000","last_fullsized":"2023-10-06T10:59:06.486551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:33.795023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.503741+0000","last_change":"2023-10-06T10:59:06.501263+0000","last_active":"2023-10-06T10:59:06.503741+0000","last_peered":"2023-10-06T10:59:06.503741+0000","last_clean":"2023-10-06T10:59:06.503741+0000","last_became_active":"2023-10-06T10:59:06.500784+0000","last_became_peered":"2023-10-06T10:59:06.500784+0000","last_unstale":"2023-10-06T10:59:06.503741+0000","last_undegraded":"2023-10-06T10:59:06.503741+0000","last_fullsized":"2023-10-06T10:59:06.503741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:49.205787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486205+0000","last_change":"2023-10-06T10:58:56.325363+0000","last_active":"2023-10-06T10:59:06.486205+0000","last_peered":"2023-10-06T10:59:06.486205+0000","last_clean":"2023-10-06T10:59:06.486205+0000","last_became_active":"2023-10-06T10:58:56.325095+0000","last_became_peered":"2023-10-06T10:58:56.325095+0000","last_unstale":"2023-10-06T10:59:06.486205+0000","last_undegraded":"2023-10-06T10:59:06.486205+0000","last_fullsized":"2023-10-06T10:59:06.486205+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501704+0000","last_change":"2023-10-06T10:58:57.328525+0000","last_active":"2023-10-06T10:59:06.501704+0000","last_peered":"2023-10-06T10:59:06.501704+0000","last_clean":"2023-10-06T10:59:06.501704+0000","last_became_active":"2023-10-06T10:58:57.327509+0000","last_became_peered":"2023-10-06T10:58:57.327509+0000","last_unstale":"2023-10-06T10:59:06.501704+0000","last_undegraded":"2023-10-06T10:59:06.501704+0000","last_fullsized":"2023-10-06T10:59:06.501704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_clean_scrub_stamp":"2023-10-06T10:58:56.314996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:45.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501654+0000","last_change":"2023-10-06T10:59:01.415927+0000","last_active":"2023-10-06T10:59:06.501654+0000","last_peered":"2023-10-06T10:59:06.501654+0000","last_clean":"2023-10-06T10:59:06.501654+0000","last_became_active":"2023-10-06T10:59:01.415660+0000","last_became_peered":"2023-10-06T10:59:01.415660+0000","last_unstale":"2023-10-06T10:59:06.501654+0000","last_undegraded":"2023-10-06T10:59:06.501654+0000","last_fullsized":"2023-10-06T10:59:06.501654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:07.977576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504353+0000","last_change":"2023-10-06T10:59:02.435783+0000","last_active":"2023-10-06T10:59:06.504353+0000","last_peered":"2023-10-06T10:59:06.504353+0000","last_clean":"2023-10-06T10:59:06.504353+0000","last_became_active":"2023-10-06T10:59:02.435445+0000","last_became_peered":"2023-10-06T10:59:02.435445+0000","last_unstale":"2023-10-06T10:59:06.504353+0000","last_undegraded":"2023-10-06T10:59:06.504353+0000","last_fullsized":"2023-10-06T10:59:06.504353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:40.197836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516018+0000","last_change":"2023-10-06T10:59:06.514112+0000","last_active":"2023-10-06T10:59:06.516018+0000","last_peered":"2023-10-06T10:59:06.516018+0000","last_clean":"2023-10-06T10:59:06.516018+0000","last_became_active":"2023-10-06T10:59:06.513425+0000","last_became_peered":"2023-10-06T10:59:06.513425+0000","last_unstale":"2023-10-06T10:59:06.516018+0000","last_undegraded":"2023-10-06T10:59:06.516018+0000","last_fullsized":"2023-10-06T10:59:06.516018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:35.463907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501411+0000","last_change":"2023-10-06T10:58:56.331567+0000","last_active":"2023-10-06T10:59:06.501411+0000","last_peered":"2023-10-06T10:59:06.501411+0000","last_clean":"2023-10-06T10:59:06.501411+0000","last_became_active":"2023-10-06T10:58:56.331244+0000","last_became_peered":"2023-10-06T10:58:56.331244+0000","last_unstale":"2023-10-06T10:59:06.501411+0000","last_undegraded":"2023-10-06T10:59:06.501411+0000","last_fullsized":"2023-10-06T10:59:06.501411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486388+0000","last_change":"2023-10-06T10:59:01.401314+0000","last_active":"2023-10-06T10:59:06.486388+0000","last_peered":"2023-10-06T10:59:06.486388+0000","last_clean":"2023-10-06T10:59:06.486388+0000","last_became_active":"2023-10-06T10:59:01.400645+0000","last_became_peered":"2023-10-06T10:59:01.400645+0000","last_unstale":"2023-10-06T10:59:06.486388+0000","last_undegraded":"2023-10-06T10:59:06.486388+0000","last_fullsized":"2023-10-06T10:59:06.486388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:02.802656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487378+0000","last_change":"2023-10-06T10:59:02.433907+0000","last_active":"2023-10-06T10:59:06.487378+0000","last_peered":"2023-10-06T10:59:06.487378+0000","last_clean":"2023-10-06T10:59:06.487378+0000","last_became_active":"2023-10-06T10:59:02.430274+0000","last_became_peered":"2023-10-06T10:59:02.430274+0000","last_unstale":"2023-10-06T10:59:06.487378+0000","last_undegraded":"2023-10-06T10:59:06.487378+0000","last_fullsized":"2023-10-06T10:59:06.487378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:17.286697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516658+0000","last_change":"2023-10-06T10:59:06.515095+0000","last_active":"2023-10-06T10:59:06.516658+0000","last_peered":"2023-10-06T10:59:06.516658+0000","last_clean":"2023-10-06T10:59:06.516658+0000","last_became_active":"2023-10-06T10:59:06.514669+0000","last_became_peered":"2023-10-06T10:59:06.514669+0000","last_unstale":"2023-10-06T10:59:06.516658+0000","last_undegraded":"2023-10-06T10:59:06.516658+0000","last_fullsized":"2023-10-06T10:59:06.516658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:49.205787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501486+0000","last_change":"2023-10-06T10:58:56.332184+0000","last_active":"2023-10-06T10:59:06.501486+0000","last_peered":"2023-10-06T10:59:06.501486+0000","last_clean":"2023-10-06T10:59:06.501486+0000","last_became_active":"2023-10-06T10:58:56.331830+0000","last_became_peered":"2023-10-06T10:58:56.331830+0000","last_unstale":"2023-10-06T10:59:06.501486+0000","last_undegraded":"2023-10-06T10:59:06.501486+0000","last_fullsized":"2023-10-06T10:59:06.501486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:54:02.320834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493508+0000","last_change":"2023-10-06T10:59:01.414711+0000","last_active":"2023-10-06T10:59:06.493508+0000","last_peered":"2023-10-06T10:59:06.493508+0000","last_clean":"2023-10-06T10:59:06.493508+0000","last_became_active":"2023-10-06T10:59:01.414409+0000","last_became_peered":"2023-10-06T10:59:01.414409+0000","last_unstale":"2023-10-06T10:59:06.493508+0000","last_undegraded":"2023-10-06T10:59:06.493508+0000","last_fullsized":"2023-10-06T10:59:06.493508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:44.340657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486245+0000","last_change":"2023-10-06T10:59:02.424669+0000","last_active":"2023-10-06T10:59:06.486245+0000","last_peered":"2023-10-06T10:59:06.486245+0000","last_clean":"2023-10-06T10:59:06.486245+0000","last_became_active":"2023-10-06T10:59:02.424353+0000","last_became_peered":"2023-10-06T10:59:02.424353+0000","last_unstale":"2023-10-06T10:59:06.486245+0000","last_undegraded":"2023-10-06T10:59:06.486245+0000","last_fullsized":"2023-10-06T10:59:06.486245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:17.558201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514130+0000","last_change":"2023-10-06T10:59:06.504921+0000","last_active":"2023-10-06T10:59:06.514130+0000","last_peered":"2023-10-06T10:59:06.514130+0000","last_clean":"2023-10-06T10:59:06.514130+0000","last_became_active":"2023-10-06T10:59:06.501375+0000","last_became_peered":"2023-10-06T10:59:06.501375+0000","last_unstale":"2023-10-06T10:59:06.514130+0000","last_undegraded":"2023-10-06T10:59:06.514130+0000","last_fullsized":"2023-10-06T10:59:06.514130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:29.878658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493427+0000","last_change":"2023-10-06T10:58:56.331654+0000","last_active":"2023-10-06T10:59:06.493427+0000","last_peered":"2023-10-06T10:59:06.493427+0000","last_clean":"2023-10-06T10:59:06.493427+0000","last_became_active":"2023-10-06T10:58:56.331345+0000","last_became_peered":"2023-10-06T10:58:56.331345+0000","last_unstale":"2023-10-06T10:59:06.493427+0000","last_undegraded":"2023-10-06T10:59:06.493427+0000","last_fullsized":"2023-10-06T10:59:06.493427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488547+0000","last_change":"2023-10-06T10:59:01.416484+0000","last_active":"2023-10-06T10:59:06.488547+0000","last_peered":"2023-10-06T10:59:06.488547+0000","last_clean":"2023-10-06T10:59:06.488547+0000","last_became_active":"2023-10-06T10:59:01.416159+0000","last_became_peered":"2023-10-06T10:59:01.416159+0000","last_unstale":"2023-10-06T10:59:06.488547+0000","last_undegraded":"2023-10-06T10:59:06.488547+0000","last_fullsized":"2023-10-06T10:59:06.488547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:19.192242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486436+0000","last_change":"2023-10-06T10:59:02.419009+0000","last_active":"2023-10-06T10:59:06.486436+0000","last_peered":"2023-10-06T10:59:06.486436+0000","last_clean":"2023-10-06T10:59:06.486436+0000","last_became_active":"2023-10-06T10:59:02.418715+0000","last_became_peered":"2023-10-06T10:59:02.418715+0000","last_unstale":"2023-10-06T10:59:06.486436+0000","last_undegraded":"2023-10-06T10:59:06.486436+0000","last_fullsized":"2023-10-06T10:59:06.486436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:20.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.514101+0000","last_change":"2023-10-06T10:59:06.504749+0000","last_active":"2023-10-06T10:59:06.514101+0000","last_peered":"2023-10-06T10:59:06.514101+0000","last_clean":"2023-10-06T10:59:06.514101+0000","last_became_active":"2023-10-06T10:59:06.504360+0000","last_became_peered":"2023-10-06T10:59:06.504360+0000","last_unstale":"2023-10-06T10:59:06.514101+0000","last_undegraded":"2023-10-06T10:59:06.514101+0000","last_fullsized":"2023-10-06T10:59:06.514101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:37.882998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486520+0000","last_change":"2023-10-06T10:58:56.331650+0000","last_active":"2023-10-06T10:59:06.486520+0000","last_peered":"2023-10-06T10:59:06.486520+0000","last_clean":"2023-10-06T10:59:06.486520+0000","last_became_active":"2023-10-06T10:58:56.331344+0000","last_became_peered":"2023-10-06T10:58:56.331344+0000","last_unstale":"2023-10-06T10:59:06.486520+0000","last_undegraded":"2023-10-06T10:59:06.486520+0000","last_fullsized":"2023-10-06T10:59:06.486520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:45.584545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486640+0000","last_change":"2023-10-06T10:59:01.405750+0000","last_active":"2023-10-06T10:59:06.486640+0000","last_peered":"2023-10-06T10:59:06.486640+0000","last_clean":"2023-10-06T10:59:06.486640+0000","last_became_active":"2023-10-06T10:59:01.403128+0000","last_became_peered":"2023-10-06T10:59:01.403128+0000","last_unstale":"2023-10-06T10:59:06.486640+0000","last_undegraded":"2023-10-06T10:59:06.486640+0000","last_fullsized":"2023-10-06T10:59:06.486640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:41.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501123+0000","last_change":"2023-10-06T10:59:02.427758+0000","last_active":"2023-10-06T10:59:06.501123+0000","last_peered":"2023-10-06T10:59:06.501123+0000","last_clean":"2023-10-06T10:59:06.501123+0000","last_became_active":"2023-10-06T10:59:02.427472+0000","last_became_peered":"2023-10-06T10:59:02.427472+0000","last_unstale":"2023-10-06T10:59:06.501123+0000","last_undegraded":"2023-10-06T10:59:06.501123+0000","last_fullsized":"2023-10-06T10:59:06.501123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:23.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.513991+0000","last_change":"2023-10-06T10:59:06.505716+0000","last_active":"2023-10-06T10:59:06.513991+0000","last_peered":"2023-10-06T10:59:06.513991+0000","last_clean":"2023-10-06T10:59:06.513991+0000","last_became_active":"2023-10-06T10:59:06.505243+0000","last_became_peered":"2023-10-06T10:59:06.505243+0000","last_unstale":"2023-10-06T10:59:06.513991+0000","last_undegraded":"2023-10-06T10:59:06.513991+0000","last_fullsized":"2023-10-06T10:59:06.513991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:56.480286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.487451+0000","last_change":"2023-10-06T10:58:56.326315+0000","last_active":"2023-10-06T10:59:06.487451+0000","last_peered":"2023-10-06T10:59:06.487451+0000","last_clean":"2023-10-06T10:59:06.487451+0000","last_became_active":"2023-10-06T10:58:56.325897+0000","last_became_peered":"2023-10-06T10:58:56.325897+0000","last_unstale":"2023-10-06T10:59:06.487451+0000","last_undegraded":"2023-10-06T10:59:06.487451+0000","last_fullsized":"2023-10-06T10:59:06.487451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493235+0000","last_change":"2023-10-06T10:59:01.416023+0000","last_active":"2023-10-06T10:59:06.493235+0000","last_peered":"2023-10-06T10:59:06.493235+0000","last_clean":"2023-10-06T10:59:06.493235+0000","last_became_active":"2023-10-06T10:59:01.415727+0000","last_became_peered":"2023-10-06T10:59:01.415727+0000","last_unstale":"2023-10-06T10:59:06.493235+0000","last_undegraded":"2023-10-06T10:59:06.493235+0000","last_fullsized":"2023-10-06T10:59:06.493235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:40.010964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485839+0000","last_change":"2023-10-06T10:59:02.427425+0000","last_active":"2023-10-06T10:59:06.485839+0000","last_peered":"2023-10-06T10:59:06.485839+0000","last_clean":"2023-10-06T10:59:06.485839+0000","last_became_active":"2023-10-06T10:59:02.427000+0000","last_became_peered":"2023-10-06T10:59:02.427000+0000","last_unstale":"2023-10-06T10:59:06.485839+0000","last_undegraded":"2023-10-06T10:59:06.485839+0000","last_fullsized":"2023-10-06T10:59:06.485839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:57.482186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.512322+0000","last_change":"2023-10-06T10:59:06.505584+0000","last_active":"2023-10-06T10:59:06.512322+0000","last_peered":"2023-10-06T10:59:06.512322+0000","last_clean":"2023-10-06T10:59:06.512322+0000","last_became_active":"2023-10-06T10:59:06.505152+0000","last_became_peered":"2023-10-06T10:59:06.505152+0000","last_unstale":"2023-10-06T10:59:06.512322+0000","last_undegraded":"2023-10-06T10:59:06.512322+0000","last_fullsized":"2023-10-06T10:59:06.512322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:50.861372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.501237+0000","last_change":"2023-10-06T10:59:01.420277+0000","last_active":"2023-10-06T10:59:06.501237+0000","last_peered":"2023-10-06T10:59:06.501237+0000","last_clean":"2023-10-06T10:59:06.501237+0000","last_became_active":"2023-10-06T10:59:01.419959+0000","last_became_peered":"2023-10-06T10:59:01.419959+0000","last_unstale":"2023-10-06T10:59:06.501237+0000","last_undegraded":"2023-10-06T10:59:06.501237+0000","last_fullsized":"2023-10-06T10:59:06.501237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:19.192242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.498094+0000","last_change":"2023-10-06T10:59:02.420998+0000","last_active":"2023-10-06T10:59:06.498094+0000","last_peered":"2023-10-06T10:59:06.498094+0000","last_clean":"2023-10-06T10:59:06.498094+0000","last_became_active":"2023-10-06T10:59:02.420652+0000","last_became_peered":"2023-10-06T10:59:02.420652+0000","last_unstale":"2023-10-06T10:59:06.498094+0000","last_undegraded":"2023-10-06T10:59:06.498094+0000","last_fullsized":"2023-10-06T10:59:06.498094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:20.197027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.516738+0000","last_change":"2023-10-06T10:59:06.513383+0000","last_active":"2023-10-06T10:59:06.516738+0000","last_peered":"2023-10-06T10:59:06.516738+0000","last_clean":"2023-10-06T10:59:06.516738+0000","last_became_active":"2023-10-06T10:59:06.512919+0000","last_became_peered":"2023-10-06T10:59:06.512919+0000","last_unstale":"2023-10-06T10:59:06.516738+0000","last_undegraded":"2023-10-06T10:59:06.516738+0000","last_fullsized":"2023-10-06T10:59:06.516738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:56.480286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492779+0000","last_change":"2023-10-06T10:59:01.417023+0000","last_active":"2023-10-06T10:59:06.492779+0000","last_peered":"2023-10-06T10:59:06.492779+0000","last_clean":"2023-10-06T10:59:06.492779+0000","last_became_active":"2023-10-06T10:59:01.416742+0000","last_became_peered":"2023-10-06T10:59:01.416742+0000","last_unstale":"2023-10-06T10:59:06.492779+0000","last_undegraded":"2023-10-06T10:59:06.492779+0000","last_fullsized":"2023-10-06T10:59:06.492779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:50.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.488089+0000","last_change":"2023-10-06T10:59:02.435269+0000","last_active":"2023-10-06T10:59:06.488089+0000","last_peered":"2023-10-06T10:59:06.488089+0000","last_clean":"2023-10-06T10:59:06.488089+0000","last_became_active":"2023-10-06T10:59:02.434615+0000","last_became_peered":"2023-10-06T10:59:02.434615+0000","last_unstale":"2023-10-06T10:59:06.488089+0000","last_undegraded":"2023-10-06T10:59:06.488089+0000","last_fullsized":"2023-10-06T10:59:06.488089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:48.645632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.512751+0000","last_change":"2023-10-06T10:59:06.511957+0000","last_active":"2023-10-06T10:59:06.512751+0000","last_peered":"2023-10-06T10:59:06.512751+0000","last_clean":"2023-10-06T10:59:06.512751+0000","last_became_active":"2023-10-06T10:59:06.511470+0000","last_became_peered":"2023-10-06T10:59:06.511470+0000","last_unstale":"2023-10-06T10:59:06.512751+0000","last_undegraded":"2023-10-06T10:59:06.512751+0000","last_fullsized":"2023-10-06T10:59:06.512751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:56.480286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493131+0000","last_change":"2023-10-06T10:59:01.418640+0000","last_active":"2023-10-06T10:59:06.493131+0000","last_peered":"2023-10-06T10:59:06.493131+0000","last_clean":"2023-10-06T10:59:06.493131+0000","last_became_active":"2023-10-06T10:59:01.418365+0000","last_became_peered":"2023-10-06T10:59:01.418365+0000","last_unstale":"2023-10-06T10:59:06.493131+0000","last_undegraded":"2023-10-06T10:59:06.493131+0000","last_fullsized":"2023-10-06T10:59:06.493131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:08.334923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486781+0000","last_change":"2023-10-06T10:59:02.431977+0000","last_active":"2023-10-06T10:59:06.486781+0000","last_peered":"2023-10-06T10:59:06.486781+0000","last_clean":"2023-10-06T10:59:06.486781+0000","last_became_active":"2023-10-06T10:59:02.431706+0000","last_became_peered":"2023-10-06T10:59:02.431706+0000","last_unstale":"2023-10-06T10:59:06.486781+0000","last_undegraded":"2023-10-06T10:59:06.486781+0000","last_fullsized":"2023-10-06T10:59:06.486781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:56.596950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.511641+0000","last_change":"2023-10-06T10:59:06.507385+0000","last_active":"2023-10-06T10:59:06.511641+0000","last_peered":"2023-10-06T10:59:06.511641+0000","last_clean":"2023-10-06T10:59:06.511641+0000","last_became_active":"2023-10-06T10:59:06.506688+0000","last_became_peered":"2023-10-06T10:59:06.506688+0000","last_unstale":"2023-10-06T10:59:06.511641+0000","last_undegraded":"2023-10-06T10:59:06.511641+0000","last_fullsized":"2023-10-06T10:59:06.511641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:27.154530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493578+0000","last_change":"2023-10-06T10:59:01.416098+0000","last_active":"2023-10-06T10:59:06.493578+0000","last_peered":"2023-10-06T10:59:06.493578+0000","last_clean":"2023-10-06T10:59:06.493578+0000","last_became_active":"2023-10-06T10:59:01.415763+0000","last_became_peered":"2023-10-06T10:59:01.415763+0000","last_unstale":"2023-10-06T10:59:06.493578+0000","last_undegraded":"2023-10-06T10:59:06.493578+0000","last_fullsized":"2023-10-06T10:59:06.493578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:03.581242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.492967+0000","last_change":"2023-10-06T10:59:02.440465+0000","last_active":"2023-10-06T10:59:06.492967+0000","last_peered":"2023-10-06T10:59:06.492967+0000","last_clean":"2023-10-06T10:59:06.492967+0000","last_became_active":"2023-10-06T10:59:02.439835+0000","last_became_peered":"2023-10-06T10:59:02.439835+0000","last_unstale":"2023-10-06T10:59:06.492967+0000","last_undegraded":"2023-10-06T10:59:06.492967+0000","last_fullsized":"2023-10-06T10:59:06.492967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:23.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.509823+0000","last_change":"2023-10-06T10:59:06.504483+0000","last_active":"2023-10-06T10:59:06.509823+0000","last_peered":"2023-10-06T10:59:06.509823+0000","last_clean":"2023-10-06T10:59:06.509823+0000","last_became_active":"2023-10-06T10:59:06.504086+0000","last_became_peered":"2023-10-06T10:59:06.504086+0000","last_unstale":"2023-10-06T10:59:06.509823+0000","last_undegraded":"2023-10-06T10:59:06.509823+0000","last_fullsized":"2023-10-06T10:59:06.509823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:05.476345+0000","last_clean_scrub_stamp":"2023-10-06T10:59:05.476345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:59.889292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.504114+0000","last_change":"2023-10-06T10:59:01.413820+0000","last_active":"2023-10-06T10:59:06.504114+0000","last_peered":"2023-10-06T10:59:06.504114+0000","last_clean":"2023-10-06T10:59:06.504114+0000","last_became_active":"2023-10-06T10:59:01.413502+0000","last_became_peered":"2023-10-06T10:59:01.413502+0000","last_unstale":"2023-10-06T10:59:06.504114+0000","last_undegraded":"2023-10-06T10:59:06.504114+0000","last_fullsized":"2023-10-06T10:59:06.504114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:00.383585+0000","last_clean_scrub_stamp":"2023-10-06T10:59:00.383585+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:23:07.954687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.489549+0000","last_change":"2023-10-06T10:59:02.419538+0000","last_active":"2023-10-06T10:59:06.489549+0000","last_peered":"2023-10-06T10:59:06.489549+0000","last_clean":"2023-10-06T10:59:06.489549+0000","last_became_active":"2023-10-06T10:59:02.419185+0000","last_became_peered":"2023-10-06T10:59:02.419185+0000","last_unstale":"2023-10-06T10:59:06.489549+0000","last_undegraded":"2023-10-06T10:59:06.489549+0000","last_fullsized":"2023-10-06T10:59:06.489549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:38.092745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.485604+0000","last_change":"2023-10-06T10:59:02.428782+0000","last_active":"2023-10-06T10:59:06.485604+0000","last_peered":"2023-10-06T10:59:06.485604+0000","last_clean":"2023-10-06T10:59:06.485604+0000","last_became_active":"2023-10-06T10:59:02.428518+0000","last_became_peered":"2023-10-06T10:59:02.428518+0000","last_unstale":"2023-10-06T10:59:06.485604+0000","last_undegraded":"2023-10-06T10:59:06.485604+0000","last_fullsized":"2023-10-06T10:59:06.485604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:20.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493061+0000","last_change":"2023-10-06T10:59:02.444220+0000","last_active":"2023-10-06T10:59:06.493061+0000","last_peered":"2023-10-06T10:59:06.493061+0000","last_clean":"2023-10-06T10:59:06.493061+0000","last_became_active":"2023-10-06T10:59:02.443920+0000","last_became_peered":"2023-10-06T10:59:02.443920+0000","last_unstale":"2023-10-06T10:59:06.493061+0000","last_undegraded":"2023-10-06T10:59:06.493061+0000","last_fullsized":"2023-10-06T10:59:06.493061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:17.096084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486954+0000","last_change":"2023-10-06T10:59:02.420323+0000","last_active":"2023-10-06T10:59:06.486954+0000","last_peered":"2023-10-06T10:59:06.486954+0000","last_clean":"2023-10-06T10:59:06.486954+0000","last_became_active":"2023-10-06T10:59:02.419903+0000","last_became_peered":"2023-10-06T10:59:02.419903+0000","last_unstale":"2023-10-06T10:59:06.486954+0000","last_undegraded":"2023-10-06T10:59:06.486954+0000","last_fullsized":"2023-10-06T10:59:06.486954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:52.603660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.493896+0000","last_change":"2023-10-06T10:59:02.435228+0000","last_active":"2023-10-06T10:59:06.493896+0000","last_peered":"2023-10-06T10:59:06.493896+0000","last_clean":"2023-10-06T10:59:06.493896+0000","last_became_active":"2023-10-06T10:59:02.434847+0000","last_became_peered":"2023-10-06T10:59:02.434847+0000","last_unstale":"2023-10-06T10:59:06.493896+0000","last_undegraded":"2023-10-06T10:59:06.493896+0000","last_fullsized":"2023-10-06T10:59:06.493896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:53.107388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T10:59:06.486540+0000","last_change":"2023-10-06T10:59:02.431384+0000","last_active":"2023-10-06T10:59:06.486540+0000","last_peered":"2023-10-06T10:59:06.486540+0000","last_clean":"2023-10-06T10:59:06.486540+0000","last_became_active":"2023-10-06T10:59:02.431073+0000","last_became_peered":"2023-10-06T10:59:02.431073+0000","last_unstale":"2023-10-06T10:59:06.486540+0000","last_undegraded":"2023-10-06T10:59:06.486540+0000","last_fullsized":"2023-10-06T10:59:06.486540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:59:01.388369+0000","last_clean_scrub_stamp":"2023-10-06T10:59:01.388369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:05:14.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298128,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073712,"statfs":{"total":96636764160,"available":96331481088,"internally_reserved":0,"allocated":860160,"data_stored":699826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":108570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.978}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T10:59:28.024 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T10:59:28.024 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T10:59:28.024 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T10:59:28.024 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T10:59:28.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.189+0000 7f9843543700 1 Processor -- start 2023-10-06T10:59:28.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.189+0000 7f9843543700 1 -- start start 2023-10-06T10:59:28.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f9843543700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f983c155e90 0x7f983c0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f9843543700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f983c156260 0x7f983c068a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f9843543700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c0a9da0 con 0x7f983c068fd0 2023-10-06T10:59:28.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f9843543700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983c0a9820 con 0x7f983c155e90 2023-10-06T10:59:28.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f9843543700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c06a000 con 0x7f983c156260 2023-10-06T10:59:28.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f98412df700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f983c155e90 0x7f983c0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f9841ae0700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f983c068fd0 0x7f983c0c9380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44356/0 (socket says 172.21.15.7:44356) 2023-10-06T10:59:28.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f9841ae0700 1 -- 172.21.15.7:0/2522219826 learned_addr learned my addr 172.21.15.7:0/2522219826 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:28.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f9840ade700 1 --2- 172.21.15.7:0/2522219826 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f983c156260 0x7f983c068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f98412df700 1 -- 172.21.15.7:0/2522219826 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f983c156260 msgr2=0x7f983c068a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:28.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f98412df700 1 --2- 172.21.15.7:0/2522219826 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f983c156260 0x7f983c068a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f98412df700 1 -- 172.21.15.7:0/2522219826 >> v1:172.21.15.7:6789/0 conn(0x7f983c068fd0 legacy=0x7f983c0c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f9833fff700 1 -- 172.21.15.7:0/2522219826 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862033376 0 0) 0x7f983c0a9da0 con 0x7f983c068fd0 2023-10-06T10:59:28.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f98412df700 1 -- 172.21.15.7:0/2522219826 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c06a2e0 con 0x7f983c155e90 2023-10-06T10:59:28.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.190+0000 7f98412df700 1 --2- 172.21.15.7:0/2522219826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c155e90 0x7f983c0cc6d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f98380098e0 tx=0x7f98380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e59943e5cc73d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:28.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.191+0000 7f9833fff700 1 -- 172.21.15.7:0/2522219826 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983800b640 con 0x7f983c155e90 2023-10-06T10:59:28.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.191+0000 7f9833fff700 1 -- 172.21.15.7:0/2522219826 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983800b7a0 con 0x7f983c155e90 2023-10-06T10:59:28.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.191+0000 7f9833fff700 1 -- 172.21.15.7:0/2522219826 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983800bb40 con 0x7f983c155e90 2023-10-06T10:59:28.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.191+0000 7f9843543700 1 -- 172.21.15.7:0/2522219826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c155e90 msgr2=0x7f983c0cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.191+0000 7f9843543700 1 --2- 172.21.15.7:0/2522219826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c155e90 0x7f983c0cc6d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f98380098e0 tx=0x7f98380091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.191+0000 7f9843543700 1 -- 172.21.15.7:0/2522219826 shutdown_connections 2023-10-06T10:59:28.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.191+0000 7f9843543700 1 --2- 172.21.15.7:0/2522219826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c155e90 0x7f983c0cc6d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.191+0000 7f9843543700 1 --2- 172.21.15.7:0/2522219826 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f983c156260 0x7f983c068a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.191+0000 7f9843543700 1 -- 172.21.15.7:0/2522219826 >> 172.21.15.7:0/2522219826 conn(0x7f983c0afc90 msgr2=0x7f983c0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.191+0000 7f9843543700 1 -- 172.21.15.7:0/2522219826 shutdown_connections 2023-10-06T10:59:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.191+0000 7f9843543700 1 -- 172.21.15.7:0/2522219826 wait complete. 2023-10-06T10:59:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.192+0000 7f9843543700 1 Processor -- start 2023-10-06T10:59:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.193+0000 7f9843543700 1 -- start start 2023-10-06T10:59:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.193+0000 7f9843543700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f983c068fd0 0x7f983c0c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.193+0000 7f9843543700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f983c155e90 0x7f983c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.193+0000 7f9843543700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c156260 0x7f983c154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.193+0000 7f9843543700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c156ab0 con 0x7f983c156260 2023-10-06T10:59:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.193+0000 7f9843543700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c154850 con 0x7f983c068fd0 2023-10-06T10:59:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.193+0000 7f9843543700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c0c9fa0 con 0x7f983c155e90 2023-10-06T10:59:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f9841ae0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c156260 0x7f983c154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f9841ae0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c156260 0x7f983c154310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43754/0 (socket says 172.21.15.7:43754) 2023-10-06T10:59:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f9841ae0700 1 -- 172.21.15.7:0/2634077817 learned_addr learned my addr 172.21.15.7:0/2634077817 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f9840ade700 1 --2- 172.21.15.7:0/2634077817 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f983c155e90 0x7f983c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f98412df700 1 --2- 172.21.15.7:0/2634077817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f983c068fd0 0x7f983c0c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f9841ae0700 1 -- 172.21.15.7:0/2634077817 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f983c155e90 msgr2=0x7f983c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f9841ae0700 1 --2- 172.21.15.7:0/2634077817 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f983c155e90 0x7f983c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f9841ae0700 1 -- 172.21.15.7:0/2634077817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f983c068fd0 msgr2=0x7f983c0c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f9841ae0700 1 --2- 172.21.15.7:0/2634077817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f983c068fd0 0x7f983c0c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f9841ae0700 1 -- 172.21.15.7:0/2634077817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9838009420 con 0x7f983c156260 2023-10-06T10:59:28.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f9841ae0700 1 --2- 172.21.15.7:0/2634077817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c156260 0x7f983c154310 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f983400cc90 tx=0x7f9834001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:28.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f98317fa700 1 -- 172.21.15.7:0/2634077817 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983400a8b0 con 0x7f983c156260 2023-10-06T10:59:28.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f98317fa700 1 -- 172.21.15.7:0/2634077817 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983400aa10 con 0x7f983c156260 2023-10-06T10:59:28.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f9843543700 1 -- 172.21.15.7:0/2634077817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c156780 con 0x7f983c156260 2023-10-06T10:59:28.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f98317fa700 1 -- 172.21.15.7:0/2634077817 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983400add0 con 0x7f983c156260 2023-10-06T10:59:28.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.194+0000 7f9843543700 1 -- 172.21.15.7:0/2634077817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983c0c9cc0 con 0x7f983c156260 2023-10-06T10:59:28.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.195+0000 7f9843543700 1 -- 172.21.15.7:0/2634077817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983c1596c0 con 0x7f983c156260 2023-10-06T10:59:28.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.196+0000 7f98317fa700 1 -- 172.21.15.7:0/2634077817 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9834007300 con 0x7f983c156260 2023-10-06T10:59:28.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.196+0000 7f98317fa700 1 --2- 172.21.15.7:0/2634077817 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9820066f30 0x7f98200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.196+0000 7f98317fa700 1 -- 172.21.15.7:0/2634077817 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9834084ce0 con 0x7f983c156260 2023-10-06T10:59:28.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.196+0000 7f98412df700 1 --2- 172.21.15.7:0/2634077817 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9820066f30 0x7f98200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.197+0000 7f98412df700 1 --2- 172.21.15.7:0/2634077817 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9820066f30 0x7f98200693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f98380093f0 tx=0x7f9838017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:28.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.201+0000 7f98317fa700 1 -- 172.21.15.7:0/2634077817 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9834051b80 con 0x7f983c156260 2023-10-06T10:59:28.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.447+0000 7f9843543700 1 -- 172.21.15.7:0/2634077817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f983c070480 con 0x7f983c156260 2023-10-06T10:59:28.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.448+0000 7f98317fa700 1 -- 172.21.15.7:0/2634077817 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f98340551a0 con 0x7f983c156260 2023-10-06T10:59:28.450 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:28.450 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T10:59:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.450+0000 7f9843543700 1 -- 172.21.15.7:0/2634077817 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9820066f30 msgr2=0x7f98200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.450+0000 7f9843543700 1 --2- 172.21.15.7:0/2634077817 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9820066f30 0x7f98200693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f98380093f0 tx=0x7f9838017000 comp rx=0 tx=0).stop 2023-10-06T10:59:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.450+0000 7f9843543700 1 -- 172.21.15.7:0/2634077817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c156260 msgr2=0x7f983c154310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.450+0000 7f9843543700 1 --2- 172.21.15.7:0/2634077817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c156260 0x7f983c154310 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f983400cc90 tx=0x7f9834001a80 comp rx=0 tx=0).stop 2023-10-06T10:59:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.450+0000 7f9843543700 1 -- 172.21.15.7:0/2634077817 shutdown_connections 2023-10-06T10:59:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.450+0000 7f9843543700 1 --2- 172.21.15.7:0/2634077817 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9820066f30 0x7f98200693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.450+0000 7f9843543700 1 --2- 172.21.15.7:0/2634077817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c156260 0x7f983c154310 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.450+0000 7f9843543700 1 --2- 172.21.15.7:0/2634077817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f983c068fd0 0x7f983c0c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.450+0000 7f9843543700 1 --2- 172.21.15.7:0/2634077817 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f983c155e90 0x7f983c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.450+0000 7f9843543700 1 -- 172.21.15.7:0/2634077817 >> 172.21.15.7:0/2634077817 conn(0x7f983c0afc90 msgr2=0x7f983c155190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.450+0000 7f9843543700 1 -- 172.21.15.7:0/2634077817 shutdown_connections 2023-10-06T10:59:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.450+0000 7f9843543700 1 -- 172.21.15.7:0/2634077817 wait complete. 2023-10-06T10:59:28.465 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T10:59:28.465 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:28.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.598+0000 7fdfc1f59700 1 Processor -- start 2023-10-06T10:59:28.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.598+0000 7fdfc1f59700 1 -- start start 2023-10-06T10:59:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.599+0000 7fdfc1f59700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdfbc15ce10 0x7fdfbc15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.599+0000 7fdfc1f59700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdfbc1594a0 0x7fdfbc1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.599+0000 7fdfc1f59700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfbc0694d0 con 0x7fdfbc1590d0 2023-10-06T10:59:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.599+0000 7fdfc1f59700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfbc15d7f0 con 0x7fdfbc1594a0 2023-10-06T10:59:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.599+0000 7fdfc1f59700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfbc068990 con 0x7fdfbc15ce10 2023-10-06T10:59:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.599+0000 7fdfbbfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdfbc1594a0 0x7fdfbc1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.599+0000 7fdfbb7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdfbc1590d0 0x7fdfbc069bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44372/0 (socket says 172.21.15.7:44372) 2023-10-06T10:59:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.599+0000 7fdfbb7fe700 1 -- 172.21.15.7:0/3506995960 learned_addr learned my addr 172.21.15.7:0/3506995960 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.600+0000 7fdfbaffd700 1 --2- 172.21.15.7:0/3506995960 >> v2:172.21.15.50:3300/0 conn(0x7fdfbc15ce10 0x7fdfbc15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.600+0000 7fdfbbfff700 1 -- 172.21.15.7:0/3506995960 >> v2:172.21.15.50:3300/0 conn(0x7fdfbc15ce10 msgr2=0x7fdfbc15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.600+0000 7fdfbbfff700 1 --2- 172.21.15.7:0/3506995960 >> v2:172.21.15.50:3300/0 conn(0x7fdfbc15ce10 0x7fdfbc15d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.600+0000 7fdfbbfff700 1 -- 172.21.15.7:0/3506995960 >> v1:172.21.15.7:6789/0 conn(0x7fdfbc1590d0 legacy=0x7fdfbc069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.600+0000 7fdfbbfff700 1 -- 172.21.15.7:0/3506995960 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc068ba0 con 0x7fdfbc1594a0 2023-10-06T10:59:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.600+0000 7fdfba7fc700 1 -- 172.21.15.7:0/3506995960 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851420706 0 0) 0x7fdfbc0694d0 con 0x7fdfbc1590d0 2023-10-06T10:59:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.600+0000 7fdfbbfff700 1 --2- 172.21.15.7:0/3506995960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfbc1594a0 0x7fdfbc1598e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc06e180 tx=0x7fdfb4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba08b04438efefc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.600+0000 7fdfba7fc700 1 -- 172.21.15.7:0/3506995960 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb400e070 con 0x7fdfbc1594a0 2023-10-06T10:59:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.600+0000 7fdfba7fc700 1 -- 172.21.15.7:0/3506995960 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb400bc30 con 0x7fdfbc1594a0 2023-10-06T10:59:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.600+0000 7fdfba7fc700 1 -- 172.21.15.7:0/3506995960 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4012430 con 0x7fdfbc1594a0 2023-10-06T10:59:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.601+0000 7fdfc1f59700 1 -- 172.21.15.7:0/3506995960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfbc1594a0 msgr2=0x7fdfbc1598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.601+0000 7fdfc1f59700 1 --2- 172.21.15.7:0/3506995960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfbc1594a0 0x7fdfbc1598e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc06e180 tx=0x7fdfb4009780 comp rx=0 tx=0).stop 2023-10-06T10:59:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.601+0000 7fdfc1f59700 1 -- 172.21.15.7:0/3506995960 shutdown_connections 2023-10-06T10:59:28.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.601+0000 7fdfc1f59700 1 --2- 172.21.15.7:0/3506995960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfbc1594a0 0x7fdfbc1598e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.601+0000 7fdfc1f59700 1 --2- 172.21.15.7:0/3506995960 >> v2:172.21.15.50:3300/0 conn(0x7fdfbc15ce10 0x7fdfbc15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.601+0000 7fdfc1f59700 1 -- 172.21.15.7:0/3506995960 >> 172.21.15.7:0/3506995960 conn(0x7fdfbc096160 msgr2=0x7fdfbc0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:28.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.601+0000 7fdfc1f59700 1 -- 172.21.15.7:0/3506995960 shutdown_connections 2023-10-06T10:59:28.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.601+0000 7fdfc1f59700 1 -- 172.21.15.7:0/3506995960 wait complete. 2023-10-06T10:59:28.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.603+0000 7fdfc1f59700 1 Processor -- start 2023-10-06T10:59:28.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.603+0000 7fdfc1f59700 1 -- start start 2023-10-06T10:59:28.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfc1f59700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfbc1590d0 0x7fdfbc14cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfc1f59700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfbc1594a0 0x7fdfbc14dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfc1f59700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfbc15ce10 0x7fdfbc0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfc1f59700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc14d0f0 con 0x7fdfbc15ce10 2023-10-06T10:59:28.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfc1f59700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc15a7d0 con 0x7fdfbc1590d0 2023-10-06T10:59:28.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfc1f59700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc15a340 con 0x7fdfbc1594a0 2023-10-06T10:59:28.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfbbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfbc15ce10 0x7fdfbc0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfbbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfbc15ce10 0x7fdfbc0afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43770/0 (socket says 172.21.15.7:43770) 2023-10-06T10:59:28.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfbbfff700 1 -- 172.21.15.7:0/2208117612 learned_addr learned my addr 172.21.15.7:0/2208117612 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:28.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfbb7fe700 1 --2- 172.21.15.7:0/2208117612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfbc1590d0 0x7fdfbc14cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfbaffd700 1 --2- 172.21.15.7:0/2208117612 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfbc1594a0 0x7fdfbc14dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfbbfff700 1 -- 172.21.15.7:0/2208117612 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfbc1594a0 msgr2=0x7fdfbc14dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfbbfff700 1 --2- 172.21.15.7:0/2208117612 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfbc1594a0 0x7fdfbc14dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfbbfff700 1 -- 172.21.15.7:0/2208117612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfbc1590d0 msgr2=0x7fdfbc14cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfbbfff700 1 --2- 172.21.15.7:0/2208117612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfbc1590d0 0x7fdfbc14cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfbbfff700 1 -- 172.21.15.7:0/2208117612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb4009a20 con 0x7fdfbc15ce10 2023-10-06T10:59:28.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.604+0000 7fdfbbfff700 1 --2- 172.21.15.7:0/2208117612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfbc15ce10 0x7fdfbc0afc80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400b6c0 tx=0x7fdfb4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:28.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.605+0000 7fdfa37fe700 1 -- 172.21.15.7:0/2208117612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4027470 con 0x7fdfbc15ce10 2023-10-06T10:59:28.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.605+0000 7fdfa37fe700 1 -- 172.21.15.7:0/2208117612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb40275d0 con 0x7fdfbc15ce10 2023-10-06T10:59:28.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.605+0000 7fdfa37fe700 1 -- 172.21.15.7:0/2208117612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4027990 con 0x7fdfbc15ce10 2023-10-06T10:59:28.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.605+0000 7fdfc1f59700 1 -- 172.21.15.7:0/2208117612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfbc159a10 con 0x7fdfbc15ce10 2023-10-06T10:59:28.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.605+0000 7fdfc1f59700 1 -- 172.21.15.7:0/2208117612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfbc159fd0 con 0x7fdfbc15ce10 2023-10-06T10:59:28.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.606+0000 7fdfc1f59700 1 -- 172.21.15.7:0/2208117612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfbc070480 con 0x7fdfbc15ce10 2023-10-06T10:59:28.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.606+0000 7fdfa37fe700 1 -- 172.21.15.7:0/2208117612 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfb4024070 con 0x7fdfbc15ce10 2023-10-06T10:59:28.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.606+0000 7fdfa37fe700 1 --2- 172.21.15.7:0/2208117612 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdfa8066f30 0x7fdfa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.607+0000 7fdfa37fe700 1 -- 172.21.15.7:0/2208117612 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdfb4086fc0 con 0x7fdfbc15ce10 2023-10-06T10:59:28.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.607+0000 7fdfbb7fe700 1 --2- 172.21.15.7:0/2208117612 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdfa8066f30 0x7fdfa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.607+0000 7fdfbb7fe700 1 --2- 172.21.15.7:0/2208117612 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdfa8066f30 0x7fdfa80693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0b07e0 tx=0x7fdfac007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:28.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.611+0000 7fdfa37fe700 1 -- 172.21.15.7:0/2208117612 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfb40b85a0 con 0x7fdfbc15ce10 2023-10-06T10:59:28.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.815+0000 7fdfc1f59700 1 -- 172.21.15.7:0/2208117612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfbc068e80 con 0x7fdfbc15ce10 2023-10-06T10:59:28.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.816+0000 7fdfa37fe700 1 -- 172.21.15.7:0/2208117612 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fdfb402c090 con 0x7fdfbc15ce10 2023-10-06T10:59:28.818 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:28.819 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:06.934264+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:28.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.818+0000 7fdfc1f59700 1 -- 172.21.15.7:0/2208117612 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdfa8066f30 msgr2=0x7fdfa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.818+0000 7fdfc1f59700 1 --2- 172.21.15.7:0/2208117612 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdfa8066f30 0x7fdfa80693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0b07e0 tx=0x7fdfac007d30 comp rx=0 tx=0).stop 2023-10-06T10:59:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.818+0000 7fdfc1f59700 1 -- 172.21.15.7:0/2208117612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfbc15ce10 msgr2=0x7fdfbc0afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.818+0000 7fdfc1f59700 1 --2- 172.21.15.7:0/2208117612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfbc15ce10 0x7fdfbc0afc80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400b6c0 tx=0x7fdfb4019000 comp rx=0 tx=0).stop 2023-10-06T10:59:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.818+0000 7fdfc1f59700 1 -- 172.21.15.7:0/2208117612 shutdown_connections 2023-10-06T10:59:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.818+0000 7fdfc1f59700 1 --2- 172.21.15.7:0/2208117612 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdfa8066f30 0x7fdfa80693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.818+0000 7fdfc1f59700 1 --2- 172.21.15.7:0/2208117612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfbc15ce10 0x7fdfbc0afc80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.818+0000 7fdfc1f59700 1 --2- 172.21.15.7:0/2208117612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfbc1590d0 0x7fdfbc14cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.818+0000 7fdfc1f59700 1 --2- 172.21.15.7:0/2208117612 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfbc1594a0 0x7fdfbc14dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.819+0000 7fdfc1f59700 1 -- 172.21.15.7:0/2208117612 >> 172.21.15.7:0/2208117612 conn(0x7fdfbc096160 msgr2=0x7fdfbc06b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:28.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.819+0000 7fdfc1f59700 1 -- 172.21.15.7:0/2208117612 shutdown_connections 2023-10-06T10:59:28.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.819+0000 7fdfc1f59700 1 -- 172.21.15.7:0/2208117612 wait complete. 2023-10-06T10:59:28.834 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T10:58:55.224661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T10:58:56.032929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T10:58:59.772827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T10:59:00.802230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T10:59:04.512252+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T10:59:28.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T10:59:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.967+0000 7f165982b700 1 Processor -- start 2023-10-06T10:59:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.967+0000 7f165982b700 1 -- start start 2023-10-06T10:59:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.968+0000 7f165982b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16540a6d30 0x7f16540ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.968+0000 7f165982b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16540acca0 0x7f1654067ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.968+0000 7f165982b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165406b1e0 con 0x7f16540aeb50 2023-10-06T10:59:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.968+0000 7f165982b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165406b4c0 con 0x7f16540a6d30 2023-10-06T10:59:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.968+0000 7f165982b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165406b7a0 con 0x7f16540acca0 2023-10-06T10:59:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.968+0000 7f1652ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16540a6d30 0x7f16540ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.968+0000 7f16527fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f16540aeb50 0x7f16540ac590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44376/0 (socket says 172.21.15.7:44376) 2023-10-06T10:59:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.969+0000 7f16527fc700 1 -- 172.21.15.7:0/3885634769 learned_addr learned my addr 172.21.15.7:0/3885634769 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.969+0000 7f16537fe700 1 --2- 172.21.15.7:0/3885634769 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16540acca0 0x7f1654067ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.969+0000 7f1652ffd700 1 -- 172.21.15.7:0/3885634769 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16540acca0 msgr2=0x7f1654067ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.969+0000 7f1652ffd700 1 --2- 172.21.15.7:0/3885634769 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16540acca0 0x7f1654067ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.969+0000 7f1652ffd700 1 -- 172.21.15.7:0/3885634769 >> v1:172.21.15.7:6789/0 conn(0x7f16540aeb50 legacy=0x7f16540ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.969+0000 7f1652ffd700 1 -- 172.21.15.7:0/3885634769 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165406ba80 con 0x7f16540a6d30 2023-10-06T10:59:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.969+0000 7f16537fe700 1 --2- 172.21.15.7:0/3885634769 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16540acca0 0x7f1654067ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.969+0000 7f1652ffd700 1 --2- 172.21.15.7:0/3885634769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16540a6d30 0x7f16540ae610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f16440098e0 tx=0x7f16440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c0f27c39dc37eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.969+0000 7f1651ffb700 1 -- 172.21.15.7:0/3885634769 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644009e80 con 0x7f16540a6d30 2023-10-06T10:59:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.969+0000 7f1651ffb700 1 -- 172.21.15.7:0/3885634769 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164400b860 con 0x7f16540a6d30 2023-10-06T10:59:28.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.969+0000 7f1651ffb700 1 -- 172.21.15.7:0/3885634769 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400bbe0 con 0x7f16540a6d30 2023-10-06T10:59:28.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.970+0000 7f165982b700 1 -- 172.21.15.7:0/3885634769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16540a6d30 msgr2=0x7f16540ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.970+0000 7f165982b700 1 --2- 172.21.15.7:0/3885634769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16540a6d30 0x7f16540ae610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f16440098e0 tx=0x7f16440091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.970+0000 7f165982b700 1 -- 172.21.15.7:0/3885634769 shutdown_connections 2023-10-06T10:59:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.970+0000 7f165982b700 1 --2- 172.21.15.7:0/3885634769 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16540acca0 0x7f1654067ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.970+0000 7f165982b700 1 --2- 172.21.15.7:0/3885634769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16540a6d30 0x7f16540ae610 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.970+0000 7f165982b700 1 -- 172.21.15.7:0/3885634769 >> 172.21.15.7:0/3885634769 conn(0x7f16540cc560 msgr2=0x7f16540cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.970+0000 7f165982b700 1 -- 172.21.15.7:0/3885634769 shutdown_connections 2023-10-06T10:59:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.970+0000 7f165982b700 1 -- 172.21.15.7:0/3885634769 wait complete. 2023-10-06T10:59:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.972+0000 7f165982b700 1 Processor -- start 2023-10-06T10:59:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.972+0000 7f165982b700 1 -- start start 2023-10-06T10:59:28.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.972+0000 7f165982b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16540a6d30 0x7f1654096750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.972+0000 7f165982b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16540acca0 0x7f16540993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.972+0000 7f165982b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16540aeb50 0x7f1654097ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.972+0000 7f165982b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1654097a60 con 0x7f16540a6d30 2023-10-06T10:59:28.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.972+0000 7f165982b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1654096e50 con 0x7f16540aeb50 2023-10-06T10:59:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.972+0000 7f165982b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1654097130 con 0x7f16540acca0 2023-10-06T10:59:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f1652ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16540a6d30 0x7f1654096750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f1652ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16540a6d30 0x7f1654096750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43790/0 (socket says 172.21.15.7:43790) 2023-10-06T10:59:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f1652ffd700 1 -- 172.21.15.7:0/490460943 learned_addr learned my addr 172.21.15.7:0/490460943 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f16527fc700 1 --2- 172.21.15.7:0/490460943 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16540acca0 0x7f16540993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f16537fe700 1 --2- 172.21.15.7:0/490460943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16540aeb50 0x7f1654097ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f1652ffd700 1 -- 172.21.15.7:0/490460943 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16540acca0 msgr2=0x7f16540993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f1652ffd700 1 --2- 172.21.15.7:0/490460943 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16540acca0 0x7f16540993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f1652ffd700 1 -- 172.21.15.7:0/490460943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16540aeb50 msgr2=0x7f1654097ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f1652ffd700 1 --2- 172.21.15.7:0/490460943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16540aeb50 0x7f1654097ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f1652ffd700 1 -- 172.21.15.7:0/490460943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1644009420 con 0x7f16540a6d30 2023-10-06T10:59:28.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f1652ffd700 1 --2- 172.21.15.7:0/490460943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16540a6d30 0x7f1654096750 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f165406fa20 tx=0x7f1644017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:28.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f164affd700 1 -- 172.21.15.7:0/490460943 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400b9d0 con 0x7f16540a6d30 2023-10-06T10:59:28.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f164affd700 1 -- 172.21.15.7:0/490460943 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164400bb30 con 0x7f16540a6d30 2023-10-06T10:59:28.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f165982b700 1 -- 172.21.15.7:0/490460943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1654097410 con 0x7f16540a6d30 2023-10-06T10:59:28.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.973+0000 7f164affd700 1 -- 172.21.15.7:0/490460943 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644011650 con 0x7f16540a6d30 2023-10-06T10:59:28.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.974+0000 7f165982b700 1 -- 172.21.15.7:0/490460943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1654156ef0 con 0x7f16540a6d30 2023-10-06T10:59:28.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.975+0000 7f165982b700 1 -- 172.21.15.7:0/490460943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1654097d40 con 0x7f16540a6d30 2023-10-06T10:59:28.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.975+0000 7f164affd700 1 -- 172.21.15.7:0/490460943 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1644011a80 con 0x7f16540a6d30 2023-10-06T10:59:28.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.975+0000 7f164affd700 1 --2- 172.21.15.7:0/490460943 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1634066f30 0x7f16340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:28.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.976+0000 7f16527fc700 1 --2- 172.21.15.7:0/490460943 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1634066f30 0x7f16340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:28.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.976+0000 7f164affd700 1 -- 172.21.15.7:0/490460943 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1644086170 con 0x7f16540a6d30 2023-10-06T10:59:28.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.976+0000 7f16527fc700 1 --2- 172.21.15.7:0/490460943 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1634066f30 0x7f16340693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f163c001950 tx=0x7f163c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:28.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:28.980+0000 7f164affd700 1 -- 172.21.15.7:0/490460943 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1644052f90 con 0x7f16540a6d30 2023-10-06T10:59:29.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.182+0000 7f165982b700 1 -- 172.21.15.7:0/490460943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1654070480 con 0x7f16540a6d30 2023-10-06T10:59:29.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.182+0000 7f164affd700 1 -- 172.21.15.7:0/490460943 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f16440565b0 con 0x7f16540a6d30 2023-10-06T10:59:29.184 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-10-06T10:59:29.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.184+0000 7f165982b700 1 -- 172.21.15.7:0/490460943 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1634066f30 msgr2=0x7f16340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:29.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.184+0000 7f165982b700 1 --2- 172.21.15.7:0/490460943 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1634066f30 0x7f16340693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f163c001950 tx=0x7f163c009040 comp rx=0 tx=0).stop 2023-10-06T10:59:29.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.184+0000 7f165982b700 1 -- 172.21.15.7:0/490460943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16540a6d30 msgr2=0x7f1654096750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:29.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.184+0000 7f165982b700 1 --2- 172.21.15.7:0/490460943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16540a6d30 0x7f1654096750 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f165406fa20 tx=0x7f1644017000 comp rx=0 tx=0).stop 2023-10-06T10:59:29.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.184+0000 7f165982b700 1 -- 172.21.15.7:0/490460943 shutdown_connections 2023-10-06T10:59:29.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.184+0000 7f165982b700 1 --2- 172.21.15.7:0/490460943 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1634066f30 0x7f16340693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.184+0000 7f165982b700 1 --2- 172.21.15.7:0/490460943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16540a6d30 0x7f1654096750 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.184+0000 7f165982b700 1 --2- 172.21.15.7:0/490460943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16540aeb50 0x7f1654097ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.184+0000 7f165982b700 1 --2- 172.21.15.7:0/490460943 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16540acca0 0x7f16540993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.184+0000 7f165982b700 1 -- 172.21.15.7:0/490460943 >> 172.21.15.7:0/490460943 conn(0x7f16540cc560 msgr2=0x7f1654068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:29.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.184+0000 7f165982b700 1 -- 172.21.15.7:0/490460943 shutdown_connections 2023-10-06T10:59:29.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.185+0000 7f165982b700 1 -- 172.21.15.7:0/490460943 wait complete. 2023-10-06T10:59:29.200 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T10:59:29.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.333+0000 7fe9f76b5700 1 Processor -- start 2023-10-06T10:59:29.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.333+0000 7fe9f76b5700 1 -- start start 2023-10-06T10:59:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.334+0000 7fe9f76b5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f00a6d30 0x7fe9f00ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.334+0000 7fe9f76b5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe9f00aeb50 0x7fe9f00ac590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.334+0000 7fe9f76b5700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f006b1e0 con 0x7fe9f00a7100 2023-10-06T10:59:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.334+0000 7fe9f76b5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f006b4c0 con 0x7fe9f00aeb50 2023-10-06T10:59:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.334+0000 7fe9f76b5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f006b7a0 con 0x7fe9f00a6d30 2023-10-06T10:59:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.334+0000 7fe9f5c52700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe9f00a7100 0x7fe9f015ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44390/0 (socket says 172.21.15.7:44390) 2023-10-06T10:59:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.334+0000 7fe9f5c52700 1 -- 172.21.15.7:0/2117088185 learned_addr learned my addr 172.21.15.7:0/2117088185 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.334+0000 7fe9f5451700 1 --2- 172.21.15.7:0/2117088185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f00a6d30 0x7fe9f00ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.334+0000 7fe9f4c50700 1 --2- 172.21.15.7:0/2117088185 >> v2:172.21.15.50:3300/0 conn(0x7fe9f00aeb50 0x7fe9f00ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.335+0000 7fe9e7fff700 1 -- 172.21.15.7:0/2117088185 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265613054 0 0) 0x7fe9f006b1e0 con 0x7fe9f00a7100 2023-10-06T10:59:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.335+0000 7fe9e7fff700 1 -- 172.21.15.7:0/2117088185 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9dc003570 con 0x7fe9f00a7100 2023-10-06T10:59:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.335+0000 7fe9f5451700 1 -- 172.21.15.7:0/2117088185 >> v2:172.21.15.50:3300/0 conn(0x7fe9f00aeb50 msgr2=0x7fe9f00ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.335+0000 7fe9f5451700 1 --2- 172.21.15.7:0/2117088185 >> v2:172.21.15.50:3300/0 conn(0x7fe9f00aeb50 0x7fe9f00ac590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.335+0000 7fe9f5451700 1 -- 172.21.15.7:0/2117088185 >> v1:172.21.15.7:6789/0 conn(0x7fe9f00a7100 legacy=0x7fe9f015ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.335+0000 7fe9f5451700 1 -- 172.21.15.7:0/2117088185 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f006ba80 con 0x7fe9f00a6d30 2023-10-06T10:59:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.335+0000 7fe9f4c50700 1 --2- 172.21.15.7:0/2117088185 >> v2:172.21.15.50:3300/0 conn(0x7fe9f00aeb50 0x7fe9f00ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:59:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.335+0000 7fe9f5451700 1 --2- 172.21.15.7:0/2117088185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f00a6d30 0x7fe9f00ae610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0098e0 tx=0x7fe9ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2c8589413400af2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.335+0000 7fe9e7fff700 1 -- 172.21.15.7:0/2117088185 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec011630 con 0x7fe9f00a6d30 2023-10-06T10:59:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.335+0000 7fe9e7fff700 1 -- 172.21.15.7:0/2117088185 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec011790 con 0x7fe9f00a6d30 2023-10-06T10:59:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.335+0000 7fe9e7fff700 1 -- 172.21.15.7:0/2117088185 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec011b30 con 0x7fe9f00a6d30 2023-10-06T10:59:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.336+0000 7fe9f76b5700 1 -- 172.21.15.7:0/2117088185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f00a6d30 msgr2=0x7fe9f00ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.336+0000 7fe9f76b5700 1 --2- 172.21.15.7:0/2117088185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f00a6d30 0x7fe9f00ae610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0098e0 tx=0x7fe9ec0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.336+0000 7fe9f76b5700 1 -- 172.21.15.7:0/2117088185 shutdown_connections 2023-10-06T10:59:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.336+0000 7fe9f76b5700 1 --2- 172.21.15.7:0/2117088185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f00a6d30 0x7fe9f00ae610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.336+0000 7fe9f76b5700 1 --2- 172.21.15.7:0/2117088185 >> v2:172.21.15.50:3300/0 conn(0x7fe9f00aeb50 0x7fe9f00ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.336+0000 7fe9f76b5700 1 -- 172.21.15.7:0/2117088185 >> 172.21.15.7:0/2117088185 conn(0x7fe9f00cc560 msgr2=0x7fe9f00cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.336+0000 7fe9f76b5700 1 -- 172.21.15.7:0/2117088185 shutdown_connections 2023-10-06T10:59:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.336+0000 7fe9f76b5700 1 -- 172.21.15.7:0/2117088185 wait complete. 2023-10-06T10:59:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.337+0000 7fe9f76b5700 1 Processor -- start 2023-10-06T10:59:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.337+0000 7fe9f76b5700 1 -- start start 2023-10-06T10:59:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.338+0000 7fe9f76b5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f00a6d30 0x7fe9f014da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.338+0000 7fe9f76b5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9f00a7100 0x7fe9f015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.338+0000 7fe9f76b5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f00aeb50 0x7fe9f015c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.338+0000 7fe9f76b5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f016b410 con 0x7fe9f00a6d30 2023-10-06T10:59:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.338+0000 7fe9f76b5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f016a800 con 0x7fe9f00a7100 2023-10-06T10:59:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.338+0000 7fe9f76b5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f016aae0 con 0x7fe9f00aeb50 2023-10-06T10:59:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.338+0000 7fe9f5451700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f00a6d30 0x7fe9f014da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.338+0000 7fe9f5451700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f00a6d30 0x7fe9f014da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43796/0 (socket says 172.21.15.7:43796) 2023-10-06T10:59:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.338+0000 7fe9f5451700 1 -- 172.21.15.7:0/3406273902 learned_addr learned my addr 172.21.15.7:0/3406273902 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.339+0000 7fe9f4c50700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9f00a7100 0x7fe9f015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.339+0000 7fe9f5c52700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f00aeb50 0x7fe9f015c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.339+0000 7fe9f5451700 1 -- 172.21.15.7:0/3406273902 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f00aeb50 msgr2=0x7fe9f015c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.339+0000 7fe9f5451700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f00aeb50 0x7fe9f015c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.339+0000 7fe9f5451700 1 -- 172.21.15.7:0/3406273902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9f00a7100 msgr2=0x7fe9f015baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.339+0000 7fe9f5451700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9f00a7100 0x7fe9f015baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.339+0000 7fe9f5451700 1 -- 172.21.15.7:0/3406273902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e0009420 con 0x7fe9f00a6d30 2023-10-06T10:59:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.339+0000 7fe9f5c52700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f00aeb50 0x7fe9f015c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.339+0000 7fe9f5451700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f00a6d30 0x7fe9f014da80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe9f006b8e0 tx=0x7fe9ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.339+0000 7fe9e57fa700 1 -- 172.21.15.7:0/3406273902 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec01f070 con 0x7fe9f00a6d30 2023-10-06T10:59:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.339+0000 7fe9e57fa700 1 -- 172.21.15.7:0/3406273902 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec011900 con 0x7fe9f00a6d30 2023-10-06T10:59:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.339+0000 7fe9f76b5700 1 -- 172.21.15.7:0/3406273902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec009420 con 0x7fe9f00a6d30 2023-10-06T10:59:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.339+0000 7fe9e57fa700 1 -- 172.21.15.7:0/3406273902 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec023410 con 0x7fe9f00a6d30 2023-10-06T10:59:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.339+0000 7fe9f76b5700 1 -- 172.21.15.7:0/3406273902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f016b0a0 con 0x7fe9f00a6d30 2023-10-06T10:59:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.340+0000 7fe9f76b5700 1 -- 172.21.15.7:0/3406273902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f0070480 con 0x7fe9f00a6d30 2023-10-06T10:59:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.341+0000 7fe9e57fa700 1 -- 172.21.15.7:0/3406273902 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9ec02c3b0 con 0x7fe9f00a6d30 2023-10-06T10:59:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.341+0000 7fe9e57fa700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe9d4066f30 0x7fe9d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.341+0000 7fe9e57fa700 1 -- 172.21.15.7:0/3406273902 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe9ec085d30 con 0x7fe9f00a6d30 2023-10-06T10:59:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.341+0000 7fe9f4c50700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe9d4066f30 0x7fe9d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.342+0000 7fe9f4c50700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe9d4066f30 0x7fe9d40693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9f015ed90 tx=0x7fe9e00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:29.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.346+0000 7fe9e57fa700 1 -- 172.21.15.7:0/3406273902 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9ec052ab0 con 0x7fe9f00a6d30 2023-10-06T10:59:29.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.550+0000 7fe9f76b5700 1 -- 172.21.15.7:0/3406273902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9f006ad90 con 0x7fe9f00a6d30 2023-10-06T10:59:29.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.550+0000 7fe9e57fa700 1 -- 172.21.15.7:0/3406273902 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe9ec028070 con 0x7fe9f00a6d30 2023-10-06T10:59:29.552 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-06T10:59:29.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.552+0000 7fe9f76b5700 1 -- 172.21.15.7:0/3406273902 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe9d4066f30 msgr2=0x7fe9d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:29.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.552+0000 7fe9f76b5700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe9d4066f30 0x7fe9d40693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9f015ed90 tx=0x7fe9e00091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.552+0000 7fe9f76b5700 1 -- 172.21.15.7:0/3406273902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f00a6d30 msgr2=0x7fe9f014da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:29.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.552+0000 7fe9f76b5700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f00a6d30 0x7fe9f014da80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe9f006b8e0 tx=0x7fe9ec017000 comp rx=0 tx=0).stop 2023-10-06T10:59:29.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.552+0000 7fe9f76b5700 1 -- 172.21.15.7:0/3406273902 shutdown_connections 2023-10-06T10:59:29.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.552+0000 7fe9f76b5700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe9d4066f30 0x7fe9d40693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.552+0000 7fe9f76b5700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f00a6d30 0x7fe9f014da80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.552+0000 7fe9f76b5700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f00aeb50 0x7fe9f015c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.552+0000 7fe9f76b5700 1 --2- 172.21.15.7:0/3406273902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9f00a7100 0x7fe9f015baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.552+0000 7fe9f76b5700 1 -- 172.21.15.7:0/3406273902 >> 172.21.15.7:0/3406273902 conn(0x7fe9f00cc560 msgr2=0x7fe9f0158910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:29.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.552+0000 7fe9f76b5700 1 -- 172.21.15.7:0/3406273902 shutdown_connections 2023-10-06T10:59:29.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.553+0000 7fe9f76b5700 1 -- 172.21.15.7:0/3406273902 wait complete. 2023-10-06T10:59:29.568 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T10:59:29.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.701+0000 7fd0c60e8700 1 Processor -- start 2023-10-06T10:59:29.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.702+0000 7fd0c60e8700 1 -- start start 2023-10-06T10:59:29.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.702+0000 7fd0c60e8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd0c00cab40 0x7fd0c00694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:29.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.702+0000 7fd0c60e8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0c00b2430 0x7fd0c00c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:29.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.702+0000 7fd0c60e8700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c00699e0 con 0x7fd0c00caf10 2023-10-06T10:59:29.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.702+0000 7fd0c60e8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c0069dd0 con 0x7fd0c00b2430 2023-10-06T10:59:29.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.702+0000 7fd0c60e8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c006a070 con 0x7fd0c00cab40 2023-10-06T10:59:29.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.703+0000 7fd0bffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0c00b2430 0x7fd0c00c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.703+0000 7fd0bffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0c00b2430 0x7fd0c00c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43804/0 (socket says 172.21.15.7:43804) 2023-10-06T10:59:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.703+0000 7fd0bffff700 1 -- 172.21.15.7:0/2226278563 learned_addr learned my addr 172.21.15.7:0/2226278563 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.703+0000 7fd0beffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd0c00caf10 0x7fd0c00b1d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44396/0 (socket says 172.21.15.7:44396) 2023-10-06T10:59:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.703+0000 7fd0bf7fe700 1 --2- 172.21.15.7:0/2226278563 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd0c00cab40 0x7fd0c00694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.703+0000 7fd0bffff700 1 -- 172.21.15.7:0/2226278563 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd0c00cab40 msgr2=0x7fd0c00694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.703+0000 7fd0bffff700 1 --2- 172.21.15.7:0/2226278563 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd0c00cab40 0x7fd0c00694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.703+0000 7fd0bffff700 1 -- 172.21.15.7:0/2226278563 >> v1:172.21.15.7:6789/0 conn(0x7fd0c00caf10 legacy=0x7fd0c00b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.703+0000 7fd0bffff700 1 -- 172.21.15.7:0/2226278563 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c006a350 con 0x7fd0c00b2430 2023-10-06T10:59:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.703+0000 7fd0be7fc700 1 -- 172.21.15.7:0/2226278563 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510324888 0 0) 0x7fd0c00699e0 con 0x7fd0c00caf10 2023-10-06T10:59:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.703+0000 7fd0bffff700 1 --2- 172.21.15.7:0/2226278563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c00b2430 0x7fd0c00c7e40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009f20 tx=0x7fd0b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54417fb3df49630e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.703+0000 7fd0be7fc700 1 -- 172.21.15.7:0/2226278563 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800e070 con 0x7fd0c00b2430 2023-10-06T10:59:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.703+0000 7fd0be7fc700 1 -- 172.21.15.7:0/2226278563 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b800b9d0 con 0x7fd0c00b2430 2023-10-06T10:59:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.703+0000 7fd0be7fc700 1 -- 172.21.15.7:0/2226278563 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80092e0 con 0x7fd0c00b2430 2023-10-06T10:59:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.704+0000 7fd0c60e8700 1 -- 172.21.15.7:0/2226278563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c00b2430 msgr2=0x7fd0c00c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.704+0000 7fd0c60e8700 1 --2- 172.21.15.7:0/2226278563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c00b2430 0x7fd0c00c7e40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009f20 tx=0x7fd0b8009840 comp rx=0 tx=0).stop 2023-10-06T10:59:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.704+0000 7fd0c60e8700 1 -- 172.21.15.7:0/2226278563 shutdown_connections 2023-10-06T10:59:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.704+0000 7fd0c60e8700 1 --2- 172.21.15.7:0/2226278563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c00b2430 0x7fd0c00c7e40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.704+0000 7fd0c60e8700 1 --2- 172.21.15.7:0/2226278563 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd0c00cab40 0x7fd0c00694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.704+0000 7fd0c60e8700 1 -- 172.21.15.7:0/2226278563 >> 172.21.15.7:0/2226278563 conn(0x7fd0c00afc90 msgr2=0x7fd0c00b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:29.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.704+0000 7fd0c60e8700 1 -- 172.21.15.7:0/2226278563 shutdown_connections 2023-10-06T10:59:29.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.704+0000 7fd0c60e8700 1 -- 172.21.15.7:0/2226278563 wait complete. 2023-10-06T10:59:29.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.705+0000 7fd0c60e8700 1 Processor -- start 2023-10-06T10:59:29.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.705+0000 7fd0c60e8700 1 -- start start 2023-10-06T10:59:29.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.706+0000 7fd0c60e8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd0c00b2430 0x7fd0c014f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:29.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.706+0000 7fd0c60e8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0c00cab40 0x7fd0c00c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:29.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.706+0000 7fd0c60e8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c00caf10 0x7fd0c0158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:29.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.706+0000 7fd0c60e8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c014fe40 con 0x7fd0c00caf10 2023-10-06T10:59:29.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.706+0000 7fd0c60e8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00c62f0 con 0x7fd0c00cab40 2023-10-06T10:59:29.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.706+0000 7fd0c60e8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00c56e0 con 0x7fd0c00b2430 2023-10-06T10:59:29.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.706+0000 7fd0bffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c00caf10 0x7fd0c0158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:29.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.706+0000 7fd0bffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c00caf10 0x7fd0c0158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43812/0 (socket says 172.21.15.7:43812) 2023-10-06T10:59:29.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.706+0000 7fd0bffff700 1 -- 172.21.15.7:0/3551743523 learned_addr learned my addr 172.21.15.7:0/3551743523 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:29.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.706+0000 7fd0bf7fe700 1 --2- 172.21.15.7:0/3551743523 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd0c00b2430 0x7fd0c014f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:29.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.706+0000 7fd0beffd700 1 --2- 172.21.15.7:0/3551743523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0c00cab40 0x7fd0c00c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:29.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.707+0000 7fd0bffff700 1 -- 172.21.15.7:0/3551743523 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd0c00b2430 msgr2=0x7fd0c014f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:29.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.707+0000 7fd0bffff700 1 --2- 172.21.15.7:0/3551743523 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd0c00b2430 0x7fd0c014f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.707+0000 7fd0bffff700 1 -- 172.21.15.7:0/3551743523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0c00cab40 msgr2=0x7fd0c00c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:29.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.707+0000 7fd0bffff700 1 --2- 172.21.15.7:0/3551743523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0c00cab40 0x7fd0c00c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.707+0000 7fd0bffff700 1 -- 172.21.15.7:0/3551743523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b8009ae0 con 0x7fd0c00caf10 2023-10-06T10:59:29.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.707+0000 7fd0bffff700 1 --2- 172.21.15.7:0/3551743523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c00caf10 0x7fd0c0158990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd0c006e0b0 tx=0x7fd0b8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:29.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.707+0000 7fd0b77fe700 1 -- 172.21.15.7:0/3551743523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8008c70 con 0x7fd0c00caf10 2023-10-06T10:59:29.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.707+0000 7fd0b77fe700 1 -- 172.21.15.7:0/3551743523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b8008df0 con 0x7fd0c00caf10 2023-10-06T10:59:29.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.707+0000 7fd0b77fe700 1 -- 172.21.15.7:0/3551743523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80266b0 con 0x7fd0c00caf10 2023-10-06T10:59:29.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.707+0000 7fd0c60e8700 1 -- 172.21.15.7:0/3551743523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c00c59c0 con 0x7fd0c00caf10 2023-10-06T10:59:29.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.707+0000 7fd0c60e8700 1 -- 172.21.15.7:0/3551743523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c00c5f80 con 0x7fd0c00caf10 2023-10-06T10:59:29.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.708+0000 7fd0c60e8700 1 -- 172.21.15.7:0/3551743523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c0151930 con 0x7fd0c00caf10 2023-10-06T10:59:29.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.709+0000 7fd0b77fe700 1 -- 172.21.15.7:0/3551743523 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0b8003040 con 0x7fd0c00caf10 2023-10-06T10:59:29.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.709+0000 7fd0b77fe700 1 --2- 172.21.15.7:0/3551743523 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd0a0066f30 0x7fd0a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:29.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.709+0000 7fd0b77fe700 1 -- 172.21.15.7:0/3551743523 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd0b8086960 con 0x7fd0c00caf10 2023-10-06T10:59:29.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.709+0000 7fd0bf7fe700 1 --2- 172.21.15.7:0/3551743523 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd0a0066f30 0x7fd0a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:29.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.710+0000 7fd0bf7fe700 1 --2- 172.21.15.7:0/3551743523 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd0a0066f30 0x7fd0a00693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009d40 tx=0x7fd0b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:29.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.714+0000 7fd0b77fe700 1 -- 172.21.15.7:0/3551743523 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0b8053830 con 0x7fd0c00caf10 2023-10-06T10:59:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.914+0000 7fd0c60e8700 1 -- 172.21.15.7:0/3551743523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0c0070480 con 0x7fd0c00caf10 2023-10-06T10:59:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.914+0000 7fd0b77fe700 1 -- 172.21.15.7:0/3551743523 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd0b8056e50 con 0x7fd0c00caf10 2023-10-06T10:59:29.917 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T10:59:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.916+0000 7fd0c60e8700 1 -- 172.21.15.7:0/3551743523 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd0a0066f30 msgr2=0x7fd0a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.916+0000 7fd0c60e8700 1 --2- 172.21.15.7:0/3551743523 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd0a0066f30 0x7fd0a00693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009d40 tx=0x7fd0b0008040 comp rx=0 tx=0).stop 2023-10-06T10:59:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.916+0000 7fd0c60e8700 1 -- 172.21.15.7:0/3551743523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c00caf10 msgr2=0x7fd0c0158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.916+0000 7fd0c60e8700 1 --2- 172.21.15.7:0/3551743523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c00caf10 0x7fd0c0158990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd0c006e0b0 tx=0x7fd0b8018000 comp rx=0 tx=0).stop 2023-10-06T10:59:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.917+0000 7fd0c60e8700 1 -- 172.21.15.7:0/3551743523 shutdown_connections 2023-10-06T10:59:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.917+0000 7fd0c60e8700 1 --2- 172.21.15.7:0/3551743523 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd0a0066f30 0x7fd0a00693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.917+0000 7fd0c60e8700 1 --2- 172.21.15.7:0/3551743523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c00caf10 0x7fd0c0158990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.917+0000 7fd0c60e8700 1 --2- 172.21.15.7:0/3551743523 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd0c00b2430 0x7fd0c014f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.917+0000 7fd0c60e8700 1 --2- 172.21.15.7:0/3551743523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0c00cab40 0x7fd0c00c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:29.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.917+0000 7fd0c60e8700 1 -- 172.21.15.7:0/3551743523 >> 172.21.15.7:0/3551743523 conn(0x7fd0c00afc90 msgr2=0x7fd0c00ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:29.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.917+0000 7fd0c60e8700 1 -- 172.21.15.7:0/3551743523 shutdown_connections 2023-10-06T10:59:29.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:29.917+0000 7fd0c60e8700 1 -- 172.21.15.7:0/3551743523 wait complete. 2023-10-06T10:59:29.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T10:59:30.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.068+0000 7f208a6fe700 1 Processor -- start 2023-10-06T10:59:30.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.068+0000 7f208a6fe700 1 -- start start 2023-10-06T10:59:30.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.069+0000 7f208a6fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f208406cf80 0x7f20840b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.069+0000 7f208a6fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f20840ac030 0x7f2084159d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.069+0000 7f208a6fe700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20840b0650 con 0x7f20840abc60 2023-10-06T10:59:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.069+0000 7f208a6fe700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208415aae0 con 0x7f208406cf80 2023-10-06T10:59:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.069+0000 7f208a6fe700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20840afd20 con 0x7f20840ac030 2023-10-06T10:59:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.069+0000 7f20837fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f208406cf80 0x7f20840b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.070+0000 7f20837fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f208406cf80 0x7f20840b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39104/0 (socket says 172.21.15.7:39104) 2023-10-06T10:59:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.070+0000 7f20837fe700 1 -- 172.21.15.7:0/3414510763 learned_addr learned my addr 172.21.15.7:0/3414510763 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.070+0000 7f2083fff700 1 --1- 172.21.15.7:0/3414510763 >> v1:172.21.15.7:6789/0 conn(0x7f20840abc60 0x7f208406c870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34090/0 (socket says 172.21.15.7:34090) 2023-10-06T10:59:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.070+0000 7f2088c9b700 1 --2- 172.21.15.7:0/3414510763 >> v2:172.21.15.50:3300/0 conn(0x7f20840ac030 0x7f2084159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.070+0000 7f20837fe700 1 -- 172.21.15.7:0/3414510763 >> v2:172.21.15.50:3300/0 conn(0x7f20840ac030 msgr2=0x7f2084159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:30.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.070+0000 7f20837fe700 1 --2- 172.21.15.7:0/3414510763 >> v2:172.21.15.50:3300/0 conn(0x7f20840ac030 0x7f2084159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.070+0000 7f20837fe700 1 -- 172.21.15.7:0/3414510763 >> v1:172.21.15.7:6789/0 conn(0x7f20840abc60 legacy=0x7f208406c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.070+0000 7f20837fe700 1 -- 172.21.15.7:0/3414510763 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20840b0000 con 0x7f208406cf80 2023-10-06T10:59:30.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.070+0000 7f20837fe700 1 --2- 172.21.15.7:0/3414510763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208406cf80 0x7f20840b0ae0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f208406e440 tx=0x7f2078009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0eeffa0d1e7b829 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:30.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.071+0000 7f2082ffd700 1 -- 172.21.15.7:0/3414510763 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207800b860 con 0x7f208406cf80 2023-10-06T10:59:30.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.071+0000 7f2082ffd700 1 -- 172.21.15.7:0/3414510763 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207800b9c0 con 0x7f208406cf80 2023-10-06T10:59:30.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.071+0000 7f2082ffd700 1 -- 172.21.15.7:0/3414510763 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207800bd60 con 0x7f208406cf80 2023-10-06T10:59:30.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.071+0000 7f208a6fe700 1 -- 172.21.15.7:0/3414510763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208406cf80 msgr2=0x7f20840b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.071+0000 7f208a6fe700 1 --2- 172.21.15.7:0/3414510763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208406cf80 0x7f20840b0ae0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f208406e440 tx=0x7f2078009250 comp rx=0 tx=0).stop 2023-10-06T10:59:30.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.071+0000 7f208a6fe700 1 -- 172.21.15.7:0/3414510763 shutdown_connections 2023-10-06T10:59:30.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.071+0000 7f208a6fe700 1 --2- 172.21.15.7:0/3414510763 >> v2:172.21.15.50:3300/0 conn(0x7f20840ac030 0x7f2084159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.071+0000 7f208a6fe700 1 --2- 172.21.15.7:0/3414510763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208406cf80 0x7f20840b0ae0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.071+0000 7f208a6fe700 1 -- 172.21.15.7:0/3414510763 >> 172.21.15.7:0/3414510763 conn(0x7f20840cce30 msgr2=0x7f20840cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:30.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.071+0000 7f208a6fe700 1 -- 172.21.15.7:0/3414510763 shutdown_connections 2023-10-06T10:59:30.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.071+0000 7f208a6fe700 1 -- 172.21.15.7:0/3414510763 wait complete. 2023-10-06T10:59:30.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.072+0000 7f208a6fe700 1 Processor -- start 2023-10-06T10:59:30.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.073+0000 7f208a6fe700 1 -- start start 2023-10-06T10:59:30.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.073+0000 7f208a6fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208406cf80 0x7f208414dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.073+0000 7f208a6fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20840abc60 0x7f208414a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.073+0000 7f208a6fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20840ac030 0x7f20840af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.073+0000 7f208a6fe700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2084068730 con 0x7f208406cf80 2023-10-06T10:59:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.073+0000 7f208a6fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208414aa10 con 0x7f20840ac030 2023-10-06T10:59:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.073+0000 7f208a6fe700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2084067ab0 con 0x7f20840abc60 2023-10-06T10:59:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f2083fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208406cf80 0x7f208414dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f2083fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208406cf80 0x7f208414dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39112/0 (socket says 172.21.15.7:39112) 2023-10-06T10:59:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f2083fff700 1 -- 172.21.15.7:0/4135594986 learned_addr learned my addr 172.21.15.7:0/4135594986 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f20837fe700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20840abc60 0x7f208414a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f2088c9b700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20840ac030 0x7f20840af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f2083fff700 1 -- 172.21.15.7:0/4135594986 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20840abc60 msgr2=0x7f208414a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f2083fff700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20840abc60 0x7f208414a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f2083fff700 1 -- 172.21.15.7:0/4135594986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20840ac030 msgr2=0x7f20840af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f2083fff700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20840ac030 0x7f20840af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f2083fff700 1 -- 172.21.15.7:0/4135594986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20780094f0 con 0x7f208406cf80 2023-10-06T10:59:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f2088c9b700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20840ac030 0x7f20840af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f2083fff700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208406cf80 0x7f208414dc70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f207400c7c0 tx=0x7f2074007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f206bfff700 1 -- 172.21.15.7:0/4135594986 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20740072e0 con 0x7f208406cf80 2023-10-06T10:59:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f206bfff700 1 -- 172.21.15.7:0/4135594986 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2074007440 con 0x7f208406cf80 2023-10-06T10:59:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f206bfff700 1 -- 172.21.15.7:0/4135594986 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20740057f0 con 0x7f208406cf80 2023-10-06T10:59:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f208a6fe700 1 -- 172.21.15.7:0/4135594986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2084067d90 con 0x7f208406cf80 2023-10-06T10:59:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.074+0000 7f208a6fe700 1 -- 172.21.15.7:0/4135594986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2084068350 con 0x7f208406cf80 2023-10-06T10:59:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.075+0000 7f208a6fe700 1 -- 172.21.15.7:0/4135594986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2084070480 con 0x7f208406cf80 2023-10-06T10:59:30.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.076+0000 7f206bfff700 1 -- 172.21.15.7:0/4135594986 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2074005c40 con 0x7f208406cf80 2023-10-06T10:59:30.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.076+0000 7f206bfff700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2070066f30 0x7f20700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.076+0000 7f206bfff700 1 -- 172.21.15.7:0/4135594986 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2074083ef0 con 0x7f208406cf80 2023-10-06T10:59:30.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.076+0000 7f20837fe700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2070066f30 0x7f20700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.077+0000 7f20837fe700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2070066f30 0x7f20700693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f208406e440 tx=0x7f2078017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:30.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.081+0000 7f206bfff700 1 -- 172.21.15.7:0/4135594986 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2074050c70 con 0x7f208406cf80 2023-10-06T10:59:30.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.282+0000 7f208a6fe700 1 -- 172.21.15.7:0/4135594986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20840b02e0 con 0x7f208406cf80 2023-10-06T10:59:30.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.283+0000 7f206bfff700 1 -- 172.21.15.7:0/4135594986 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20740170a0 con 0x7f208406cf80 2023-10-06T10:59:30.285 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-06T10:59:30.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.285+0000 7f208a6fe700 1 -- 172.21.15.7:0/4135594986 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2070066f30 msgr2=0x7f20700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.285+0000 7f208a6fe700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2070066f30 0x7f20700693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f208406e440 tx=0x7f2078017000 comp rx=0 tx=0).stop 2023-10-06T10:59:30.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.285+0000 7f208a6fe700 1 -- 172.21.15.7:0/4135594986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208406cf80 msgr2=0x7f208414dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.285+0000 7f208a6fe700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208406cf80 0x7f208414dc70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f207400c7c0 tx=0x7f2074007ea0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.285+0000 7f208a6fe700 1 -- 172.21.15.7:0/4135594986 shutdown_connections 2023-10-06T10:59:30.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.285+0000 7f208a6fe700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2070066f30 0x7f20700693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.285+0000 7f208a6fe700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208406cf80 0x7f208414dc70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.285+0000 7f208a6fe700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20840ac030 0x7f20840af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.285+0000 7f208a6fe700 1 --2- 172.21.15.7:0/4135594986 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20840abc60 0x7f208414a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.285+0000 7f208a6fe700 1 -- 172.21.15.7:0/4135594986 >> 172.21.15.7:0/4135594986 conn(0x7f20840cce30 msgr2=0x7f2084069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:30.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.285+0000 7f208a6fe700 1 -- 172.21.15.7:0/4135594986 shutdown_connections 2023-10-06T10:59:30.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.285+0000 7f208a6fe700 1 -- 172.21.15.7:0/4135594986 wait complete. 2023-10-06T10:59:30.300 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T10:59:30.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.433+0000 7fb5b67d8700 1 Processor -- start 2023-10-06T10:59:30.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.433+0000 7fb5b67d8700 1 -- start start 2023-10-06T10:59:30.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.434+0000 7fb5b67d8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5b006c850 0x7fb5b0158d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.434+0000 7fb5b67d8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5b01592b0 0x7fb5b00690f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.434+0000 7fb5b67d8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b00c8510 con 0x7fb5b006c480 2023-10-06T10:59:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.434+0000 7fb5b67d8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b00c96c0 con 0x7fb5b01592b0 2023-10-06T10:59:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.434+0000 7fb5b67d8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b0069e20 con 0x7fb5b006c850 2023-10-06T10:59:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.434+0000 7fb5b4d75700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5b01592b0 0x7fb5b00690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.434+0000 7fb5b4d75700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5b01592b0 0x7fb5b00690f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39116/0 (socket says 172.21.15.7:39116) 2023-10-06T10:59:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.434+0000 7fb5b4d75700 1 -- 172.21.15.7:0/66995048 learned_addr learned my addr 172.21.15.7:0/66995048 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.434+0000 7fb5af7fe700 1 --2- 172.21.15.7:0/66995048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5b006c850 0x7fb5b0158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.435+0000 7fb5b4d75700 1 -- 172.21.15.7:0/66995048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5b006c850 msgr2=0x7fb5b0158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.435+0000 7fb5b4d75700 1 --2- 172.21.15.7:0/66995048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5b006c850 0x7fb5b0158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.435+0000 7fb5b4d75700 1 -- 172.21.15.7:0/66995048 >> v1:172.21.15.50:6789/0 conn(0x7fb5b006c480 legacy=0x7fb5b00c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.435+0000 7fb5b4d75700 1 -- 172.21.15.7:0/66995048 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b00c87b0 con 0x7fb5b01592b0 2023-10-06T10:59:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.435+0000 7fb5aeffd700 1 -- 172.21.15.7:0/66995048 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141007339 0 0) 0x7fb5b00c8510 con 0x7fb5b006c480 2023-10-06T10:59:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.435+0000 7fb5b4d75700 1 --2- 172.21.15.7:0/66995048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b01592b0 0x7fb5b00690f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009f20 tx=0x7fb5a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282af43e97674211 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.435+0000 7fb5aeffd700 1 -- 172.21.15.7:0/66995048 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a800e070 con 0x7fb5b01592b0 2023-10-06T10:59:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.435+0000 7fb5aeffd700 1 -- 172.21.15.7:0/66995048 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a800b9d0 con 0x7fb5b01592b0 2023-10-06T10:59:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.435+0000 7fb5aeffd700 1 -- 172.21.15.7:0/66995048 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80092e0 con 0x7fb5b01592b0 2023-10-06T10:59:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.435+0000 7fb5b67d8700 1 -- 172.21.15.7:0/66995048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b01592b0 msgr2=0x7fb5b00690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.435+0000 7fb5b67d8700 1 --2- 172.21.15.7:0/66995048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b01592b0 0x7fb5b00690f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009f20 tx=0x7fb5a8009840 comp rx=0 tx=0).stop 2023-10-06T10:59:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.436+0000 7fb5b67d8700 1 -- 172.21.15.7:0/66995048 shutdown_connections 2023-10-06T10:59:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.436+0000 7fb5b67d8700 1 --2- 172.21.15.7:0/66995048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b01592b0 0x7fb5b00690f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.436+0000 7fb5b67d8700 1 --2- 172.21.15.7:0/66995048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5b006c850 0x7fb5b0158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.436+0000 7fb5b67d8700 1 -- 172.21.15.7:0/66995048 >> 172.21.15.7:0/66995048 conn(0x7fb5b00cded0 msgr2=0x7fb5b00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.436+0000 7fb5b67d8700 1 -- 172.21.15.7:0/66995048 shutdown_connections 2023-10-06T10:59:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.436+0000 7fb5b67d8700 1 -- 172.21.15.7:0/66995048 wait complete. 2023-10-06T10:59:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.437+0000 7fb5b67d8700 1 Processor -- start 2023-10-06T10:59:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.437+0000 7fb5b67d8700 1 -- start start 2023-10-06T10:59:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5b67d8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5b006c480 0x7fb5b01691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5b67d8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b006c850 0x7fb5b00c1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5b67d8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5b01592b0 0x7fb5b016cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5b67d8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00af030 con 0x7fb5b006c850 2023-10-06T10:59:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5b67d8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00af310 con 0x7fb5b01592b0 2023-10-06T10:59:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5b67d8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00af5f0 con 0x7fb5b006c480 2023-10-06T10:59:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5af7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b006c850 0x7fb5b00c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5af7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b006c850 0x7fb5b00c1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39124/0 (socket says 172.21.15.7:39124) 2023-10-06T10:59:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5af7fe700 1 -- 172.21.15.7:0/2306196427 learned_addr learned my addr 172.21.15.7:0/2306196427 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5affff700 1 --2- 172.21.15.7:0/2306196427 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5b006c480 0x7fb5b01691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5b4d75700 1 --2- 172.21.15.7:0/2306196427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5b01592b0 0x7fb5b016cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5af7fe700 1 -- 172.21.15.7:0/2306196427 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5b006c480 msgr2=0x7fb5b01691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5af7fe700 1 --2- 172.21.15.7:0/2306196427 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5b006c480 0x7fb5b01691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5af7fe700 1 -- 172.21.15.7:0/2306196427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5b01592b0 msgr2=0x7fb5b016cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5af7fe700 1 --2- 172.21.15.7:0/2306196427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5b01592b0 0x7fb5b016cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.438+0000 7fb5af7fe700 1 -- 172.21.15.7:0/2306196427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a8009ae0 con 0x7fb5b006c850 2023-10-06T10:59:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.439+0000 7fb5af7fe700 1 --2- 172.21.15.7:0/2306196427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b006c850 0x7fb5b00c1930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400ec80 tx=0x7fb5a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.439+0000 7fb597fff700 1 -- 172.21.15.7:0/2306196427 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a400c9d0 con 0x7fb5b006c850 2023-10-06T10:59:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.439+0000 7fb597fff700 1 -- 172.21.15.7:0/2306196427 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a400cb30 con 0x7fb5b006c850 2023-10-06T10:59:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.439+0000 7fb5b67d8700 1 -- 172.21.15.7:0/2306196427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b00af8d0 con 0x7fb5b006c850 2023-10-06T10:59:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.439+0000 7fb597fff700 1 -- 172.21.15.7:0/2306196427 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4013470 con 0x7fb5b006c850 2023-10-06T10:59:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.439+0000 7fb5b67d8700 1 -- 172.21.15.7:0/2306196427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b00c1e70 con 0x7fb5b006c850 2023-10-06T10:59:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.440+0000 7fb5b67d8700 1 -- 172.21.15.7:0/2306196427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b00afa60 con 0x7fb5b006c850 2023-10-06T10:59:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.440+0000 7fb597fff700 1 -- 172.21.15.7:0/2306196427 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5a4013820 con 0x7fb5b006c850 2023-10-06T10:59:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.441+0000 7fb597fff700 1 --2- 172.21.15.7:0/2306196427 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb59c066f30 0x7fb59c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.441+0000 7fb597fff700 1 -- 172.21.15.7:0/2306196427 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb5a4084d10 con 0x7fb5b006c850 2023-10-06T10:59:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.441+0000 7fb5affff700 1 --2- 172.21.15.7:0/2306196427 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb59c066f30 0x7fb59c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.441+0000 7fb5affff700 1 --2- 172.21.15.7:0/2306196427 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb59c066f30 0x7fb59c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00011e0 tx=0x7fb5a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.445+0000 7fb597fff700 1 -- 172.21.15.7:0/2306196427 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5a4051b30 con 0x7fb5b006c850 2023-10-06T10:59:30.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.649+0000 7fb5b67d8700 1 -- 172.21.15.7:0/2306196427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb5b0070480 con 0x7fb5b006c850 2023-10-06T10:59:30.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.649+0000 7fb597fff700 1 -- 172.21.15.7:0/2306196427 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb5a4055150 con 0x7fb5b006c850 2023-10-06T10:59:30.651 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T10:59:30.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.651+0000 7fb5b67d8700 1 -- 172.21.15.7:0/2306196427 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb59c066f30 msgr2=0x7fb59c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.651+0000 7fb5b67d8700 1 --2- 172.21.15.7:0/2306196427 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb59c066f30 0x7fb59c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00011e0 tx=0x7fb5a0009040 comp rx=0 tx=0).stop 2023-10-06T10:59:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.651+0000 7fb5b67d8700 1 -- 172.21.15.7:0/2306196427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b006c850 msgr2=0x7fb5b00c1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.651+0000 7fb5b67d8700 1 --2- 172.21.15.7:0/2306196427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b006c850 0x7fb5b00c1930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400ec80 tx=0x7fb5a40091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.651+0000 7fb5b67d8700 1 -- 172.21.15.7:0/2306196427 shutdown_connections 2023-10-06T10:59:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.651+0000 7fb5b67d8700 1 --2- 172.21.15.7:0/2306196427 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb59c066f30 0x7fb59c0693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.651+0000 7fb5b67d8700 1 --2- 172.21.15.7:0/2306196427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5b01592b0 0x7fb5b016cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.651+0000 7fb5b67d8700 1 --2- 172.21.15.7:0/2306196427 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5b006c480 0x7fb5b01691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.651+0000 7fb5b67d8700 1 --2- 172.21.15.7:0/2306196427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b006c850 0x7fb5b00c1930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.652+0000 7fb5b67d8700 1 -- 172.21.15.7:0/2306196427 >> 172.21.15.7:0/2306196427 conn(0x7fb5b00cded0 msgr2=0x7fb5b015e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.652+0000 7fb5b67d8700 1 -- 172.21.15.7:0/2306196427 shutdown_connections 2023-10-06T10:59:30.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.652+0000 7fb5b67d8700 1 -- 172.21.15.7:0/2306196427 wait complete. 2023-10-06T10:59:30.667 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T10:59:30.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.798+0000 7f56a9819700 1 Processor -- start 2023-10-06T10:59:30.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.798+0000 7f56a9819700 1 -- start start 2023-10-06T10:59:30.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.799+0000 7f56a9819700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56a415c8e0 0x7f56a406d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.799+0000 7f56a9819700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56a406dd90 0x7f56a40cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.799+0000 7f56a9819700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a406e7f0 con 0x7f56a415c510 2023-10-06T10:59:30.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.799+0000 7f56a9819700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a40c8df0 con 0x7f56a406dd90 2023-10-06T10:59:30.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.799+0000 7f56a9819700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a4069810 con 0x7f56a415c8e0 2023-10-06T10:59:30.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.799+0000 7f56a37fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56a406dd90 0x7f56a40cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.799+0000 7f56a2ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f56a415c510 0x7f56a4069100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34104/0 (socket says 172.21.15.7:34104) 2023-10-06T10:59:30.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.799+0000 7f56a2ffd700 1 -- 172.21.15.7:0/1169622834 learned_addr learned my addr 172.21.15.7:0/1169622834 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:30.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.799+0000 7f56a27fc700 1 --2- 172.21.15.7:0/1169622834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56a415c8e0 0x7f56a406d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.799+0000 7f56a37fe700 1 -- 172.21.15.7:0/1169622834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56a415c8e0 msgr2=0x7f56a406d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:30.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.799+0000 7f56a37fe700 1 --2- 172.21.15.7:0/1169622834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56a415c8e0 0x7f56a406d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.799+0000 7f56a37fe700 1 -- 172.21.15.7:0/1169622834 >> v1:172.21.15.7:6789/0 conn(0x7f56a415c510 legacy=0x7f56a4069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.799+0000 7f56a37fe700 1 -- 172.21.15.7:0/1169622834 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a406e230 con 0x7f56a406dd90 2023-10-06T10:59:30.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.799+0000 7f56a1ffb700 1 -- 172.21.15.7:0/1169622834 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963585020 0 0) 0x7f56a406e7f0 con 0x7f56a415c510 2023-10-06T10:59:30.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.800+0000 7f56a37fe700 1 --2- 172.21.15.7:0/1169622834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56a406dd90 0x7f56a40cc3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f569c009e90 tx=0x7f569c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2290b9bc0d73b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:30.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.800+0000 7f56a1ffb700 1 -- 172.21.15.7:0/1169622834 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c00e070 con 0x7f56a406dd90 2023-10-06T10:59:30.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.800+0000 7f56a1ffb700 1 -- 172.21.15.7:0/1169622834 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c00bbf0 con 0x7f56a406dd90 2023-10-06T10:59:30.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.800+0000 7f56a1ffb700 1 -- 172.21.15.7:0/1169622834 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c012430 con 0x7f56a406dd90 2023-10-06T10:59:30.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.800+0000 7f56a9819700 1 -- 172.21.15.7:0/1169622834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56a406dd90 msgr2=0x7f56a40cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.800+0000 7f56a9819700 1 --2- 172.21.15.7:0/1169622834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56a406dd90 0x7f56a40cc3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f569c009e90 tx=0x7f569c009780 comp rx=0 tx=0).stop 2023-10-06T10:59:30.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.801+0000 7f56a9819700 1 -- 172.21.15.7:0/1169622834 shutdown_connections 2023-10-06T10:59:30.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.801+0000 7f56a9819700 1 --2- 172.21.15.7:0/1169622834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56a406dd90 0x7f56a40cc3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.801+0000 7f56a9819700 1 --2- 172.21.15.7:0/1169622834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56a415c8e0 0x7f56a406d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.801+0000 7f56a9819700 1 -- 172.21.15.7:0/1169622834 >> 172.21.15.7:0/1169622834 conn(0x7f56a406c2c0 msgr2=0x7f56a406c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:30.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.801+0000 7f56a9819700 1 -- 172.21.15.7:0/1169622834 shutdown_connections 2023-10-06T10:59:30.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.801+0000 7f56a9819700 1 -- 172.21.15.7:0/1169622834 wait complete. 2023-10-06T10:59:30.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.802+0000 7f56a9819700 1 Processor -- start 2023-10-06T10:59:30.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.802+0000 7f56a9819700 1 -- start start 2023-10-06T10:59:30.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a9819700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a406dd90 0x7f56a4155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a9819700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56a415c510 0x7f56a40c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a9819700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56a415c8e0 0x7f56a4157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a9819700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a40c7050 con 0x7f56a415c8e0 2023-10-06T10:59:30.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a9819700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a40b2d20 con 0x7f56a406dd90 2023-10-06T10:59:30.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a9819700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a40c6440 con 0x7f56a415c510 2023-10-06T10:59:30.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56a415c8e0 0x7f56a4157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56a415c8e0 0x7f56a4157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39144/0 (socket says 172.21.15.7:39144) 2023-10-06T10:59:30.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a37fe700 1 -- 172.21.15.7:0/3860329355 learned_addr learned my addr 172.21.15.7:0/3860329355 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:30.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a27fc700 1 --2- 172.21.15.7:0/3860329355 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56a415c510 0x7f56a40c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a2ffd700 1 --2- 172.21.15.7:0/3860329355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a406dd90 0x7f56a4155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a37fe700 1 -- 172.21.15.7:0/3860329355 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56a415c510 msgr2=0x7f56a40c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a37fe700 1 --2- 172.21.15.7:0/3860329355 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56a415c510 0x7f56a40c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a37fe700 1 -- 172.21.15.7:0/3860329355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a406dd90 msgr2=0x7f56a4155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:30.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a37fe700 1 --2- 172.21.15.7:0/3860329355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a406dd90 0x7f56a4155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:30.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a37fe700 1 -- 172.21.15.7:0/3860329355 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c009a20 con 0x7f56a415c8e0 2023-10-06T10:59:30.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.803+0000 7f56a37fe700 1 --2- 172.21.15.7:0/3860329355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56a415c8e0 0x7f56a4157be0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f56a40c4f20 tx=0x7f569c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:30.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.804+0000 7f569affd700 1 -- 172.21.15.7:0/3860329355 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c012e20 con 0x7f56a415c8e0 2023-10-06T10:59:30.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.804+0000 7f569affd700 1 -- 172.21.15.7:0/3860329355 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c01d630 con 0x7f56a415c8e0 2023-10-06T10:59:30.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.804+0000 7f56a9819700 1 -- 172.21.15.7:0/3860329355 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a40c6720 con 0x7f56a415c8e0 2023-10-06T10:59:30.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.804+0000 7f569affd700 1 -- 172.21.15.7:0/3860329355 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c01d9f0 con 0x7f56a415c8e0 2023-10-06T10:59:30.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.804+0000 7f56a9819700 1 -- 172.21.15.7:0/3860329355 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a40c6ce0 con 0x7f56a415c8e0 2023-10-06T10:59:30.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.805+0000 7f56a9819700 1 -- 172.21.15.7:0/3860329355 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a40c7200 con 0x7f56a415c8e0 2023-10-06T10:59:30.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.805+0000 7f569affd700 1 -- 172.21.15.7:0/3860329355 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f569c024070 con 0x7f56a415c8e0 2023-10-06T10:59:30.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.806+0000 7f569affd700 1 --2- 172.21.15.7:0/3860329355 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5684066f30 0x7f56840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:30.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.806+0000 7f569affd700 1 -- 172.21.15.7:0/3860329355 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f569c087290 con 0x7f56a415c8e0 2023-10-06T10:59:30.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.806+0000 7f56a2ffd700 1 --2- 172.21.15.7:0/3860329355 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5684066f30 0x7f56840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:30.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.806+0000 7f56a2ffd700 1 --2- 172.21.15.7:0/3860329355 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5684066f30 0x7f56840693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f56a414b400 tx=0x7f5694007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:30.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:30.810+0000 7f569affd700 1 -- 172.21.15.7:0/3860329355 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56a40c7200 con 0x7f56a415c8e0 2023-10-06T10:59:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.062+0000 7f56a9819700 1 -- 172.21.15.7:0/3860329355 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56a4070480 con 0x7f56a415c8e0 2023-10-06T10:59:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.063+0000 7f569affd700 1 -- 172.21.15.7:0/3860329355 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4581 (secure 0 0 0) 0x7f569c054010 con 0x7f56a415c8e0 2023-10-06T10:59:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:31.065 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/941534596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":941534596},{"type":"v1","addr":"172.21.15.50:6835","nonce":941534596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3152699387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3152699387},{"type":"v1","addr":"172.21.15.50:6834","nonce":3152699387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/271704556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":271704556},{"type":"v1","addr":"172.21.15.7:6837","nonce":271704556}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T10:59:01.833627+0000","modified":"2023-10-06T10:59:21.515113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3123178887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3123178887},{"type":"v1","addr":"172.21.15.7:6836","nonce":3123178887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T10:59:31.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.065+0000 7f56a9819700 1 -- 172.21.15.7:0/3860329355 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5684066f30 msgr2=0x7f56840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.065+0000 7f56a9819700 1 --2- 172.21.15.7:0/3860329355 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5684066f30 0x7f56840693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f56a414b400 tx=0x7f5694007d30 comp rx=0 tx=0).stop 2023-10-06T10:59:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.065+0000 7f56a9819700 1 -- 172.21.15.7:0/3860329355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56a415c8e0 msgr2=0x7f56a4157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.065+0000 7f56a9819700 1 --2- 172.21.15.7:0/3860329355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56a415c8e0 0x7f56a4157be0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f56a40c4f20 tx=0x7f569c019000 comp rx=0 tx=0).stop 2023-10-06T10:59:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.065+0000 7f56a9819700 1 -- 172.21.15.7:0/3860329355 shutdown_connections 2023-10-06T10:59:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.065+0000 7f56a9819700 1 --2- 172.21.15.7:0/3860329355 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5684066f30 0x7f56840693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.065+0000 7f56a9819700 1 --2- 172.21.15.7:0/3860329355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56a415c8e0 0x7f56a4157be0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.065+0000 7f56a9819700 1 --2- 172.21.15.7:0/3860329355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a406dd90 0x7f56a4155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.065+0000 7f56a9819700 1 --2- 172.21.15.7:0/3860329355 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56a415c510 0x7f56a40c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.065+0000 7f56a9819700 1 -- 172.21.15.7:0/3860329355 >> 172.21.15.7:0/3860329355 conn(0x7f56a406c2c0 msgr2=0x7f56a415b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.065+0000 7f56a9819700 1 -- 172.21.15.7:0/3860329355 shutdown_connections 2023-10-06T10:59:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.065+0000 7f56a9819700 1 -- 172.21.15.7:0/3860329355 wait complete. 2023-10-06T10:59:31.069 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2023-10-06T10:59:31.081 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:31.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.211+0000 7f9822415700 1 Processor -- start 2023-10-06T10:59:31.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.211+0000 7f9822415700 1 -- start start 2023-10-06T10:59:31.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.212+0000 7f9822415700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f981c0a6e20 0x7f981c0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.212+0000 7f9822415700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f981c0afb40 0x7f981c0ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.212+0000 7f9822415700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f981c0ad280 0x7f981c0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.212+0000 7f9822415700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c0affb0 con 0x7f981c0afb40 2023-10-06T10:59:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.212+0000 7f9822415700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c0adc40 con 0x7f981c0a6e20 2023-10-06T10:59:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.212+0000 7f9822415700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981c0670f0 con 0x7f981c0ad280 2023-10-06T10:59:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.212+0000 7f981b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f981c0afb40 0x7f981c0ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.212+0000 7f981b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f981c0afb40 0x7f981c0ac7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39156/0 (socket says 172.21.15.7:39156) 2023-10-06T10:59:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.212+0000 7f981b7fe700 1 -- 172.21.15.7:0/748305208 learned_addr learned my addr 172.21.15.7:0/748305208 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.212+0000 7f981bfff700 1 --2- 172.21.15.7:0/748305208 >> v2:172.21.15.50:3300/0 conn(0x7f981c0a6e20 0x7f981c0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.212+0000 7f98209b2700 1 --2- 172.21.15.7:0/748305208 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f981c0ad280 0x7f981c0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.213+0000 7f981b7fe700 1 -- 172.21.15.7:0/748305208 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f981c0ad280 msgr2=0x7f981c0ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:31.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.213+0000 7f981b7fe700 1 --2- 172.21.15.7:0/748305208 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f981c0ad280 0x7f981c0ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.213+0000 7f981b7fe700 1 -- 172.21.15.7:0/748305208 >> v2:172.21.15.50:3300/0 conn(0x7f981c0a6e20 msgr2=0x7f981c0c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:31.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.213+0000 7f981b7fe700 1 --2- 172.21.15.7:0/748305208 >> v2:172.21.15.50:3300/0 conn(0x7f981c0a6e20 0x7f981c0c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.213+0000 7f981b7fe700 1 -- 172.21.15.7:0/748305208 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c067c70 con 0x7f981c0afb40 2023-10-06T10:59:31.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.213+0000 7f981b7fe700 1 --2- 172.21.15.7:0/748305208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f981c0afb40 0x7f981c0ac7f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f981c0b25c0 tx=0x7f9810009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5025d4a887aeb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:31.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.213+0000 7f981affd700 1 -- 172.21.15.7:0/748305208 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000b820 con 0x7f981c0afb40 2023-10-06T10:59:31.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.213+0000 7f981affd700 1 -- 172.21.15.7:0/748305208 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981000b980 con 0x7f981c0afb40 2023-10-06T10:59:31.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.213+0000 7f981affd700 1 -- 172.21.15.7:0/748305208 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000bd20 con 0x7f981c0afb40 2023-10-06T10:59:31.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.214+0000 7f9822415700 1 -- 172.21.15.7:0/748305208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f981c0afb40 msgr2=0x7f981c0ac7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.214+0000 7f9822415700 1 --2- 172.21.15.7:0/748305208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f981c0afb40 0x7f981c0ac7f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f981c0b25c0 tx=0x7f9810009250 comp rx=0 tx=0).stop 2023-10-06T10:59:31.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.214+0000 7f9822415700 1 -- 172.21.15.7:0/748305208 shutdown_connections 2023-10-06T10:59:31.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.214+0000 7f9822415700 1 --2- 172.21.15.7:0/748305208 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f981c0ad280 0x7f981c0ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.214+0000 7f9822415700 1 --2- 172.21.15.7:0/748305208 >> v2:172.21.15.50:3300/0 conn(0x7f981c0a6e20 0x7f981c0c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.214+0000 7f9822415700 1 --2- 172.21.15.7:0/748305208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f981c0afb40 0x7f981c0ac7f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.214+0000 7f9822415700 1 -- 172.21.15.7:0/748305208 >> 172.21.15.7:0/748305208 conn(0x7f981c095a70 msgr2=0x7f981c0af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:31.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.214+0000 7f9822415700 1 -- 172.21.15.7:0/748305208 shutdown_connections 2023-10-06T10:59:31.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.214+0000 7f9822415700 1 -- 172.21.15.7:0/748305208 wait complete. 2023-10-06T10:59:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.215+0000 7f9822415700 1 Processor -- start 2023-10-06T10:59:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.216+0000 7f9822415700 1 -- start start 2023-10-06T10:59:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f9822415700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f981c0a6e20 0x7f981c0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f9822415700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f981c0ad280 0x7f981c14bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f9822415700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981c0afb40 0x7f981c156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f9822415700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c1579a0 con 0x7f981c0ad280 2023-10-06T10:59:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f9822415700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c148c70 con 0x7f981c0afb40 2023-10-06T10:59:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f9822415700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981c148f10 con 0x7f981c0a6e20 2023-10-06T10:59:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f981b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f981c0ad280 0x7f981c14bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f981b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f981c0ad280 0x7f981c14bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39162/0 (socket says 172.21.15.7:39162) 2023-10-06T10:59:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f981b7fe700 1 -- 172.21.15.7:0/452464605 learned_addr learned my addr 172.21.15.7:0/452464605 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f981bfff700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f981c0a6e20 0x7f981c0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f98209b2700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981c0afb40 0x7f981c156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f981b7fe700 1 -- 172.21.15.7:0/452464605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f981c0a6e20 msgr2=0x7f981c0c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f981b7fe700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f981c0a6e20 0x7f981c0c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f981b7fe700 1 -- 172.21.15.7:0/452464605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981c0afb40 msgr2=0x7f981c156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f981b7fe700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981c0afb40 0x7f981c156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f981b7fe700 1 -- 172.21.15.7:0/452464605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98100094f0 con 0x7f981c0ad280 2023-10-06T10:59:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f981bfff700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f981c0a6e20 0x7f981c0c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f981b7fe700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f981c0ad280 0x7f981c14bb20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f98100094c0 tx=0x7f9810017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:31.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f9803fff700 1 -- 172.21.15.7:0/452464605 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981001a450 con 0x7f981c0ad280 2023-10-06T10:59:31.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.217+0000 7f9803fff700 1 -- 172.21.15.7:0/452464605 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981001a5d0 con 0x7f981c0ad280 2023-10-06T10:59:31.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.218+0000 7f9822415700 1 -- 172.21.15.7:0/452464605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981c157100 con 0x7f981c0ad280 2023-10-06T10:59:31.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.218+0000 7f9803fff700 1 -- 172.21.15.7:0/452464605 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981001a990 con 0x7f981c0ad280 2023-10-06T10:59:31.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.218+0000 7f9822415700 1 -- 172.21.15.7:0/452464605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981c1576c0 con 0x7f981c0ad280 2023-10-06T10:59:31.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.219+0000 7f9822415700 1 -- 172.21.15.7:0/452464605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981c070480 con 0x7f981c0ad280 2023-10-06T10:59:31.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.219+0000 7f9803fff700 1 -- 172.21.15.7:0/452464605 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9810025440 con 0x7f981c0ad280 2023-10-06T10:59:31.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.219+0000 7f9803fff700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9808066f30 0x7f98080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.219+0000 7f9803fff700 1 -- 172.21.15.7:0/452464605 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f98100864b0 con 0x7f981c0ad280 2023-10-06T10:59:31.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.220+0000 7f981bfff700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9808066f30 0x7f98080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.220+0000 7f981bfff700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9808066f30 0x7f98080693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f980c006fd0 tx=0x7f980c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:31.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.224+0000 7f9803fff700 1 -- 172.21.15.7:0/452464605 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98100532d0 con 0x7f981c0ad280 2023-10-06T10:59:31.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.427+0000 7f9822415700 1 -- 172.21.15.7:0/452464605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f981c14fb00 con 0x7f981c0ad280 2023-10-06T10:59:31.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.428+0000 7f9803fff700 1 -- 172.21.15.7:0/452464605 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f98100568f0 con 0x7f981c0ad280 2023-10-06T10:59:31.430 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:31.430 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:06.934264+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:31.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.430+0000 7f9822415700 1 -- 172.21.15.7:0/452464605 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9808066f30 msgr2=0x7f98080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.430+0000 7f9822415700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9808066f30 0x7f98080693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f980c006fd0 tx=0x7f980c008040 comp rx=0 tx=0).stop 2023-10-06T10:59:31.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.430+0000 7f9822415700 1 -- 172.21.15.7:0/452464605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f981c0ad280 msgr2=0x7f981c14bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.430+0000 7f9822415700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f981c0ad280 0x7f981c14bb20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f98100094c0 tx=0x7f9810017000 comp rx=0 tx=0).stop 2023-10-06T10:59:31.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.430+0000 7f9822415700 1 -- 172.21.15.7:0/452464605 shutdown_connections 2023-10-06T10:59:31.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.430+0000 7f9822415700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9808066f30 0x7f98080693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.430+0000 7f9822415700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981c0afb40 0x7f981c156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.430+0000 7f9822415700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f981c0a6e20 0x7f981c0c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.430+0000 7f9822415700 1 --2- 172.21.15.7:0/452464605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f981c0ad280 0x7f981c14bb20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.431+0000 7f9822415700 1 -- 172.21.15.7:0/452464605 >> 172.21.15.7:0/452464605 conn(0x7f981c095a70 msgr2=0x7f981c1503c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:31.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.431+0000 7f9822415700 1 -- 172.21.15.7:0/452464605 shutdown_connections 2023-10-06T10:59:31.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.431+0000 7f9822415700 1 -- 172.21.15.7:0/452464605 wait complete. 2023-10-06T10:59:31.446 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T10:58:55.224661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T10:58:56.032929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T10:58:59.772827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T10:59:00.802230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T10:59:04.512252+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T10:59:31.447 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T10:59:31.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.582+0000 7f209cfc1700 1 Processor -- start 2023-10-06T10:59:31.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.582+0000 7f209cfc1700 1 -- start start 2023-10-06T10:59:31.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f209cfc1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f20980b01c0 0x7f20980cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f209cfc1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20980b0590 0x7f20980cca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f209cfc1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f20980c8ab0 0x7f20980c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f209cfc1700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20980c9450 con 0x7f20980c8ab0 2023-10-06T10:59:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f209cfc1700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20980cedc0 con 0x7f20980b01c0 2023-10-06T10:59:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f209cfc1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20980c9720 con 0x7f20980b0590 2023-10-06T10:59:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f2096d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f20980c8ab0 0x7f20980c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f2096d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f20980c8ab0 0x7f20980c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39172/0 (socket says 172.21.15.7:39172) 2023-10-06T10:59:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f2096d9d700 1 -- 172.21.15.7:0/649402120 learned_addr learned my addr 172.21.15.7:0/649402120 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f2095d9b700 1 --2- 172.21.15.7:0/649402120 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20980b0590 0x7f20980cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f209659c700 1 --2- 172.21.15.7:0/649402120 >> v2:172.21.15.50:3300/0 conn(0x7f20980b01c0 0x7f20980cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f2096d9d700 1 -- 172.21.15.7:0/649402120 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20980b0590 msgr2=0x7f20980cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f2096d9d700 1 --2- 172.21.15.7:0/649402120 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20980b0590 0x7f20980cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f2096d9d700 1 -- 172.21.15.7:0/649402120 >> v2:172.21.15.50:3300/0 conn(0x7f20980b01c0 msgr2=0x7f20980cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f2096d9d700 1 --2- 172.21.15.7:0/649402120 >> v2:172.21.15.50:3300/0 conn(0x7f20980b01c0 0x7f20980cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f2096d9d700 1 -- 172.21.15.7:0/649402120 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20980c9a00 con 0x7f20980c8ab0 2023-10-06T10:59:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.583+0000 7f2096d9d700 1 --2- 172.21.15.7:0/649402120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20980c8ab0 0x7f20980c8f10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f209806ed90 tx=0x7f2090009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0def773b91d0f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.584+0000 7f209559a700 1 -- 172.21.15.7:0/649402120 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209000e070 con 0x7f20980c8ab0 2023-10-06T10:59:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.584+0000 7f209559a700 1 -- 172.21.15.7:0/649402120 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209000b970 con 0x7f20980c8ab0 2023-10-06T10:59:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.584+0000 7f209559a700 1 -- 172.21.15.7:0/649402120 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20900092e0 con 0x7f20980c8ab0 2023-10-06T10:59:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.584+0000 7f209cfc1700 1 -- 172.21.15.7:0/649402120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20980c8ab0 msgr2=0x7f20980c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.584+0000 7f209cfc1700 1 --2- 172.21.15.7:0/649402120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20980c8ab0 0x7f20980c8f10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f209806ed90 tx=0x7f2090009840 comp rx=0 tx=0).stop 2023-10-06T10:59:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.584+0000 7f209cfc1700 1 -- 172.21.15.7:0/649402120 shutdown_connections 2023-10-06T10:59:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.584+0000 7f209cfc1700 1 --2- 172.21.15.7:0/649402120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20980c8ab0 0x7f20980c8f10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.584+0000 7f209cfc1700 1 --2- 172.21.15.7:0/649402120 >> v2:172.21.15.50:3300/0 conn(0x7f20980b01c0 0x7f20980cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.584+0000 7f209cfc1700 1 --2- 172.21.15.7:0/649402120 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20980b0590 0x7f20980cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.584+0000 7f209cfc1700 1 -- 172.21.15.7:0/649402120 >> 172.21.15.7:0/649402120 conn(0x7f209806cd00 msgr2=0x7f20980cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.584+0000 7f209cfc1700 1 -- 172.21.15.7:0/649402120 shutdown_connections 2023-10-06T10:59:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.584+0000 7f209cfc1700 1 -- 172.21.15.7:0/649402120 wait complete. 2023-10-06T10:59:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.586+0000 7f209cfc1700 1 Processor -- start 2023-10-06T10:59:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.586+0000 7f209cfc1700 1 -- start start 2023-10-06T10:59:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.586+0000 7f209cfc1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20980b01c0 0x7f20980b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.586+0000 7f209cfc1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20980b0590 0x7f20980c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.586+0000 7f209cfc1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20980c8ab0 0x7f2098144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.586+0000 7f209cfc1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20980b33b0 con 0x7f20980b01c0 2023-10-06T10:59:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.586+0000 7f209cfc1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20980c57c0 con 0x7f20980b0590 2023-10-06T10:59:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.586+0000 7f209cfc1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20980b27a0 con 0x7f20980c8ab0 2023-10-06T10:59:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f209659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20980b01c0 0x7f20980b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f209659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20980b01c0 0x7f20980b21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39180/0 (socket says 172.21.15.7:39180) 2023-10-06T10:59:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f209659c700 1 -- 172.21.15.7:0/245529614 learned_addr learned my addr 172.21.15.7:0/245529614 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f2095d9b700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20980b0590 0x7f20980c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f2096d9d700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20980c8ab0 0x7f2098144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f209659c700 1 -- 172.21.15.7:0/245529614 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20980c8ab0 msgr2=0x7f2098144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f209659c700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20980c8ab0 0x7f2098144880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f209659c700 1 -- 172.21.15.7:0/245529614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20980b0590 msgr2=0x7f20980c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f209659c700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20980b0590 0x7f20980c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f209659c700 1 -- 172.21.15.7:0/245529614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2090009ae0 con 0x7f20980b01c0 2023-10-06T10:59:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f2096d9d700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20980c8ab0 0x7f2098144880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f209659c700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20980b01c0 0x7f20980b21c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f208800ec80 tx=0x7f20880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f20867fc700 1 -- 172.21.15.7:0/245529614 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208800c9d0 con 0x7f20980b01c0 2023-10-06T10:59:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f20867fc700 1 -- 172.21.15.7:0/245529614 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208800cb30 con 0x7f20980b01c0 2023-10-06T10:59:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f209cfc1700 1 -- 172.21.15.7:0/245529614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20980b2a80 con 0x7f20980b01c0 2023-10-06T10:59:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f20867fc700 1 -- 172.21.15.7:0/245529614 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088013470 con 0x7f20980b01c0 2023-10-06T10:59:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.587+0000 7f209cfc1700 1 -- 172.21.15.7:0/245529614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20980b3040 con 0x7f20980b01c0 2023-10-06T10:59:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.588+0000 7f209cfc1700 1 -- 172.21.15.7:0/245529614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2098070480 con 0x7f20980b01c0 2023-10-06T10:59:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.589+0000 7f20867fc700 1 -- 172.21.15.7:0/245529614 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2088013820 con 0x7f20980b01c0 2023-10-06T10:59:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.589+0000 7f20867fc700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2078066f30 0x7f20780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.589+0000 7f20867fc700 1 -- 172.21.15.7:0/245529614 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2088084d70 con 0x7f20980b01c0 2023-10-06T10:59:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.589+0000 7f2095d9b700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2078066f30 0x7f20780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.590+0000 7f2095d9b700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2078066f30 0x7f20780693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f209806a510 tx=0x7f208c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:31.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.594+0000 7f20867fc700 1 -- 172.21.15.7:0/245529614 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2088051b90 con 0x7f20980b01c0 2023-10-06T10:59:31.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.796+0000 7f209cfc1700 1 -- 172.21.15.7:0/245529614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f20980c9ce0 con 0x7f20980b01c0 2023-10-06T10:59:31.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.797+0000 7f20867fc700 1 -- 172.21.15.7:0/245529614 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f20880551b0 con 0x7f20980b01c0 2023-10-06T10:59:31.799 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-10-06T10:59:31.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.799+0000 7f209cfc1700 1 -- 172.21.15.7:0/245529614 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2078066f30 msgr2=0x7f20780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.799+0000 7f209cfc1700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2078066f30 0x7f20780693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f209806a510 tx=0x7f208c008040 comp rx=0 tx=0).stop 2023-10-06T10:59:31.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.799+0000 7f209cfc1700 1 -- 172.21.15.7:0/245529614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20980b01c0 msgr2=0x7f20980b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.799+0000 7f209cfc1700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20980b01c0 0x7f20980b21c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f208800ec80 tx=0x7f20880091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.799+0000 7f209cfc1700 1 -- 172.21.15.7:0/245529614 shutdown_connections 2023-10-06T10:59:31.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.799+0000 7f209cfc1700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2078066f30 0x7f20780693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.799+0000 7f209cfc1700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20980b01c0 0x7f20980b21c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.799+0000 7f209cfc1700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20980c8ab0 0x7f2098144880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.799+0000 7f209cfc1700 1 --2- 172.21.15.7:0/245529614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20980b0590 0x7f20980c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.799+0000 7f209cfc1700 1 -- 172.21.15.7:0/245529614 >> 172.21.15.7:0/245529614 conn(0x7f209806cd00 msgr2=0x7f2098068a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.799+0000 7f209cfc1700 1 -- 172.21.15.7:0/245529614 shutdown_connections 2023-10-06T10:59:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.799+0000 7f209cfc1700 1 -- 172.21.15.7:0/245529614 wait complete. 2023-10-06T10:59:31.814 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T10:59:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.947+0000 7ff33cf5d700 1 Processor -- start 2023-10-06T10:59:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.947+0000 7ff33cf5d700 1 -- start start 2023-10-06T10:59:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.948+0000 7ff33cf5d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3380ae130 0x7ff3380ae590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.948+0000 7ff33cf5d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3380aead0 con 0x7ff33806ad30 2023-10-06T10:59:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.948+0000 7ff33cf5d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3380cb110 con 0x7ff33815a200 2023-10-06T10:59:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.948+0000 7ff33cf5d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff338067800 con 0x7ff3380ae130 2023-10-06T10:59:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.948+0000 7ff335d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff33806ad30 0x7ff3380670f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34116/0 (socket says 172.21.15.7:34116) 2023-10-06T10:59:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.948+0000 7ff335d9b700 1 -- 172.21.15.7:0/1115018974 learned_addr learned my addr 172.21.15.7:0/1115018974 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.948+0000 7ff336d9d700 1 --2- 172.21.15.7:0/1115018974 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3380ae130 0x7ff3380ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.948+0000 7ff33559a700 1 -- 172.21.15.7:0/1115018974 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264344385 0 0) 0x7ff320001110 con 0x7ff33806ad30 2023-10-06T10:59:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.948+0000 7ff33559a700 1 -- 172.21.15.7:0/1115018974 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff324003570 con 0x7ff33806ad30 2023-10-06T10:59:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.949+0000 7ff33559a700 1 -- 172.21.15.7:0/1115018974 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820769168 0 0) 0x7ff3380cb110 con 0x7ff33815a200 2023-10-06T10:59:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.949+0000 7ff33559a700 1 -- 172.21.15.7:0/1115018974 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff320001110 con 0x7ff33815a200 2023-10-06T10:59:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.949+0000 7ff336d9d700 1 -- 172.21.15.7:0/1115018974 >> v1:172.21.15.50:6789/0 conn(0x7ff33815a200 legacy=0x7ff33815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.949+0000 7ff336d9d700 1 -- 172.21.15.7:0/1115018974 >> v1:172.21.15.7:6789/0 conn(0x7ff33806ad30 legacy=0x7ff3380670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.949+0000 7ff336d9d700 1 -- 172.21.15.7:0/1115018974 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33806c070 con 0x7ff3380ae130 2023-10-06T10:59:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.949+0000 7ff336d9d700 1 --2- 172.21.15.7:0/1115018974 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3380ae130 0x7ff3380ae590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff330009e90 tx=0x7ff330009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d1d172b4d46e52 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.949+0000 7ff33559a700 1 -- 172.21.15.7:0/1115018974 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33000e070 con 0x7ff3380ae130 2023-10-06T10:59:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.949+0000 7ff33559a700 1 -- 172.21.15.7:0/1115018974 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33000bb80 con 0x7ff3380ae130 2023-10-06T10:59:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.949+0000 7ff33559a700 1 -- 172.21.15.7:0/1115018974 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330012430 con 0x7ff3380ae130 2023-10-06T10:59:31.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.950+0000 7ff33cf5d700 1 -- 172.21.15.7:0/1115018974 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3380ae130 msgr2=0x7ff3380ae590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.950+0000 7ff33cf5d700 1 --2- 172.21.15.7:0/1115018974 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3380ae130 0x7ff3380ae590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff330009e90 tx=0x7ff330009780 comp rx=0 tx=0).stop 2023-10-06T10:59:31.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.950+0000 7ff33cf5d700 1 -- 172.21.15.7:0/1115018974 shutdown_connections 2023-10-06T10:59:31.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.950+0000 7ff33cf5d700 1 --2- 172.21.15.7:0/1115018974 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3380ae130 0x7ff3380ae590 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.950+0000 7ff33cf5d700 1 -- 172.21.15.7:0/1115018974 >> 172.21.15.7:0/1115018974 conn(0x7ff3380cc560 msgr2=0x7ff3380cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.950+0000 7ff33cf5d700 1 -- 172.21.15.7:0/1115018974 shutdown_connections 2023-10-06T10:59:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.950+0000 7ff33cf5d700 1 -- 172.21.15.7:0/1115018974 wait complete. 2023-10-06T10:59:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.951+0000 7ff33cf5d700 1 Processor -- start 2023-10-06T10:59:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.951+0000 7ff33cf5d700 1 -- start start 2023-10-06T10:59:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff33cf5d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff33806ad30 0x7ff338155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff33cf5d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3380ae130 0x7ff3380a9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff33cf5d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff33815a200 0x7ff3380a75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff33cf5d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33816a0c0 con 0x7ff33806ad30 2023-10-06T10:59:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff33cf5d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff338099c30 con 0x7ff33815a200 2023-10-06T10:59:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff33cf5d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff338166f80 con 0x7ff3380ae130 2023-10-06T10:59:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff33659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff33806ad30 0x7ff338155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff33659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff33806ad30 0x7ff338155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39192/0 (socket says 172.21.15.7:39192) 2023-10-06T10:59:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff33659c700 1 -- 172.21.15.7:0/3273561522 learned_addr learned my addr 172.21.15.7:0/3273561522 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff335d9b700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3380ae130 0x7ff3380a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff336d9d700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff33815a200 0x7ff3380a75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff33659c700 1 -- 172.21.15.7:0/3273561522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3380ae130 msgr2=0x7ff3380a9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff33659c700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3380ae130 0x7ff3380a9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff33659c700 1 -- 172.21.15.7:0/3273561522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff33815a200 msgr2=0x7ff3380a75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff33659c700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff33815a200 0x7ff3380a75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff33659c700 1 -- 172.21.15.7:0/3273561522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff330009a20 con 0x7ff33806ad30 2023-10-06T10:59:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.952+0000 7ff335d9b700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3380ae130 0x7ff3380a9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.953+0000 7ff33659c700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff33806ad30 0x7ff338155630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c7c0 tx=0x7ff328007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.953+0000 7ff32e7fc700 1 -- 172.21.15.7:0/3273561522 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328001520 con 0x7ff33806ad30 2023-10-06T10:59:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.953+0000 7ff32e7fc700 1 -- 172.21.15.7:0/3273561522 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3280016a0 con 0x7ff33806ad30 2023-10-06T10:59:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.953+0000 7ff33cf5d700 1 -- 172.21.15.7:0/3273561522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff338167260 con 0x7ff33806ad30 2023-10-06T10:59:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.953+0000 7ff32e7fc700 1 -- 172.21.15.7:0/3273561522 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328001a60 con 0x7ff33806ad30 2023-10-06T10:59:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.953+0000 7ff33cf5d700 1 -- 172.21.15.7:0/3273561522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff338167820 con 0x7ff33806ad30 2023-10-06T10:59:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.954+0000 7ff33cf5d700 1 -- 172.21.15.7:0/3273561522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff338070480 con 0x7ff33806ad30 2023-10-06T10:59:31.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.954+0000 7ff32e7fc700 1 -- 172.21.15.7:0/3273561522 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff32801b3b0 con 0x7ff33806ad30 2023-10-06T10:59:31.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.955+0000 7ff32e7fc700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff318066f30 0x7ff3180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:31.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.955+0000 7ff32e7fc700 1 -- 172.21.15.7:0/3273561522 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff328084390 con 0x7ff33806ad30 2023-10-06T10:59:31.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.955+0000 7ff335d9b700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff318066f30 0x7ff3180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:31.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.955+0000 7ff335d9b700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff318066f30 0x7ff3180693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff3380caea0 tx=0x7ff320009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:31.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:31.959+0000 7ff32e7fc700 1 -- 172.21.15.7:0/3273561522 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3280511b0 con 0x7ff33806ad30 2023-10-06T10:59:32.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.163+0000 7ff33cf5d700 1 -- 172.21.15.7:0/3273561522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff33806bbc0 con 0x7ff33806ad30 2023-10-06T10:59:32.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.163+0000 7ff32e7fc700 1 -- 172.21.15.7:0/3273561522 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff328017020 con 0x7ff33806ad30 2023-10-06T10:59:32.165 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-06T10:59:32.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.165+0000 7ff33cf5d700 1 -- 172.21.15.7:0/3273561522 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff318066f30 msgr2=0x7ff3180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:32.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.165+0000 7ff33cf5d700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff318066f30 0x7ff3180693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff3380caea0 tx=0x7ff320009040 comp rx=0 tx=0).stop 2023-10-06T10:59:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.165+0000 7ff33cf5d700 1 -- 172.21.15.7:0/3273561522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff33806ad30 msgr2=0x7ff338155630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.165+0000 7ff33cf5d700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff33806ad30 0x7ff338155630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c7c0 tx=0x7ff328007dd0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.165+0000 7ff33cf5d700 1 -- 172.21.15.7:0/3273561522 shutdown_connections 2023-10-06T10:59:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.165+0000 7ff33cf5d700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff318066f30 0x7ff3180693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.165+0000 7ff33cf5d700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff33806ad30 0x7ff338155630 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.165+0000 7ff33cf5d700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff33815a200 0x7ff3380a75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.165+0000 7ff33cf5d700 1 --2- 172.21.15.7:0/3273561522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3380ae130 0x7ff3380a9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.165+0000 7ff33cf5d700 1 -- 172.21.15.7:0/3273561522 >> 172.21.15.7:0/3273561522 conn(0x7ff3380cc560 msgr2=0x7ff3380b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.166+0000 7ff33cf5d700 1 -- 172.21.15.7:0/3273561522 shutdown_connections 2023-10-06T10:59:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.166+0000 7ff33cf5d700 1 -- 172.21.15.7:0/3273561522 wait complete. 2023-10-06T10:59:32.180 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T10:59:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.314+0000 7fe1f861d700 1 Processor -- start 2023-10-06T10:59:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.314+0000 7fe1f861d700 1 -- start start 2023-10-06T10:59:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.315+0000 7fe1f861d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1f00a6d30 0x7fe1f00ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.315+0000 7fe1f861d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f006b1e0 con 0x7fe1f00acca0 2023-10-06T10:59:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.315+0000 7fe1f861d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f006b4c0 con 0x7fe1f00aeb50 2023-10-06T10:59:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.315+0000 7fe1f861d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f006b7a0 con 0x7fe1f00a6d30 2023-10-06T10:59:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.315+0000 7fe1f6bba700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe1f00acca0 0x7fe1f0067ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34128/0 (socket says 172.21.15.7:34128) 2023-10-06T10:59:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.315+0000 7fe1f6bba700 1 -- 172.21.15.7:0/214151807 learned_addr learned my addr 172.21.15.7:0/214151807 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.315+0000 7fe1f63b9700 1 --2- 172.21.15.7:0/214151807 >> v2:172.21.15.50:3300/0 conn(0x7fe1f00a6d30 0x7fe1f00ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.315+0000 7fe1f53b7700 1 -- 172.21.15.7:0/214151807 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876931383 0 0) 0x7fe1f006b1e0 con 0x7fe1f00acca0 2023-10-06T10:59:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.315+0000 7fe1f53b7700 1 -- 172.21.15.7:0/214151807 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1dc003570 con 0x7fe1f00acca0 2023-10-06T10:59:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.315+0000 7fe1f53b7700 1 -- 172.21.15.7:0/214151807 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008459540 0 0) 0x7fe1f006b4c0 con 0x7fe1f00aeb50 2023-10-06T10:59:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.315+0000 7fe1f53b7700 1 -- 172.21.15.7:0/214151807 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1f006b1e0 con 0x7fe1f00aeb50 2023-10-06T10:59:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.315+0000 7fe1f63b9700 1 -- 172.21.15.7:0/214151807 >> v1:172.21.15.50:6789/0 conn(0x7fe1f00aeb50 legacy=0x7fe1f00ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.315+0000 7fe1f63b9700 1 -- 172.21.15.7:0/214151807 >> v1:172.21.15.7:6789/0 conn(0x7fe1f00acca0 legacy=0x7fe1f0067ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.315+0000 7fe1f63b9700 1 -- 172.21.15.7:0/214151807 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f006ba80 con 0x7fe1f00a6d30 2023-10-06T10:59:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.316+0000 7fe1f63b9700 1 --2- 172.21.15.7:0/214151807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f00a6d30 0x7fe1f00ae610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40098e0 tx=0x7fe1e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffe59b31f6cd4b13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.316+0000 7fe1f53b7700 1 -- 172.21.15.7:0/214151807 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4011630 con 0x7fe1f00a6d30 2023-10-06T10:59:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.316+0000 7fe1f53b7700 1 -- 172.21.15.7:0/214151807 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e4011790 con 0x7fe1f00a6d30 2023-10-06T10:59:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.316+0000 7fe1f53b7700 1 -- 172.21.15.7:0/214151807 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4011b30 con 0x7fe1f00a6d30 2023-10-06T10:59:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.316+0000 7fe1f861d700 1 -- 172.21.15.7:0/214151807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f00a6d30 msgr2=0x7fe1f00ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.316+0000 7fe1f861d700 1 --2- 172.21.15.7:0/214151807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f00a6d30 0x7fe1f00ae610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40098e0 tx=0x7fe1e40091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.316+0000 7fe1f861d700 1 -- 172.21.15.7:0/214151807 shutdown_connections 2023-10-06T10:59:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.316+0000 7fe1f861d700 1 --2- 172.21.15.7:0/214151807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f00a6d30 0x7fe1f00ae610 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.316+0000 7fe1f861d700 1 -- 172.21.15.7:0/214151807 >> 172.21.15.7:0/214151807 conn(0x7fe1f00cc560 msgr2=0x7fe1f00cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.317+0000 7fe1f861d700 1 -- 172.21.15.7:0/214151807 shutdown_connections 2023-10-06T10:59:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.317+0000 7fe1f861d700 1 -- 172.21.15.7:0/214151807 wait complete. 2023-10-06T10:59:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.318+0000 7fe1f861d700 1 Processor -- start 2023-10-06T10:59:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.318+0000 7fe1f861d700 1 -- start start 2023-10-06T10:59:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.318+0000 7fe1f861d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f00a6d30 0x7fe1f00c1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.318+0000 7fe1f861d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1f00acca0 0x7fe1f0097140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.318+0000 7fe1f861d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f00aeb50 0x7fe1f014ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.318+0000 7fe1f861d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f014bfa0 con 0x7fe1f00acca0 2023-10-06T10:59:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.318+0000 7fe1f861d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f0096420 con 0x7fe1f00a6d30 2023-10-06T10:59:32.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.318+0000 7fe1f861d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f0096cb0 con 0x7fe1f00aeb50 2023-10-06T10:59:32.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1f5bb8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1f00acca0 0x7fe1f0097140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:32.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1f5bb8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1f00acca0 0x7fe1f0097140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39208/0 (socket says 172.21.15.7:39208) 2023-10-06T10:59:32.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1f5bb8700 1 -- 172.21.15.7:0/749164621 learned_addr learned my addr 172.21.15.7:0/749164621 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:32.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1f63b9700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f00a6d30 0x7fe1f00c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:32.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1f6bba700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f00aeb50 0x7fe1f014ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:32.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1f5bb8700 1 -- 172.21.15.7:0/749164621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f00aeb50 msgr2=0x7fe1f014ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:32.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1f5bb8700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f00aeb50 0x7fe1f014ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1f5bb8700 1 -- 172.21.15.7:0/749164621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f00a6d30 msgr2=0x7fe1f00c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:32.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1f5bb8700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f00a6d30 0x7fe1f00c1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1f5bb8700 1 -- 172.21.15.7:0/749164621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4009420 con 0x7fe1f00acca0 2023-10-06T10:59:32.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1f6bba700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f00aeb50 0x7fe1f014ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1f5bb8700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1f00acca0 0x7fe1f0097140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00c580 tx=0x7fe1ec007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1e27fc700 1 -- 172.21.15.7:0/749164621 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec010510 con 0x7fe1f00acca0 2023-10-06T10:59:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1e27fc700 1 -- 172.21.15.7:0/749164621 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec010670 con 0x7fe1f00acca0 2023-10-06T10:59:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1f861d700 1 -- 172.21.15.7:0/749164621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f0098320 con 0x7fe1f00acca0 2023-10-06T10:59:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.319+0000 7fe1e27fc700 1 -- 172.21.15.7:0/749164621 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec010a30 con 0x7fe1f00acca0 2023-10-06T10:59:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.320+0000 7fe1f861d700 1 -- 172.21.15.7:0/749164621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f0096940 con 0x7fe1f00acca0 2023-10-06T10:59:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.320+0000 7fe1f861d700 1 -- 172.21.15.7:0/749164621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f0070480 con 0x7fe1f00acca0 2023-10-06T10:59:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.321+0000 7fe1e27fc700 1 -- 172.21.15.7:0/749164621 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1ec01b400 con 0x7fe1f00acca0 2023-10-06T10:59:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.321+0000 7fe1e27fc700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe1d4066f30 0x7fe1d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.321+0000 7fe1e27fc700 1 -- 172.21.15.7:0/749164621 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe1ec0845d0 con 0x7fe1f00acca0 2023-10-06T10:59:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.322+0000 7fe1f63b9700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe1d4066f30 0x7fe1d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:32.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.322+0000 7fe1f63b9700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe1d4066f30 0x7fe1d40693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40093f0 tx=0x7fe1e4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:32.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.326+0000 7fe1e27fc700 1 -- 172.21.15.7:0/749164621 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1ec0513f0 con 0x7fe1f00acca0 2023-10-06T10:59:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.529+0000 7fe1f861d700 1 -- 172.21.15.7:0/749164621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1f0096df0 con 0x7fe1f00acca0 2023-10-06T10:59:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.529+0000 7fe1e27fc700 1 -- 172.21.15.7:0/749164621 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1ec054a10 con 0x7fe1f00acca0 2023-10-06T10:59:32.531 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T10:59:32.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.531+0000 7fe1f861d700 1 -- 172.21.15.7:0/749164621 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe1d4066f30 msgr2=0x7fe1d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:32.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.531+0000 7fe1f861d700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe1d4066f30 0x7fe1d40693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40093f0 tx=0x7fe1e4017000 comp rx=0 tx=0).stop 2023-10-06T10:59:32.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.531+0000 7fe1f861d700 1 -- 172.21.15.7:0/749164621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1f00acca0 msgr2=0x7fe1f0097140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:32.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.532+0000 7fe1f861d700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1f00acca0 0x7fe1f0097140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00c580 tx=0x7fe1ec007e10 comp rx=0 tx=0).stop 2023-10-06T10:59:32.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.532+0000 7fe1f861d700 1 -- 172.21.15.7:0/749164621 shutdown_connections 2023-10-06T10:59:32.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.532+0000 7fe1f861d700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe1d4066f30 0x7fe1d40693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.532+0000 7fe1f861d700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f00aeb50 0x7fe1f014ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.532+0000 7fe1f861d700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f00a6d30 0x7fe1f00c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.532+0000 7fe1f861d700 1 --2- 172.21.15.7:0/749164621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1f00acca0 0x7fe1f0097140 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.532+0000 7fe1f861d700 1 -- 172.21.15.7:0/749164621 >> 172.21.15.7:0/749164621 conn(0x7fe1f00cc560 msgr2=0x7fe1f0158aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.532+0000 7fe1f861d700 1 -- 172.21.15.7:0/749164621 shutdown_connections 2023-10-06T10:59:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.532+0000 7fe1f861d700 1 -- 172.21.15.7:0/749164621 wait complete. 2023-10-06T10:59:32.547 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T10:59:32.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.680+0000 7f6512f7e700 1 Processor -- start 2023-10-06T10:59:32.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.680+0000 7f6512f7e700 1 -- start start 2023-10-06T10:59:32.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.681+0000 7f6512f7e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f650c0cbf20 0x7f650c0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:32.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.681+0000 7f6512f7e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f650c0cc2f0 0x7f650c0cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:32.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.681+0000 7f6512f7e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f650c0ca080 0x7f650c158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.681+0000 7f6512f7e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650c0cb7f0 con 0x7f650c0cbf20 2023-10-06T10:59:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.681+0000 7f6512f7e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650c0c8fe0 con 0x7f650c0cc2f0 2023-10-06T10:59:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.681+0000 7f6512f7e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650c0c92c0 con 0x7f650c0ca080 2023-10-06T10:59:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.681+0000 7f6510d1a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f650c0cbf20 0x7f650c0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.682+0000 7f6510d1a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f650c0cbf20 0x7f650c0c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39220/0 (socket says 172.21.15.7:39220) 2023-10-06T10:59:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.682+0000 7f6510d1a700 1 -- 172.21.15.7:0/4221403325 learned_addr learned my addr 172.21.15.7:0/4221403325 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.682+0000 7f651151b700 1 --2- 172.21.15.7:0/4221403325 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f650c0ca080 0x7f650c158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.682+0000 7f650bfff700 1 --2- 172.21.15.7:0/4221403325 >> v2:172.21.15.50:3300/0 conn(0x7f650c0cc2f0 0x7f650c0cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.682+0000 7f6510d1a700 1 -- 172.21.15.7:0/4221403325 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f650c0ca080 msgr2=0x7f650c158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.682+0000 7f6510d1a700 1 --2- 172.21.15.7:0/4221403325 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f650c0ca080 0x7f650c158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.682+0000 7f6510d1a700 1 -- 172.21.15.7:0/4221403325 >> v2:172.21.15.50:3300/0 conn(0x7f650c0cc2f0 msgr2=0x7f650c0cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.682+0000 7f6510d1a700 1 --2- 172.21.15.7:0/4221403325 >> v2:172.21.15.50:3300/0 conn(0x7f650c0cc2f0 0x7f650c0cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.682+0000 7f6510d1a700 1 -- 172.21.15.7:0/4221403325 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c0c95a0 con 0x7f650c0cbf20 2023-10-06T10:59:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.682+0000 7f6510d1a700 1 --2- 172.21.15.7:0/4221403325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f650c0cbf20 0x7f650c0c8920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f650c063e80 tx=0x7f64fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3717220ac350845 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.682+0000 7f650b7fe700 1 -- 172.21.15.7:0/4221403325 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc00b860 con 0x7f650c0cbf20 2023-10-06T10:59:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.682+0000 7f650b7fe700 1 -- 172.21.15.7:0/4221403325 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc00b9c0 con 0x7f650c0cbf20 2023-10-06T10:59:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.682+0000 7f650b7fe700 1 -- 172.21.15.7:0/4221403325 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc00bd60 con 0x7f650c0cbf20 2023-10-06T10:59:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.683+0000 7f6512f7e700 1 -- 172.21.15.7:0/4221403325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f650c0cbf20 msgr2=0x7f650c0c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.683+0000 7f6512f7e700 1 --2- 172.21.15.7:0/4221403325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f650c0cbf20 0x7f650c0c8920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f650c063e80 tx=0x7f64fc009250 comp rx=0 tx=0).stop 2023-10-06T10:59:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.683+0000 7f6512f7e700 1 -- 172.21.15.7:0/4221403325 shutdown_connections 2023-10-06T10:59:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.683+0000 7f6512f7e700 1 --2- 172.21.15.7:0/4221403325 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f650c0ca080 0x7f650c158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.683+0000 7f6512f7e700 1 --2- 172.21.15.7:0/4221403325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f650c0cbf20 0x7f650c0c8920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.683+0000 7f6512f7e700 1 --2- 172.21.15.7:0/4221403325 >> v2:172.21.15.50:3300/0 conn(0x7f650c0cc2f0 0x7f650c0cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.683+0000 7f6512f7e700 1 -- 172.21.15.7:0/4221403325 >> 172.21.15.7:0/4221403325 conn(0x7f650c0afc90 msgr2=0x7f650c0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.683+0000 7f6512f7e700 1 -- 172.21.15.7:0/4221403325 shutdown_connections 2023-10-06T10:59:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.683+0000 7f6512f7e700 1 -- 172.21.15.7:0/4221403325 wait complete. 2023-10-06T10:59:32.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.684+0000 7f6512f7e700 1 Processor -- start 2023-10-06T10:59:32.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.684+0000 7f6512f7e700 1 -- start start 2023-10-06T10:59:32.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.685+0000 7f6512f7e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f650c0ca080 0x7f650c0c3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:32.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.685+0000 7f6512f7e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f650c0cbf20 0x7f650c069220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:32.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.685+0000 7f6512f7e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f650c0cc2f0 0x7f650c146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.685+0000 7f6512f7e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c0c62a0 con 0x7f650c0cc2f0 2023-10-06T10:59:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.685+0000 7f6512f7e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c0c5070 con 0x7f650c0ca080 2023-10-06T10:59:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.685+0000 7f6512f7e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650c0c53b0 con 0x7f650c0cbf20 2023-10-06T10:59:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.685+0000 7f651151b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f650c0cc2f0 0x7f650c146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.685+0000 7f651151b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f650c0cc2f0 0x7f650c146df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39236/0 (socket says 172.21.15.7:39236) 2023-10-06T10:59:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.685+0000 7f651151b700 1 -- 172.21.15.7:0/2507680516 learned_addr learned my addr 172.21.15.7:0/2507680516 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.685+0000 7f6510d1a700 1 --2- 172.21.15.7:0/2507680516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f650c0ca080 0x7f650c0c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.685+0000 7f650bfff700 1 --2- 172.21.15.7:0/2507680516 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f650c0cbf20 0x7f650c069220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.686+0000 7f651151b700 1 -- 172.21.15.7:0/2507680516 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f650c0cbf20 msgr2=0x7f650c069220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.686+0000 7f651151b700 1 --2- 172.21.15.7:0/2507680516 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f650c0cbf20 0x7f650c069220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.686+0000 7f651151b700 1 -- 172.21.15.7:0/2507680516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f650c0ca080 msgr2=0x7f650c0c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:32.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.686+0000 7f651151b700 1 --2- 172.21.15.7:0/2507680516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f650c0ca080 0x7f650c0c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.686+0000 7f651151b700 1 -- 172.21.15.7:0/2507680516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0094f0 con 0x7f650c0cc2f0 2023-10-06T10:59:32.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.686+0000 7f651151b700 1 --2- 172.21.15.7:0/2507680516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f650c0cc2f0 0x7f650c146df0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6504009fa0 tx=0x7f6504009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:32.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.686+0000 7f6508ff9700 1 -- 172.21.15.7:0/2507680516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650400ebc0 con 0x7f650c0cc2f0 2023-10-06T10:59:32.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.686+0000 7f6508ff9700 1 -- 172.21.15.7:0/2507680516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650400ed20 con 0x7f650c0cc2f0 2023-10-06T10:59:32.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.686+0000 7f6512f7e700 1 -- 172.21.15.7:0/2507680516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f650c0c5690 con 0x7f650c0cc2f0 2023-10-06T10:59:32.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.686+0000 7f6508ff9700 1 -- 172.21.15.7:0/2507680516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6504014670 con 0x7f650c0cc2f0 2023-10-06T10:59:32.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.686+0000 7f6512f7e700 1 -- 172.21.15.7:0/2507680516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650c0c5c50 con 0x7f650c0cc2f0 2023-10-06T10:59:32.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.687+0000 7f6512f7e700 1 -- 172.21.15.7:0/2507680516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f650c0b2d30 con 0x7f650c0cc2f0 2023-10-06T10:59:32.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.687+0000 7f6508ff9700 1 -- 172.21.15.7:0/2507680516 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65040149e0 con 0x7f650c0cc2f0 2023-10-06T10:59:32.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.688+0000 7f6508ff9700 1 --2- 172.21.15.7:0/2507680516 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f64f8066f30 0x7f64f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:32.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.688+0000 7f6508ff9700 1 -- 172.21.15.7:0/2507680516 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6504085020 con 0x7f650c0cc2f0 2023-10-06T10:59:32.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.688+0000 7f6510d1a700 1 --2- 172.21.15.7:0/2507680516 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f64f8066f30 0x7f64f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:32.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.688+0000 7f6510d1a700 1 --2- 172.21.15.7:0/2507680516 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f64f8066f30 0x7f64f80693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f650c063e80 tx=0x7f64fc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:32.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.692+0000 7f6508ff9700 1 -- 172.21.15.7:0/2507680516 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6504051e40 con 0x7f650c0cc2f0 2023-10-06T10:59:32.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.893+0000 7f6512f7e700 1 -- 172.21.15.7:0/2507680516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f650c070480 con 0x7f650c0cc2f0 2023-10-06T10:59:32.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.894+0000 7f6508ff9700 1 -- 172.21.15.7:0/2507680516 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6504055460 con 0x7f650c0cc2f0 2023-10-06T10:59:32.896 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-06T10:59:32.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.896+0000 7f6512f7e700 1 -- 172.21.15.7:0/2507680516 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f64f8066f30 msgr2=0x7f64f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:32.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.896+0000 7f6512f7e700 1 --2- 172.21.15.7:0/2507680516 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f64f8066f30 0x7f64f80693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f650c063e80 tx=0x7f64fc017000 comp rx=0 tx=0).stop 2023-10-06T10:59:32.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.896+0000 7f6512f7e700 1 -- 172.21.15.7:0/2507680516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f650c0cc2f0 msgr2=0x7f650c146df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:32.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.896+0000 7f6512f7e700 1 --2- 172.21.15.7:0/2507680516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f650c0cc2f0 0x7f650c146df0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6504009fa0 tx=0x7f6504009900 comp rx=0 tx=0).stop 2023-10-06T10:59:32.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.896+0000 7f6512f7e700 1 -- 172.21.15.7:0/2507680516 shutdown_connections 2023-10-06T10:59:32.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.896+0000 7f6512f7e700 1 --2- 172.21.15.7:0/2507680516 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f64f8066f30 0x7f64f80693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.896+0000 7f6512f7e700 1 --2- 172.21.15.7:0/2507680516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f650c0cc2f0 0x7f650c146df0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.896+0000 7f6512f7e700 1 --2- 172.21.15.7:0/2507680516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f650c0ca080 0x7f650c0c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.896+0000 7f6512f7e700 1 --2- 172.21.15.7:0/2507680516 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f650c0cbf20 0x7f650c069220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:32.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.896+0000 7f6512f7e700 1 -- 172.21.15.7:0/2507680516 >> 172.21.15.7:0/2507680516 conn(0x7f650c0afc90 msgr2=0x7f650c0631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:32.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.896+0000 7f6512f7e700 1 -- 172.21.15.7:0/2507680516 shutdown_connections 2023-10-06T10:59:32.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:32.896+0000 7f6512f7e700 1 -- 172.21.15.7:0/2507680516 wait complete. 2023-10-06T10:59:32.911 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T10:59:33.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.044+0000 7f76dd938700 1 Processor -- start 2023-10-06T10:59:33.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.045+0000 7f76dd938700 1 -- start start 2023-10-06T10:59:33.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.045+0000 7f76dd938700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76d81594c0 0x7f76d80aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.045+0000 7f76dd938700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d80cf870 con 0x7f76d80cb700 2023-10-06T10:59:33.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.045+0000 7f76dd938700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d80cecf0 con 0x7f76d8159890 2023-10-06T10:59:33.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.045+0000 7f76dd938700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d80cef40 con 0x7f76d81594c0 2023-10-06T10:59:33.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d77fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f76d80cb700 0x7f76d80b0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34140/0 (socket says 172.21.15.7:34140) 2023-10-06T10:59:33.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d77fe700 1 -- 172.21.15.7:0/2573374250 learned_addr learned my addr 172.21.15.7:0/2573374250 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:33.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d6ffd700 1 --2- 172.21.15.7:0/2573374250 >> v2:172.21.15.50:3300/0 conn(0x7f76d81594c0 0x7f76d80aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 -- 172.21.15.7:0/2573374250 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201779060 0 0) 0x7f76d80cf870 con 0x7f76d80cb700 2023-10-06T10:59:33.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 -- 172.21.15.7:0/2573374250 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76c4003570 con 0x7f76d80cb700 2023-10-06T10:59:33.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 -- 172.21.15.7:0/2573374250 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3782421009 0 0) 0x7f76c4003570 con 0x7f76d80cb700 2023-10-06T10:59:33.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 -- 172.21.15.7:0/2573374250 >> v2:172.21.15.50:3300/0 conn(0x7f76d81594c0 msgr2=0x7f76d80aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:33.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 --2- 172.21.15.7:0/2573374250 >> v2:172.21.15.50:3300/0 conn(0x7f76d81594c0 0x7f76d80aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 -- 172.21.15.7:0/2573374250 >> v1:172.21.15.50:6789/0 conn(0x7f76d8159890 legacy=0x7f76d80caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 -- 172.21.15.7:0/2573374250 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d80cf220 con 0x7f76d80cb700 2023-10-06T10:59:33.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 -- 172.21.15.7:0/2573374250 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f76d00017f0 con 0x7f76d80cb700 2023-10-06T10:59:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 -- 172.21.15.7:0/2573374250 >> v1:172.21.15.7:6789/0 conn(0x7f76d80cb700 legacy=0x7f76d80b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 --2- 172.21.15.7:0/2573374250 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f76c4003a60 0x7f76c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 --2- 172.21.15.7:0/2573374250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c4004810 0x7f76c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 --2- 172.21.15.7:0/2573374250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c40051c0 0x7f76c400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 -- 172.21.15.7:0/2573374250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d80cef40 con 0x7f76c4004810 2023-10-06T10:59:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 -- 172.21.15.7:0/2573374250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c400c050 con 0x7f76c40051c0 2023-10-06T10:59:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d5ffb700 1 -- 172.21.15.7:0/2573374250 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c400c210 con 0x7f76c4003a60 2023-10-06T10:59:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.046+0000 7f76d67fc700 1 --2- 172.21.15.7:0/2573374250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c4004810 0x7f76c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.047+0000 7f76d6ffd700 1 --2- 172.21.15.7:0/2573374250 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f76c4003a60 0x7f76c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.047+0000 7f76d77fe700 1 --2- 172.21.15.7:0/2573374250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c40051c0 0x7f76c400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.047+0000 7f76d67fc700 1 -- 172.21.15.7:0/2573374250 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f76c4003a60 msgr2=0x7f76c4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:33.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.047+0000 7f76d67fc700 1 --2- 172.21.15.7:0/2573374250 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f76c4003a60 0x7f76c4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.047+0000 7f76d67fc700 1 -- 172.21.15.7:0/2573374250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c40051c0 msgr2=0x7f76c400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:33.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.047+0000 7f76d67fc700 1 --2- 172.21.15.7:0/2573374250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c40051c0 0x7f76c400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.047+0000 7f76d77fe700 1 -- 172.21.15.7:0/2573374250 reap_dead start 2023-10-06T10:59:33.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.047+0000 7f76d67fc700 1 -- 172.21.15.7:0/2573374250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c4003570 con 0x7f76c4004810 2023-10-06T10:59:33.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.047+0000 7f76d67fc700 1 --2- 172.21.15.7:0/2573374250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c4004810 0x7f76c4004c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f76c80019a0 tx=0x7f76c8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e164d5c9c216f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:33.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.047+0000 7f76d5ffb700 1 -- 172.21.15.7:0/2573374250 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c800c5d0 con 0x7f76c4004810 2023-10-06T10:59:33.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.047+0000 7f76d5ffb700 1 -- 172.21.15.7:0/2573374250 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c800c730 con 0x7f76c4004810 2023-10-06T10:59:33.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.047+0000 7f76d5ffb700 1 -- 172.21.15.7:0/2573374250 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c800cad0 con 0x7f76c4004810 2023-10-06T10:59:33.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.048+0000 7f76dd938700 1 -- 172.21.15.7:0/2573374250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c4004810 msgr2=0x7f76c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.048+0000 7f76dd938700 1 --2- 172.21.15.7:0/2573374250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c4004810 0x7f76c4004c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f76c80019a0 tx=0x7f76c8007d10 comp rx=0 tx=0).stop 2023-10-06T10:59:33.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.048+0000 7f76dd938700 1 -- 172.21.15.7:0/2573374250 shutdown_connections 2023-10-06T10:59:33.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.048+0000 7f76dd938700 1 --2- 172.21.15.7:0/2573374250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c4004810 0x7f76c4004c80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.048+0000 7f76dd938700 1 -- 172.21.15.7:0/2573374250 >> 172.21.15.7:0/2573374250 conn(0x7f76d8067bc0 msgr2=0x7f76d80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:33.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.048+0000 7f76dd938700 1 -- 172.21.15.7:0/2573374250 shutdown_connections 2023-10-06T10:59:33.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.048+0000 7f76dd938700 1 -- 172.21.15.7:0/2573374250 wait complete. 2023-10-06T10:59:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.050+0000 7f76dd938700 1 Processor -- start 2023-10-06T10:59:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.050+0000 7f76dd938700 1 -- start start 2023-10-06T10:59:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76dd938700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c4004810 0x7f76d80c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76dd938700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f76d814ed00 0x7f76d80b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76dd938700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76d814f170 0x7f76d80b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76dd938700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d815b460 con 0x7f76d814f170 2023-10-06T10:59:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76dd938700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d80b4ca0 con 0x7f76c4004810 2023-10-06T10:59:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76dd938700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d80b4370 con 0x7f76d814ed00 2023-10-06T10:59:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76d77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76d814f170 0x7f76d80b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76d77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76d814f170 0x7f76d80b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39258/0 (socket says 172.21.15.7:39258) 2023-10-06T10:59:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76d77fe700 1 -- 172.21.15.7:0/2121699772 learned_addr learned my addr 172.21.15.7:0/2121699772 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76d67fc700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f76d814ed00 0x7f76d80b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76d6ffd700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c4004810 0x7f76d80c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76d77fe700 1 -- 172.21.15.7:0/2121699772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f76d814ed00 msgr2=0x7f76d80b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76d77fe700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f76d814ed00 0x7f76d80b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76d77fe700 1 -- 172.21.15.7:0/2121699772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c4004810 msgr2=0x7f76d80c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76d77fe700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c4004810 0x7f76d80c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76d77fe700 1 -- 172.21.15.7:0/2121699772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d80b4650 con 0x7f76d814f170 2023-10-06T10:59:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76d6ffd700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c4004810 0x7f76d80c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76d77fe700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76d814f170 0x7f76d80b1770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f76d80d1220 tx=0x7f76d00021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.051+0000 7f76ceffd700 1 -- 172.21.15.7:0/2121699772 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0007b40 con 0x7f76d814f170 2023-10-06T10:59:33.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.052+0000 7f76ceffd700 1 -- 172.21.15.7:0/2121699772 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d000ad00 con 0x7f76d814f170 2023-10-06T10:59:33.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.052+0000 7f76dd938700 1 -- 172.21.15.7:0/2121699772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d80b4930 con 0x7f76d814f170 2023-10-06T10:59:33.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.052+0000 7f76ceffd700 1 -- 172.21.15.7:0/2121699772 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0013640 con 0x7f76d814f170 2023-10-06T10:59:33.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.052+0000 7f76dd938700 1 -- 172.21.15.7:0/2121699772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d80b5130 con 0x7f76d814f170 2023-10-06T10:59:33.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.053+0000 7f76dd938700 1 -- 172.21.15.7:0/2121699772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d80b4e10 con 0x7f76d814f170 2023-10-06T10:59:33.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.053+0000 7f76ceffd700 1 -- 172.21.15.7:0/2121699772 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f76d00139b0 con 0x7f76d814f170 2023-10-06T10:59:33.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.053+0000 7f76ceffd700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f76b8066f30 0x7f76b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.054+0000 7f76ceffd700 1 -- 172.21.15.7:0/2121699772 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f76d0085210 con 0x7f76d814f170 2023-10-06T10:59:33.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.054+0000 7f76d6ffd700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f76b8066f30 0x7f76b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.054+0000 7f76d6ffd700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f76b8066f30 0x7f76b80693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76c0006f00 tx=0x7f76c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:33.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.058+0000 7f76ceffd700 1 -- 172.21.15.7:0/2121699772 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76d0052030 con 0x7f76d814f170 2023-10-06T10:59:33.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.264+0000 7f76dd938700 1 -- 172.21.15.7:0/2121699772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f76d8070480 con 0x7f76d814f170 2023-10-06T10:59:33.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.265+0000 7f76ceffd700 1 -- 172.21.15.7:0/2121699772 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f76d0055650 con 0x7f76d814f170 2023-10-06T10:59:33.266 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T10:59:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.267+0000 7f76dd938700 1 -- 172.21.15.7:0/2121699772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f76b8066f30 msgr2=0x7f76b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.267+0000 7f76dd938700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f76b8066f30 0x7f76b80693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76c0006f00 tx=0x7f76c0008040 comp rx=0 tx=0).stop 2023-10-06T10:59:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.267+0000 7f76dd938700 1 -- 172.21.15.7:0/2121699772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76d814f170 msgr2=0x7f76d80b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.267+0000 7f76dd938700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76d814f170 0x7f76d80b1770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f76d80d1220 tx=0x7f76d00021f0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.267+0000 7f76dd938700 1 -- 172.21.15.7:0/2121699772 shutdown_connections 2023-10-06T10:59:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.267+0000 7f76dd938700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f76b8066f30 0x7f76b80693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.267+0000 7f76dd938700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76d814f170 0x7f76d80b1770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.267+0000 7f76dd938700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c4004810 0x7f76d80c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.267+0000 7f76dd938700 1 --2- 172.21.15.7:0/2121699772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f76d814ed00 0x7f76d80b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.267+0000 7f76dd938700 1 -- 172.21.15.7:0/2121699772 >> 172.21.15.7:0/2121699772 conn(0x7f76d8067bc0 msgr2=0x7f76d8156610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:33.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.267+0000 7f76dd938700 1 -- 172.21.15.7:0/2121699772 shutdown_connections 2023-10-06T10:59:33.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.267+0000 7f76dd938700 1 -- 172.21.15.7:0/2121699772 wait complete. 2023-10-06T10:59:33.282 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T10:59:33.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.412+0000 7fa472ed5700 1 Processor -- start 2023-10-06T10:59:33.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.412+0000 7fa472ed5700 1 -- start start 2023-10-06T10:59:33.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa472ed5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa46c1590d0 0x7fa46c069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa472ed5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa46c06a0f0 0x7fa46c15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa472ed5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa46c15d350 0x7fa46c067980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa472ed5700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46c15d7b0 con 0x7fa46c1590d0 2023-10-06T10:59:33.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa472ed5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46c0694d0 con 0x7fa46c06a0f0 2023-10-06T10:59:33.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa472ed5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c068ba0 con 0x7fa46c15d350 2023-10-06T10:59:33.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa470c71700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa46c1590d0 0x7fa46c069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa46bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa46c06a0f0 0x7fa46c15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa471472700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa46c15d350 0x7fa46c067980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa470c71700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa46c1590d0 0x7fa46c069bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39266/0 (socket says 172.21.15.7:39266) 2023-10-06T10:59:33.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa470c71700 1 -- 172.21.15.7:0/1978299484 learned_addr learned my addr 172.21.15.7:0/1978299484 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:33.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa470c71700 1 -- 172.21.15.7:0/1978299484 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa46c15d350 msgr2=0x7fa46c067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:33.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa470c71700 1 --2- 172.21.15.7:0/1978299484 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa46c15d350 0x7fa46c067980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa470c71700 1 -- 172.21.15.7:0/1978299484 >> v2:172.21.15.50:3300/0 conn(0x7fa46c06a0f0 msgr2=0x7fa46c15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:33.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa470c71700 1 --2- 172.21.15.7:0/1978299484 >> v2:172.21.15.50:3300/0 conn(0x7fa46c06a0f0 0x7fa46c15ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa470c71700 1 -- 172.21.15.7:0/1978299484 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c068e80 con 0x7fa46c1590d0 2023-10-06T10:59:33.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.414+0000 7fa46bfff700 1 --2- 172.21.15.7:0/1978299484 >> v2:172.21.15.50:3300/0 conn(0x7fa46c06a0f0 0x7fa46c15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:59:33.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.415+0000 7fa470c71700 1 --2- 172.21.15.7:0/1978299484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa46c1590d0 0x7fa46c069bb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa46c06e180 tx=0x7fa45c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4218fcd9649d6c1f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:33.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.415+0000 7fa46b7fe700 1 -- 172.21.15.7:0/1978299484 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c00b640 con 0x7fa46c1590d0 2023-10-06T10:59:33.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.415+0000 7fa46b7fe700 1 -- 172.21.15.7:0/1978299484 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45c00b7a0 con 0x7fa46c1590d0 2023-10-06T10:59:33.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.415+0000 7fa46b7fe700 1 -- 172.21.15.7:0/1978299484 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c00bb60 con 0x7fa46c1590d0 2023-10-06T10:59:33.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.415+0000 7fa472ed5700 1 -- 172.21.15.7:0/1978299484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa46c1590d0 msgr2=0x7fa46c069bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.415+0000 7fa472ed5700 1 --2- 172.21.15.7:0/1978299484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa46c1590d0 0x7fa46c069bb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa46c06e180 tx=0x7fa45c009250 comp rx=0 tx=0).stop 2023-10-06T10:59:33.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.415+0000 7fa472ed5700 1 -- 172.21.15.7:0/1978299484 shutdown_connections 2023-10-06T10:59:33.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.415+0000 7fa472ed5700 1 --2- 172.21.15.7:0/1978299484 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa46c15d350 0x7fa46c067980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.415+0000 7fa472ed5700 1 --2- 172.21.15.7:0/1978299484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa46c1590d0 0x7fa46c069bb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.415+0000 7fa472ed5700 1 --2- 172.21.15.7:0/1978299484 >> v2:172.21.15.50:3300/0 conn(0x7fa46c06a0f0 0x7fa46c15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.415+0000 7fa472ed5700 1 -- 172.21.15.7:0/1978299484 >> 172.21.15.7:0/1978299484 conn(0x7fa46c096160 msgr2=0x7fa46c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:33.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.416+0000 7fa472ed5700 1 -- 172.21.15.7:0/1978299484 shutdown_connections 2023-10-06T10:59:33.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.416+0000 7fa472ed5700 1 -- 172.21.15.7:0/1978299484 wait complete. 2023-10-06T10:59:33.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.417+0000 7fa472ed5700 1 Processor -- start 2023-10-06T10:59:33.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.417+0000 7fa472ed5700 1 -- start start 2023-10-06T10:59:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa472ed5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa46c06a0f0 0x7fa46c098be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa472ed5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa46c1590d0 0x7fa46c099bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa472ed5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa46c15d350 0x7fa46c15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa472ed5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c09a9c0 con 0x7fa46c06a0f0 2023-10-06T10:59:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa472ed5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c156360 con 0x7fa46c1590d0 2023-10-06T10:59:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa472ed5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c09a110 con 0x7fa46c15d350 2023-10-06T10:59:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa470c71700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa46c06a0f0 0x7fa46c098be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa470c71700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa46c06a0f0 0x7fa46c098be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39280/0 (socket says 172.21.15.7:39280) 2023-10-06T10:59:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa470c71700 1 -- 172.21.15.7:0/1587574571 learned_addr learned my addr 172.21.15.7:0/1587574571 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa471472700 1 --2- 172.21.15.7:0/1587574571 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa46c15d350 0x7fa46c15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa46bfff700 1 --2- 172.21.15.7:0/1587574571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa46c1590d0 0x7fa46c099bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa470c71700 1 -- 172.21.15.7:0/1587574571 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa46c15d350 msgr2=0x7fa46c15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa470c71700 1 --2- 172.21.15.7:0/1587574571 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa46c15d350 0x7fa46c15a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa470c71700 1 -- 172.21.15.7:0/1587574571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa46c1590d0 msgr2=0x7fa46c099bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa470c71700 1 --2- 172.21.15.7:0/1587574571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa46c1590d0 0x7fa46c099bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.418+0000 7fa470c71700 1 -- 172.21.15.7:0/1587574571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa454009420 con 0x7fa46c06a0f0 2023-10-06T10:59:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.419+0000 7fa470c71700 1 --2- 172.21.15.7:0/1587574571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa46c06a0f0 0x7fa46c098be0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0b2e50 tx=0x7fa45c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.419+0000 7fa468ff9700 1 -- 172.21.15.7:0/1587574571 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c00b910 con 0x7fa46c06a0f0 2023-10-06T10:59:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.419+0000 7fa468ff9700 1 -- 172.21.15.7:0/1587574571 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45c00ba70 con 0x7fa46c06a0f0 2023-10-06T10:59:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.419+0000 7fa472ed5700 1 -- 172.21.15.7:0/1587574571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45c0094f0 con 0x7fa46c06a0f0 2023-10-06T10:59:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.419+0000 7fa468ff9700 1 -- 172.21.15.7:0/1587574571 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c011630 con 0x7fa46c06a0f0 2023-10-06T10:59:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.419+0000 7fa472ed5700 1 -- 172.21.15.7:0/1587574571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c09a3f0 con 0x7fa46c06a0f0 2023-10-06T10:59:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.420+0000 7fa472ed5700 1 -- 172.21.15.7:0/1587574571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c070480 con 0x7fa46c06a0f0 2023-10-06T10:59:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.420+0000 7fa468ff9700 1 -- 172.21.15.7:0/1587574571 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa45c0119a0 con 0x7fa46c06a0f0 2023-10-06T10:59:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.421+0000 7fa468ff9700 1 --2- 172.21.15.7:0/1587574571 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa44c066f30 0x7fa44c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.421+0000 7fa468ff9700 1 -- 172.21.15.7:0/1587574571 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa45c0860c0 con 0x7fa46c06a0f0 2023-10-06T10:59:33.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.421+0000 7fa46bfff700 1 --2- 172.21.15.7:0/1587574571 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa44c066f30 0x7fa44c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.421+0000 7fa46bfff700 1 --2- 172.21.15.7:0/1587574571 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa44c066f30 0x7fa44c0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa46c096890 tx=0x7fa4540091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:33.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.425+0000 7fa468ff9700 1 -- 172.21.15.7:0/1587574571 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa45c052ee0 con 0x7fa46c06a0f0 2023-10-06T10:59:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.677+0000 7fa472ed5700 1 -- 172.21.15.7:0/1587574571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa46c0cdb60 con 0x7fa46c06a0f0 2023-10-06T10:59:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.678+0000 7fa468ff9700 1 -- 172.21.15.7:0/1587574571 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4581 (secure 0 0 0) 0x7fa45c056500 con 0x7fa46c06a0f0 2023-10-06T10:59:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:33.680 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/941534596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":941534596},{"type":"v1","addr":"172.21.15.50:6835","nonce":941534596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3152699387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3152699387},{"type":"v1","addr":"172.21.15.50:6834","nonce":3152699387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/271704556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":271704556},{"type":"v1","addr":"172.21.15.7:6837","nonce":271704556}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T10:59:01.833627+0000","modified":"2023-10-06T10:59:21.515113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3123178887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3123178887},{"type":"v1","addr":"172.21.15.7:6836","nonce":3123178887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T10:59:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.680+0000 7fa472ed5700 1 -- 172.21.15.7:0/1587574571 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa44c066f30 msgr2=0x7fa44c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.680+0000 7fa472ed5700 1 --2- 172.21.15.7:0/1587574571 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa44c066f30 0x7fa44c0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa46c096890 tx=0x7fa4540091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.680+0000 7fa472ed5700 1 -- 172.21.15.7:0/1587574571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa46c06a0f0 msgr2=0x7fa46c098be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.680+0000 7fa472ed5700 1 --2- 172.21.15.7:0/1587574571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa46c06a0f0 0x7fa46c098be0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0b2e50 tx=0x7fa45c017000 comp rx=0 tx=0).stop 2023-10-06T10:59:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.680+0000 7fa472ed5700 1 -- 172.21.15.7:0/1587574571 shutdown_connections 2023-10-06T10:59:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.680+0000 7fa472ed5700 1 --2- 172.21.15.7:0/1587574571 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa44c066f30 0x7fa44c0693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.680+0000 7fa472ed5700 1 --2- 172.21.15.7:0/1587574571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa46c06a0f0 0x7fa46c098be0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.680+0000 7fa472ed5700 1 --2- 172.21.15.7:0/1587574571 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa46c15d350 0x7fa46c15a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.680+0000 7fa472ed5700 1 --2- 172.21.15.7:0/1587574571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa46c1590d0 0x7fa46c099bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.680+0000 7fa472ed5700 1 -- 172.21.15.7:0/1587574571 >> 172.21.15.7:0/1587574571 conn(0x7fa46c096160 msgr2=0x7fa46c0acb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.681+0000 7fa472ed5700 1 -- 172.21.15.7:0/1587574571 shutdown_connections 2023-10-06T10:59:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.681+0000 7fa472ed5700 1 -- 172.21.15.7:0/1587574571 wait complete. 2023-10-06T10:59:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2023-10-06T10:59:33.696 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:33.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.826+0000 7fd120b2b700 1 Processor -- start 2023-10-06T10:59:33.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.826+0000 7fd120b2b700 1 -- start start 2023-10-06T10:59:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.827+0000 7fd120b2b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd11c1590d0 0x7fd11c069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.827+0000 7fd120b2b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11c0694d0 con 0x7fd11c15d520 2023-10-06T10:59:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.827+0000 7fd120b2b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11c15abc0 con 0x7fd11c06a0f0 2023-10-06T10:59:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.827+0000 7fd120b2b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11c068990 con 0x7fd11c1590d0 2023-10-06T10:59:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.827+0000 7fd11a59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd11c1590d0 0x7fd11c069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.827+0000 7fd11ad9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd11c15d520 0x7fd11c1594a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34144/0 (socket says 172.21.15.7:34144) 2023-10-06T10:59:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.827+0000 7fd11ad9d700 1 -- 172.21.15.7:0/4278162389 learned_addr learned my addr 172.21.15.7:0/4278162389 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.828+0000 7fd11a59c700 1 -- 172.21.15.7:0/4278162389 >> v1:172.21.15.50:6789/0 conn(0x7fd11c06a0f0 legacy=0x7fd11c15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.828+0000 7fd11a59c700 1 -- 172.21.15.7:0/4278162389 >> v1:172.21.15.7:6789/0 conn(0x7fd11c15d520 legacy=0x7fd11c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.828+0000 7fd11959a700 1 -- 172.21.15.7:0/4278162389 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839942517 0 0) 0x7fd11c0694d0 con 0x7fd11c15d520 2023-10-06T10:59:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.828+0000 7fd11a59c700 1 -- 172.21.15.7:0/4278162389 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c068ba0 con 0x7fd11c1590d0 2023-10-06T10:59:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.828+0000 7fd11a59c700 1 --2- 172.21.15.7:0/4278162389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd11c1590d0 0x7fd11c069bb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0098e0 tx=0x7fd10c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ca23784896574a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.828+0000 7fd11959a700 1 -- 172.21.15.7:0/4278162389 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c009e80 con 0x7fd11c1590d0 2023-10-06T10:59:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.828+0000 7fd11959a700 1 -- 172.21.15.7:0/4278162389 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10c00b860 con 0x7fd11c1590d0 2023-10-06T10:59:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.828+0000 7fd11959a700 1 -- 172.21.15.7:0/4278162389 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c00bbe0 con 0x7fd11c1590d0 2023-10-06T10:59:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.829+0000 7fd120b2b700 1 -- 172.21.15.7:0/4278162389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd11c1590d0 msgr2=0x7fd11c069bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.829+0000 7fd120b2b700 1 --2- 172.21.15.7:0/4278162389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd11c1590d0 0x7fd11c069bb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0098e0 tx=0x7fd10c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.829+0000 7fd120b2b700 1 -- 172.21.15.7:0/4278162389 shutdown_connections 2023-10-06T10:59:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.829+0000 7fd120b2b700 1 --2- 172.21.15.7:0/4278162389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd11c1590d0 0x7fd11c069bb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.829+0000 7fd120b2b700 1 -- 172.21.15.7:0/4278162389 >> 172.21.15.7:0/4278162389 conn(0x7fd11c096160 msgr2=0x7fd11c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.829+0000 7fd120b2b700 1 -- 172.21.15.7:0/4278162389 shutdown_connections 2023-10-06T10:59:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.829+0000 7fd120b2b700 1 -- 172.21.15.7:0/4278162389 wait complete. 2023-10-06T10:59:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.830+0000 7fd120b2b700 1 Processor -- start 2023-10-06T10:59:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.830+0000 7fd120b2b700 1 -- start start 2023-10-06T10:59:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd120b2b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd11c06a0f0 0x7fd11c0acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd120b2b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd11c1590d0 0x7fd11c150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd120b2b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd11c15d520 0x7fd11c15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd120b2b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c151a30 con 0x7fd11c15d520 2023-10-06T10:59:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd120b2b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c158530 con 0x7fd11c06a0f0 2023-10-06T10:59:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd120b2b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c157920 con 0x7fd11c1590d0 2023-10-06T10:59:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd11ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd11c15d520 0x7fd11c15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd11a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd11c06a0f0 0x7fd11c0acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd11ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd11c15d520 0x7fd11c15bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39300/0 (socket says 172.21.15.7:39300) 2023-10-06T10:59:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd11ad9d700 1 -- 172.21.15.7:0/2063331979 learned_addr learned my addr 172.21.15.7:0/2063331979 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd119d9b700 1 --2- 172.21.15.7:0/2063331979 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd11c1590d0 0x7fd11c150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd11ad9d700 1 -- 172.21.15.7:0/2063331979 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd11c1590d0 msgr2=0x7fd11c150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd11ad9d700 1 --2- 172.21.15.7:0/2063331979 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd11c1590d0 0x7fd11c150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd11ad9d700 1 -- 172.21.15.7:0/2063331979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd11c06a0f0 msgr2=0x7fd11c0acba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd11ad9d700 1 --2- 172.21.15.7:0/2063331979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd11c06a0f0 0x7fd11c0acba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd11ad9d700 1 -- 172.21.15.7:0/2063331979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c009420 con 0x7fd11c15d520 2023-10-06T10:59:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.831+0000 7fd11ad9d700 1 --2- 172.21.15.7:0/2063331979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd11c15d520 0x7fd11c15bef0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd11400cbc0 tx=0x7fd114001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.832+0000 7fd1127fc700 1 -- 172.21.15.7:0/2063331979 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11400a7e0 con 0x7fd11c15d520 2023-10-06T10:59:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.832+0000 7fd1127fc700 1 -- 172.21.15.7:0/2063331979 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11400a940 con 0x7fd11c15d520 2023-10-06T10:59:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.832+0000 7fd120b2b700 1 -- 172.21.15.7:0/2063331979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11c157c00 con 0x7fd11c15d520 2023-10-06T10:59:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.832+0000 7fd1127fc700 1 -- 172.21.15.7:0/2063331979 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11400ad00 con 0x7fd11c15d520 2023-10-06T10:59:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.832+0000 7fd120b2b700 1 -- 172.21.15.7:0/2063331979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11c1581c0 con 0x7fd11c15d520 2023-10-06T10:59:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.833+0000 7fd120b2b700 1 -- 172.21.15.7:0/2063331979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11c158670 con 0x7fd11c15d520 2023-10-06T10:59:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.833+0000 7fd1127fc700 1 -- 172.21.15.7:0/2063331979 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd114007300 con 0x7fd11c15d520 2023-10-06T10:59:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.834+0000 7fd1127fc700 1 --2- 172.21.15.7:0/2063331979 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd0fc066f30 0x7fd0fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.834+0000 7fd11a59c700 1 --2- 172.21.15.7:0/2063331979 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd0fc066f30 0x7fd0fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.834+0000 7fd1127fc700 1 -- 172.21.15.7:0/2063331979 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd114084c20 con 0x7fd11c15d520 2023-10-06T10:59:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.834+0000 7fd11a59c700 1 --2- 172.21.15.7:0/2063331979 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd0fc066f30 0x7fd0fc0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0093f0 tx=0x7fd10c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:33.838+0000 7fd1127fc700 1 -- 172.21.15.7:0/2063331979 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd11c158670 con 0x7fd11c15d520 2023-10-06T10:59:34.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.044+0000 7fd120b2b700 1 -- 172.21.15.7:0/2063331979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd11c158670 con 0x7fd11c15d520 2023-10-06T10:59:34.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.045+0000 7fd1127fc700 1 -- 172.21.15.7:0/2063331979 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fd11c158670 con 0x7fd11c15d520 2023-10-06T10:59:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:34.048 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:06.934264+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:34.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.047+0000 7fd120b2b700 1 -- 172.21.15.7:0/2063331979 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd0fc066f30 msgr2=0x7fd0fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:34.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.047+0000 7fd120b2b700 1 --2- 172.21.15.7:0/2063331979 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd0fc066f30 0x7fd0fc0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0093f0 tx=0x7fd10c017000 comp rx=0 tx=0).stop 2023-10-06T10:59:34.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.047+0000 7fd120b2b700 1 -- 172.21.15.7:0/2063331979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd11c15d520 msgr2=0x7fd11c15bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:34.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.047+0000 7fd120b2b700 1 --2- 172.21.15.7:0/2063331979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd11c15d520 0x7fd11c15bef0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd11400cbc0 tx=0x7fd114001980 comp rx=0 tx=0).stop 2023-10-06T10:59:34.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.047+0000 7fd120b2b700 1 -- 172.21.15.7:0/2063331979 shutdown_connections 2023-10-06T10:59:34.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.047+0000 7fd120b2b700 1 --2- 172.21.15.7:0/2063331979 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd0fc066f30 0x7fd0fc0693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.047+0000 7fd120b2b700 1 --2- 172.21.15.7:0/2063331979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd11c15d520 0x7fd11c15bef0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.047+0000 7fd120b2b700 1 --2- 172.21.15.7:0/2063331979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd11c06a0f0 0x7fd11c0acba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.047+0000 7fd120b2b700 1 --2- 172.21.15.7:0/2063331979 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd11c1590d0 0x7fd11c150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.047+0000 7fd120b2b700 1 -- 172.21.15.7:0/2063331979 >> 172.21.15.7:0/2063331979 conn(0x7fd11c096160 msgr2=0x7fd11c153120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:34.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.047+0000 7fd120b2b700 1 -- 172.21.15.7:0/2063331979 shutdown_connections 2023-10-06T10:59:34.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.047+0000 7fd120b2b700 1 -- 172.21.15.7:0/2063331979 wait complete. 2023-10-06T10:59:34.063 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T10:59:34.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.194+0000 7f4e0cda0700 1 Processor -- start 2023-10-06T10:59:34.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.194+0000 7f4e0cda0700 1 -- start start 2023-10-06T10:59:34.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.194+0000 7f4e0cda0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e08159170 0x7f4e0806e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:34.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.194+0000 7f4e0cda0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e0806ba50 0x7f4e0806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:34.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e0cda0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4e0806bee0 0x7f4e0815cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:34.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e0cda0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0806a750 con 0x7f4e08159170 2023-10-06T10:59:34.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e0cda0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0806b5b0 con 0x7f4e0806bee0 2023-10-06T10:59:34.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e0cda0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e080c8c10 con 0x7f4e0806ba50 2023-10-06T10:59:34.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e077fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e08159170 0x7f4e0806e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:34.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e077fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e08159170 0x7f4e0806e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39312/0 (socket says 172.21.15.7:39312) 2023-10-06T10:59:34.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e077fe700 1 -- 172.21.15.7:0/2494016698 learned_addr learned my addr 172.21.15.7:0/2494016698 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:34.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e07fff700 1 --2- 172.21.15.7:0/2494016698 >> v2:172.21.15.50:3300/0 conn(0x7f4e0806bee0 0x7f4e0815cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:34.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e06ffd700 1 --2- 172.21.15.7:0/2494016698 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e0806ba50 0x7f4e0806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:34.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e077fe700 1 -- 172.21.15.7:0/2494016698 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e0806ba50 msgr2=0x7f4e0806ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:34.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e077fe700 1 --2- 172.21.15.7:0/2494016698 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e0806ba50 0x7f4e0806ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e077fe700 1 -- 172.21.15.7:0/2494016698 >> v2:172.21.15.50:3300/0 conn(0x7f4e0806bee0 msgr2=0x7f4e0815cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:34.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e077fe700 1 --2- 172.21.15.7:0/2494016698 >> v2:172.21.15.50:3300/0 conn(0x7f4e0806bee0 0x7f4e0815cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e077fe700 1 -- 172.21.15.7:0/2494016698 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0806a9a0 con 0x7f4e08159170 2023-10-06T10:59:34.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e07fff700 1 --2- 172.21.15.7:0/2494016698 >> v2:172.21.15.50:3300/0 conn(0x7f4e0806bee0 0x7f4e0815cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:34.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e06ffd700 1 --2- 172.21.15.7:0/2494016698 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e0806ba50 0x7f4e0806ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:34.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e077fe700 1 --2- 172.21.15.7:0/2494016698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e08159170 0x7f4e0806e780 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4e0809a230 tx=0x7f4df8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e03a5ef6af8dc5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:34.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e067fc700 1 -- 172.21.15.7:0/2494016698 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800b860 con 0x7f4e08159170 2023-10-06T10:59:34.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e067fc700 1 -- 172.21.15.7:0/2494016698 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df800b9c0 con 0x7f4e08159170 2023-10-06T10:59:34.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.195+0000 7f4e067fc700 1 -- 172.21.15.7:0/2494016698 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800bd60 con 0x7f4e08159170 2023-10-06T10:59:34.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.196+0000 7f4e0cda0700 1 -- 172.21.15.7:0/2494016698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e08159170 msgr2=0x7f4e0806e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:34.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.196+0000 7f4e0cda0700 1 --2- 172.21.15.7:0/2494016698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e08159170 0x7f4e0806e780 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4e0809a230 tx=0x7f4df8009250 comp rx=0 tx=0).stop 2023-10-06T10:59:34.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.196+0000 7f4e0cda0700 1 -- 172.21.15.7:0/2494016698 shutdown_connections 2023-10-06T10:59:34.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.196+0000 7f4e0cda0700 1 --2- 172.21.15.7:0/2494016698 >> v2:172.21.15.50:3300/0 conn(0x7f4e0806bee0 0x7f4e0815cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.196+0000 7f4e0cda0700 1 --2- 172.21.15.7:0/2494016698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e08159170 0x7f4e0806e780 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.196+0000 7f4e0cda0700 1 --2- 172.21.15.7:0/2494016698 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e0806ba50 0x7f4e0806ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.196+0000 7f4e0cda0700 1 -- 172.21.15.7:0/2494016698 >> 172.21.15.7:0/2494016698 conn(0x7f4e080cc3f0 msgr2=0x7f4e080cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:34.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.196+0000 7f4e0cda0700 1 -- 172.21.15.7:0/2494016698 shutdown_connections 2023-10-06T10:59:34.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.196+0000 7f4e0cda0700 1 -- 172.21.15.7:0/2494016698 wait complete. 2023-10-06T10:59:34.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.197+0000 7f4e0cda0700 1 Processor -- start 2023-10-06T10:59:34.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.197+0000 7f4e0cda0700 1 -- start start 2023-10-06T10:59:34.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.198+0000 7f4e0cda0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e0806ba50 0x7f4e08151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:34.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.198+0000 7f4e0cda0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e0806bee0 0x7f4e080ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:34.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.198+0000 7f4e0cda0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e08159170 0x7f4e08156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:34.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.198+0000 7f4e0cda0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e080abb50 con 0x7f4e08159170 2023-10-06T10:59:34.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.198+0000 7f4e0cda0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08152850 con 0x7f4e0806ba50 2023-10-06T10:59:34.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.198+0000 7f4e0cda0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e080abdc0 con 0x7f4e0806bee0 2023-10-06T10:59:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.198+0000 7f4e07fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e08159170 0x7f4e08156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.198+0000 7f4e07fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e08159170 0x7f4e08156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39326/0 (socket says 172.21.15.7:39326) 2023-10-06T10:59:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.198+0000 7f4e07fff700 1 -- 172.21.15.7:0/206222125 learned_addr learned my addr 172.21.15.7:0/206222125 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.199+0000 7f4e06ffd700 1 --2- 172.21.15.7:0/206222125 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e0806bee0 0x7f4e080ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.199+0000 7f4e077fe700 1 --2- 172.21.15.7:0/206222125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e0806ba50 0x7f4e08151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.199+0000 7f4e07fff700 1 -- 172.21.15.7:0/206222125 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e0806bee0 msgr2=0x7f4e080ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.199+0000 7f4e07fff700 1 --2- 172.21.15.7:0/206222125 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e0806bee0 0x7f4e080ac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.199+0000 7f4e07fff700 1 -- 172.21.15.7:0/206222125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e0806ba50 msgr2=0x7f4e08151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.199+0000 7f4e07fff700 1 --2- 172.21.15.7:0/206222125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e0806ba50 0x7f4e08151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.199+0000 7f4e07fff700 1 -- 172.21.15.7:0/206222125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df80094f0 con 0x7f4e08159170 2023-10-06T10:59:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.199+0000 7f4e07fff700 1 --2- 172.21.15.7:0/206222125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e08159170 0x7f4e08156020 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000d180 tx=0x7f4e00009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.199+0000 7f4def7fe700 1 -- 172.21.15.7:0/206222125 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0000de20 con 0x7f4e08159170 2023-10-06T10:59:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.199+0000 7f4def7fe700 1 -- 172.21.15.7:0/206222125 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0000f040 con 0x7f4e08159170 2023-10-06T10:59:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.199+0000 7f4e0cda0700 1 -- 172.21.15.7:0/206222125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e080ac0a0 con 0x7f4e08159170 2023-10-06T10:59:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.199+0000 7f4def7fe700 1 -- 172.21.15.7:0/206222125 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00015690 con 0x7f4e08159170 2023-10-06T10:59:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.199+0000 7f4e0cda0700 1 -- 172.21.15.7:0/206222125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e080acb00 con 0x7f4e08159170 2023-10-06T10:59:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.200+0000 7f4e0cda0700 1 -- 172.21.15.7:0/206222125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e080ac2c0 con 0x7f4e08159170 2023-10-06T10:59:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.201+0000 7f4def7fe700 1 -- 172.21.15.7:0/206222125 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e0001e3b0 con 0x7f4e08159170 2023-10-06T10:59:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.201+0000 7f4def7fe700 1 --2- 172.21.15.7:0/206222125 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4df4066f30 0x7f4df40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:34.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.201+0000 7f4def7fe700 1 -- 172.21.15.7:0/206222125 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4e00084f90 con 0x7f4e08159170 2023-10-06T10:59:34.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.201+0000 7f4e077fe700 1 --2- 172.21.15.7:0/206222125 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4df4066f30 0x7f4df40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:34.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.202+0000 7f4e077fe700 1 --2- 172.21.15.7:0/206222125 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4df4066f30 0x7f4df40693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e0809a230 tx=0x7f4df8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:34.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.206+0000 7f4def7fe700 1 -- 172.21.15.7:0/206222125 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e00051db0 con 0x7f4e08159170 2023-10-06T10:59:34.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.463+0000 7f4e0cda0700 1 -- 172.21.15.7:0/206222125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e08070480 con 0x7f4e08159170 2023-10-06T10:59:34.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.464+0000 7f4def7fe700 1 -- 172.21.15.7:0/206222125 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4581 (secure 0 0 0) 0x7f4e0001a090 con 0x7f4e08159170 2023-10-06T10:59:34.466 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:34.466 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/941534596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":941534596},{"type":"v1","addr":"172.21.15.50:6835","nonce":941534596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3152699387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3152699387},{"type":"v1","addr":"172.21.15.50:6834","nonce":3152699387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/271704556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":271704556},{"type":"v1","addr":"172.21.15.7:6837","nonce":271704556}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T10:59:01.833627+0000","modified":"2023-10-06T10:59:21.515113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3123178887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3123178887},{"type":"v1","addr":"172.21.15.7:6836","nonce":3123178887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T10:59:34.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.466+0000 7f4e0cda0700 1 -- 172.21.15.7:0/206222125 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4df4066f30 msgr2=0x7f4df40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.466+0000 7f4e0cda0700 1 --2- 172.21.15.7:0/206222125 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4df4066f30 0x7f4df40693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e0809a230 tx=0x7f4df8017000 comp rx=0 tx=0).stop 2023-10-06T10:59:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.466+0000 7f4e0cda0700 1 -- 172.21.15.7:0/206222125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e08159170 msgr2=0x7f4e08156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.466+0000 7f4e0cda0700 1 --2- 172.21.15.7:0/206222125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e08159170 0x7f4e08156020 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000d180 tx=0x7f4e00009a50 comp rx=0 tx=0).stop 2023-10-06T10:59:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.466+0000 7f4e0cda0700 1 -- 172.21.15.7:0/206222125 shutdown_connections 2023-10-06T10:59:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.466+0000 7f4e0cda0700 1 --2- 172.21.15.7:0/206222125 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4df4066f30 0x7f4df40693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.466+0000 7f4e0cda0700 1 --2- 172.21.15.7:0/206222125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e08159170 0x7f4e08156020 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.466+0000 7f4e0cda0700 1 --2- 172.21.15.7:0/206222125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e0806ba50 0x7f4e08151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.466+0000 7f4e0cda0700 1 --2- 172.21.15.7:0/206222125 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e0806bee0 0x7f4e080ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.466+0000 7f4e0cda0700 1 -- 172.21.15.7:0/206222125 >> 172.21.15.7:0/206222125 conn(0x7f4e080cc3f0 msgr2=0x7f4e080ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.467+0000 7f4e0cda0700 1 -- 172.21.15.7:0/206222125 shutdown_connections 2023-10-06T10:59:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:34.467+0000 7f4e0cda0700 1 -- 172.21.15.7:0/206222125 wait complete. 2023-10-06T10:59:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2023-10-06T10:59:34.884 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T10:59:01.833627+0000', 'modified': '2023-10-06T10:59:21.515113+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6836/3123178887', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3123178887}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3123178887}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T10:59:34.884 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T10:59:34.884 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T10:59:35.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.026+0000 7fd96829c700 1 Processor -- start 2023-10-06T10:59:35.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.026+0000 7fd96829c700 1 -- start start 2023-10-06T10:59:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.027+0000 7fd96829c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd960158120 0x7fd9600c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.027+0000 7fd96829c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd9600cae30 0x7fd9600cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.027+0000 7fd96829c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9600cbd10 con 0x7fd9600c8ba0 2023-10-06T10:59:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.027+0000 7fd96829c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9600cb9e0 con 0x7fd9600cae30 2023-10-06T10:59:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.027+0000 7fd96829c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600c9300 con 0x7fd960158120 2023-10-06T10:59:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.027+0000 7fd966839700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd9600cae30 0x7fd9600cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.027+0000 7fd966038700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd960158120 0x7fd9600c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.027+0000 7fd965837700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd9600c8ba0 0x7fd9600ca720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:41342/0 (socket says 172.21.15.7:41342) 2023-10-06T10:59:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.027+0000 7fd965837700 1 -- 172.21.15.7:0/2695648368 learned_addr learned my addr 172.21.15.7:0/2695648368 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.028+0000 7fd965036700 1 -- 172.21.15.7:0/2695648368 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534642618 0 0) 0x7fd9600cbd10 con 0x7fd9600c8ba0 2023-10-06T10:59:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.028+0000 7fd965036700 1 -- 172.21.15.7:0/2695648368 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd94c003570 con 0x7fd9600c8ba0 2023-10-06T10:59:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.028+0000 7fd966839700 1 -- 172.21.15.7:0/2695648368 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd960158120 msgr2=0x7fd9600c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.028+0000 7fd966839700 1 --2- 172.21.15.7:0/2695648368 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd960158120 0x7fd9600c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.028+0000 7fd966839700 1 -- 172.21.15.7:0/2695648368 >> v1:172.21.15.50:6789/0 conn(0x7fd9600c8ba0 legacy=0x7fd9600ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.028+0000 7fd966839700 1 -- 172.21.15.7:0/2695648368 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9600c95e0 con 0x7fd9600cae30 2023-10-06T10:59:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.028+0000 7fd966038700 1 --2- 172.21.15.7:0/2695648368 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd960158120 0x7fd9600c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:59:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.028+0000 7fd966839700 1 --2- 172.21.15.7:0/2695648368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9600cae30 0x7fd9600cc1a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd958009e60 tx=0x7fd958009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6772ef02b7891094 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.028+0000 7fd965036700 1 -- 172.21.15.7:0/2695648368 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95800e070 con 0x7fd9600cae30 2023-10-06T10:59:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.028+0000 7fd965036700 1 -- 172.21.15.7:0/2695648368 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95800bab0 con 0x7fd9600cae30 2023-10-06T10:59:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.028+0000 7fd965036700 1 -- 172.21.15.7:0/2695648368 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95800be70 con 0x7fd9600cae30 2023-10-06T10:59:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.029+0000 7fd96829c700 1 -- 172.21.15.7:0/2695648368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9600cae30 msgr2=0x7fd9600cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.029+0000 7fd96829c700 1 --2- 172.21.15.7:0/2695648368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9600cae30 0x7fd9600cc1a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd958009e60 tx=0x7fd958009780 comp rx=0 tx=0).stop 2023-10-06T10:59:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.029+0000 7fd96829c700 1 -- 172.21.15.7:0/2695648368 shutdown_connections 2023-10-06T10:59:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.029+0000 7fd96829c700 1 --2- 172.21.15.7:0/2695648368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9600cae30 0x7fd9600cc1a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.029+0000 7fd96829c700 1 --2- 172.21.15.7:0/2695648368 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd960158120 0x7fd9600c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.029+0000 7fd96829c700 1 -- 172.21.15.7:0/2695648368 >> 172.21.15.7:0/2695648368 conn(0x7fd960087920 msgr2=0x7fd960097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.029+0000 7fd96829c700 1 -- 172.21.15.7:0/2695648368 shutdown_connections 2023-10-06T10:59:35.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.029+0000 7fd96829c700 1 -- 172.21.15.7:0/2695648368 wait complete. 2023-10-06T10:59:35.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.030+0000 7fd96829c700 1 Processor -- start 2023-10-06T10:59:35.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.030+0000 7fd96829c700 1 -- start start 2023-10-06T10:59:35.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.031+0000 7fd96829c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9600c8ba0 0x7fd9600c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.031+0000 7fd96829c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9600cae30 0x7fd9600c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.031+0000 7fd96829c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd960158120 0x7fd9600ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.031+0000 7fd96829c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600c3b10 con 0x7fd9600cae30 2023-10-06T10:59:35.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.031+0000 7fd96829c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600c44e0 con 0x7fd960158120 2023-10-06T10:59:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.031+0000 7fd96829c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600c2f00 con 0x7fd9600c8ba0 2023-10-06T10:59:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.031+0000 7fd965837700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9600cae30 0x7fd9600c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.031+0000 7fd965837700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9600cae30 0x7fd9600c3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39340/0 (socket says 172.21.15.7:39340) 2023-10-06T10:59:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.031+0000 7fd965837700 1 -- 172.21.15.7:0/3707222781 learned_addr learned my addr 172.21.15.7:0/3707222781 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.032+0000 7fd966038700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9600c8ba0 0x7fd9600c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.032+0000 7fd966839700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd960158120 0x7fd9600ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.032+0000 7fd965837700 1 -- 172.21.15.7:0/3707222781 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9600c8ba0 msgr2=0x7fd9600c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.032+0000 7fd965837700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9600c8ba0 0x7fd9600c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.032+0000 7fd965837700 1 -- 172.21.15.7:0/3707222781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd960158120 msgr2=0x7fd9600ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.032+0000 7fd965837700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd960158120 0x7fd9600ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.032+0000 7fd965837700 1 -- 172.21.15.7:0/3707222781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c0093c0 con 0x7fd9600cae30 2023-10-06T10:59:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.032+0000 7fd966839700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd960158120 0x7fd9600ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.032+0000 7fd965837700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9600cae30 0x7fd9600c3fa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd95000c590 tx=0x7fd950007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.032+0000 7fd9567fc700 1 -- 172.21.15.7:0/3707222781 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950005cd0 con 0x7fd9600cae30 2023-10-06T10:59:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.032+0000 7fd9567fc700 1 -- 172.21.15.7:0/3707222781 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd950005e50 con 0x7fd9600cae30 2023-10-06T10:59:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.032+0000 7fd9567fc700 1 -- 172.21.15.7:0/3707222781 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950007320 con 0x7fd9600cae30 2023-10-06T10:59:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.032+0000 7fd96829c700 1 -- 172.21.15.7:0/3707222781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd958009a20 con 0x7fd9600cae30 2023-10-06T10:59:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.032+0000 7fd96829c700 1 -- 172.21.15.7:0/3707222781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9600c34c0 con 0x7fd9600cae30 2023-10-06T10:59:35.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.034+0000 7fd9567fc700 1 -- 172.21.15.7:0/3707222781 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd95001b3b0 con 0x7fd9600cae30 2023-10-06T10:59:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.035+0000 7fd9567fc700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd944066f30 0x7fd9440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.035+0000 7fd9567fc700 1 -- 172.21.15.7:0/3707222781 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd950084070 con 0x7fd9600cae30 2023-10-06T10:59:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.035+0000 7fd966038700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd944066f30 0x7fd9440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.035+0000 7fd966038700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd944066f30 0x7fd9440693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009f30 tx=0x7fd95c009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.037+0000 7fd9715b0b80 1 Processor -- start 2023-10-06T10:59:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.037+0000 7fd9715b0b80 1 -- start start 2023-10-06T10:59:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.037+0000 7fd9715b0b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc408450 0x55fccc408820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.037+0000 7fd9715b0b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc3edf40 0x55fccc410f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.037+0000 7fd9715b0b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc4114d0 0x55fccc411940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.037+0000 7fd9715b0b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc2db310 con 0x55fccc408450 2023-10-06T10:59:35.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.037+0000 7fd9715b0b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc318130 con 0x55fccc3edf40 2023-10-06T10:59:35.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.037+0000 7fd9715b0b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fccc315af0 con 0x55fccc4114d0 2023-10-06T10:59:35.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.037+0000 7fd966038700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc408450 0x55fccc408820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.038+0000 7fd966038700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc408450 0x55fccc408820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39348/0 (socket says 172.21.15.7:39348) 2023-10-06T10:59:35.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.038+0000 7fd966038700 1 -- 172.21.15.7:0/2928293528 learned_addr learned my addr 172.21.15.7:0/2928293528 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:35.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.038+0000 7fd965837700 1 --2- 172.21.15.7:0/2928293528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc3edf40 0x55fccc410f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.038+0000 7fd966839700 1 --2- 172.21.15.7:0/2928293528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc4114d0 0x55fccc411940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.038+0000 7fd966038700 1 -- 172.21.15.7:0/2928293528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc4114d0 msgr2=0x55fccc411940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:35.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.038+0000 7fd966038700 1 --2- 172.21.15.7:0/2928293528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc4114d0 0x55fccc411940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.038+0000 7fd966038700 1 -- 172.21.15.7:0/2928293528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc3edf40 msgr2=0x55fccc410f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:35.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.038+0000 7fd966038700 1 --2- 172.21.15.7:0/2928293528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc3edf40 0x55fccc410f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.038+0000 7fd966038700 1 -- 172.21.15.7:0/2928293528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fccc117790 con 0x55fccc408450 2023-10-06T10:59:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.038+0000 7fd966038700 1 --2- 172.21.15.7:0/2928293528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc408450 0x55fccc408820 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd95c012000 tx=0x7fd95c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8c95b345419528 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.038+0000 7fd9437fe700 1 -- 172.21.15.7:0/2928293528 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c014dc0 con 0x55fccc408450 2023-10-06T10:59:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.038+0000 7fd9437fe700 1 -- 172.21.15.7:0/2928293528 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c021420 con 0x55fccc408450 2023-10-06T10:59:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.038+0000 7fd9437fe700 1 -- 172.21.15.7:0/2928293528 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c0217a0 con 0x55fccc408450 2023-10-06T10:59:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.039+0000 7fd9715b0b80 1 -- 172.21.15.7:0/2928293528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc408450 msgr2=0x55fccc408820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.039+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/2928293528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc408450 0x55fccc408820 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd95c012000 tx=0x7fd95c016000 comp rx=0 tx=0).stop 2023-10-06T10:59:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.039+0000 7fd9715b0b80 1 -- 172.21.15.7:0/2928293528 shutdown_connections 2023-10-06T10:59:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.039+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/2928293528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc408450 0x55fccc408820 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.039+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/2928293528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc4114d0 0x55fccc411940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.039+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/2928293528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc3edf40 0x55fccc410f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.039+0000 7fd9715b0b80 1 -- 172.21.15.7:0/2928293528 >> 172.21.15.7:0/2928293528 conn(0x55fccc40b880 msgr2=0x55fccc40bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.039+0000 7fd9715b0b80 1 -- 172.21.15.7:0/2928293528 shutdown_connections 2023-10-06T10:59:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.039+0000 7fd9715b0b80 1 -- 172.21.15.7:0/2928293528 wait complete. 2023-10-06T10:59:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.040+0000 7fd9715b0b80 1 -- start start 2023-10-06T10:59:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.040+0000 7fd9715b0b80 1 Processor -- start 2023-10-06T10:59:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.041+0000 7fd9715b0b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc3edf40 0x55fccc3e37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.041+0000 7fd9715b0b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc408450 0x55fccc3c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.041+0000 7fd9715b0b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc4114d0 0x55fccc41ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.041+0000 7fd9715b0b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc3118e0 con 0x55fccc3edf40 2023-10-06T10:59:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.041+0000 7fd9715b0b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc2bd980 con 0x55fccc408450 2023-10-06T10:59:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.041+0000 7fd9715b0b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fccc2bd620 con 0x55fccc4114d0 2023-10-06T10:59:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.041+0000 7fd9715b0b80 10 client.0 _ll_register_callbacks cb 0x55fccc120a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T10:59:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.041+0000 7fd966038700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc3edf40 0x55fccc3e37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.041+0000 7fd966038700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc3edf40 0x55fccc3e37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39358/0 (socket says 172.21.15.7:39358) 2023-10-06T10:59:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.041+0000 7fd966038700 1 -- 172.21.15.7:0/1468125622 learned_addr learned my addr 172.21.15.7:0/1468125622 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.041+0000 7fd965837700 1 --2- 172.21.15.7:0/1468125622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc408450 0x55fccc3c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd966839700 1 --2- 172.21.15.7:0/1468125622 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc4114d0 0x55fccc41ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd966038700 1 -- 172.21.15.7:0/1468125622 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc4114d0 msgr2=0x55fccc41ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd966038700 1 --2- 172.21.15.7:0/1468125622 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc4114d0 0x55fccc41ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd966038700 1 -- 172.21.15.7:0/1468125622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc408450 msgr2=0x55fccc3c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd966038700 1 --2- 172.21.15.7:0/1468125622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc408450 0x55fccc3c27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd966038700 1 -- 172.21.15.7:0/1468125622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95c011cb0 con 0x55fccc3edf40 2023-10-06T10:59:35.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd966038700 1 --2- 172.21.15.7:0/1468125622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc3edf40 0x55fccc3e37b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd95c014fd0 tx=0x7fd95c022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b661c0d93df3d3a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:35.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd940ff9700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-06T10:59:35.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd940ff9700 1 -- 172.21.15.7:0/1468125622 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c021d60 con 0x55fccc3edf40 2023-10-06T10:59:35.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd940ff9700 1 -- 172.21.15.7:0/1468125622 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd95c005a00 con 0x55fccc3edf40 2023-10-06T10:59:35.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd9715b0b80 1 -- 172.21.15.7:0/1468125622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fccc3b5d60 con 0x55fccc3edf40 2023-10-06T10:59:35.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd940ff9700 1 -- 172.21.15.7:0/1468125622 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd95c005e10 con 0x55fccc3edf40 2023-10-06T10:59:35.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd9715b0b80 10 client.4767 fetch_fsmap learned FSMap version 9 2023-10-06T10:59:35.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd9715b0b80 1 -- 172.21.15.7:0/1468125622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55fccc2040a0 con 0x55fccc3edf40 2023-10-06T10:59:35.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd940ff9700 1 -- 172.21.15.7:0/1468125622 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fccc3b5d60 con 0x55fccc3edf40 2023-10-06T10:59:35.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.042+0000 7fd940ff9700 1 -- 172.21.15.7:0/1468125622 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fd95c006040 con 0x55fccc3edf40 2023-10-06T10:59:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.043+0000 7fd9715b0b80 10 client.4767 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T10:59:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.043+0000 7fd9715b0b80 10 client.4767 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T10:59:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.043+0000 7fd9715b0b80 20 client.4767 populate_metadata read hostname 'smithi007' 2023-10-06T10:59:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.043+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/1468125622 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x55fccc407380 0x55fccc407750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.043+0000 7fd9715b0b80 4 client.4767 mds_command: new command op to 4272 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T10:59:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.043+0000 7fd9715b0b80 1 -- 172.21.15.7:0/1468125622 --> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fccc392b30 con 0x55fccc407380 2023-10-06T10:59:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.043+0000 7fd965837700 1 --2- 172.21.15.7:0/1468125622 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x55fccc407380 0x55fccc407750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.043+0000 7fd940ff9700 10 client.4767 ms_handle_connect on v2:172.21.15.7:6834/3123178887 2023-10-06T10:59:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.043+0000 7fd965837700 1 --2- 172.21.15.7:0/1468125622 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x55fccc407380 0x55fccc407750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c5135867dde0d8c server_cookie=c0e3a1b63d9036f4 in_seq=0 out_seq=0 2023-10-06T10:59:35.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd940ff9700 1 -- 172.21.15.7:0/1468125622 <== mds.0 v2:172.21.15.7:6834/3123178887 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55fccc392b30 con 0x55fccc407380 2023-10-06T10:59:35.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd940ff9700 10 client.4767 handle_command_reply: tid=0 2023-10-06T10:59:35.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd9715b0b80 1 client.4767 shutdown 2023-10-06T10:59:35.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd9715b0b80 1 -- 172.21.15.7:0/1468125622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc3edf40 msgr2=0x55fccc3e37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/1468125622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc3edf40 0x55fccc3e37b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd95c014fd0 tx=0x7fd95c022000 comp rx=0 tx=0).stop 2023-10-06T10:59:35.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd9715b0b80 1 -- 172.21.15.7:0/1468125622 shutdown_connections 2023-10-06T10:59:35.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/1468125622 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x55fccc407380 0x55fccc407750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/1468125622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc3edf40 0x55fccc3e37b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/1468125622 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc4114d0 0x55fccc41ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/1468125622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc408450 0x55fccc3c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd9715b0b80 1 -- 172.21.15.7:0/1468125622 >> 172.21.15.7:0/1468125622 conn(0x55fccc40b880 msgr2=0x55fccc3bdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:35.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd940ff9700 0 client.4767 ms_handle_reset on v2:172.21.15.7:6834/3123178887 2023-10-06T10:59:35.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd9715b0b80 1 -- 172.21.15.7:0/1468125622 shutdown_connections 2023-10-06T10:59:35.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd9715b0b80 1 -- 172.21.15.7:0/1468125622 wait complete. 2023-10-06T10:59:35.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.044+0000 7fd9715b0b80 20 client.4767 trim_cache size 0 max 16384 2023-10-06T10:59:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.062+0000 7fd9715b0b80 1 Processor -- start 2023-10-06T10:59:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.062+0000 7fd9715b0b80 1 -- start start 2023-10-06T10:59:35.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd9715b0b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc3edf40 0x55fccc40b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd9715b0b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc408450 0x55fccc3c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd9715b0b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc4114d0 0x55fccc3c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd9715b0b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc409540 con 0x55fccc3edf40 2023-10-06T10:59:35.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd9715b0b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc1a91e0 con 0x55fccc4114d0 2023-10-06T10:59:35.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd9715b0b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fccc3e7790 con 0x55fccc408450 2023-10-06T10:59:35.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd966038700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc3edf40 0x55fccc40b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd966038700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc3edf40 0x55fccc40b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39374/0 (socket says 172.21.15.7:39374) 2023-10-06T10:59:35.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd966038700 1 -- 172.21.15.7:0/740573290 learned_addr learned my addr 172.21.15.7:0/740573290 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:35.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd965837700 1 --2- 172.21.15.7:0/740573290 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc408450 0x55fccc3c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd966839700 1 --2- 172.21.15.7:0/740573290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc4114d0 0x55fccc3c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd966038700 1 -- 172.21.15.7:0/740573290 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc408450 msgr2=0x55fccc3c26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:35.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd966038700 1 --2- 172.21.15.7:0/740573290 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc408450 0x55fccc3c26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd966038700 1 -- 172.21.15.7:0/740573290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc4114d0 msgr2=0x55fccc3c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd966038700 1 --2- 172.21.15.7:0/740573290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc4114d0 0x55fccc3c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd966038700 1 -- 172.21.15.7:0/740573290 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fccc2e03c0 con 0x55fccc3edf40 2023-10-06T10:59:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd966839700 1 --2- 172.21.15.7:0/740573290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc4114d0 0x55fccc3c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd966038700 1 --2- 172.21.15.7:0/740573290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc3edf40 0x55fccc40b2c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd95c011f20 tx=0x7fd95c02e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bb72882bcd6666 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.063+0000 7fd943fff700 1 -- 172.21.15.7:0/740573290 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c005a00 con 0x55fccc3edf40 2023-10-06T10:59:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.064+0000 7fd943fff700 1 -- 172.21.15.7:0/740573290 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c0067e0 con 0x55fccc3edf40 2023-10-06T10:59:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.064+0000 7fd943fff700 1 -- 172.21.15.7:0/740573290 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c014ab0 con 0x55fccc3edf40 2023-10-06T10:59:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.064+0000 7fd9715b0b80 1 -- 172.21.15.7:0/740573290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc3edf40 msgr2=0x55fccc40b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.064+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/740573290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc3edf40 0x55fccc40b2c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd95c011f20 tx=0x7fd95c02e040 comp rx=0 tx=0).stop 2023-10-06T10:59:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.064+0000 7fd9715b0b80 1 -- 172.21.15.7:0/740573290 shutdown_connections 2023-10-06T10:59:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.064+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/740573290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc3edf40 0x55fccc40b2c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.064+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/740573290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc4114d0 0x55fccc3c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.064+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/740573290 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc408450 0x55fccc3c26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.064+0000 7fd9715b0b80 1 -- 172.21.15.7:0/740573290 >> 172.21.15.7:0/740573290 conn(0x55fccc40b880 msgr2=0x55fccc3befd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.064+0000 7fd9715b0b80 1 -- 172.21.15.7:0/740573290 shutdown_connections 2023-10-06T10:59:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.064+0000 7fd9715b0b80 1 -- 172.21.15.7:0/740573290 wait complete. 2023-10-06T10:59:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.065+0000 7fd9715b0b80 1 -- start start 2023-10-06T10:59:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.065+0000 7fd9715b0b80 1 Processor -- start 2023-10-06T10:59:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd9715b0b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc3edf40 0x55fccc46a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd9715b0b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc408450 0x55fccc3c1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd9715b0b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc4114d0 0x55fccc3c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd9715b0b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc3e19e0 con 0x55fccc4114d0 2023-10-06T10:59:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd9715b0b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc410b00 con 0x55fccc3edf40 2023-10-06T10:59:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd9715b0b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fccc471410 con 0x55fccc408450 2023-10-06T10:59:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd9715b0b80 10 client.0 _ll_register_callbacks cb 0x55fccc120a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T10:59:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd966839700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc4114d0 0x55fccc3c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd966839700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc4114d0 0x55fccc3c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39390/0 (socket says 172.21.15.7:39390) 2023-10-06T10:59:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd966839700 1 -- 172.21.15.7:0/188607563 learned_addr learned my addr 172.21.15.7:0/188607563 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd966038700 1 --2- 172.21.15.7:0/188607563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc3edf40 0x55fccc46a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd965837700 1 --2- 172.21.15.7:0/188607563 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc408450 0x55fccc3c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd966839700 1 -- 172.21.15.7:0/188607563 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc408450 msgr2=0x55fccc3c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd966839700 1 --2- 172.21.15.7:0/188607563 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc408450 0x55fccc3c1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd966839700 1 -- 172.21.15.7:0/188607563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc3edf40 msgr2=0x55fccc46a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd966839700 1 --2- 172.21.15.7:0/188607563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc3edf40 0x55fccc46a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.066+0000 7fd966839700 1 -- 172.21.15.7:0/188607563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fccc2040a0 con 0x55fccc4114d0 2023-10-06T10:59:35.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd966839700 1 --2- 172.21.15.7:0/188607563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc4114d0 0x55fccc3c1c90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd958013000 tx=0x7fd958019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64707728957dda7a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:35.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd940ff9700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-06T10:59:35.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd940ff9700 1 -- 172.21.15.7:0/188607563 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958025070 con 0x55fccc4114d0 2023-10-06T10:59:35.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd940ff9700 1 -- 172.21.15.7:0/188607563 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd958029410 con 0x55fccc4114d0 2023-10-06T10:59:35.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd9715b0b80 1 -- 172.21.15.7:0/188607563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd95c021420 con 0x55fccc4114d0 2023-10-06T10:59:35.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd940ff9700 1 -- 172.21.15.7:0/188607563 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd95800bec0 con 0x55fccc4114d0 2023-10-06T10:59:35.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd9715b0b80 10 client.4773 fetch_fsmap learned FSMap version 9 2023-10-06T10:59:35.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd9715b0b80 1 -- 172.21.15.7:0/188607563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55fccc1781d0 con 0x55fccc4114d0 2023-10-06T10:59:35.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd940ff9700 1 -- 172.21.15.7:0/188607563 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c021420 con 0x55fccc4114d0 2023-10-06T10:59:35.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd940ff9700 1 -- 172.21.15.7:0/188607563 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fd9580297e0 con 0x55fccc4114d0 2023-10-06T10:59:35.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd9715b0b80 10 client.4773 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T10:59:35.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd9715b0b80 10 client.4773 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T10:59:35.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd9715b0b80 20 client.4773 populate_metadata read hostname 'smithi007' 2023-10-06T10:59:35.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/188607563 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x55fccc474480 0x55fccc474850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd9715b0b80 4 client.4773 mds_command: new command op to 4272 tid=0[{"prefix": "status"}] 2023-10-06T10:59:35.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd9715b0b80 1 -- 172.21.15.7:0/188607563 --> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fccc2b48d0 con 0x55fccc474480 2023-10-06T10:59:35.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.067+0000 7fd966038700 1 --2- 172.21.15.7:0/188607563 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x55fccc474480 0x55fccc474850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd940ff9700 10 client.4773 ms_handle_connect on v2:172.21.15.7:6834/3123178887 2023-10-06T10:59:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd966038700 1 --2- 172.21.15.7:0/188607563 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x55fccc474480 0x55fccc474850 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cae5fa5855abc01 server_cookie=800a3eb6410f917d in_seq=0 out_seq=0 2023-10-06T10:59:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd940ff9700 1 -- 172.21.15.7:0/188607563 <== mds.0 v2:172.21.15.7:6834/3123178887 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55fccc2b48d0 con 0x55fccc474480 2023-10-06T10:59:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd940ff9700 10 client.4773 handle_command_reply: tid=0 2023-10-06T10:59:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd9715b0b80 1 client.4773 shutdown 2023-10-06T10:59:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd9715b0b80 1 -- 172.21.15.7:0/188607563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc4114d0 msgr2=0x55fccc3c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/188607563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc4114d0 0x55fccc3c1c90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd958013000 tx=0x7fd958019000 comp rx=0 tx=0).stop 2023-10-06T10:59:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd9715b0b80 1 -- 172.21.15.7:0/188607563 shutdown_connections 2023-10-06T10:59:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/188607563 >> [v2:172.21.15.7:6834/3123178887,v1:172.21.15.7:6836/3123178887] conn(0x55fccc474480 0x55fccc474850 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/188607563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fccc4114d0 0x55fccc3c1c90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/188607563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fccc3edf40 0x55fccc46a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd940ff9700 0 client.4773 ms_handle_reset on v2:172.21.15.7:6834/3123178887 2023-10-06T10:59:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd9715b0b80 1 --2- 172.21.15.7:0/188607563 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55fccc408450 0x55fccc3c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd9715b0b80 1 -- 172.21.15.7:0/188607563 >> 172.21.15.7:0/188607563 conn(0x55fccc40b880 msgr2=0x55fccc3befd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd9715b0b80 1 -- 172.21.15.7:0/188607563 shutdown_connections 2023-10-06T10:59:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.068+0000 7fd9715b0b80 1 -- 172.21.15.7:0/188607563 wait complete. 2023-10-06T10:59:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.069+0000 7fd9715b0b80 20 client.4773 trim_cache size 0 max 16384 2023-10-06T10:59:35.081 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T10:59:35.081 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "ff7fc17b-4d49-4596-ba3b-1d865cad8f21", 2023-10-06T10:59:35.081 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-06T10:59:35.081 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4272, 2023-10-06T10:59:35.081 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-06T10:59:35.081 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-06T10:59:35.081 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-06T10:59:35.081 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 32.654524790000004, 2023-10-06T10:59:35.082 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 9, 2023-10-06T10:59:35.082 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 25, 2023-10-06T10:59:35.082 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 25, 2023-10-06T10:59:35.082 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 38.574688061000003 2023-10-06T10:59:35.082 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T10:59:35.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.069+0000 7fd96829c700 1 -- 172.21.15.7:0/3707222781 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd944066f30 msgr2=0x7fd9440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.069+0000 7fd96829c700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd944066f30 0x7fd9440693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009f30 tx=0x7fd95c009120 comp rx=0 tx=0).stop 2023-10-06T10:59:35.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.069+0000 7fd96829c700 1 -- 172.21.15.7:0/3707222781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9600cae30 msgr2=0x7fd9600c3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.069+0000 7fd96829c700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9600cae30 0x7fd9600c3fa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd95000c590 tx=0x7fd950007e00 comp rx=0 tx=0).stop 2023-10-06T10:59:35.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.069+0000 7fd96829c700 1 -- 172.21.15.7:0/3707222781 shutdown_connections 2023-10-06T10:59:35.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.069+0000 7fd96829c700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd944066f30 0x7fd9440693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.069+0000 7fd96829c700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd960158120 0x7fd9600ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.069+0000 7fd96829c700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9600c8ba0 0x7fd9600c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.069+0000 7fd96829c700 1 --2- 172.21.15.7:0/3707222781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9600cae30 0x7fd9600c3fa0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.069+0000 7fd96829c700 1 -- 172.21.15.7:0/3707222781 >> 172.21.15.7:0/3707222781 conn(0x7fd960087920 msgr2=0x7fd96006d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:35.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.069+0000 7fd96829c700 1 -- 172.21.15.7:0/3707222781 shutdown_connections 2023-10-06T10:59:35.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.069+0000 7fd96829c700 1 -- 172.21.15.7:0/3707222781 wait complete. 2023-10-06T10:59:35.085 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-06T10:59:35.101 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-06T10:59:35.102 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T10:59:35.102 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-06T10:59:35.102 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-06T10:59:35.102 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-06T10:59:35.103 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-06T10:59:35.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:35.103 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-06T10:59:35.125 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-06T10:59:35.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:35.126 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T10:59:35.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:35.210 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2023-10-06T10:59:35.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:35.294 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-06T10:59:35.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:35.319 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-10-06T10:59:35.396 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2023-10-06T10:59:35.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T10:59:35.398 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-06T10:59:35.398 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T10:59:35.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.538+0000 7f989cd10700 1 Processor -- start 2023-10-06T10:59:35.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.538+0000 7f989cd10700 1 -- start start 2023-10-06T10:59:35.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.539+0000 7f989cd10700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98980cb1c0 0x7f98981596d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989cd10700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9898159cf0 con 0x7f9898155420 2023-10-06T10:59:35.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989cd10700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9898159fd0 con 0x7f9898159230 2023-10-06T10:59:35.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989cd10700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98980c85a0 con 0x7f98980cb1c0 2023-10-06T10:59:35.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989659c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9898155420 0x7f98980c7e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34154/0 (socket says 172.21.15.7:34154) 2023-10-06T10:59:35.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989659c700 1 -- 172.21.15.7:0/3720583313 learned_addr learned my addr 172.21.15.7:0/3720583313 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:35.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f9896d9d700 1 --2- 172.21.15.7:0/3720583313 >> v2:172.21.15.50:3300/0 conn(0x7f98980cb1c0 0x7f98981596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924191381 0 0) 0x7f9898159cf0 con 0x7f9898155420 2023-10-06T10:59:35.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9884003570 con 0x7f9898155420 2023-10-06T10:59:35.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106143053 0 0) 0x7f9898159fd0 con 0x7f9898159230 2023-10-06T10:59:35.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9898159cf0 con 0x7f9898159230 2023-10-06T10:59:35.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2720372257 0 0) 0x7f9884003570 con 0x7f9898155420 2023-10-06T10:59:35.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 >> v2:172.21.15.50:3300/0 conn(0x7f98980cb1c0 msgr2=0x7f98981596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:35.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 --2- 172.21.15.7:0/3720583313 >> v2:172.21.15.50:3300/0 conn(0x7f98980cb1c0 0x7f98981596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 >> v1:172.21.15.50:6789/0 conn(0x7f9898159230 legacy=0x7f98980caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98980c7690 con 0x7f9898155420 2023-10-06T10:59:35.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f9888001470 con 0x7f9898155420 2023-10-06T10:59:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f9896d9d700 1 --2- 172.21.15.7:0/3720583313 >> v2:172.21.15.50:3300/0 conn(0x7f98980cb1c0 0x7f98981596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:59:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 >> v1:172.21.15.7:6789/0 conn(0x7f9898155420 legacy=0x7f98980c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 --2- 172.21.15.7:0/3720583313 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9884003bf0 0x7f9884003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 --2- 172.21.15.7:0/3720583313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9884004810 0x7f9884004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 --2- 172.21.15.7:0/3720583313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98840051c0 0x7f988400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.540+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980c85a0 con 0x7f98840051c0 2023-10-06T10:59:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988400c160 con 0x7f9884004810 2023-10-06T10:59:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988400c320 con 0x7f9884003bf0 2023-10-06T10:59:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f9896d9d700 1 --2- 172.21.15.7:0/3720583313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98840051c0 0x7f988400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f989659c700 1 --2- 172.21.15.7:0/3720583313 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9884003bf0 0x7f9884003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f9895d9b700 1 --2- 172.21.15.7:0/3720583313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9884004810 0x7f9884004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f9896d9d700 1 -- 172.21.15.7:0/3720583313 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9884003bf0 msgr2=0x7f9884003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f9896d9d700 1 --2- 172.21.15.7:0/3720583313 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9884003bf0 0x7f9884003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f9896d9d700 1 -- 172.21.15.7:0/3720583313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9884004810 msgr2=0x7f9884004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f9896d9d700 1 --2- 172.21.15.7:0/3720583313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9884004810 0x7f9884004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f9896d9d700 1 -- 172.21.15.7:0/3720583313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9884003570 con 0x7f98840051c0 2023-10-06T10:59:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f989659c700 1 --2- 172.21.15.7:0/3720583313 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9884003bf0 0x7f9884003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f9895d9b700 1 --2- 172.21.15.7:0/3720583313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9884004810 0x7f9884004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f9896d9d700 1 -- 172.21.15.7:0/3720583313 reap_dead start 2023-10-06T10:59:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f9896d9d700 1 --2- 172.21.15.7:0/3720583313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98840051c0 0x7f988400ba60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f989000a5e0 tx=0x7f989000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838a8af8eb2ba7cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989000fd60 con 0x7f98840051c0 2023-10-06T10:59:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9890010040 con 0x7f98840051c0 2023-10-06T10:59:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.541+0000 7f989559a700 1 -- 172.21.15.7:0/3720583313 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989000fee0 con 0x7f98840051c0 2023-10-06T10:59:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.542+0000 7f989cd10700 1 -- 172.21.15.7:0/3720583313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98840051c0 msgr2=0x7f988400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.542+0000 7f989cd10700 1 --2- 172.21.15.7:0/3720583313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98840051c0 0x7f988400ba60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f989000a5e0 tx=0x7f989000c040 comp rx=0 tx=0).stop 2023-10-06T10:59:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.542+0000 7f989cd10700 1 -- 172.21.15.7:0/3720583313 shutdown_connections 2023-10-06T10:59:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.542+0000 7f989cd10700 1 --2- 172.21.15.7:0/3720583313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98840051c0 0x7f988400ba60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.542+0000 7f989cd10700 1 -- 172.21.15.7:0/3720583313 >> 172.21.15.7:0/3720583313 conn(0x7f98980cc790 msgr2=0x7f98980c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.542+0000 7f989cd10700 1 -- 172.21.15.7:0/3720583313 shutdown_connections 2023-10-06T10:59:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.542+0000 7f989cd10700 1 -- 172.21.15.7:0/3720583313 wait complete. 2023-10-06T10:59:35.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.543+0000 7f989cd10700 1 Processor -- start 2023-10-06T10:59:35.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.543+0000 7f989cd10700 1 -- start start 2023-10-06T10:59:35.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f989cd10700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98840051c0 0x7f9898144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f989cd10700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98980c3780 0x7f98980c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f989cd10700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f98980c4a00 0x7f98980c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f989cd10700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980c53b0 con 0x7f98980c3780 2023-10-06T10:59:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f989cd10700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980af140 con 0x7f98840051c0 2023-10-06T10:59:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f989cd10700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98980aeb60 con 0x7f98980c4a00 2023-10-06T10:59:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f9895d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98980c3780 0x7f98980c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f9895d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98980c3780 0x7f98980c3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39402/0 (socket says 172.21.15.7:39402) 2023-10-06T10:59:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f9895d9b700 1 -- 172.21.15.7:0/2075947120 learned_addr learned my addr 172.21.15.7:0/2075947120 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f9896d9d700 1 --2- 172.21.15.7:0/2075947120 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f98980c4a00 0x7f98980c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f989659c700 1 --2- 172.21.15.7:0/2075947120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98840051c0 0x7f9898144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f9895d9b700 1 -- 172.21.15.7:0/2075947120 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f98980c4a00 msgr2=0x7f98980c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f9895d9b700 1 --2- 172.21.15.7:0/2075947120 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f98980c4a00 0x7f98980c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f9895d9b700 1 -- 172.21.15.7:0/2075947120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98840051c0 msgr2=0x7f9898144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.544+0000 7f9895d9b700 1 --2- 172.21.15.7:0/2075947120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98840051c0 0x7f9898144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.545+0000 7f9895d9b700 1 -- 172.21.15.7:0/2075947120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98980c41d0 con 0x7f98980c3780 2023-10-06T10:59:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.545+0000 7f9895d9b700 1 --2- 172.21.15.7:0/2075947120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98980c3780 0x7f98980c3bf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f988000e5b0 tx=0x7f9880009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.545+0000 7f988e7fc700 1 -- 172.21.15.7:0/2075947120 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9880006820 con 0x7f98980c3780 2023-10-06T10:59:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.545+0000 7f988e7fc700 1 -- 172.21.15.7:0/2075947120 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9880010040 con 0x7f98980c3780 2023-10-06T10:59:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.545+0000 7f989cd10700 1 -- 172.21.15.7:0/2075947120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98980aedd0 con 0x7f98980c3780 2023-10-06T10:59:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.545+0000 7f988e7fc700 1 -- 172.21.15.7:0/2075947120 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9880006bd0 con 0x7f98980c3780 2023-10-06T10:59:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.545+0000 7f989cd10700 1 -- 172.21.15.7:0/2075947120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98981569a0 con 0x7f98980c3780 2023-10-06T10:59:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.546+0000 7f989cd10700 1 -- 172.21.15.7:0/2075947120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98980af2f0 con 0x7f98980c3780 2023-10-06T10:59:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.546+0000 7f988e7fc700 1 -- 172.21.15.7:0/2075947120 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9880007030 con 0x7f98980c3780 2023-10-06T10:59:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.547+0000 7f988e7fc700 1 --2- 172.21.15.7:0/2075947120 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9878066f30 0x7f98780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.547+0000 7f988e7fc700 1 -- 172.21.15.7:0/2075947120 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9880083da0 con 0x7f98980c3780 2023-10-06T10:59:35.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.547+0000 7f989659c700 1 --2- 172.21.15.7:0/2075947120 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9878066f30 0x7f98780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:35.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.548+0000 7f989659c700 1 --2- 172.21.15.7:0/2075947120 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9878066f30 0x7f98780693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9888000e10 tx=0x7f9888007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:35.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.551+0000 7f988e7fc700 1 -- 172.21.15.7:0/2075947120 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f988004d5a0 con 0x7f98980c3780 2023-10-06T10:59:35.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.800+0000 7f989cd10700 1 -- 172.21.15.7:0/2075947120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9898070480 con 0x7f98980c3780 2023-10-06T10:59:35.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.800+0000 7f988e7fc700 1 -- 172.21.15.7:0/2075947120 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9880019070 con 0x7f98980c3780 2023-10-06T10:59:35.802 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T10:59:35.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.802+0000 7f989cd10700 1 -- 172.21.15.7:0/2075947120 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9878066f30 msgr2=0x7f98780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.802+0000 7f989cd10700 1 --2- 172.21.15.7:0/2075947120 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9878066f30 0x7f98780693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9888000e10 tx=0x7f9888007040 comp rx=0 tx=0).stop 2023-10-06T10:59:35.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.802+0000 7f989cd10700 1 -- 172.21.15.7:0/2075947120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98980c3780 msgr2=0x7f98980c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:35.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.802+0000 7f989cd10700 1 --2- 172.21.15.7:0/2075947120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98980c3780 0x7f98980c3bf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f988000e5b0 tx=0x7f9880009040 comp rx=0 tx=0).stop 2023-10-06T10:59:35.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.802+0000 7f989cd10700 1 -- 172.21.15.7:0/2075947120 shutdown_connections 2023-10-06T10:59:35.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.802+0000 7f989cd10700 1 --2- 172.21.15.7:0/2075947120 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9878066f30 0x7f98780693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.802+0000 7f989cd10700 1 --2- 172.21.15.7:0/2075947120 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f98980c4a00 0x7f98980c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.802+0000 7f989cd10700 1 --2- 172.21.15.7:0/2075947120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98840051c0 0x7f9898144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.802+0000 7f989cd10700 1 --2- 172.21.15.7:0/2075947120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98980c3780 0x7f98980c3bf0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:35.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.802+0000 7f989cd10700 1 -- 172.21.15.7:0/2075947120 >> 172.21.15.7:0/2075947120 conn(0x7f98980cc790 msgr2=0x7f98980ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:35.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.802+0000 7f989cd10700 1 -- 172.21.15.7:0/2075947120 shutdown_connections 2023-10-06T10:59:35.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:35.802+0000 7f989cd10700 1 -- 172.21.15.7:0/2075947120 wait complete. 2023-10-06T10:59:35.817 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T10:59:35.817 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T10:59:35.818 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-06T10:59:35.818 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T10:59:35.818 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T10:59:35.818 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T10:59:35.818 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T10:59:35.818 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T10:59:35.818 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T10:59:35.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:35.818 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-06T10:59:35.838 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T10:59:35.839 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T10:59:35.839 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T10:59:35.839 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:35.839 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-06T10:59:35.839 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:35.839 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:35.839 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:35.839 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-06T10:59:35.839 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-06T10:59:35.840 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T10:59:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-06T10:59:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T10:59:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42390sec preferred_lft 42390sec 2023-10-06T10:59:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-06T10:59:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:35.840 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-06T10:59:35.841 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T10:59:35.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:35.841 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T10:59:35.841 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T10:59:35.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2023-10-06T10:59:35.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2023-10-06T10:59:35.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2023-10-06T10:59:35.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T10:59:35.841 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T10:59:35.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:35.970 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T10:59:36.001 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-06T10:59:36.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:36.003 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-06T10:59:36.068 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-06T10:59:36.068 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T10:59:36.068 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T10:59:36.068 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T10:59:36.068 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T10:59:36.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:36.068 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T10:59:36.069 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T10:59:36.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T10:59:36.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T10:59:36.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T10:59:36.069 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T10:59:36.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:36.191 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-06T10:59:36.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:36.213 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2023-10-06T10:59:36.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:36.275 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T10:59:36.276 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T10:59:36.276 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T10:59:36.276 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T10:59:36.276 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T10:59:36.386 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T10:59:36.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:36.387 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T10:59:36.387 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T10:59:36.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T10:59:36.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T10:59:36.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T10:59:36.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T10:59:36.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T10:59:36.388 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T10:59:36.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:36.614 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T10:59:36.614 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T10:59:36.614 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-06T10:59:36.614 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T10:59:36.614 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T10:59:36.728 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T10:59:36.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T10:59:36.729 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T10:59:36.749 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T10:59:36.750 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T10:59:36.750 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T10:59:36.812 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T10:59:36.888 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T10:59:36.888 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T10:59:36.963 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T10:59:36.964 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T10:59:36.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:36.965 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T10:59:37.029 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T10:59:37.029 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T10:59:37.072 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T10:59:37.106 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T10:59:37.107 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T10:59:37.173 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2023-10-06T10:59:37.171+0000 7f0dc91e7540 -1 init, newargv = 0x55856d75cc50 newargc=15 2023-10-06T10:59:37.173 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[130655]: starting ceph client 2023-10-06T10:59:37.178 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[130655]: starting fuse 2023-10-06T10:59:37.179 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T10:59:37.180 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T10:59:37.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:37.181 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T10:59:37.241 INFO:teuthology.orchestra.run.smithi007.stdout:47 2023-10-06T10:59:37.242 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T10:59:37.242 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T10:59:37.242 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2023-10-06T10:59:37.242 DEBUG:teuthology.orchestra.run.smithi007:> import re 2023-10-06T10:59:37.242 DEBUG:teuthology.orchestra.run.smithi007:> import os 2023-10-06T10:59:37.242 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2023-10-06T10:59:37.242 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T10:59:37.243 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2023-10-06T10:59:37.243 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T10:59:37.243 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2023-10-06T10:59:37.243 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T10:59:37.243 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T10:59:37.243 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2023-10-06T10:59:37.243 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2023-10-06T10:59:37.243 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2023-10-06T10:59:37.243 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2023-10-06T10:59:37.244 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T10:59:37.244 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2023-10-06T10:59:37.244 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T10:59:37.244 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T10:59:37.244 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T10:59:37.244 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2023-10-06T10:59:37.244 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2023-10-06T10:59:37.244 DEBUG:teuthology.orchestra.run.smithi007:> return f 2023-10-06T10:59:37.244 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T10:59:37.245 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T10:59:37.245 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.0")) 2023-10-06T10:59:37.245 DEBUG:teuthology.orchestra.run.smithi007:> ' 2023-10-06T10:59:37.381 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.130655.asok 2023-10-06T10:59:37.563 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.130655.asok 2023-10-06T10:59:37.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:37.563 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.130655.asok status 2023-10-06T10:59:37.739 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T10:59:37.739 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2023-10-06T10:59:37.739 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T10:59:37.739 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T10:59:37.740 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2023-10-06T10:59:37.740 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2023-10-06T10:59:37.740 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T10:59:37.740 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "130655", 2023-10-06T10:59:37.740 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2023-10-06T10:59:37.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T10:59:37.740 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2023-10-06T10:59:37.740 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2023-10-06T10:59:37.740 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4785, 2023-10-06T10:59:37.740 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2023-10-06T10:59:37.740 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2023-10-06T10:59:37.740 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2023-10-06T10:59:37.741 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 4785 2023-10-06T10:59:37.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T10:59:37.741 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T10:59:37.741 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T10:59:37.741 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T10:59:37.741 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 427450864 2023-10-06T10:59:37.741 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T10:59:37.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T10:59:37.741 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T10:59:37.741 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T10:59:37.741 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T10:59:37.741 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 427450864 2023-10-06T10:59:37.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T10:59:37.742 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.4785 192.168.0.1:0/427450864", 2023-10-06T10:59:37.742 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.1:0/427450864", 2023-10-06T10:59:37.742 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2023-10-06T10:59:37.742 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 9, 2023-10-06T10:59:37.742 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 25, 2023-10-06T10:59:37.742 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2023-10-06T10:59:37.742 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2023-10-06T10:59:37.742 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2023-10-06T10:59:37.742 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T10:59:37.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T10:59:37.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.881+0000 7f6a499cd700 1 Processor -- start 2023-10-06T10:59:37.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.881+0000 7f6a499cd700 1 -- start start 2023-10-06T10:59:37.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.883+0000 7f6a499cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a440cfb50 0x7f6a44068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:37.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.883+0000 7f6a499cd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a44069420 0x7f6a440afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:37.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.883+0000 7f6a499cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a440cf6c0 con 0x7f6a440af320 2023-10-06T10:59:37.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.883+0000 7f6a499cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a44159c00 con 0x7f6a440cfb50 2023-10-06T10:59:37.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.883+0000 7f6a499cd700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440698a0 con 0x7f6a44069420 2023-10-06T10:59:37.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.883+0000 7f6a3bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a440cfb50 0x7f6a44068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:37.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.883+0000 7f6a437fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a44069420 0x7f6a440afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:37.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.883+0000 7f6a42ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6a440af320 0x7f6a440cb040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:41360/0 (socket says 172.21.15.7:41360) 2023-10-06T10:59:37.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.883+0000 7f6a3bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a440cfb50 0x7f6a44068ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:37846/0 (socket says 172.21.15.7:37846) 2023-10-06T10:59:37.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.883+0000 7f6a42ffd700 1 -- 172.21.15.7:0/1342176695 learned_addr learned my addr 172.21.15.7:0/1342176695 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.883+0000 7f6a3bfff700 1 -- 172.21.15.7:0/1342176695 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a44069420 msgr2=0x7f6a440afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.883+0000 7f6a3bfff700 1 --2- 172.21.15.7:0/1342176695 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a44069420 0x7f6a440afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.883+0000 7f6a3bfff700 1 -- 172.21.15.7:0/1342176695 >> v1:172.21.15.50:6789/0 conn(0x7f6a440af320 legacy=0x7f6a440cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.883+0000 7f6a3bfff700 1 -- 172.21.15.7:0/1342176695 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a440cb750 con 0x7f6a440cfb50 2023-10-06T10:59:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.884+0000 7f6a3bfff700 1 --2- 172.21.15.7:0/1342176695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a440cfb50 0x7f6a44068ee0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009910 tx=0x7f6a2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=346caf68452de6c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.884+0000 7f6a427fc700 1 -- 172.21.15.7:0/1342176695 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00b6d0 con 0x7f6a440cfb50 2023-10-06T10:59:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.884+0000 7f6a427fc700 1 -- 172.21.15.7:0/1342176695 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c00b830 con 0x7f6a440cfb50 2023-10-06T10:59:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.884+0000 7f6a427fc700 1 -- 172.21.15.7:0/1342176695 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00bbf0 con 0x7f6a440cfb50 2023-10-06T10:59:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.884+0000 7f6a499cd700 1 -- 172.21.15.7:0/1342176695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a440cfb50 msgr2=0x7f6a44068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.884+0000 7f6a499cd700 1 --2- 172.21.15.7:0/1342176695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a440cfb50 0x7f6a44068ee0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009910 tx=0x7f6a2c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.884+0000 7f6a499cd700 1 -- 172.21.15.7:0/1342176695 shutdown_connections 2023-10-06T10:59:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.884+0000 7f6a499cd700 1 --2- 172.21.15.7:0/1342176695 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a44069420 0x7f6a440afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.884+0000 7f6a499cd700 1 --2- 172.21.15.7:0/1342176695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a440cfb50 0x7f6a44068ee0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.884+0000 7f6a499cd700 1 -- 172.21.15.7:0/1342176695 >> 172.21.15.7:0/1342176695 conn(0x7f6a44067b80 msgr2=0x7f6a440d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.884+0000 7f6a499cd700 1 -- 172.21.15.7:0/1342176695 shutdown_connections 2023-10-06T10:59:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.884+0000 7f6a499cd700 1 -- 172.21.15.7:0/1342176695 wait complete. 2023-10-06T10:59:37.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.886+0000 7f6a499cd700 1 Processor -- start 2023-10-06T10:59:37.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.886+0000 7f6a499cd700 1 -- start start 2023-10-06T10:59:37.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.886+0000 7f6a499cd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a44069420 0x7f6a440b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:37.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.886+0000 7f6a499cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a440af320 0x7f6a440c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:37.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.886+0000 7f6a499cd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a440cfb50 0x7f6a440c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.886+0000 7f6a499cd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440b17f0 con 0x7f6a440cfb50 2023-10-06T10:59:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.886+0000 7f6a499cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440b1ad0 con 0x7f6a440af320 2023-10-06T10:59:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.886+0000 7f6a499cd700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440b1db0 con 0x7f6a44069420 2023-10-06T10:59:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a437fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a440cfb50 0x7f6a440c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a437fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a440cfb50 0x7f6a440c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39414/0 (socket says 172.21.15.7:39414) 2023-10-06T10:59:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a437fe700 1 -- 172.21.15.7:0/1259441745 learned_addr learned my addr 172.21.15.7:0/1259441745 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a3bfff700 1 --2- 172.21.15.7:0/1259441745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a440af320 0x7f6a440c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a42ffd700 1 --2- 172.21.15.7:0/1259441745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a44069420 0x7f6a440b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a437fe700 1 -- 172.21.15.7:0/1259441745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a44069420 msgr2=0x7f6a440b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a437fe700 1 --2- 172.21.15.7:0/1259441745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a44069420 0x7f6a440b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a437fe700 1 -- 172.21.15.7:0/1259441745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a440af320 msgr2=0x7f6a440c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a437fe700 1 --2- 172.21.15.7:0/1259441745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a440af320 0x7f6a440c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a437fe700 1 -- 172.21.15.7:0/1259441745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c009420 con 0x7f6a440cfb50 2023-10-06T10:59:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a437fe700 1 --2- 172.21.15.7:0/1259441745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a440cfb50 0x7f6a440c9470 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009e90 tx=0x7f6a3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a3affd700 1 -- 172.21.15.7:0/1259441745 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00cb70 con 0x7f6a440cfb50 2023-10-06T10:59:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a3affd700 1 -- 172.21.15.7:0/1259441745 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c00f040 con 0x7f6a440cfb50 2023-10-06T10:59:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a499cd700 1 -- 172.21.15.7:0/1259441745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a440b2090 con 0x7f6a440cfb50 2023-10-06T10:59:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.887+0000 7f6a3affd700 1 -- 172.21.15.7:0/1259441745 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c014480 con 0x7f6a440cfb50 2023-10-06T10:59:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.888+0000 7f6a499cd700 1 -- 172.21.15.7:0/1259441745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a440b13c0 con 0x7f6a440cfb50 2023-10-06T10:59:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.889+0000 7f6a499cd700 1 -- 172.21.15.7:0/1259441745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a44070480 con 0x7f6a440cfb50 2023-10-06T10:59:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.889+0000 7f6a3affd700 1 -- 172.21.15.7:0/1259441745 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a3c014830 con 0x7f6a440cfb50 2023-10-06T10:59:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.889+0000 7f6a3affd700 1 --2- 172.21.15.7:0/1259441745 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a24066f30 0x7f6a240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.889+0000 7f6a3affd700 1 -- 172.21.15.7:0/1259441745 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6a3c085350 con 0x7f6a440cfb50 2023-10-06T10:59:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.889+0000 7f6a42ffd700 1 --2- 172.21.15.7:0/1259441745 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a24066f30 0x7f6a240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.890+0000 7f6a42ffd700 1 --2- 172.21.15.7:0/1259441745 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a24066f30 0x7f6a240693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6a44069140 tx=0x7f6a34007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:37.894+0000 7f6a3affd700 1 -- 172.21.15.7:0/1259441745 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a3c052170 con 0x7f6a440cfb50 2023-10-06T10:59:38.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:38.141+0000 7f6a499cd700 1 -- 172.21.15.7:0/1259441745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6a440ceab0 con 0x7f6a440cfb50 2023-10-06T10:59:38.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:38.141+0000 7f6a3affd700 1 -- 172.21.15.7:0/1259441745 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6a3c055790 con 0x7f6a440cfb50 2023-10-06T10:59:38.143 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T10:59:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:38.144+0000 7f6a499cd700 1 -- 172.21.15.7:0/1259441745 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a24066f30 msgr2=0x7f6a240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:38.144+0000 7f6a499cd700 1 --2- 172.21.15.7:0/1259441745 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a24066f30 0x7f6a240693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6a44069140 tx=0x7f6a34007eb0 comp rx=0 tx=0).stop 2023-10-06T10:59:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:38.144+0000 7f6a499cd700 1 -- 172.21.15.7:0/1259441745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a440cfb50 msgr2=0x7f6a440c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:38.144+0000 7f6a499cd700 1 --2- 172.21.15.7:0/1259441745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a440cfb50 0x7f6a440c9470 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009e90 tx=0x7f6a3c00b040 comp rx=0 tx=0).stop 2023-10-06T10:59:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:38.144+0000 7f6a499cd700 1 -- 172.21.15.7:0/1259441745 shutdown_connections 2023-10-06T10:59:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:38.144+0000 7f6a499cd700 1 --2- 172.21.15.7:0/1259441745 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a24066f30 0x7f6a240693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:38.144+0000 7f6a499cd700 1 --2- 172.21.15.7:0/1259441745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a440cfb50 0x7f6a440c9470 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:38.144+0000 7f6a499cd700 1 --2- 172.21.15.7:0/1259441745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a44069420 0x7f6a440b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:38.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:38.144+0000 7f6a499cd700 1 --2- 172.21.15.7:0/1259441745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a440af320 0x7f6a440c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:38.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:38.144+0000 7f6a499cd700 1 -- 172.21.15.7:0/1259441745 >> 172.21.15.7:0/1259441745 conn(0x7f6a44067b80 msgr2=0x7f6a4415cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:38.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:38.144+0000 7f6a499cd700 1 -- 172.21.15.7:0/1259441745 shutdown_connections 2023-10-06T10:59:38.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:38.144+0000 7f6a499cd700 1 -- 172.21.15.7:0/1259441745 wait complete. 2023-10-06T10:59:38.159 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T10:59:38.159 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T10:59:38.159 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-06T10:59:38.159 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T10:59:38.159 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T10:59:38.159 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T10:59:38.159 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T10:59:38.159 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T10:59:38.159 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T10:59:38.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:38.160 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-06T10:59:38.180 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T10:59:38.180 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T10:59:38.180 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T10:59:38.180 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:38.180 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-06T10:59:38.180 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:38.180 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:38.180 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:38.180 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-06T10:59:38.181 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:38.181 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:38.181 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-06T10:59:38.181 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T10:59:38.181 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:38.181 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-06T10:59:38.181 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T10:59:38.181 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42387sec preferred_lft 42387sec 2023-10-06T10:59:38.181 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-06T10:59:38.181 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:38.181 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:38.182 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:38.182 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-06T10:59:38.182 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T10:59:38.182 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether b6:89:e7:77:c6:3a brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:38.182 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T10:59:38.182 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:38.182 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::10ea:76ff:fedd:887a/64 scope link 2023-10-06T10:59:38.182 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:38.182 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T10:59:38.182 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether b6:89:e7:77:c6:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T10:59:38.183 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::b489:e7ff:fe77:c63a/64 scope link tentative 2023-10-06T10:59:38.183 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:38.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:38.183 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T10:59:38.252 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-06T10:59:38.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:38.254 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-06T10:59:38.319 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-06T10:59:38.319 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T10:59:38.319 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T10:59:38.319 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T10:59:38.319 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T10:59:38.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:38.320 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T10:59:38.320 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T10:59:38.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T10:59:38.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T10:59:38.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T10:59:38.320 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T10:59:38.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:38.442 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-06T10:59:38.464 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T10:59:38.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:38.465 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2023-10-06T10:59:38.529 INFO:teuthology.orchestra.run.smithi007.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T10:59:38.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:38.529 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T10:59:38.529 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T10:59:38.530 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T10:59:38.530 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T10:59:38.530 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T10:59:38.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:38.639 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T10:59:38.687 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T10:59:38.687 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T10:59:38.687 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T10:59:38.687 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:38.687 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-06T10:59:38.687 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:38.687 INFO:teuthology.orchestra.run.smithi007.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T10:59:38.687 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 16:bf:60:d5:e2:44 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T10:59:38.688 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T10:59:38.688 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:38.688 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::14bf:60ff:fed5:e244/64 scope link 2023-10-06T10:59:38.688 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:38.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:38.704 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T10:59:38.752 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T10:59:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T10:59:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T10:59:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-06T10:59:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:38.752 INFO:teuthology.orchestra.run.smithi007.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T10:59:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 16:bf:60:d5:e2:44 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T10:59:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T10:59:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::14bf:60ff:fed5:e244/64 scope link 2023-10-06T10:59:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:38.769 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T10:59:38.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:38.770 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T10:59:38.770 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T10:59:38.770 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T10:59:38.770 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T10:59:38.770 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T10:59:38.770 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T10:59:38.770 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T10:59:38.770 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T10:59:38.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:38.985 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T10:59:38.986 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T10:59:38.986 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.1 up 2023-10-06T10:59:38.986 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T10:59:38.986 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T10:59:39.097 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-06T10:59:39.097 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T10:59:39.097 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T10:59:39.118 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T10:59:39.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T10:59:39.118 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T10:59:39.180 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T10:59:39.257 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T10:59:39.257 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T10:59:39.331 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T10:59:39.332 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T10:59:39.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:39.333 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T10:59:39.397 INFO:teuthology.orchestra.run.smithi007.stdout:47 2023-10-06T10:59:39.397 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2023-10-06T10:59:39.397 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-06T10:59:39.439 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T10:59:39.474 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T10:59:39.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T10:59:39.539 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi007.stderr:2023-10-06T10:59:39.537+0000 7fdebc99b540 -1 init, newargv = 0x561385869720 newargc=15 2023-10-06T10:59:39.539 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi007.stderr:ceph-fuse[131379]: starting ceph client 2023-10-06T10:59:39.544 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi007.stderr:ceph-fuse[131379]: starting fuse 2023-10-06T10:59:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T10:59:39.547 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T10:59:39.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:39.547 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T10:59:39.608 INFO:teuthology.orchestra.run.smithi007.stdout:47 2023-10-06T10:59:39.609 INFO:teuthology.orchestra.run.smithi007.stdout:48 2023-10-06T10:59:39.609 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 48] 2023-10-06T10:59:39.609 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T10:59:39.609 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2023-10-06T10:59:39.609 DEBUG:teuthology.orchestra.run.smithi007:> import re 2023-10-06T10:59:39.609 DEBUG:teuthology.orchestra.run.smithi007:> import os 2023-10-06T10:59:39.609 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2023-10-06T10:59:39.609 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T10:59:39.610 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2023-10-06T10:59:39.610 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-06T10:59:39.610 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2023-10-06T10:59:39.610 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-06T10:59:39.610 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T10:59:39.610 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2023-10-06T10:59:39.610 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2023-10-06T10:59:39.610 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2023-10-06T10:59:39.610 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2023-10-06T10:59:39.610 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T10:59:39.610 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2023-10-06T10:59:39.610 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T10:59:39.610 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T10:59:39.611 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T10:59:39.611 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2023-10-06T10:59:39.611 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2023-10-06T10:59:39.611 DEBUG:teuthology.orchestra.run.smithi007:> return f 2023-10-06T10:59:39.611 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T10:59:39.611 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T10:59:39.611 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.2")) 2023-10-06T10:59:39.611 DEBUG:teuthology.orchestra.run.smithi007:> ' 2023-10-06T10:59:39.748 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.2.131379.asok 2023-10-06T10:59:39.929 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.131379.asok 2023-10-06T10:59:39.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:39.930 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.131379.asok status 2023-10-06T10:59:40.105 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T10:59:40.105 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2023-10-06T10:59:40.106 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T10:59:40.106 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T10:59:40.106 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "2", 2023-10-06T10:59:40.106 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2023-10-06T10:59:40.106 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-06T10:59:40.106 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "131379", 2023-10-06T10:59:40.106 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2023-10-06T10:59:40.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T10:59:40.106 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2023-10-06T10:59:40.106 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2023-10-06T10:59:40.106 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4797, 2023-10-06T10:59:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2023-10-06T10:59:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2023-10-06T10:59:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2023-10-06T10:59:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 4797 2023-10-06T10:59:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T10:59:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T10:59:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T10:59:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.2:0", 2023-10-06T10:59:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2009839177 2023-10-06T10:59:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T10:59:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T10:59:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T10:59:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T10:59:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.2:0", 2023-10-06T10:59:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2009839177 2023-10-06T10:59:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T10:59:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.4797 192.168.0.2:0/2009839177", 2023-10-06T10:59:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.2:0/2009839177", 2023-10-06T10:59:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2023-10-06T10:59:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 9, 2023-10-06T10:59:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 25, 2023-10-06T10:59:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2023-10-06T10:59:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2023-10-06T10:59:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2023-10-06T10:59:40.109 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T10:59:40.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T10:59:40.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.246+0000 7efd94681700 1 Processor -- start 2023-10-06T10:59:40.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.246+0000 7efd94681700 1 -- start start 2023-10-06T10:59:40.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.247+0000 7efd94681700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd8c0c8d70 0x7efd8c0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:40.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.247+0000 7efd94681700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efd8c0cac60 0x7efd8c0cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.247+0000 7efd94681700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8c0cbd10 con 0x7efd8c158120 2023-10-06T10:59:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.247+0000 7efd94681700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8c0cb9e0 con 0x7efd8c0cac60 2023-10-06T10:59:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.247+0000 7efd94681700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8c0c9300 con 0x7efd8c0c8d70 2023-10-06T10:59:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.247+0000 7efd92c1e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efd8c0cac60 0x7efd8c0cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.247+0000 7efd9241d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7efd8c158120 0x7efd8c0c8660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56536/0 (socket says 172.21.15.7:56536) 2023-10-06T10:59:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.247+0000 7efd9241d700 1 -- 172.21.15.7:0/1828416359 learned_addr learned my addr 172.21.15.7:0/1828416359 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.247+0000 7efd91c1c700 1 --2- 172.21.15.7:0/1828416359 >> v2:172.21.15.50:3300/0 conn(0x7efd8c0c8d70 0x7efd8c0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.247+0000 7efd92c1e700 1 -- 172.21.15.7:0/1828416359 >> v2:172.21.15.50:3300/0 conn(0x7efd8c0c8d70 msgr2=0x7efd8c0ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.247+0000 7efd92c1e700 1 --2- 172.21.15.7:0/1828416359 >> v2:172.21.15.50:3300/0 conn(0x7efd8c0c8d70 0x7efd8c0ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.247+0000 7efd92c1e700 1 -- 172.21.15.7:0/1828416359 >> v1:172.21.15.7:6789/0 conn(0x7efd8c158120 legacy=0x7efd8c0c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.247+0000 7efd92c1e700 1 -- 172.21.15.7:0/1828416359 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c0c95e0 con 0x7efd8c0cac60 2023-10-06T10:59:40.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.247+0000 7efd9141b700 1 -- 172.21.15.7:0/1828416359 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486338164 0 0) 0x7efd8c0cbd10 con 0x7efd8c158120 2023-10-06T10:59:40.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.248+0000 7efd92c1e700 1 --2- 172.21.15.7:0/1828416359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c0cac60 0x7efd8c0cc1a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efd8c06bf60 tx=0x7efd84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec06144ed62a1013 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:40.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.248+0000 7efd9141b700 1 -- 172.21.15.7:0/1828416359 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400e070 con 0x7efd8c0cac60 2023-10-06T10:59:40.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.248+0000 7efd9141b700 1 -- 172.21.15.7:0/1828416359 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8400bc30 con 0x7efd8c0cac60 2023-10-06T10:59:40.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.248+0000 7efd9141b700 1 -- 172.21.15.7:0/1828416359 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84012430 con 0x7efd8c0cac60 2023-10-06T10:59:40.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.248+0000 7efd94681700 1 -- 172.21.15.7:0/1828416359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c0cac60 msgr2=0x7efd8c0cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:40.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.248+0000 7efd94681700 1 --2- 172.21.15.7:0/1828416359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c0cac60 0x7efd8c0cc1a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efd8c06bf60 tx=0x7efd84009780 comp rx=0 tx=0).stop 2023-10-06T10:59:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.248+0000 7efd94681700 1 -- 172.21.15.7:0/1828416359 shutdown_connections 2023-10-06T10:59:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.248+0000 7efd94681700 1 --2- 172.21.15.7:0/1828416359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c0cac60 0x7efd8c0cc1a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.248+0000 7efd94681700 1 --2- 172.21.15.7:0/1828416359 >> v2:172.21.15.50:3300/0 conn(0x7efd8c0c8d70 0x7efd8c0ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.248+0000 7efd94681700 1 -- 172.21.15.7:0/1828416359 >> 172.21.15.7:0/1828416359 conn(0x7efd8c087920 msgr2=0x7efd8c097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.248+0000 7efd94681700 1 -- 172.21.15.7:0/1828416359 shutdown_connections 2023-10-06T10:59:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.248+0000 7efd94681700 1 -- 172.21.15.7:0/1828416359 wait complete. 2023-10-06T10:59:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.250+0000 7efd94681700 1 Processor -- start 2023-10-06T10:59:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.250+0000 7efd94681700 1 -- start start 2023-10-06T10:59:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.250+0000 7efd94681700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8c0c8d70 0x7efd8c09b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.250+0000 7efd94681700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c0cac60 0x7efd8c0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.250+0000 7efd94681700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd8c158120 0x7efd8c0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.250+0000 7efd94681700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0c7c40 con 0x7efd8c0cac60 2023-10-06T10:59:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.250+0000 7efd94681700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0c80d0 con 0x7efd8c0c8d70 2023-10-06T10:59:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.250+0000 7efd94681700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0c7030 con 0x7efd8c158120 2023-10-06T10:59:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd91c1c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c0cac60 0x7efd8c0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd91c1c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c0cac60 0x7efd8c0c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35220/0 (socket says 172.21.15.7:35220) 2023-10-06T10:59:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd91c1c700 1 -- 172.21.15.7:0/928010302 learned_addr learned my addr 172.21.15.7:0/928010302 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd9241d700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8c0c8d70 0x7efd8c09b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd92c1e700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd8c158120 0x7efd8c0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd91c1c700 1 -- 172.21.15.7:0/928010302 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd8c158120 msgr2=0x7efd8c0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd91c1c700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd8c158120 0x7efd8c0c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd91c1c700 1 -- 172.21.15.7:0/928010302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8c0c8d70 msgr2=0x7efd8c09b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd91c1c700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8c0c8d70 0x7efd8c09b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:40.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd91c1c700 1 -- 172.21.15.7:0/928010302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84009a20 con 0x7efd8c0cac60 2023-10-06T10:59:40.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd92c1e700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd8c158120 0x7efd8c0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:40.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd9241d700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8c0c8d70 0x7efd8c09b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:40.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd91c1c700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c0cac60 0x7efd8c0c4f70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00d860 tx=0x7efd7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:40.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd827fc700 1 -- 172.21.15.7:0/928010302 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c009610 con 0x7efd8c0cac60 2023-10-06T10:59:40.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd827fc700 1 -- 172.21.15.7:0/928010302 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c009770 con 0x7efd8c0cac60 2023-10-06T10:59:40.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd827fc700 1 -- 172.21.15.7:0/928010302 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c009b30 con 0x7efd8c0cac60 2023-10-06T10:59:40.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd94681700 1 -- 172.21.15.7:0/928010302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8c0c7310 con 0x7efd8c0cac60 2023-10-06T10:59:40.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.251+0000 7efd94681700 1 -- 172.21.15.7:0/928010302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8c0c78d0 con 0x7efd8c0cac60 2023-10-06T10:59:40.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.252+0000 7efd94681700 1 -- 172.21.15.7:0/928010302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8c070480 con 0x7efd8c0cac60 2023-10-06T10:59:40.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.253+0000 7efd827fc700 1 -- 172.21.15.7:0/928010302 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd7c01e460 con 0x7efd8c0cac60 2023-10-06T10:59:40.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.253+0000 7efd827fc700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efd70066f30 0x7efd700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:40.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.253+0000 7efd827fc700 1 -- 172.21.15.7:0/928010302 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7efd7c085050 con 0x7efd8c0cac60 2023-10-06T10:59:40.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.253+0000 7efd9241d700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efd70066f30 0x7efd700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:40.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.254+0000 7efd9241d700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efd70066f30 0x7efd700693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd88001860 tx=0x7efd88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:40.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.258+0000 7efd827fc700 1 -- 172.21.15.7:0/928010302 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd7c051e70 con 0x7efd8c0cac60 2023-10-06T10:59:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.510+0000 7efd94681700 1 -- 172.21.15.7:0/928010302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efd8c0c7d80 con 0x7efd8c0cac60 2023-10-06T10:59:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.510+0000 7efd827fc700 1 -- 172.21.15.7:0/928010302 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7efd7c055490 con 0x7efd8c0cac60 2023-10-06T10:59:40.512 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T10:59:40.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.512+0000 7efd94681700 1 -- 172.21.15.7:0/928010302 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efd70066f30 msgr2=0x7efd700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:40.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.512+0000 7efd94681700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efd70066f30 0x7efd700693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd88001860 tx=0x7efd88009040 comp rx=0 tx=0).stop 2023-10-06T10:59:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.512+0000 7efd94681700 1 -- 172.21.15.7:0/928010302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c0cac60 msgr2=0x7efd8c0c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.512+0000 7efd94681700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c0cac60 0x7efd8c0c4f70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00d860 tx=0x7efd7c008040 comp rx=0 tx=0).stop 2023-10-06T10:59:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.512+0000 7efd94681700 1 -- 172.21.15.7:0/928010302 shutdown_connections 2023-10-06T10:59:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.512+0000 7efd94681700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efd70066f30 0x7efd700693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.512+0000 7efd94681700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd8c158120 0x7efd8c0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.512+0000 7efd94681700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8c0c8d70 0x7efd8c09b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.512+0000 7efd94681700 1 --2- 172.21.15.7:0/928010302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c0cac60 0x7efd8c0c4f70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.512+0000 7efd94681700 1 -- 172.21.15.7:0/928010302 >> 172.21.15.7:0/928010302 conn(0x7efd8c087920 msgr2=0x7efd8c0aaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.512+0000 7efd94681700 1 -- 172.21.15.7:0/928010302 shutdown_connections 2023-10-06T10:59:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:40.512+0000 7efd94681700 1 -- 172.21.15.7:0/928010302 wait complete. 2023-10-06T10:59:40.527 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T10:59:40.527 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T10:59:40.527 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-10-06T10:59:40.527 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T10:59:40.527 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T10:59:40.528 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T10:59:40.528 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T10:59:40.528 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T10:59:40.528 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T10:59:40.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:40.528 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-10-06T10:59:40.553 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T10:59:40.553 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T10:59:40.553 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T10:59:40.553 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:40.553 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-10-06T10:59:40.553 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:40.553 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:40.554 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:40.554 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-10-06T10:59:40.554 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:40.554 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:40.554 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-10-06T10:59:40.554 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T10:59:40.554 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:40.554 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-10-06T10:59:40.554 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T10:59:40.554 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42383sec preferred_lft 42383sec 2023-10-06T10:59:40.554 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-10-06T10:59:40.555 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:40.555 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:40.555 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:40.555 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-10-06T10:59:40.555 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T10:59:40.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:40.555 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T10:59:40.555 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T10:59:40.556 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2023-10-06T10:59:40.556 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2023-10-06T10:59:40.556 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2023-10-06T10:59:40.556 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T10:59:40.556 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T10:59:40.609 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T10:59:40.612 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T10:59:40.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:40.771 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T10:59:40.809 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-10-06T10:59:40.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:40.852 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-10-06T10:59:40.938 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-10-06T10:59:40.938 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T10:59:40.939 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T10:59:40.939 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T10:59:40.939 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T10:59:40.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:40.939 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T10:59:40.939 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T10:59:40.939 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T10:59:40.939 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T10:59:40.940 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T10:59:40.940 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T10:59:41.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:41.221 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-06T10:59:41.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:41.245 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-10-06T10:59:41.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:41.309 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T10:59:41.309 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T10:59:41.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T10:59:41.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T10:59:41.310 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T10:59:41.421 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T10:59:41.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:41.422 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T10:59:41.422 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T10:59:41.422 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T10:59:41.422 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T10:59:41.422 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T10:59:41.423 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T10:59:41.423 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T10:59:41.423 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T10:59:41.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:41.660 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T10:59:41.660 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T10:59:41.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-10-06T10:59:41.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T10:59:41.660 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T10:59:41.773 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-06T10:59:41.773 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T10:59:41.773 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T10:59:41.794 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T10:59:41.795 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T10:59:41.795 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T10:59:41.856 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-10-06T10:59:41.933 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T10:59:41.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T10:59:42.008 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T10:59:42.009 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T10:59:42.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:42.010 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-10-06T10:59:42.075 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T10:59:42.075 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-06T10:59:42.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-10-06T10:59:42.151 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T10:59:42.152 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T10:59:42.219 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi050.stderr:2023-10-06T10:59:42.218+0000 7f32a473a540 -1 init, newargv = 0x558fef0e0bb0 newargc=15 2023-10-06T10:59:42.219 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi050.stderr:ceph-fuse[125869]: starting ceph client 2023-10-06T10:59:42.224 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T10:59:42.225 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi050.stderr:ceph-fuse[125869]: starting fuse 2023-10-06T10:59:42.225 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T10:59:42.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:42.226 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-10-06T10:59:42.287 INFO:teuthology.orchestra.run.smithi050.stdout:47 2023-10-06T10:59:42.287 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T10:59:42.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T10:59:42.287 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-10-06T10:59:42.287 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-10-06T10:59:42.287 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-10-06T10:59:42.288 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-10-06T10:59:42.288 DEBUG:teuthology.orchestra.run.smithi050:> 2023-10-06T10:59:42.288 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-10-06T10:59:42.288 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-06T10:59:42.288 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-10-06T10:59:42.288 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-06T10:59:42.288 DEBUG:teuthology.orchestra.run.smithi050:> 2023-10-06T10:59:42.288 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-10-06T10:59:42.288 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-10-06T10:59:42.288 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-10-06T10:59:42.288 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-10-06T10:59:42.288 DEBUG:teuthology.orchestra.run.smithi050:> 2023-10-06T10:59:42.289 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-10-06T10:59:42.289 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T10:59:42.289 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T10:59:42.289 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T10:59:42.289 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-10-06T10:59:42.289 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-10-06T10:59:42.289 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-10-06T10:59:42.289 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T10:59:42.289 DEBUG:teuthology.orchestra.run.smithi050:> 2023-10-06T10:59:42.289 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.1")) 2023-10-06T10:59:42.289 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-10-06T10:59:42.429 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.1.125869.asok 2023-10-06T10:59:42.609 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.125869.asok 2023-10-06T10:59:42.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:42.609 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.125869.asok status 2023-10-06T10:59:42.785 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T10:59:42.785 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-10-06T10:59:42.785 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T10:59:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T10:59:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "1", 2023-10-06T10:59:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-10-06T10:59:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-06T10:59:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "125869", 2023-10-06T10:59:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-10-06T10:59:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T10:59:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-10-06T10:59:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-10-06T10:59:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4604, 2023-10-06T10:59:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-10-06T10:59:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-10-06T10:59:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-10-06T10:59:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 4604 2023-10-06T10:59:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T10:59:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-10-06T10:59:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-10-06T10:59:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-10-06T10:59:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1171486853 2023-10-06T10:59:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T10:59:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T10:59:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-10-06T10:59:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-10-06T10:59:42.788 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-10-06T10:59:42.788 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1171486853 2023-10-06T10:59:42.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T10:59:42.788 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.4604 192.168.0.1:0/1171486853", 2023-10-06T10:59:42.788 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/1171486853", 2023-10-06T10:59:42.788 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-10-06T10:59:42.788 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 9, 2023-10-06T10:59:42.788 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 25, 2023-10-06T10:59:42.788 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-10-06T10:59:42.788 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-10-06T10:59:42.788 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-10-06T10:59:42.788 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T10:59:42.796 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T10:59:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.934+0000 7f12a387d700 1 Processor -- start 2023-10-06T10:59:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.935+0000 7f12a387d700 1 -- start start 2023-10-06T10:59:42.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.935+0000 7f12a387d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f129c15ce10 0x7f129c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:42.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.936+0000 7f12a387d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c0694d0 con 0x7f129c1594a0 2023-10-06T10:59:42.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.936+0000 7f12a387d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c068ba0 con 0x7f129c1590d0 2023-10-06T10:59:42.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.936+0000 7f12a387d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129c15d7f0 con 0x7f129c15ce10 2023-10-06T10:59:42.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.936+0000 7f12a1e1a700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f129c1594a0 0x7f129c1598e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56542/0 (socket says 172.21.15.7:56542) 2023-10-06T10:59:42.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.936+0000 7f12a1e1a700 1 -- 172.21.15.7:0/2226966294 learned_addr learned my addr 172.21.15.7:0/2226966294 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:42.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.936+0000 7f12a0e18700 1 --2- 172.21.15.7:0/2226966294 >> v2:172.21.15.50:3300/0 conn(0x7f129c15ce10 0x7f129c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:42.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.936+0000 7f1293fff700 1 -- 172.21.15.7:0/2226966294 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068486707 0 0) 0x7f129c0694d0 con 0x7f129c1594a0 2023-10-06T10:59:42.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.936+0000 7f1293fff700 1 -- 172.21.15.7:0/2226966294 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1288003570 con 0x7f129c1594a0 2023-10-06T10:59:42.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.936+0000 7f1293fff700 1 -- 172.21.15.7:0/2226966294 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355117101 0 0) 0x7f129c068ba0 con 0x7f129c1590d0 2023-10-06T10:59:42.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.936+0000 7f1293fff700 1 -- 172.21.15.7:0/2226966294 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f129c0694d0 con 0x7f129c1590d0 2023-10-06T10:59:42.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.936+0000 7f12a0e18700 1 -- 172.21.15.7:0/2226966294 >> v1:172.21.15.50:6789/0 conn(0x7f129c1590d0 legacy=0x7f129c069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:42.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.936+0000 7f12a0e18700 1 -- 172.21.15.7:0/2226966294 >> v1:172.21.15.7:6789/0 conn(0x7f129c1594a0 legacy=0x7f129c1598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:42.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.936+0000 7f12a0e18700 1 -- 172.21.15.7:0/2226966294 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c068e80 con 0x7f129c15ce10 2023-10-06T10:59:42.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.937+0000 7f12a0e18700 1 --2- 172.21.15.7:0/2226966294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c15ce10 0x7f129c15d2b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f128c0098e0 tx=0x7f128c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c40bf5ce4a40d121 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:42.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.937+0000 7f1293fff700 1 -- 172.21.15.7:0/2226966294 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c011630 con 0x7f129c15ce10 2023-10-06T10:59:42.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.937+0000 7f1293fff700 1 -- 172.21.15.7:0/2226966294 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c011790 con 0x7f129c15ce10 2023-10-06T10:59:42.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.937+0000 7f1293fff700 1 -- 172.21.15.7:0/2226966294 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c011b10 con 0x7f129c15ce10 2023-10-06T10:59:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.937+0000 7f12a387d700 1 -- 172.21.15.7:0/2226966294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c15ce10 msgr2=0x7f129c15d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.937+0000 7f12a387d700 1 --2- 172.21.15.7:0/2226966294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c15ce10 0x7f129c15d2b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f128c0098e0 tx=0x7f128c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.937+0000 7f12a387d700 1 -- 172.21.15.7:0/2226966294 shutdown_connections 2023-10-06T10:59:42.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.937+0000 7f12a387d700 1 --2- 172.21.15.7:0/2226966294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c15ce10 0x7f129c15d2b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:42.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.937+0000 7f12a387d700 1 -- 172.21.15.7:0/2226966294 >> 172.21.15.7:0/2226966294 conn(0x7f129c096160 msgr2=0x7f129c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:42.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.937+0000 7f12a387d700 1 -- 172.21.15.7:0/2226966294 shutdown_connections 2023-10-06T10:59:42.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.938+0000 7f12a387d700 1 -- 172.21.15.7:0/2226966294 wait complete. 2023-10-06T10:59:42.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.939+0000 7f12a387d700 1 Processor -- start 2023-10-06T10:59:42.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.939+0000 7f12a387d700 1 -- start start 2023-10-06T10:59:42.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a387d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c1590d0 0x7f129c150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:42.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a387d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f129c1594a0 0x7f129c15b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:42.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a387d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f129c15ce10 0x7f129c155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:42.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a387d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c151430 con 0x7f129c1594a0 2023-10-06T10:59:42.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a387d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c151710 con 0x7f129c1590d0 2023-10-06T10:59:42.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a387d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c1519f0 con 0x7f129c15ce10 2023-10-06T10:59:42.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a0e18700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f129c1594a0 0x7f129c15b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:42.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a0e18700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f129c1594a0 0x7f129c15b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35224/0 (socket says 172.21.15.7:35224) 2023-10-06T10:59:42.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a0e18700 1 -- 172.21.15.7:0/3401911424 learned_addr learned my addr 172.21.15.7:0/3401911424 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:42.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a1619700 1 --2- 172.21.15.7:0/3401911424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c1590d0 0x7f129c150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:42.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a1e1a700 1 --2- 172.21.15.7:0/3401911424 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f129c15ce10 0x7f129c155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:42.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a0e18700 1 -- 172.21.15.7:0/3401911424 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f129c15ce10 msgr2=0x7f129c155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:42.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a0e18700 1 --2- 172.21.15.7:0/3401911424 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f129c15ce10 0x7f129c155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:42.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a0e18700 1 -- 172.21.15.7:0/3401911424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c1590d0 msgr2=0x7f129c150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:42.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a0e18700 1 --2- 172.21.15.7:0/3401911424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c1590d0 0x7f129c150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:42.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a0e18700 1 -- 172.21.15.7:0/3401911424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c009420 con 0x7f129c1594a0 2023-10-06T10:59:42.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.940+0000 7f12a0e18700 1 --2- 172.21.15.7:0/3401911424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f129c1594a0 0x7f129c15b970 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f129c0b2e50 tx=0x7f128c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:42.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.941+0000 7f12917fa700 1 -- 172.21.15.7:0/3401911424 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c011b10 con 0x7f129c1594a0 2023-10-06T10:59:42.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.941+0000 7f12917fa700 1 -- 172.21.15.7:0/3401911424 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c01a430 con 0x7f129c1594a0 2023-10-06T10:59:42.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.941+0000 7f12a387d700 1 -- 172.21.15.7:0/3401911424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c151cd0 con 0x7f129c1594a0 2023-10-06T10:59:42.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.941+0000 7f12917fa700 1 -- 172.21.15.7:0/3401911424 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c01a7d0 con 0x7f129c1594a0 2023-10-06T10:59:42.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.941+0000 7f12a387d700 1 -- 172.21.15.7:0/3401911424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c151000 con 0x7f129c1594a0 2023-10-06T10:59:42.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.942+0000 7f12a387d700 1 -- 172.21.15.7:0/3401911424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c1521f0 con 0x7f129c1594a0 2023-10-06T10:59:42.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.942+0000 7f12917fa700 1 -- 172.21.15.7:0/3401911424 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f128c01ab80 con 0x7f129c1594a0 2023-10-06T10:59:42.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.943+0000 7f12917fa700 1 --2- 172.21.15.7:0/3401911424 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1280066f30 0x7f12800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:42.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.943+0000 7f12917fa700 1 -- 172.21.15.7:0/3401911424 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f128c086690 con 0x7f129c1594a0 2023-10-06T10:59:42.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.943+0000 7f12a1619700 1 --2- 172.21.15.7:0/3401911424 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1280066f30 0x7f12800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:42.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.943+0000 7f12a1619700 1 --2- 172.21.15.7:0/3401911424 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1280066f30 0x7f12800693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1298000c00 tx=0x7f1298009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:42.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:42.947+0000 7f12917fa700 1 -- 172.21.15.7:0/3401911424 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f129c1521f0 con 0x7f129c1594a0 2023-10-06T10:59:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:43.201+0000 7f12a387d700 1 -- 172.21.15.7:0/3401911424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f129c1521f0 con 0x7f129c1594a0 2023-10-06T10:59:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:43.201+0000 7f12917fa700 1 -- 172.21.15.7:0/3401911424 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f129c1521f0 con 0x7f129c1594a0 2023-10-06T10:59:43.203 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T10:59:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:43.203+0000 7f12a387d700 1 -- 172.21.15.7:0/3401911424 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1280066f30 msgr2=0x7f12800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:43.203+0000 7f12a387d700 1 --2- 172.21.15.7:0/3401911424 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1280066f30 0x7f12800693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1298000c00 tx=0x7f1298009040 comp rx=0 tx=0).stop 2023-10-06T10:59:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:43.203+0000 7f12a387d700 1 -- 172.21.15.7:0/3401911424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f129c1594a0 msgr2=0x7f129c15b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:43.203+0000 7f12a387d700 1 --2- 172.21.15.7:0/3401911424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f129c1594a0 0x7f129c15b970 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f129c0b2e50 tx=0x7f128c017000 comp rx=0 tx=0).stop 2023-10-06T10:59:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:43.203+0000 7f12a387d700 1 -- 172.21.15.7:0/3401911424 shutdown_connections 2023-10-06T10:59:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:43.203+0000 7f12a387d700 1 --2- 172.21.15.7:0/3401911424 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1280066f30 0x7f12800693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:43.203+0000 7f12a387d700 1 --2- 172.21.15.7:0/3401911424 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f129c15ce10 0x7f129c155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:43.203+0000 7f12a387d700 1 --2- 172.21.15.7:0/3401911424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c1590d0 0x7f129c150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:43.203+0000 7f12a387d700 1 --2- 172.21.15.7:0/3401911424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f129c1594a0 0x7f129c15b970 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:43.203+0000 7f12a387d700 1 -- 172.21.15.7:0/3401911424 >> 172.21.15.7:0/3401911424 conn(0x7f129c096160 msgr2=0x7f129c06c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:43.204+0000 7f12a387d700 1 -- 172.21.15.7:0/3401911424 shutdown_connections 2023-10-06T10:59:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:43.204+0000 7f12a387d700 1 -- 172.21.15.7:0/3401911424 wait complete. 2023-10-06T10:59:43.218 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T10:59:43.218 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T10:59:43.219 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-10-06T10:59:43.219 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T10:59:43.219 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T10:59:43.219 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T10:59:43.219 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T10:59:43.219 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T10:59:43.219 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T10:59:43.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:43.220 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-10-06T10:59:43.244 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T10:59:43.244 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T10:59:43.244 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T10:59:43.244 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:43.244 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-10-06T10:59:43.244 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:43.244 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:43.244 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:43.245 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-10-06T10:59:43.245 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:43.245 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:43.245 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-10-06T10:59:43.245 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T10:59:43.245 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:43.245 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-10-06T10:59:43.245 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T10:59:43.245 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42380sec preferred_lft 42380sec 2023-10-06T10:59:43.245 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-10-06T10:59:43.245 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:43.246 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T10:59:43.246 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:43.246 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-10-06T10:59:43.246 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T10:59:43.246 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ee:59:a8:a3:fb:29 brd ff:ff:ff:ff:ff:ff 2023-10-06T10:59:43.246 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T10:59:43.246 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:43.246 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::a050:faff:fe67:569b/64 scope link 2023-10-06T10:59:43.246 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:43.246 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T10:59:43.247 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ee:59:a8:a3:fb:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T10:59:43.247 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec59:a8ff:fea3:fb29/64 scope link tentative 2023-10-06T10:59:43.247 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:43.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:43.247 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T10:59:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-10-06T10:59:43.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:43.320 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-10-06T10:59:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-10-06T10:59:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T10:59:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T10:59:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T10:59:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T10:59:43.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:43.387 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T10:59:43.387 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T10:59:43.387 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T10:59:43.387 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T10:59:43.387 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T10:59:43.387 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T10:59:43.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:43.511 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-06T10:59:43.532 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T10:59:43.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:43.533 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-10-06T10:59:43.596 INFO:teuthology.orchestra.run.smithi050.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T10:59:43.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:43.596 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T10:59:43.597 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T10:59:43.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T10:59:43.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T10:59:43.597 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T10:59:43.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:43.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T10:59:43.747 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T10:59:43.748 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T10:59:43.748 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T10:59:43.748 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:43.748 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-10-06T10:59:43.748 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:43.748 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T10:59:43.748 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 66:8e:4d:bd:7c:c4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T10:59:43.748 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T10:59:43.748 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:43.749 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::648e:4dff:febd:7cc4/64 scope link 2023-10-06T10:59:43.749 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:43.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:43.762 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T10:59:43.847 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T10:59:43.847 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T10:59:43.847 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T10:59:43.847 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:43.847 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-10-06T10:59:43.847 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:43.847 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T10:59:43.847 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 66:8e:4d:bd:7c:c4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T10:59:43.847 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T10:59:43.847 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:43.848 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::648e:4dff:febd:7cc4/64 scope link 2023-10-06T10:59:43.848 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T10:59:43.862 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T10:59:43.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:43.862 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T10:59:43.862 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T10:59:43.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T10:59:43.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T10:59:43.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T10:59:43.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T10:59:43.863 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T10:59:43.863 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T10:59:44.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:44.069 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T10:59:44.069 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T10:59:44.069 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.1 up 2023-10-06T10:59:44.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T10:59:44.070 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T10:59:44.182 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-06T10:59:44.182 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T10:59:44.182 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T10:59:44.202 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T10:59:44.203 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T10:59:44.203 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T10:59:44.264 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-10-06T10:59:44.340 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T10:59:44.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T10:59:44.415 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T10:59:44.416 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T10:59:44.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:44.417 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-10-06T10:59:44.481 INFO:teuthology.orchestra.run.smithi050.stdout:47 2023-10-06T10:59:44.481 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2023-10-06T10:59:44.481 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-06T10:59:44.524 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-10-06T10:59:44.559 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T10:59:44.559 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T10:59:44.626 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi050.stderr:2023-10-06T10:59:44.626+0000 7f83f9799540 -1 init, newargv = 0x5635f2c059c0 newargc=15 2023-10-06T10:59:44.627 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi050.stderr:ceph-fuse[126544]: starting ceph client 2023-10-06T10:59:44.632 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T10:59:44.632 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi050.stderr:ceph-fuse[126544]: starting fuse 2023-10-06T10:59:44.633 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T10:59:44.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:44.634 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-10-06T10:59:44.695 INFO:teuthology.orchestra.run.smithi050.stdout:47 2023-10-06T10:59:44.695 INFO:teuthology.orchestra.run.smithi050.stdout:48 2023-10-06T10:59:44.695 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 48] 2023-10-06T10:59:44.696 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T10:59:44.696 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-10-06T10:59:44.696 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-10-06T10:59:44.696 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-10-06T10:59:44.696 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-10-06T10:59:44.696 DEBUG:teuthology.orchestra.run.smithi050:> 2023-10-06T10:59:44.696 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-10-06T10:59:44.696 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-06T10:59:44.696 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-10-06T10:59:44.696 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-06T10:59:44.696 DEBUG:teuthology.orchestra.run.smithi050:> 2023-10-06T10:59:44.696 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-10-06T10:59:44.697 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-10-06T10:59:44.697 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-10-06T10:59:44.697 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-10-06T10:59:44.697 DEBUG:teuthology.orchestra.run.smithi050:> 2023-10-06T10:59:44.697 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-10-06T10:59:44.697 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T10:59:44.697 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T10:59:44.697 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T10:59:44.697 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-10-06T10:59:44.697 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-10-06T10:59:44.697 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-10-06T10:59:44.697 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T10:59:44.698 DEBUG:teuthology.orchestra.run.smithi050:> 2023-10-06T10:59:44.698 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.3")) 2023-10-06T10:59:44.698 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-10-06T10:59:44.835 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.3.126544.asok 2023-10-06T10:59:45.016 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.126544.asok 2023-10-06T10:59:45.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:45.016 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.126544.asok status 2023-10-06T10:59:45.190 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T10:59:45.190 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-10-06T10:59:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T10:59:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T10:59:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "3", 2023-10-06T10:59:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-10-06T10:59:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-06T10:59:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "126544", 2023-10-06T10:59:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-10-06T10:59:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T10:59:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-10-06T10:59:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-10-06T10:59:45.192 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4786, 2023-10-06T10:59:45.192 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-10-06T10:59:45.192 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-10-06T10:59:45.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-10-06T10:59:45.192 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 4786 2023-10-06T10:59:45.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T10:59:45.192 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-10-06T10:59:45.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-10-06T10:59:45.192 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.2:0", 2023-10-06T10:59:45.192 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 506464509 2023-10-06T10:59:45.192 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T10:59:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T10:59:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-10-06T10:59:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-10-06T10:59:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.2:0", 2023-10-06T10:59:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 506464509 2023-10-06T10:59:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T10:59:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.4786 192.168.0.2:0/506464509", 2023-10-06T10:59:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.2:0/506464509", 2023-10-06T10:59:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-10-06T10:59:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 9, 2023-10-06T10:59:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 25, 2023-10-06T10:59:45.194 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-10-06T10:59:45.194 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-10-06T10:59:45.194 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-10-06T10:59:45.194 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T10:59:45.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:45.201 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2023-10-06T10:59:45.201 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T10:59:45.225 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2023-10-06T10:59:45.225 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T10:59:45.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:45.226 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T10:59:45.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:45.302 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2023-10-06T10:59:45.302 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-06T10:59:45.366 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2023-10-06T10:59:45.367 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-06T10:59:45.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:45.367 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T10:59:45.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:45.442 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-10-06T10:59:45.442 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-06T10:59:45.465 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-10-06T10:59:45.465 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-06T10:59:45.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:45.466 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T10:59:45.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:45.541 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-10-06T10:59:45.541 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-06T10:59:45.604 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-10-06T10:59:45.604 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-06T10:59:45.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T10:59:45.604 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T10:59:45.680 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T10:59:45.697 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:45.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.835+0000 7f714ae9d700 1 Processor -- start 2023-10-06T10:59:45.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.835+0000 7f714ae9d700 1 -- start start 2023-10-06T10:59:45.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.836+0000 7f714ae9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7144159360 0x7f71440afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:45.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.836+0000 7f714ae9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7144068100 0x7f7144162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:45.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.836+0000 7f714ae9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71440aeba0 con 0x7f71440ac7f0 2023-10-06T10:59:45.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.836+0000 7f714ae9d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7144159730 con 0x7f7144068100 2023-10-06T10:59:45.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.836+0000 7f714ae9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71440ae270 con 0x7f7144159360 2023-10-06T10:59:45.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.836+0000 7f714943a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7144068100 0x7f7144162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:45.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.836+0000 7f714943a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7144068100 0x7f7144162ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35236/0 (socket says 172.21.15.7:35236) 2023-10-06T10:59:45.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.836+0000 7f714943a700 1 -- 172.21.15.7:0/1389200430 learned_addr learned my addr 172.21.15.7:0/1389200430 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:45.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.836+0000 7f7148c39700 1 --2- 172.21.15.7:0/1389200430 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7144159360 0x7f71440afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:45.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.836+0000 7f714943a700 1 -- 172.21.15.7:0/1389200430 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7144159360 msgr2=0x7f71440afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:45.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.836+0000 7f714943a700 1 --2- 172.21.15.7:0/1389200430 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7144159360 0x7f71440afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:45.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.836+0000 7f714943a700 1 -- 172.21.15.7:0/1389200430 >> v1:172.21.15.50:6789/0 conn(0x7f71440ac7f0 legacy=0x7f71440a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:45.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.836+0000 7f714943a700 1 -- 172.21.15.7:0/1389200430 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71440ae550 con 0x7f7144068100 2023-10-06T10:59:45.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.836+0000 7f714943a700 1 --2- 172.21.15.7:0/1389200430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7144068100 0x7f7144162ea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f713c009f20 tx=0x7f713c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8dfc6095342889 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:45.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.837+0000 7f71437fe700 1 -- 172.21.15.7:0/1389200430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c00e070 con 0x7f7144068100 2023-10-06T10:59:45.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.837+0000 7f71437fe700 1 -- 172.21.15.7:0/1389200430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c00ba80 con 0x7f7144068100 2023-10-06T10:59:45.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.837+0000 7f71437fe700 1 -- 172.21.15.7:0/1389200430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0092e0 con 0x7f7144068100 2023-10-06T10:59:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.837+0000 7f714ae9d700 1 -- 172.21.15.7:0/1389200430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7144068100 msgr2=0x7f7144162ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.837+0000 7f714ae9d700 1 --2- 172.21.15.7:0/1389200430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7144068100 0x7f7144162ea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f713c009f20 tx=0x7f713c009840 comp rx=0 tx=0).stop 2023-10-06T10:59:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.837+0000 7f714ae9d700 1 -- 172.21.15.7:0/1389200430 shutdown_connections 2023-10-06T10:59:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.837+0000 7f714ae9d700 1 --2- 172.21.15.7:0/1389200430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7144068100 0x7f7144162ea0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.837+0000 7f714ae9d700 1 --2- 172.21.15.7:0/1389200430 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7144159360 0x7f71440afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.837+0000 7f714ae9d700 1 -- 172.21.15.7:0/1389200430 >> 172.21.15.7:0/1389200430 conn(0x7f7144095a70 msgr2=0x7f71440af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.837+0000 7f714ae9d700 1 -- 172.21.15.7:0/1389200430 shutdown_connections 2023-10-06T10:59:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.837+0000 7f714ae9d700 1 -- 172.21.15.7:0/1389200430 wait complete. 2023-10-06T10:59:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.838+0000 7f714ae9d700 1 Processor -- start 2023-10-06T10:59:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.839+0000 7f714ae9d700 1 -- start start 2023-10-06T10:59:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.839+0000 7f714ae9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7144068100 0x7f714414d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.839+0000 7f714ae9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71440ac7f0 0x7f71441505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.839+0000 7f714ae9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7144159360 0x7f71440af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.839+0000 7f714ae9d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7144153f50 con 0x7f71440ac7f0 2023-10-06T10:59:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.839+0000 7f714ae9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7144153620 con 0x7f7144159360 2023-10-06T10:59:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.839+0000 7f714ae9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7144153900 con 0x7f7144068100 2023-10-06T10:59:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f7143fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71440ac7f0 0x7f71441505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f7143fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71440ac7f0 0x7f71441505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35248/0 (socket says 172.21.15.7:35248) 2023-10-06T10:59:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f7143fff700 1 -- 172.21.15.7:0/2511587084 learned_addr learned my addr 172.21.15.7:0/2511587084 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f7148c39700 1 --2- 172.21.15.7:0/2511587084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7144068100 0x7f714414d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f714943a700 1 --2- 172.21.15.7:0/2511587084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7144159360 0x7f71440af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f7143fff700 1 -- 172.21.15.7:0/2511587084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7144068100 msgr2=0x7f714414d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f7143fff700 1 --2- 172.21.15.7:0/2511587084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7144068100 0x7f714414d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f7143fff700 1 -- 172.21.15.7:0/2511587084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7144159360 msgr2=0x7f71440af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f7143fff700 1 --2- 172.21.15.7:0/2511587084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7144159360 0x7f71440af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f7143fff700 1 -- 172.21.15.7:0/2511587084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c009ae0 con 0x7f71440ac7f0 2023-10-06T10:59:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f7143fff700 1 --2- 172.21.15.7:0/2511587084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71440ac7f0 0x7f71441505d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f713000c7c0 tx=0x7f7130007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:45.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f7140ff9700 1 -- 172.21.15.7:0/2511587084 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130011590 con 0x7f71440ac7f0 2023-10-06T10:59:45.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f7140ff9700 1 -- 172.21.15.7:0/2511587084 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71300116f0 con 0x7f71440ac7f0 2023-10-06T10:59:45.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f714ae9d700 1 -- 172.21.15.7:0/2511587084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7144153be0 con 0x7f71440ac7f0 2023-10-06T10:59:45.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.840+0000 7f7140ff9700 1 -- 172.21.15.7:0/2511587084 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130011ab0 con 0x7f71440ac7f0 2023-10-06T10:59:45.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.841+0000 7f714ae9d700 1 -- 172.21.15.7:0/2511587084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7144151090 con 0x7f71440ac7f0 2023-10-06T10:59:45.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.841+0000 7f714ae9d700 1 -- 172.21.15.7:0/2511587084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7144153d70 con 0x7f71440ac7f0 2023-10-06T10:59:45.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.842+0000 7f7140ff9700 1 -- 172.21.15.7:0/2511587084 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f713001b3b0 con 0x7f71440ac7f0 2023-10-06T10:59:45.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.842+0000 7f7140ff9700 1 --2- 172.21.15.7:0/2511587084 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7128066f30 0x7f71280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:45.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.842+0000 7f7140ff9700 1 -- 172.21.15.7:0/2511587084 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7130083d30 con 0x7f71440ac7f0 2023-10-06T10:59:45.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.843+0000 7f7148c39700 1 --2- 172.21.15.7:0/2511587084 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7128066f30 0x7f71280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:45.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.843+0000 7f7148c39700 1 --2- 172.21.15.7:0/2511587084 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7128066f30 0x7f71280693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7138006fd0 tx=0x7f7138008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:45.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:45.847+0000 7f7140ff9700 1 -- 172.21.15.7:0/2511587084 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7130050b50 con 0x7f71440ac7f0 2023-10-06T10:59:46.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.049+0000 7f714ae9d700 1 -- 172.21.15.7:0/2511587084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7144070480 con 0x7f71440ac7f0 2023-10-06T10:59:46.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.050+0000 7f7140ff9700 1 -- 172.21.15.7:0/2511587084 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f7130017070 con 0x7f71440ac7f0 2023-10-06T10:59:46.053 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:46.053 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:06.934264+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:46.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.052+0000 7f714ae9d700 1 -- 172.21.15.7:0/2511587084 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7128066f30 msgr2=0x7f71280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.052+0000 7f714ae9d700 1 --2- 172.21.15.7:0/2511587084 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7128066f30 0x7f71280693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7138006fd0 tx=0x7f7138008040 comp rx=0 tx=0).stop 2023-10-06T10:59:46.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.052+0000 7f714ae9d700 1 -- 172.21.15.7:0/2511587084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71440ac7f0 msgr2=0x7f71441505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.052+0000 7f714ae9d700 1 --2- 172.21.15.7:0/2511587084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71440ac7f0 0x7f71441505d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f713000c7c0 tx=0x7f7130007f50 comp rx=0 tx=0).stop 2023-10-06T10:59:46.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.052+0000 7f714ae9d700 1 -- 172.21.15.7:0/2511587084 shutdown_connections 2023-10-06T10:59:46.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.052+0000 7f714ae9d700 1 --2- 172.21.15.7:0/2511587084 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7128066f30 0x7f71280693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.052+0000 7f714ae9d700 1 --2- 172.21.15.7:0/2511587084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7144159360 0x7f71440af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.052+0000 7f714ae9d700 1 --2- 172.21.15.7:0/2511587084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7144068100 0x7f714414d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.052+0000 7f714ae9d700 1 --2- 172.21.15.7:0/2511587084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71440ac7f0 0x7f71441505d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.052+0000 7f714ae9d700 1 -- 172.21.15.7:0/2511587084 >> 172.21.15.7:0/2511587084 conn(0x7f7144095a70 msgr2=0x7f71440b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:46.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.052+0000 7f714ae9d700 1 -- 172.21.15.7:0/2511587084 shutdown_connections 2023-10-06T10:59:46.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.052+0000 7f714ae9d700 1 -- 172.21.15.7:0/2511587084 wait complete. 2023-10-06T10:59:46.068 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T10:58:55.224661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T10:58:56.032929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T10:58:59.772827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T10:59:00.802230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T10:59:04.512252+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T10:59:46.068 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T10:59:46.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.202+0000 7fcb6088b700 1 Processor -- start 2023-10-06T10:59:46.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.202+0000 7fcb6088b700 1 -- start start 2023-10-06T10:59:46.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.203+0000 7fcb6088b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb5c06dac0 0x7fcb5c15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.203+0000 7fcb6088b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb5c06de90 0x7fcb5c15b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.203+0000 7fcb6088b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5c15bb80 con 0x7fcb5c0cc670 2023-10-06T10:59:46.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.203+0000 7fcb6088b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5c0c92c0 con 0x7fcb5c06dac0 2023-10-06T10:59:46.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.203+0000 7fcb6088b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0cc1e0 con 0x7fcb5c06de90 2023-10-06T10:59:46.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.203+0000 7fcb5a59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb5c06dac0 0x7fcb5c15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.203+0000 7fcb5ad9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcb5c0cc670 0x7fcb5c0ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56550/0 (socket says 172.21.15.7:56550) 2023-10-06T10:59:46.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.203+0000 7fcb5ad9d700 1 -- 172.21.15.7:0/1228127740 learned_addr learned my addr 172.21.15.7:0/1228127740 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:46.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.204+0000 7fcb53fff700 1 --2- 172.21.15.7:0/1228127740 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb5c06de90 0x7fcb5c15b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.204+0000 7fcb5a59c700 1 -- 172.21.15.7:0/1228127740 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb5c06de90 msgr2=0x7fcb5c15b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:46.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.204+0000 7fcb5a59c700 1 --2- 172.21.15.7:0/1228127740 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb5c06de90 0x7fcb5c15b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.204+0000 7fcb5a59c700 1 -- 172.21.15.7:0/1228127740 >> v1:172.21.15.7:6789/0 conn(0x7fcb5c0cc670 legacy=0x7fcb5c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.204+0000 7fcb5a59c700 1 -- 172.21.15.7:0/1228127740 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c15b8a0 con 0x7fcb5c06dac0 2023-10-06T10:59:46.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.204+0000 7fcb59d9b700 1 -- 172.21.15.7:0/1228127740 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046287339 0 0) 0x7fcb5c15bb80 con 0x7fcb5c0cc670 2023-10-06T10:59:46.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.204+0000 7fcb5a59c700 1 --2- 172.21.15.7:0/1228127740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c06dac0 0x7fcb5c15ac50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009910 tx=0x7fcb4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149feae5cb6def4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:46.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.204+0000 7fcb59d9b700 1 -- 172.21.15.7:0/1228127740 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00b820 con 0x7fcb5c06dac0 2023-10-06T10:59:46.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.204+0000 7fcb59d9b700 1 -- 172.21.15.7:0/1228127740 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c00b980 con 0x7fcb5c06dac0 2023-10-06T10:59:46.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.204+0000 7fcb59d9b700 1 -- 172.21.15.7:0/1228127740 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00bd20 con 0x7fcb5c06dac0 2023-10-06T10:59:46.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.205+0000 7fcb6088b700 1 -- 172.21.15.7:0/1228127740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c06dac0 msgr2=0x7fcb5c15ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.205+0000 7fcb6088b700 1 --2- 172.21.15.7:0/1228127740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c06dac0 0x7fcb5c15ac50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009910 tx=0x7fcb4c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.205+0000 7fcb6088b700 1 -- 172.21.15.7:0/1228127740 shutdown_connections 2023-10-06T10:59:46.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.205+0000 7fcb6088b700 1 --2- 172.21.15.7:0/1228127740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c06dac0 0x7fcb5c15ac50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.205+0000 7fcb6088b700 1 --2- 172.21.15.7:0/1228127740 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb5c06de90 0x7fcb5c15b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.205+0000 7fcb6088b700 1 -- 172.21.15.7:0/1228127740 >> 172.21.15.7:0/1228127740 conn(0x7fcb5c06cd00 msgr2=0x7fcb5c0cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:46.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.205+0000 7fcb6088b700 1 -- 172.21.15.7:0/1228127740 shutdown_connections 2023-10-06T10:59:46.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.205+0000 7fcb6088b700 1 -- 172.21.15.7:0/1228127740 wait complete. 2023-10-06T10:59:46.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.206+0000 7fcb6088b700 1 Processor -- start 2023-10-06T10:59:46.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.206+0000 7fcb6088b700 1 -- start start 2023-10-06T10:59:46.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb6088b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb5c06dac0 0x7fcb5c0c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb6088b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb5c06de90 0x7fcb5c147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb6088b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c0cc670 0x7fcb5c0c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb6088b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0c7980 con 0x7fcb5c0cc670 2023-10-06T10:59:46.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb6088b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0c6d70 con 0x7fcb5c06de90 2023-10-06T10:59:46.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb6088b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0c7050 con 0x7fcb5c06dac0 2023-10-06T10:59:46.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb5ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c0cc670 0x7fcb5c0c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb5ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c0cc670 0x7fcb5c0c5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35268/0 (socket says 172.21.15.7:35268) 2023-10-06T10:59:46.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb5ad9d700 1 -- 172.21.15.7:0/312944351 learned_addr learned my addr 172.21.15.7:0/312944351 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:46.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb5a59c700 1 --2- 172.21.15.7:0/312944351 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb5c06dac0 0x7fcb5c0c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb53fff700 1 --2- 172.21.15.7:0/312944351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb5c06de90 0x7fcb5c147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb5ad9d700 1 -- 172.21.15.7:0/312944351 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb5c06dac0 msgr2=0x7fcb5c0c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb5ad9d700 1 --2- 172.21.15.7:0/312944351 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb5c06dac0 0x7fcb5c0c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb5ad9d700 1 -- 172.21.15.7:0/312944351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb5c06de90 msgr2=0x7fcb5c147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb5ad9d700 1 --2- 172.21.15.7:0/312944351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb5c06de90 0x7fcb5c147950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.207+0000 7fcb5ad9d700 1 -- 172.21.15.7:0/312944351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c009420 con 0x7fcb5c0cc670 2023-10-06T10:59:46.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.208+0000 7fcb5ad9d700 1 --2- 172.21.15.7:0/312944351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c0cc670 0x7fcb5c0c5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400cc10 tx=0x7fcb54001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:46.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.208+0000 7fcb527fc700 1 -- 172.21.15.7:0/312944351 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5400a850 con 0x7fcb5c0cc670 2023-10-06T10:59:46.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.208+0000 7fcb527fc700 1 -- 172.21.15.7:0/312944351 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5400a9d0 con 0x7fcb5c0cc670 2023-10-06T10:59:46.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.208+0000 7fcb6088b700 1 -- 172.21.15.7:0/312944351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5c0c7330 con 0x7fcb5c0cc670 2023-10-06T10:59:46.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.208+0000 7fcb527fc700 1 -- 172.21.15.7:0/312944351 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5400ad90 con 0x7fcb5c0cc670 2023-10-06T10:59:46.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.208+0000 7fcb6088b700 1 -- 172.21.15.7:0/312944351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5c147e90 con 0x7fcb5c0cc670 2023-10-06T10:59:46.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.209+0000 7fcb6088b700 1 -- 172.21.15.7:0/312944351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5c0c7b30 con 0x7fcb5c0cc670 2023-10-06T10:59:46.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.209+0000 7fcb527fc700 1 -- 172.21.15.7:0/312944351 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb54007300 con 0x7fcb5c0cc670 2023-10-06T10:59:46.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.210+0000 7fcb527fc700 1 --2- 172.21.15.7:0/312944351 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fcb3c066f30 0x7fcb3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.210+0000 7fcb527fc700 1 -- 172.21.15.7:0/312944351 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcb54084c40 con 0x7fcb5c0cc670 2023-10-06T10:59:46.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.210+0000 7fcb5a59c700 1 --2- 172.21.15.7:0/312944351 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fcb3c066f30 0x7fcb3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.210+0000 7fcb5a59c700 1 --2- 172.21.15.7:0/312944351 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fcb3c066f30 0x7fcb3c0693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0091e0 tx=0x7fcb4c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:46.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.214+0000 7fcb527fc700 1 -- 172.21.15.7:0/312944351 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb5c0c7b30 con 0x7fcb5c0cc670 2023-10-06T10:59:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.415+0000 7fcb6088b700 1 -- 172.21.15.7:0/312944351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcb5c070480 con 0x7fcb5c0cc670 2023-10-06T10:59:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.415+0000 7fcb527fc700 1 -- 172.21.15.7:0/312944351 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcb54051a40 con 0x7fcb5c0cc670 2023-10-06T10:59:46.417 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-10-06T10:59:46.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.417+0000 7fcb6088b700 1 -- 172.21.15.7:0/312944351 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fcb3c066f30 msgr2=0x7fcb3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.417+0000 7fcb6088b700 1 --2- 172.21.15.7:0/312944351 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fcb3c066f30 0x7fcb3c0693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0091e0 tx=0x7fcb4c017000 comp rx=0 tx=0).stop 2023-10-06T10:59:46.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.417+0000 7fcb6088b700 1 -- 172.21.15.7:0/312944351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c0cc670 msgr2=0x7fcb5c0c5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.417+0000 7fcb6088b700 1 --2- 172.21.15.7:0/312944351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c0cc670 0x7fcb5c0c5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400cc10 tx=0x7fcb54001970 comp rx=0 tx=0).stop 2023-10-06T10:59:46.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.418+0000 7fcb6088b700 1 -- 172.21.15.7:0/312944351 shutdown_connections 2023-10-06T10:59:46.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.418+0000 7fcb6088b700 1 --2- 172.21.15.7:0/312944351 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fcb3c066f30 0x7fcb3c0693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.418+0000 7fcb6088b700 1 --2- 172.21.15.7:0/312944351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c0cc670 0x7fcb5c0c5040 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.418+0000 7fcb6088b700 1 --2- 172.21.15.7:0/312944351 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb5c06dac0 0x7fcb5c0c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.418+0000 7fcb6088b700 1 --2- 172.21.15.7:0/312944351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb5c06de90 0x7fcb5c147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.418+0000 7fcb6088b700 1 -- 172.21.15.7:0/312944351 >> 172.21.15.7:0/312944351 conn(0x7fcb5c06cd00 msgr2=0x7fcb5c0c8800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:46.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.418+0000 7fcb6088b700 1 -- 172.21.15.7:0/312944351 shutdown_connections 2023-10-06T10:59:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.418+0000 7fcb6088b700 1 -- 172.21.15.7:0/312944351 wait complete. 2023-10-06T10:59:46.432 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T10:59:46.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.569+0000 7ff8ce438700 1 Processor -- start 2023-10-06T10:59:46.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.569+0000 7ff8ce438700 1 -- start start 2023-10-06T10:59:46.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8ce438700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8c80caf10 0x7ff8c8159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8ce438700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8c815a300 0x7ff8c815a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8ce438700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c8069dd0 con 0x7ff8c80cab40 2023-10-06T10:59:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8ce438700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c806a070 con 0x7ff8c80caf10 2023-10-06T10:59:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8ce438700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c806a350 con 0x7ff8c815a300 2023-10-06T10:59:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8c77fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8c80caf10 0x7ff8c8159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8c7fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff8c80cab40 0x7ff8c80694a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56562/0 (socket says 172.21.15.7:56562) 2023-10-06T10:59:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8c7fff700 1 -- 172.21.15.7:0/3272139836 learned_addr learned my addr 172.21.15.7:0/3272139836 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8cc9d5700 1 --2- 172.21.15.7:0/3272139836 >> v2:172.21.15.50:3300/0 conn(0x7ff8c815a300 0x7ff8c815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8c77fe700 1 -- 172.21.15.7:0/3272139836 >> v2:172.21.15.50:3300/0 conn(0x7ff8c815a300 msgr2=0x7ff8c815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8c77fe700 1 --2- 172.21.15.7:0/3272139836 >> v2:172.21.15.50:3300/0 conn(0x7ff8c815a300 0x7ff8c815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8c77fe700 1 -- 172.21.15.7:0/3272139836 >> v1:172.21.15.7:6789/0 conn(0x7ff8c80cab40 legacy=0x7ff8c80694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8c77fe700 1 -- 172.21.15.7:0/3272139836 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c80c7360 con 0x7ff8c80caf10 2023-10-06T10:59:46.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8c6ffd700 1 -- 172.21.15.7:0/3272139836 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203991821 0 0) 0x7ff8c8069dd0 con 0x7ff8c80cab40 2023-10-06T10:59:46.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.570+0000 7ff8cc9d5700 1 --2- 172.21.15.7:0/3272139836 >> v2:172.21.15.50:3300/0 conn(0x7ff8c815a300 0x7ff8c815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:46.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.571+0000 7ff8c77fe700 1 --2- 172.21.15.7:0/3272139836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8c80caf10 0x7ff8c8159dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80ccd90 tx=0x7ff8bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0392c861286b44 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:46.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.571+0000 7ff8c6ffd700 1 -- 172.21.15.7:0/3272139836 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00b6b0 con 0x7ff8c80caf10 2023-10-06T10:59:46.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.571+0000 7ff8c6ffd700 1 -- 172.21.15.7:0/3272139836 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc00b810 con 0x7ff8c80caf10 2023-10-06T10:59:46.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.571+0000 7ff8c6ffd700 1 -- 172.21.15.7:0/3272139836 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00bbb0 con 0x7ff8c80caf10 2023-10-06T10:59:46.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.571+0000 7ff8ce438700 1 -- 172.21.15.7:0/3272139836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8c80caf10 msgr2=0x7ff8c8159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.571+0000 7ff8ce438700 1 --2- 172.21.15.7:0/3272139836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8c80caf10 0x7ff8c8159dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80ccd90 tx=0x7ff8bc0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.571+0000 7ff8ce438700 1 -- 172.21.15.7:0/3272139836 shutdown_connections 2023-10-06T10:59:46.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.571+0000 7ff8ce438700 1 --2- 172.21.15.7:0/3272139836 >> v2:172.21.15.50:3300/0 conn(0x7ff8c815a300 0x7ff8c815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.571+0000 7ff8ce438700 1 --2- 172.21.15.7:0/3272139836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8c80caf10 0x7ff8c8159dc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.571+0000 7ff8ce438700 1 -- 172.21.15.7:0/3272139836 >> 172.21.15.7:0/3272139836 conn(0x7ff8c80afc90 msgr2=0x7ff8c80b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:46.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.571+0000 7ff8ce438700 1 -- 172.21.15.7:0/3272139836 shutdown_connections 2023-10-06T10:59:46.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.571+0000 7ff8ce438700 1 -- 172.21.15.7:0/3272139836 wait complete. 2023-10-06T10:59:46.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.573+0000 7ff8ce438700 1 Processor -- start 2023-10-06T10:59:46.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.573+0000 7ff8ce438700 1 -- start start 2023-10-06T10:59:46.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.574+0000 7ff8ce438700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8c80cab40 0x7ff8c80c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.574+0000 7ff8ce438700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8c80caf10 0x7ff8c814a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.574+0000 7ff8ce438700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8c815a300 0x7ff8c80c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.574+0000 7ff8ce438700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c80c2c10 con 0x7ff8c80cab40 2023-10-06T10:59:46.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.574+0000 7ff8ce438700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8155c80 con 0x7ff8c80caf10 2023-10-06T10:59:46.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.574+0000 7ff8ce438700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8155f60 con 0x7ff8c815a300 2023-10-06T10:59:46.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.574+0000 7ff8c7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8c80cab40 0x7ff8c80c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.574+0000 7ff8c7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8c80cab40 0x7ff8c80c10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35288/0 (socket says 172.21.15.7:35288) 2023-10-06T10:59:46.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.574+0000 7ff8c7fff700 1 -- 172.21.15.7:0/54893758 learned_addr learned my addr 172.21.15.7:0/54893758 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:46.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.575+0000 7ff8cc9d5700 1 --2- 172.21.15.7:0/54893758 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8c815a300 0x7ff8c80c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.575+0000 7ff8c77fe700 1 --2- 172.21.15.7:0/54893758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8c80caf10 0x7ff8c814a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.575+0000 7ff8c7fff700 1 -- 172.21.15.7:0/54893758 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8c815a300 msgr2=0x7ff8c80c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.575+0000 7ff8c7fff700 1 --2- 172.21.15.7:0/54893758 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8c815a300 0x7ff8c80c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.575+0000 7ff8c7fff700 1 -- 172.21.15.7:0/54893758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8c80caf10 msgr2=0x7ff8c814a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.575+0000 7ff8c7fff700 1 --2- 172.21.15.7:0/54893758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8c80caf10 0x7ff8c814a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.575+0000 7ff8c7fff700 1 -- 172.21.15.7:0/54893758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc009420 con 0x7ff8c80cab40 2023-10-06T10:59:46.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.575+0000 7ff8c7fff700 1 --2- 172.21.15.7:0/54893758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8c80cab40 0x7ff8c80c10d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff8b800c5b0 tx=0x7ff8b8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:46.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.575+0000 7ff8affff700 1 -- 172.21.15.7:0/54893758 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8005b30 con 0x7ff8c80cab40 2023-10-06T10:59:46.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.575+0000 7ff8affff700 1 -- 172.21.15.7:0/54893758 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b8005c90 con 0x7ff8c80cab40 2023-10-06T10:59:46.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.575+0000 7ff8ce438700 1 -- 172.21.15.7:0/54893758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c8156240 con 0x7ff8c80cab40 2023-10-06T10:59:46.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.575+0000 7ff8affff700 1 -- 172.21.15.7:0/54893758 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8007300 con 0x7ff8c80cab40 2023-10-06T10:59:46.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.575+0000 7ff8ce438700 1 -- 172.21.15.7:0/54893758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c814adb0 con 0x7ff8c80cab40 2023-10-06T10:59:46.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.576+0000 7ff8ce438700 1 -- 172.21.15.7:0/54893758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c80c29e0 con 0x7ff8c80cab40 2023-10-06T10:59:46.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.577+0000 7ff8affff700 1 -- 172.21.15.7:0/54893758 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8b801b3b0 con 0x7ff8c80cab40 2023-10-06T10:59:46.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.577+0000 7ff8affff700 1 --2- 172.21.15.7:0/54893758 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff8b4066f30 0x7ff8b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.577+0000 7ff8affff700 1 -- 172.21.15.7:0/54893758 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff8b8083eb0 con 0x7ff8c80cab40 2023-10-06T10:59:46.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.577+0000 7ff8c77fe700 1 --2- 172.21.15.7:0/54893758 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff8b4066f30 0x7ff8b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.578+0000 7ff8c77fe700 1 --2- 172.21.15.7:0/54893758 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff8b4066f30 0x7ff8b40693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0093f0 tx=0x7ff8bc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:46.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.582+0000 7ff8affff700 1 -- 172.21.15.7:0/54893758 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8c80c29e0 con 0x7ff8c80cab40 2023-10-06T10:59:46.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.783+0000 7ff8ce438700 1 -- 172.21.15.7:0/54893758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8c80c29e0 con 0x7ff8c80cab40 2023-10-06T10:59:46.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.784+0000 7ff8affff700 1 -- 172.21.15.7:0/54893758 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8c80c29e0 con 0x7ff8c80cab40 2023-10-06T10:59:46.786 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-06T10:59:46.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.786+0000 7ff8ce438700 1 -- 172.21.15.7:0/54893758 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff8b4066f30 msgr2=0x7ff8b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.786+0000 7ff8ce438700 1 --2- 172.21.15.7:0/54893758 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff8b4066f30 0x7ff8b40693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0093f0 tx=0x7ff8bc017000 comp rx=0 tx=0).stop 2023-10-06T10:59:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.786+0000 7ff8ce438700 1 -- 172.21.15.7:0/54893758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8c80cab40 msgr2=0x7ff8c80c10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.786+0000 7ff8ce438700 1 --2- 172.21.15.7:0/54893758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8c80cab40 0x7ff8c80c10d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff8b800c5b0 tx=0x7ff8b8001070 comp rx=0 tx=0).stop 2023-10-06T10:59:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.786+0000 7ff8ce438700 1 -- 172.21.15.7:0/54893758 shutdown_connections 2023-10-06T10:59:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.786+0000 7ff8ce438700 1 --2- 172.21.15.7:0/54893758 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff8b4066f30 0x7ff8b40693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.786+0000 7ff8ce438700 1 --2- 172.21.15.7:0/54893758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8c80cab40 0x7ff8c80c10d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.786+0000 7ff8ce438700 1 --2- 172.21.15.7:0/54893758 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff8c815a300 0x7ff8c80c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.786+0000 7ff8ce438700 1 --2- 172.21.15.7:0/54893758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8c80caf10 0x7ff8c814a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.786+0000 7ff8ce438700 1 -- 172.21.15.7:0/54893758 >> 172.21.15.7:0/54893758 conn(0x7ff8c80afc90 msgr2=0x7ff8c8151d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.786+0000 7ff8ce438700 1 -- 172.21.15.7:0/54893758 shutdown_connections 2023-10-06T10:59:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.786+0000 7ff8ce438700 1 -- 172.21.15.7:0/54893758 wait complete. 2023-10-06T10:59:46.801 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T10:59:46.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.934+0000 7fa3fa8fc700 1 Processor -- start 2023-10-06T10:59:46.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.934+0000 7fa3fa8fc700 1 -- start start 2023-10-06T10:59:46.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.935+0000 7fa3fa8fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3f40cab40 0x7fa3f40694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.935+0000 7fa3fa8fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3f40caf10 0x7fa3f40b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.935+0000 7fa3fa8fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa3f40b2260 0x7fa3f40b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.935+0000 7fa3fa8fc700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f40699e0 con 0x7fa3f40b2260 2023-10-06T10:59:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.935+0000 7fa3fa8fc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f4069dd0 con 0x7fa3f40caf10 2023-10-06T10:59:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.935+0000 7fa3fa8fc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f406a070 con 0x7fa3f40cab40 2023-10-06T10:59:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.935+0000 7fa3f8e99700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa3f40b2260 0x7fa3f40b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.935+0000 7fa3f8e99700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa3f40b2260 0x7fa3f40b26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35292/0 (socket says 172.21.15.7:35292) 2023-10-06T10:59:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.935+0000 7fa3f8e99700 1 -- 172.21.15.7:0/3986281034 learned_addr learned my addr 172.21.15.7:0/3986281034 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.935+0000 7fa3f3fff700 1 --2- 172.21.15.7:0/3986281034 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3f40cab40 0x7fa3f40694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.935+0000 7fa3f37fe700 1 --2- 172.21.15.7:0/3986281034 >> v2:172.21.15.50:3300/0 conn(0x7fa3f40caf10 0x7fa3f40b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.936+0000 7fa3f8e99700 1 -- 172.21.15.7:0/3986281034 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3f40cab40 msgr2=0x7fa3f40694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.936+0000 7fa3f8e99700 1 --2- 172.21.15.7:0/3986281034 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3f40cab40 0x7fa3f40694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.936+0000 7fa3f8e99700 1 -- 172.21.15.7:0/3986281034 >> v2:172.21.15.50:3300/0 conn(0x7fa3f40caf10 msgr2=0x7fa3f40b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.936+0000 7fa3f8e99700 1 --2- 172.21.15.7:0/3986281034 >> v2:172.21.15.50:3300/0 conn(0x7fa3f40caf10 0x7fa3f40b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.936+0000 7fa3f8e99700 1 -- 172.21.15.7:0/3986281034 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f406a350 con 0x7fa3f40b2260 2023-10-06T10:59:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.936+0000 7fa3f37fe700 1 --2- 172.21.15.7:0/3986281034 >> v2:172.21.15.50:3300/0 conn(0x7fa3f40caf10 0x7fa3f40b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.936+0000 7fa3f3fff700 1 --2- 172.21.15.7:0/3986281034 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3f40cab40 0x7fa3f40694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.936+0000 7fa3f8e99700 1 --2- 172.21.15.7:0/3986281034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f40b2260 0x7fa3f40b26e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa3f406e0e0 tx=0x7fa3ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae40bed0805e99b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.936+0000 7fa3f2ffd700 1 -- 172.21.15.7:0/3986281034 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec00e070 con 0x7fa3f40b2260 2023-10-06T10:59:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.936+0000 7fa3f2ffd700 1 -- 172.21.15.7:0/3986281034 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec00ba50 con 0x7fa3f40b2260 2023-10-06T10:59:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.936+0000 7fa3f2ffd700 1 -- 172.21.15.7:0/3986281034 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0092e0 con 0x7fa3f40b2260 2023-10-06T10:59:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.937+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/3986281034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f40b2260 msgr2=0x7fa3f40b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.937+0000 7fa3fa8fc700 1 --2- 172.21.15.7:0/3986281034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f40b2260 0x7fa3f40b26e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa3f406e0e0 tx=0x7fa3ec009840 comp rx=0 tx=0).stop 2023-10-06T10:59:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.937+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/3986281034 shutdown_connections 2023-10-06T10:59:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.937+0000 7fa3fa8fc700 1 --2- 172.21.15.7:0/3986281034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f40b2260 0x7fa3f40b26e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.937+0000 7fa3fa8fc700 1 --2- 172.21.15.7:0/3986281034 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3f40cab40 0x7fa3f40694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.937+0000 7fa3fa8fc700 1 --2- 172.21.15.7:0/3986281034 >> v2:172.21.15.50:3300/0 conn(0x7fa3f40caf10 0x7fa3f40b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.937+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/3986281034 >> 172.21.15.7:0/3986281034 conn(0x7fa3f40afc90 msgr2=0x7fa3f40b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.937+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/3986281034 shutdown_connections 2023-10-06T10:59:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.937+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/3986281034 wait complete. 2023-10-06T10:59:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.938+0000 7fa3fa8fc700 1 Processor -- start 2023-10-06T10:59:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.938+0000 7fa3fa8fc700 1 -- start start 2023-10-06T10:59:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3fa8fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f40b2260 0x7fa3f415b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3fa8fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3f40cab40 0x7fa3f40c1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3fa8fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f40caf10 0x7fa3f40c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3fa8fc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40c3290 con 0x7fa3f40b2260 2023-10-06T10:59:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3fa8fc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f4158e20 con 0x7fa3f40caf10 2023-10-06T10:59:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3fa8fc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40c2610 con 0x7fa3f40cab40 2023-10-06T10:59:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3f3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f40b2260 0x7fa3f415b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3f3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f40b2260 0x7fa3f415b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35308/0 (socket says 172.21.15.7:35308) 2023-10-06T10:59:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3f3fff700 1 -- 172.21.15.7:0/932874828 learned_addr learned my addr 172.21.15.7:0/932874828 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3f37fe700 1 --2- 172.21.15.7:0/932874828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3f40cab40 0x7fa3f40c1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3f3fff700 1 -- 172.21.15.7:0/932874828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3f40cab40 msgr2=0x7fa3f40c1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3f3fff700 1 --2- 172.21.15.7:0/932874828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3f40cab40 0x7fa3f40c1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3f3fff700 1 -- 172.21.15.7:0/932874828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f40caf10 msgr2=0x7fa3f40c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3f3fff700 1 --2- 172.21.15.7:0/932874828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f40caf10 0x7fa3f40c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3f3fff700 1 -- 172.21.15.7:0/932874828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec009ae0 con 0x7fa3f40b2260 2023-10-06T10:59:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.939+0000 7fa3f37fe700 1 --2- 172.21.15.7:0/932874828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3f40cab40 0x7fa3f40c1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.940+0000 7fa3f3fff700 1 --2- 172.21.15.7:0/932874828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f40b2260 0x7fa3f415b8c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400d890 tx=0x7fa3e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.940+0000 7fa3dbfff700 1 -- 172.21.15.7:0/932874828 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e400b600 con 0x7fa3f40b2260 2023-10-06T10:59:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.940+0000 7fa3dbfff700 1 -- 172.21.15.7:0/932874828 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e400b760 con 0x7fa3f40b2260 2023-10-06T10:59:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.940+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/932874828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f40c28f0 con 0x7fa3f40b2260 2023-10-06T10:59:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.940+0000 7fa3dbfff700 1 -- 172.21.15.7:0/932874828 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e400bb00 con 0x7fa3f40b2260 2023-10-06T10:59:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.940+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/932874828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f40c2eb0 con 0x7fa3f40b2260 2023-10-06T10:59:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.941+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/932874828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f4070480 con 0x7fa3f40b2260 2023-10-06T10:59:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.941+0000 7fa3dbfff700 1 -- 172.21.15.7:0/932874828 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3e4014430 con 0x7fa3f40b2260 2023-10-06T10:59:46.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.942+0000 7fa3dbfff700 1 --2- 172.21.15.7:0/932874828 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa3e0066f30 0x7fa3e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:46.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.942+0000 7fa3dbfff700 1 -- 172.21.15.7:0/932874828 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa3e4084e70 con 0x7fa3f40b2260 2023-10-06T10:59:46.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.942+0000 7fa3f37fe700 1 --2- 172.21.15.7:0/932874828 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa3e0066f30 0x7fa3e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:46.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.942+0000 7fa3f37fe700 1 --2- 172.21.15.7:0/932874828 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa3e0066f30 0x7fa3e00693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40c9590 tx=0x7fa3e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:46.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:46.946+0000 7fa3dbfff700 1 -- 172.21.15.7:0/932874828 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3e4051ca0 con 0x7fa3f40b2260 2023-10-06T10:59:47.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.147+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/932874828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3f40c3b90 con 0x7fa3f40b2260 2023-10-06T10:59:47.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.147+0000 7fa3dbfff700 1 -- 172.21.15.7:0/932874828 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa3e40552c0 con 0x7fa3f40b2260 2023-10-06T10:59:47.150 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T10:59:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.150+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/932874828 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa3e0066f30 msgr2=0x7fa3e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.150+0000 7fa3fa8fc700 1 --2- 172.21.15.7:0/932874828 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa3e0066f30 0x7fa3e00693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40c9590 tx=0x7fa3e8008040 comp rx=0 tx=0).stop 2023-10-06T10:59:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.150+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/932874828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f40b2260 msgr2=0x7fa3f415b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.150+0000 7fa3fa8fc700 1 --2- 172.21.15.7:0/932874828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f40b2260 0x7fa3f415b8c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400d890 tx=0x7fa3e4008040 comp rx=0 tx=0).stop 2023-10-06T10:59:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.150+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/932874828 shutdown_connections 2023-10-06T10:59:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.150+0000 7fa3fa8fc700 1 --2- 172.21.15.7:0/932874828 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa3e0066f30 0x7fa3e00693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.150+0000 7fa3fa8fc700 1 --2- 172.21.15.7:0/932874828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f40b2260 0x7fa3f415b8c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.150+0000 7fa3fa8fc700 1 --2- 172.21.15.7:0/932874828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f40caf10 0x7fa3f40c1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.150+0000 7fa3fa8fc700 1 --2- 172.21.15.7:0/932874828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3f40cab40 0x7fa3f40c1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.150+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/932874828 >> 172.21.15.7:0/932874828 conn(0x7fa3f40afc90 msgr2=0x7fa3f4153a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.150+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/932874828 shutdown_connections 2023-10-06T10:59:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.150+0000 7fa3fa8fc700 1 -- 172.21.15.7:0/932874828 wait complete. 2023-10-06T10:59:47.165 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T10:59:47.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.298+0000 7f39f97a6700 1 Processor -- start 2023-10-06T10:59:47.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.298+0000 7f39f97a6700 1 -- start start 2023-10-06T10:59:47.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.299+0000 7f39f97a6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39f40af440 0x7f39f40caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:47.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.299+0000 7f39f97a6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39f4159890 0x7f39f40cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:47.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.299+0000 7f39f97a6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f40cf870 con 0x7f39f41594c0 2023-10-06T10:59:47.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.299+0000 7f39f97a6700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f40cecf0 con 0x7f39f40af440 2023-10-06T10:59:47.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.299+0000 7f39f97a6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40cba70 con 0x7f39f4159890 2023-10-06T10:59:47.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.299+0000 7f39f27fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39f40af440 0x7f39f40caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:47.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.299+0000 7f39f27fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39f40af440 0x7f39f40caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35318/0 (socket says 172.21.15.7:35318) 2023-10-06T10:59:47.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.299+0000 7f39f27fc700 1 -- 172.21.15.7:0/2406814378 learned_addr learned my addr 172.21.15.7:0/2406814378 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:47.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.299+0000 7f39f37fe700 1 --2- 172.21.15.7:0/2406814378 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39f4159890 0x7f39f40cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:47.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.300+0000 7f39f27fc700 1 -- 172.21.15.7:0/2406814378 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39f4159890 msgr2=0x7f39f40cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.300+0000 7f39f27fc700 1 --2- 172.21.15.7:0/2406814378 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39f4159890 0x7f39f40cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.300+0000 7f39f27fc700 1 -- 172.21.15.7:0/2406814378 >> v1:172.21.15.50:6789/0 conn(0x7f39f41594c0 legacy=0x7f39f40aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.300+0000 7f39f27fc700 1 -- 172.21.15.7:0/2406814378 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f40b1030 con 0x7f39f40af440 2023-10-06T10:59:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.300+0000 7f39f27fc700 1 --2- 172.21.15.7:0/2406814378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39f40af440 0x7f39f40caff0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f39e40099b0 tx=0x7f39e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e239ed9e095a43dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.300+0000 7f39f1ffb700 1 -- 172.21.15.7:0/2406814378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e400b820 con 0x7f39f40af440 2023-10-06T10:59:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.300+0000 7f39f1ffb700 1 -- 172.21.15.7:0/2406814378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e400b980 con 0x7f39f40af440 2023-10-06T10:59:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.300+0000 7f39f1ffb700 1 -- 172.21.15.7:0/2406814378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e400bd20 con 0x7f39f40af440 2023-10-06T10:59:47.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.300+0000 7f39f97a6700 1 -- 172.21.15.7:0/2406814378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39f40af440 msgr2=0x7f39f40caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:47.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.301+0000 7f39f97a6700 1 --2- 172.21.15.7:0/2406814378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39f40af440 0x7f39f40caff0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f39e40099b0 tx=0x7f39e4009250 comp rx=0 tx=0).stop 2023-10-06T10:59:47.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.301+0000 7f39f97a6700 1 -- 172.21.15.7:0/2406814378 shutdown_connections 2023-10-06T10:59:47.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.301+0000 7f39f97a6700 1 --2- 172.21.15.7:0/2406814378 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39f4159890 0x7f39f40cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.301+0000 7f39f97a6700 1 --2- 172.21.15.7:0/2406814378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39f40af440 0x7f39f40caff0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.301+0000 7f39f97a6700 1 -- 172.21.15.7:0/2406814378 >> 172.21.15.7:0/2406814378 conn(0x7f39f4067bc0 msgr2=0x7f39f40d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:47.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.301+0000 7f39f97a6700 1 -- 172.21.15.7:0/2406814378 shutdown_connections 2023-10-06T10:59:47.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.301+0000 7f39f97a6700 1 -- 172.21.15.7:0/2406814378 wait complete. 2023-10-06T10:59:47.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.302+0000 7f39f97a6700 1 Processor -- start 2023-10-06T10:59:47.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.302+0000 7f39f97a6700 1 -- start start 2023-10-06T10:59:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f97a6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39f40af440 0x7f39f415c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f97a6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39f41594c0 0x7f39f416cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f97a6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f4159890 0x7f39f416d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f97a6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4154570 con 0x7f39f40af440 2023-10-06T10:59:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f97a6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f415cc10 con 0x7f39f4159890 2023-10-06T10:59:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f97a6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f415cef0 con 0x7f39f41594c0 2023-10-06T10:59:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f2ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39f40af440 0x7f39f415c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f2ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39f40af440 0x7f39f415c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35320/0 (socket says 172.21.15.7:35320) 2023-10-06T10:59:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f2ffd700 1 -- 172.21.15.7:0/3591037346 learned_addr learned my addr 172.21.15.7:0/3591037346 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f27fc700 1 --2- 172.21.15.7:0/3591037346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39f41594c0 0x7f39f416cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f37fe700 1 --2- 172.21.15.7:0/3591037346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f4159890 0x7f39f416d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f2ffd700 1 -- 172.21.15.7:0/3591037346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39f41594c0 msgr2=0x7f39f416cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f2ffd700 1 --2- 172.21.15.7:0/3591037346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39f41594c0 0x7f39f416cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f2ffd700 1 -- 172.21.15.7:0/3591037346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f4159890 msgr2=0x7f39f416d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f2ffd700 1 --2- 172.21.15.7:0/3591037346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f4159890 0x7f39f416d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.303+0000 7f39f2ffd700 1 -- 172.21.15.7:0/3591037346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e40094f0 con 0x7f39f40af440 2023-10-06T10:59:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.304+0000 7f39f2ffd700 1 --2- 172.21.15.7:0/3591037346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39f40af440 0x7f39f415c530 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00b5e0 tx=0x7f39dc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.304+0000 7f39eaffd700 1 -- 172.21.15.7:0/3591037346 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc00f510 con 0x7f39f40af440 2023-10-06T10:59:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.304+0000 7f39eaffd700 1 -- 172.21.15.7:0/3591037346 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39dc00f670 con 0x7f39f40af440 2023-10-06T10:59:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.304+0000 7f39eaffd700 1 -- 172.21.15.7:0/3591037346 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc00fa30 con 0x7f39f40af440 2023-10-06T10:59:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.304+0000 7f39f97a6700 1 -- 172.21.15.7:0/3591037346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f40c84f0 con 0x7f39f40af440 2023-10-06T10:59:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.304+0000 7f39f97a6700 1 -- 172.21.15.7:0/3591037346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f40c8ab0 con 0x7f39f40af440 2023-10-06T10:59:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.305+0000 7f39f97a6700 1 -- 172.21.15.7:0/3591037346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f4070480 con 0x7f39f40af440 2023-10-06T10:59:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.305+0000 7f39eaffd700 1 -- 172.21.15.7:0/3591037346 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39dc01a400 con 0x7f39f40af440 2023-10-06T10:59:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.306+0000 7f39eaffd700 1 --2- 172.21.15.7:0/3591037346 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f39d4066f30 0x7f39d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.306+0000 7f39eaffd700 1 -- 172.21.15.7:0/3591037346 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f39dc084370 con 0x7f39f40af440 2023-10-06T10:59:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.306+0000 7f39f27fc700 1 --2- 172.21.15.7:0/3591037346 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f39d4066f30 0x7f39d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.306+0000 7f39f27fc700 1 --2- 172.21.15.7:0/3591037346 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f39d4066f30 0x7f39d40693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f39e40099b0 tx=0x7f39e4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:47.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.310+0000 7f39eaffd700 1 -- 172.21.15.7:0/3591037346 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39dc051210 con 0x7f39f40af440 2023-10-06T10:59:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.513+0000 7f39f97a6700 1 -- 172.21.15.7:0/3591037346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39f4068be0 con 0x7f39f40af440 2023-10-06T10:59:47.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.513+0000 7f39eaffd700 1 -- 172.21.15.7:0/3591037346 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39dc058e60 con 0x7f39f40af440 2023-10-06T10:59:47.515 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-06T10:59:47.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.516+0000 7f39f97a6700 1 -- 172.21.15.7:0/3591037346 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f39d4066f30 msgr2=0x7f39d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:47.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.516+0000 7f39f97a6700 1 --2- 172.21.15.7:0/3591037346 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f39d4066f30 0x7f39d40693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f39e40099b0 tx=0x7f39e4016000 comp rx=0 tx=0).stop 2023-10-06T10:59:47.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.516+0000 7f39f97a6700 1 -- 172.21.15.7:0/3591037346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39f40af440 msgr2=0x7f39f415c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:47.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.516+0000 7f39f97a6700 1 --2- 172.21.15.7:0/3591037346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39f40af440 0x7f39f415c530 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00b5e0 tx=0x7f39dc009120 comp rx=0 tx=0).stop 2023-10-06T10:59:47.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.516+0000 7f39f97a6700 1 -- 172.21.15.7:0/3591037346 shutdown_connections 2023-10-06T10:59:47.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.516+0000 7f39f97a6700 1 --2- 172.21.15.7:0/3591037346 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f39d4066f30 0x7f39d40693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.516+0000 7f39f97a6700 1 --2- 172.21.15.7:0/3591037346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39f40af440 0x7f39f415c530 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.516+0000 7f39f97a6700 1 --2- 172.21.15.7:0/3591037346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f4159890 0x7f39f416d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.516+0000 7f39f97a6700 1 --2- 172.21.15.7:0/3591037346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39f41594c0 0x7f39f416cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.516+0000 7f39f97a6700 1 -- 172.21.15.7:0/3591037346 >> 172.21.15.7:0/3591037346 conn(0x7f39f4067bc0 msgr2=0x7f39f4154aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:47.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.516+0000 7f39f97a6700 1 -- 172.21.15.7:0/3591037346 shutdown_connections 2023-10-06T10:59:47.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.516+0000 7f39f97a6700 1 -- 172.21.15.7:0/3591037346 wait complete. 2023-10-06T10:59:47.531 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T10:59:47.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.665+0000 7f6481782700 1 Processor -- start 2023-10-06T10:59:47.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.665+0000 7f6481782700 1 -- start start 2023-10-06T10:59:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.666+0000 7f6481782700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f647c0cd680 0x7f647c156a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.666+0000 7f6481782700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f647c15b360 0x7f647c156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.666+0000 7f6481782700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c15bb80 con 0x7f647c06dac0 2023-10-06T10:59:47.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.666+0000 7f6481782700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c0c92c0 con 0x7f647c0cd680 2023-10-06T10:59:47.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.666+0000 7f6481782700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0cc1e0 con 0x7f647c15b360 2023-10-06T10:59:47.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.667+0000 7f647b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f647c15b360 0x7f647c156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:47.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.667+0000 7f647b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f647c15b360 0x7f647c156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:47202/0 (socket says 172.21.15.7:47202) 2023-10-06T10:59:47.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.667+0000 7f647b7fe700 1 -- 172.21.15.7:0/2542627353 learned_addr learned my addr 172.21.15.7:0/2542627353 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:47.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.667+0000 7f647a7fc700 1 --2- 172.21.15.7:0/2542627353 >> v2:172.21.15.50:3300/0 conn(0x7f647c0cd680 0x7f647c156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.667+0000 7f6479ffb700 1 -- 172.21.15.7:0/2542627353 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164764440 0 0) 0x7f647c15bb80 con 0x7f647c06dac0 2023-10-06T10:59:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.667+0000 7f6479ffb700 1 -- 172.21.15.7:0/2542627353 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6464003570 con 0x7f647c06dac0 2023-10-06T10:59:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.667+0000 7f647b7fe700 1 -- 172.21.15.7:0/2542627353 >> v2:172.21.15.50:3300/0 conn(0x7f647c0cd680 msgr2=0x7f647c156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.667+0000 7f647b7fe700 1 --2- 172.21.15.7:0/2542627353 >> v2:172.21.15.50:3300/0 conn(0x7f647c0cd680 0x7f647c156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.667+0000 7f647b7fe700 1 -- 172.21.15.7:0/2542627353 >> v1:172.21.15.50:6789/0 conn(0x7f647c06dac0 legacy=0x7f647c15ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.667+0000 7f647b7fe700 1 -- 172.21.15.7:0/2542627353 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c15b8a0 con 0x7f647c15b360 2023-10-06T10:59:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.667+0000 7f647b7fe700 1 --2- 172.21.15.7:0/2542627353 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f647c15b360 0x7f647c156f60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6474009f20 tx=0x7f6474009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8031fe6223a1fd5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.668+0000 7f6479ffb700 1 -- 172.21.15.7:0/2542627353 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647400e070 con 0x7f647c15b360 2023-10-06T10:59:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.668+0000 7f6479ffb700 1 -- 172.21.15.7:0/2542627353 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647400b970 con 0x7f647c15b360 2023-10-06T10:59:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.668+0000 7f6479ffb700 1 -- 172.21.15.7:0/2542627353 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64740092e0 con 0x7f647c15b360 2023-10-06T10:59:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.668+0000 7f6481782700 1 -- 172.21.15.7:0/2542627353 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f647c15b360 msgr2=0x7f647c156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.668+0000 7f6481782700 1 --2- 172.21.15.7:0/2542627353 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f647c15b360 0x7f647c156f60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6474009f20 tx=0x7f6474009840 comp rx=0 tx=0).stop 2023-10-06T10:59:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.668+0000 7f6481782700 1 -- 172.21.15.7:0/2542627353 shutdown_connections 2023-10-06T10:59:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.668+0000 7f6481782700 1 --2- 172.21.15.7:0/2542627353 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f647c15b360 0x7f647c156f60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.668+0000 7f6481782700 1 --2- 172.21.15.7:0/2542627353 >> v2:172.21.15.50:3300/0 conn(0x7f647c0cd680 0x7f647c156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.668+0000 7f6481782700 1 -- 172.21.15.7:0/2542627353 >> 172.21.15.7:0/2542627353 conn(0x7f647c06cd00 msgr2=0x7f647c0cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.668+0000 7f6481782700 1 -- 172.21.15.7:0/2542627353 shutdown_connections 2023-10-06T10:59:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.668+0000 7f6481782700 1 -- 172.21.15.7:0/2542627353 wait complete. 2023-10-06T10:59:47.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.670+0000 7f6481782700 1 Processor -- start 2023-10-06T10:59:47.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.670+0000 7f6481782700 1 -- start start 2023-10-06T10:59:47.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.670+0000 7f6481782700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f647c06dac0 0x7f647c0add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:47.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.670+0000 7f6481782700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f647c0cd680 0x7f647c16b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:47.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.670+0000 7f6481782700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f647c15b360 0x7f647c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:47.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.670+0000 7f6481782700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0b0090 con 0x7f647c06dac0 2023-10-06T10:59:47.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.670+0000 7f6481782700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0b0860 con 0x7f647c15b360 2023-10-06T10:59:47.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.670+0000 7f6481782700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0c6d20 con 0x7f647c0cd680 2023-10-06T10:59:47.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f647affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f647c06dac0 0x7f647c0add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:47.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f647affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f647c06dac0 0x7f647c0add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35330/0 (socket says 172.21.15.7:35330) 2023-10-06T10:59:47.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f647affd700 1 -- 172.21.15.7:0/516742360 learned_addr learned my addr 172.21.15.7:0/516742360 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:47.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f647a7fc700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f647c0cd680 0x7f647c16b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:47.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f647b7fe700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f647c15b360 0x7f647c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:47.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f647affd700 1 -- 172.21.15.7:0/516742360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f647c0cd680 msgr2=0x7f647c16b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:47.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f647affd700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f647c0cd680 0x7f647c16b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f647affd700 1 -- 172.21.15.7:0/516742360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f647c15b360 msgr2=0x7f647c15d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:47.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f647affd700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f647c15b360 0x7f647c15d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f647affd700 1 -- 172.21.15.7:0/516742360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474009ae0 con 0x7f647c06dac0 2023-10-06T10:59:47.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f647b7fe700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f647c15b360 0x7f647c15d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:47.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f647affd700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f647c06dac0 0x7f647c0add50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f647000c790 tx=0x7f6470007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:47.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f6462ffd700 1 -- 172.21.15.7:0/516742360 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470010510 con 0x7f647c06dac0 2023-10-06T10:59:47.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f6462ffd700 1 -- 172.21.15.7:0/516742360 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6470010670 con 0x7f647c06dac0 2023-10-06T10:59:47.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f6462ffd700 1 -- 172.21.15.7:0/516742360 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470010a30 con 0x7f647c06dac0 2023-10-06T10:59:47.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f6481782700 1 -- 172.21.15.7:0/516742360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c16b630 con 0x7f647c06dac0 2023-10-06T10:59:47.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.671+0000 7f6481782700 1 -- 172.21.15.7:0/516742360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c0b02a0 con 0x7f647c06dac0 2023-10-06T10:59:47.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.672+0000 7f6481782700 1 -- 172.21.15.7:0/516742360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647c0c8520 con 0x7f647c06dac0 2023-10-06T10:59:47.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.673+0000 7f6462ffd700 1 -- 172.21.15.7:0/516742360 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f647001b3b0 con 0x7f647c06dac0 2023-10-06T10:59:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.673+0000 7f6462ffd700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6468066f30 0x7f64680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.673+0000 7f6462ffd700 1 -- 172.21.15.7:0/516742360 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6470084240 con 0x7f647c06dac0 2023-10-06T10:59:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.673+0000 7f647a7fc700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6468066f30 0x7f64680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.674+0000 7f647a7fc700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6468066f30 0x7f64680693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f647c0affa0 tx=0x7f646c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.678+0000 7f6462ffd700 1 -- 172.21.15.7:0/516742360 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6470051060 con 0x7f647c06dac0 2023-10-06T10:59:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.881+0000 7f6481782700 1 -- 172.21.15.7:0/516742360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f647c070480 con 0x7f647c06dac0 2023-10-06T10:59:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.882+0000 7f6462ffd700 1 -- 172.21.15.7:0/516742360 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6470017020 con 0x7f647c06dac0 2023-10-06T10:59:47.884 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T10:59:47.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.884+0000 7f6481782700 1 -- 172.21.15.7:0/516742360 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6468066f30 msgr2=0x7f64680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:47.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.884+0000 7f6481782700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6468066f30 0x7f64680693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f647c0affa0 tx=0x7f646c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.884+0000 7f6481782700 1 -- 172.21.15.7:0/516742360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f647c06dac0 msgr2=0x7f647c0add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.884+0000 7f6481782700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f647c06dac0 0x7f647c0add50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f647000c790 tx=0x7f6470007e10 comp rx=0 tx=0).stop 2023-10-06T10:59:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.884+0000 7f6481782700 1 -- 172.21.15.7:0/516742360 shutdown_connections 2023-10-06T10:59:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.884+0000 7f6481782700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6468066f30 0x7f64680693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.884+0000 7f6481782700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f647c06dac0 0x7f647c0add50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.884+0000 7f6481782700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f647c15b360 0x7f647c15d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.884+0000 7f6481782700 1 --2- 172.21.15.7:0/516742360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f647c0cd680 0x7f647c16b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.884+0000 7f6481782700 1 -- 172.21.15.7:0/516742360 >> 172.21.15.7:0/516742360 conn(0x7f647c06cd00 msgr2=0x7f647c158890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.884+0000 7f6481782700 1 -- 172.21.15.7:0/516742360 shutdown_connections 2023-10-06T10:59:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:47.884+0000 7f6481782700 1 -- 172.21.15.7:0/516742360 wait complete. 2023-10-06T10:59:47.899 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:48.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.029+0000 7f39e11db700 1 Processor -- start 2023-10-06T10:59:48.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.030+0000 7f39e11db700 1 -- start start 2023-10-06T10:59:48.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.030+0000 7f39e11db700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39dc0ccda0 0x7f39dc0cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.030+0000 7f39e11db700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39dc069110 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.030+0000 7f39e11db700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39dc068b30 con 0x7f39dc0aaa40 2023-10-06T10:59:48.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.030+0000 7f39e11db700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc0aafb0 con 0x7f39dc0ccda0 2023-10-06T10:59:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.031+0000 7f39da59c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f39dc0ac8d0 0x7f39dc0aa330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56566/0 (socket says 172.21.15.7:56566) 2023-10-06T10:59:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.031+0000 7f39da59c700 1 -- 172.21.15.7:0/2343363519 learned_addr learned my addr 172.21.15.7:0/2343363519 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.031+0000 7f39dad9d700 1 --2- 172.21.15.7:0/2343363519 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39dc0ccda0 0x7f39dc0cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.031+0000 7f39d9d9b700 1 -- 172.21.15.7:0/2343363519 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919832636 0 0) 0x7f39dc069110 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.031+0000 7f39d9d9b700 1 -- 172.21.15.7:0/2343363519 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39c4003570 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.031+0000 7f39dad9d700 1 -- 172.21.15.7:0/2343363519 >> v1:172.21.15.50:6789/0 conn(0x7f39dc0aaa40 legacy=0x7f39dc155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.031+0000 7f39d9d9b700 1 -- 172.21.15.7:0/2343363519 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337317872 0 0) 0x7f39dc068b30 con 0x7f39dc0aaa40 2023-10-06T10:59:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.031+0000 7f39dad9d700 1 -- 172.21.15.7:0/2343363519 >> v1:172.21.15.7:6789/0 conn(0x7f39dc0ac8d0 legacy=0x7f39dc0aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.031+0000 7f39dad9d700 1 -- 172.21.15.7:0/2343363519 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc068da0 con 0x7f39dc0ccda0 2023-10-06T10:59:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.031+0000 7f39dad9d700 1 --2- 172.21.15.7:0/2343363519 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39dc0ccda0 0x7f39dc0cd170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009910 tx=0x7f39cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86432aff2e6d3ff9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.031+0000 7f39d9d9b700 1 -- 172.21.15.7:0/2343363519 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc00b710 con 0x7f39dc0ccda0 2023-10-06T10:59:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.032+0000 7f39d9d9b700 1 -- 172.21.15.7:0/2343363519 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39cc00b870 con 0x7f39dc0ccda0 2023-10-06T10:59:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.032+0000 7f39d9d9b700 1 -- 172.21.15.7:0/2343363519 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc00bc30 con 0x7f39dc0ccda0 2023-10-06T10:59:48.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.032+0000 7f39e11db700 1 -- 172.21.15.7:0/2343363519 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39dc0ccda0 msgr2=0x7f39dc0cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.032+0000 7f39e11db700 1 --2- 172.21.15.7:0/2343363519 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39dc0ccda0 0x7f39dc0cd170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009910 tx=0x7f39cc0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.032+0000 7f39e11db700 1 -- 172.21.15.7:0/2343363519 shutdown_connections 2023-10-06T10:59:48.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.032+0000 7f39e11db700 1 --2- 172.21.15.7:0/2343363519 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39dc0ccda0 0x7f39dc0cd170 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.032+0000 7f39e11db700 1 -- 172.21.15.7:0/2343363519 >> 172.21.15.7:0/2343363519 conn(0x7f39dc096160 msgr2=0x7f39dc0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:48.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.032+0000 7f39e11db700 1 -- 172.21.15.7:0/2343363519 shutdown_connections 2023-10-06T10:59:48.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.032+0000 7f39e11db700 1 -- 172.21.15.7:0/2343363519 wait complete. 2023-10-06T10:59:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.033+0000 7f39e11db700 1 Processor -- start 2023-10-06T10:59:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.033+0000 7f39e11db700 1 -- start start 2023-10-06T10:59:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.034+0000 7f39e11db700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39dc0aaa40 0x7f39dc148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.034+0000 7f39e11db700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39dc0ac8d0 0x7f39dc14ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.034+0000 7f39e11db700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39dc0ccda0 0x7f39dc148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.034+0000 7f39e11db700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc1480d0 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.034+0000 7f39e11db700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc1474c0 con 0x7f39dc0aaa40 2023-10-06T10:59:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.034+0000 7f39e11db700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc1477a0 con 0x7f39dc0ccda0 2023-10-06T10:59:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.034+0000 7f39da59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39dc0ac8d0 0x7f39dc14ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.034+0000 7f39da59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39dc0ac8d0 0x7f39dc14ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35344/0 (socket says 172.21.15.7:35344) 2023-10-06T10:59:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.034+0000 7f39da59c700 1 -- 172.21.15.7:0/1742356561 learned_addr learned my addr 172.21.15.7:0/1742356561 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.035+0000 7f39db59e700 1 --2- 172.21.15.7:0/1742356561 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39dc0ccda0 0x7f39dc148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.035+0000 7f39dad9d700 1 --2- 172.21.15.7:0/1742356561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39dc0aaa40 0x7f39dc148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.035+0000 7f39da59c700 1 -- 172.21.15.7:0/1742356561 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39dc0ccda0 msgr2=0x7f39dc148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.035+0000 7f39da59c700 1 --2- 172.21.15.7:0/1742356561 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39dc0ccda0 0x7f39dc148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.035+0000 7f39da59c700 1 -- 172.21.15.7:0/1742356561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39dc0aaa40 msgr2=0x7f39dc148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.035+0000 7f39da59c700 1 --2- 172.21.15.7:0/1742356561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39dc0aaa40 0x7f39dc148560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.035+0000 7f39da59c700 1 -- 172.21.15.7:0/1742356561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc009420 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.035+0000 7f39da59c700 1 --2- 172.21.15.7:0/1742356561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39dc0ac8d0 0x7f39dc14ce60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f39d00011e0 tx=0x7f39d0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.035+0000 7f39c2ffd700 1 -- 172.21.15.7:0/1742356561 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0005b30 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.035+0000 7f39c2ffd700 1 -- 172.21.15.7:0/1742356561 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d0005c90 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.035+0000 7f39e11db700 1 -- 172.21.15.7:0/1742356561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39dc147a80 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.035+0000 7f39c2ffd700 1 -- 172.21.15.7:0/1742356561 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d00072e0 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.035+0000 7f39e11db700 1 -- 172.21.15.7:0/1742356561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39dc14d3a0 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.036+0000 7f39e11db700 1 -- 172.21.15.7:0/1742356561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39dc070480 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.037+0000 7f39c2ffd700 1 -- 172.21.15.7:0/1742356561 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39d0007650 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.037+0000 7f39c2ffd700 1 --2- 172.21.15.7:0/1742356561 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f39c8066f30 0x7f39c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.037+0000 7f39c2ffd700 1 -- 172.21.15.7:0/1742356561 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f39d0083e60 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.037+0000 7f39dad9d700 1 --2- 172.21.15.7:0/1742356561 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f39c8066f30 0x7f39c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.038+0000 7f39dad9d700 1 --2- 172.21.15.7:0/1742356561 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f39c8066f30 0x7f39c80693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c010 tx=0x7f39cc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.042+0000 7f39c2ffd700 1 -- 172.21.15.7:0/1742356561 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39d0050d30 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.242+0000 7f39e11db700 1 -- 172.21.15.7:0/1742356561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39dc148210 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.243+0000 7f39c2ffd700 1 -- 172.21.15.7:0/1742356561 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f39d0017020 con 0x7f39dc0ac8d0 2023-10-06T10:59:48.245 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:48.245 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:06.934264+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.245+0000 7f39e11db700 1 -- 172.21.15.7:0/1742356561 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f39c8066f30 msgr2=0x7f39c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.245+0000 7f39e11db700 1 --2- 172.21.15.7:0/1742356561 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f39c8066f30 0x7f39c80693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c010 tx=0x7f39cc017000 comp rx=0 tx=0).stop 2023-10-06T10:59:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.245+0000 7f39e11db700 1 -- 172.21.15.7:0/1742356561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39dc0ac8d0 msgr2=0x7f39dc14ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.245+0000 7f39e11db700 1 --2- 172.21.15.7:0/1742356561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39dc0ac8d0 0x7f39dc14ce60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f39d00011e0 tx=0x7f39d0007df0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.245+0000 7f39e11db700 1 -- 172.21.15.7:0/1742356561 shutdown_connections 2023-10-06T10:59:48.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.245+0000 7f39e11db700 1 --2- 172.21.15.7:0/1742356561 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f39c8066f30 0x7f39c80693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.245+0000 7f39e11db700 1 --2- 172.21.15.7:0/1742356561 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39dc0ccda0 0x7f39dc148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.245+0000 7f39e11db700 1 --2- 172.21.15.7:0/1742356561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39dc0aaa40 0x7f39dc148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.245+0000 7f39e11db700 1 --2- 172.21.15.7:0/1742356561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39dc0ac8d0 0x7f39dc14ce60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.245+0000 7f39e11db700 1 -- 172.21.15.7:0/1742356561 >> 172.21.15.7:0/1742356561 conn(0x7f39dc096160 msgr2=0x7f39dc0acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:48.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.245+0000 7f39e11db700 1 -- 172.21.15.7:0/1742356561 shutdown_connections 2023-10-06T10:59:48.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.245+0000 7f39e11db700 1 -- 172.21.15.7:0/1742356561 wait complete. 2023-10-06T10:59:48.260 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T10:58:55.224661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T10:58:56.032929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T10:58:59.772827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T10:59:00.802230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T10:59:04.512252+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T10:59:48.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T10:59:48.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.394+0000 7fa3cc3ea700 1 Processor -- start 2023-10-06T10:59:48.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.395+0000 7fa3cc3ea700 1 -- start start 2023-10-06T10:59:48.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3cc3ea700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3c406dac0 0x7fa3c415ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3cc3ea700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3c415b190 0x7fa3c4157a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3cc3ea700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c415bb80 con 0x7fa3c406de90 2023-10-06T10:59:48.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3cc3ea700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c40c92c0 con 0x7fa3c415b190 2023-10-06T10:59:48.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3cc3ea700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40cc1e0 con 0x7fa3c406dac0 2023-10-06T10:59:48.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3c9985700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa3c406de90 0x7fa3c40cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56568/0 (socket says 172.21.15.7:56568) 2023-10-06T10:59:48.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3c9985700 1 -- 172.21.15.7:0/1668846853 learned_addr learned my addr 172.21.15.7:0/1668846853 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:48.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3ca186700 1 --2- 172.21.15.7:0/1668846853 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3c406dac0 0x7fa3c415ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3ca987700 1 --2- 172.21.15.7:0/1668846853 >> v2:172.21.15.50:3300/0 conn(0x7fa3c415b190 0x7fa3c4157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3c9184700 1 -- 172.21.15.7:0/1668846853 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073184709 0 0) 0x7fa3c415bb80 con 0x7fa3c406de90 2023-10-06T10:59:48.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3c9184700 1 -- 172.21.15.7:0/1668846853 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3b0003570 con 0x7fa3c406de90 2023-10-06T10:59:48.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3ca186700 1 -- 172.21.15.7:0/1668846853 >> v2:172.21.15.50:3300/0 conn(0x7fa3c415b190 msgr2=0x7fa3c4157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:48.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3ca186700 1 --2- 172.21.15.7:0/1668846853 >> v2:172.21.15.50:3300/0 conn(0x7fa3c415b190 0x7fa3c4157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3ca186700 1 -- 172.21.15.7:0/1668846853 >> v1:172.21.15.7:6789/0 conn(0x7fa3c406de90 legacy=0x7fa3c40cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3ca186700 1 -- 172.21.15.7:0/1668846853 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c415b610 con 0x7fa3c406dac0 2023-10-06T10:59:48.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3ca987700 1 --2- 172.21.15.7:0/1668846853 >> v2:172.21.15.50:3300/0 conn(0x7fa3c415b190 0x7fa3c4157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:59:48.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.396+0000 7fa3ca186700 1 --2- 172.21.15.7:0/1668846853 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3c406dac0 0x7fa3c415ac50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009910 tx=0x7fa3b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd4dcd200879c98 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:48.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.397+0000 7fa3c9184700 1 -- 172.21.15.7:0/1668846853 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4011630 con 0x7fa3c406dac0 2023-10-06T10:59:48.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.397+0000 7fa3c9184700 1 -- 172.21.15.7:0/1668846853 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b4011790 con 0x7fa3c406dac0 2023-10-06T10:59:48.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.397+0000 7fa3c9184700 1 -- 172.21.15.7:0/1668846853 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4011b30 con 0x7fa3c406dac0 2023-10-06T10:59:48.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.397+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/1668846853 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3c406dac0 msgr2=0x7fa3c415ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.397+0000 7fa3cc3ea700 1 --2- 172.21.15.7:0/1668846853 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3c406dac0 0x7fa3c415ac50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009910 tx=0x7fa3b40091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.397+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/1668846853 shutdown_connections 2023-10-06T10:59:48.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.397+0000 7fa3cc3ea700 1 --2- 172.21.15.7:0/1668846853 >> v2:172.21.15.50:3300/0 conn(0x7fa3c415b190 0x7fa3c4157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.397+0000 7fa3cc3ea700 1 --2- 172.21.15.7:0/1668846853 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3c406dac0 0x7fa3c415ac50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.397+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/1668846853 >> 172.21.15.7:0/1668846853 conn(0x7fa3c406cd00 msgr2=0x7fa3c40cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:48.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.397+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/1668846853 shutdown_connections 2023-10-06T10:59:48.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.397+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/1668846853 wait complete. 2023-10-06T10:59:48.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.399+0000 7fa3cc3ea700 1 Processor -- start 2023-10-06T10:59:48.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.399+0000 7fa3cc3ea700 1 -- start start 2023-10-06T10:59:48.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.400+0000 7fa3cc3ea700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3c406dac0 0x7fa3c4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.400+0000 7fa3cc3ea700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3c406de90 0x7fa3c40ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.400+0000 7fa3cc3ea700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c415b190 0x7fa3c4152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.400+0000 7fa3cc3ea700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40b2d40 con 0x7fa3c406de90 2023-10-06T10:59:48.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.400+0000 7fa3cc3ea700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c4069990 con 0x7fa3c415b190 2023-10-06T10:59:48.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.400+0000 7fa3cc3ea700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40b2130 con 0x7fa3c406dac0 2023-10-06T10:59:48.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.400+0000 7fa3c9985700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3c406de90 0x7fa3c40ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.400+0000 7fa3c9985700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3c406de90 0x7fa3c40ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35350/0 (socket says 172.21.15.7:35350) 2023-10-06T10:59:48.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.400+0000 7fa3c9985700 1 -- 172.21.15.7:0/3171313110 learned_addr learned my addr 172.21.15.7:0/3171313110 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:48.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.400+0000 7fa3ca186700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3c406dac0 0x7fa3c4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.400+0000 7fa3ca987700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c415b190 0x7fa3c4152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.401+0000 7fa3c9985700 1 -- 172.21.15.7:0/3171313110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3c406dac0 msgr2=0x7fa3c4069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.401+0000 7fa3c9985700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3c406dac0 0x7fa3c4069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.401+0000 7fa3c9985700 1 -- 172.21.15.7:0/3171313110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c415b190 msgr2=0x7fa3c4152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.401+0000 7fa3c9985700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c415b190 0x7fa3c4152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.401+0000 7fa3c9985700 1 -- 172.21.15.7:0/3171313110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc009a20 con 0x7fa3c406de90 2023-10-06T10:59:48.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.401+0000 7fa3ca987700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c415b190 0x7fa3c4152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:48.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.401+0000 7fa3c9985700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3c406de90 0x7fa3c40ad250 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000c7c0 tx=0x7fa3c0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:48.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.401+0000 7fa3ba7fc700 1 -- 172.21.15.7:0/3171313110 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0005b30 con 0x7fa3c406de90 2023-10-06T10:59:48.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.401+0000 7fa3ba7fc700 1 -- 172.21.15.7:0/3171313110 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c0005cb0 con 0x7fa3c406de90 2023-10-06T10:59:48.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.401+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/3171313110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b4009420 con 0x7fa3c406de90 2023-10-06T10:59:48.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.401+0000 7fa3ba7fc700 1 -- 172.21.15.7:0/3171313110 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0007320 con 0x7fa3c406de90 2023-10-06T10:59:48.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.401+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/3171313110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c40b26f0 con 0x7fa3c406de90 2023-10-06T10:59:48.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.402+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/3171313110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c4070480 con 0x7fa3c406de90 2023-10-06T10:59:48.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.403+0000 7fa3ba7fc700 1 -- 172.21.15.7:0/3171313110 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3c001b3b0 con 0x7fa3c406de90 2023-10-06T10:59:48.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.403+0000 7fa3ba7fc700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa3a8066f30 0x7fa3a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.403+0000 7fa3ca186700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa3a8066f30 0x7fa3a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.403+0000 7fa3ba7fc700 1 -- 172.21.15.7:0/3171313110 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa3c0083e80 con 0x7fa3c406de90 2023-10-06T10:59:48.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.404+0000 7fa3ca186700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa3a8066f30 0x7fa3a80693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40091e0 tx=0x7fa3b4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:48.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.408+0000 7fa3ba7fc700 1 -- 172.21.15.7:0/3171313110 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3c0050ca0 con 0x7fa3c406de90 2023-10-06T10:59:48.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.612+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/3171313110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa3c415b8d0 con 0x7fa3c406de90 2023-10-06T10:59:48.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.612+0000 7fa3ba7fc700 1 -- 172.21.15.7:0/3171313110 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa3c0017020 con 0x7fa3c406de90 2023-10-06T10:59:48.614 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-10-06T10:59:48.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.614+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/3171313110 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa3a8066f30 msgr2=0x7fa3a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.614+0000 7fa3cc3ea700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa3a8066f30 0x7fa3a80693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40091e0 tx=0x7fa3b4017000 comp rx=0 tx=0).stop 2023-10-06T10:59:48.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.614+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/3171313110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3c406de90 msgr2=0x7fa3c40ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.614+0000 7fa3cc3ea700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3c406de90 0x7fa3c40ad250 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000c7c0 tx=0x7fa3c0007e00 comp rx=0 tx=0).stop 2023-10-06T10:59:48.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.615+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/3171313110 shutdown_connections 2023-10-06T10:59:48.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.615+0000 7fa3cc3ea700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa3a8066f30 0x7fa3a80693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.615+0000 7fa3cc3ea700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c415b190 0x7fa3c4152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.615+0000 7fa3cc3ea700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3c406dac0 0x7fa3c4069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.615+0000 7fa3cc3ea700 1 --2- 172.21.15.7:0/3171313110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3c406de90 0x7fa3c40ad250 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.615+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/3171313110 >> 172.21.15.7:0/3171313110 conn(0x7fa3c406cd00 msgr2=0x7fa3c4158ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:48.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.615+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/3171313110 shutdown_connections 2023-10-06T10:59:48.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.615+0000 7fa3cc3ea700 1 -- 172.21.15.7:0/3171313110 wait complete. 2023-10-06T10:59:48.632 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T10:59:48.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.765+0000 7fef3cae4700 1 Processor -- start 2023-10-06T10:59:48.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.765+0000 7fef3cae4700 1 -- start start 2023-10-06T10:59:48.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.766+0000 7fef3cae4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef381594c0 0x7fef38068500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.766+0000 7fef3cae4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef380afbf0 0x7fef3806c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.766+0000 7fef3cae4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef380abf30 con 0x7fef381590f0 2023-10-06T10:59:48.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.766+0000 7fef3cae4700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef380ac210 con 0x7fef380afbf0 2023-10-06T10:59:48.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.766+0000 7fef3cae4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef38067a20 con 0x7fef381594c0 2023-10-06T10:59:48.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.766+0000 7fef36d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef380afbf0 0x7fef3806c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.767+0000 7fef36d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef380afbf0 0x7fef3806c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35352/0 (socket says 172.21.15.7:35352) 2023-10-06T10:59:48.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.767+0000 7fef36d9d700 1 -- 172.21.15.7:0/232947580 learned_addr learned my addr 172.21.15.7:0/232947580 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:48.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.767+0000 7fef35d9b700 1 --2- 172.21.15.7:0/232947580 >> v2:172.21.15.50:3300/0 conn(0x7fef381594c0 0x7fef38068500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.767+0000 7fef36d9d700 1 -- 172.21.15.7:0/232947580 >> v2:172.21.15.50:3300/0 conn(0x7fef381594c0 msgr2=0x7fef38068500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:48.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.767+0000 7fef36d9d700 1 --2- 172.21.15.7:0/232947580 >> v2:172.21.15.50:3300/0 conn(0x7fef381594c0 0x7fef38068500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.767+0000 7fef36d9d700 1 -- 172.21.15.7:0/232947580 >> v1:172.21.15.50:6789/0 conn(0x7fef381590f0 legacy=0x7fef380ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.767+0000 7fef36d9d700 1 -- 172.21.15.7:0/232947580 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef38067d00 con 0x7fef380afbf0 2023-10-06T10:59:48.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.767+0000 7fef35d9b700 1 --2- 172.21.15.7:0/232947580 >> v2:172.21.15.50:3300/0 conn(0x7fef381594c0 0x7fef38068500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:48.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.767+0000 7fef36d9d700 1 --2- 172.21.15.7:0/232947580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380afbf0 0x7fef3806c870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fef380b0880 tx=0x7fef30009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76483358a326e2a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:48.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.767+0000 7fef3559a700 1 -- 172.21.15.7:0/232947580 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000e070 con 0x7fef380afbf0 2023-10-06T10:59:48.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.767+0000 7fef3559a700 1 -- 172.21.15.7:0/232947580 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3000ba50 con 0x7fef380afbf0 2023-10-06T10:59:48.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.767+0000 7fef3559a700 1 -- 172.21.15.7:0/232947580 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef300092e0 con 0x7fef380afbf0 2023-10-06T10:59:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.768+0000 7fef3cae4700 1 -- 172.21.15.7:0/232947580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380afbf0 msgr2=0x7fef3806c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.768+0000 7fef3cae4700 1 --2- 172.21.15.7:0/232947580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380afbf0 0x7fef3806c870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fef380b0880 tx=0x7fef30009840 comp rx=0 tx=0).stop 2023-10-06T10:59:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.768+0000 7fef3cae4700 1 -- 172.21.15.7:0/232947580 shutdown_connections 2023-10-06T10:59:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.768+0000 7fef3cae4700 1 --2- 172.21.15.7:0/232947580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380afbf0 0x7fef3806c870 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.768+0000 7fef3cae4700 1 --2- 172.21.15.7:0/232947580 >> v2:172.21.15.50:3300/0 conn(0x7fef381594c0 0x7fef38068500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.768+0000 7fef3cae4700 1 -- 172.21.15.7:0/232947580 >> 172.21.15.7:0/232947580 conn(0x7fef380cce30 msgr2=0x7fef380cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.768+0000 7fef3cae4700 1 -- 172.21.15.7:0/232947580 shutdown_connections 2023-10-06T10:59:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.768+0000 7fef3cae4700 1 -- 172.21.15.7:0/232947580 wait complete. 2023-10-06T10:59:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.769+0000 7fef3cae4700 1 Processor -- start 2023-10-06T10:59:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.769+0000 7fef3cae4700 1 -- start start 2023-10-06T10:59:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef3cae4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef380afbf0 0x7fef3815c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef3cae4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef381590f0 0x7fef3815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef3cae4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef381594c0 0x7fef38157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef3cae4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef38158900 con 0x7fef381594c0 2023-10-06T10:59:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef3cae4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3815b1d0 con 0x7fef381590f0 2023-10-06T10:59:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef3cae4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef38158060 con 0x7fef380afbf0 2023-10-06T10:59:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef36d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef381594c0 0x7fef38157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef36d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef381594c0 0x7fef38157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35362/0 (socket says 172.21.15.7:35362) 2023-10-06T10:59:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef36d9d700 1 -- 172.21.15.7:0/3420760654 learned_addr learned my addr 172.21.15.7:0/3420760654 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:48.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef35d9b700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef381590f0 0x7fef3815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef3659c700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef380afbf0 0x7fef3815c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef36d9d700 1 -- 172.21.15.7:0/3420760654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef380afbf0 msgr2=0x7fef3815c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef36d9d700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef380afbf0 0x7fef3815c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef36d9d700 1 -- 172.21.15.7:0/3420760654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef381590f0 msgr2=0x7fef3815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef36d9d700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef381590f0 0x7fef3815baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef36d9d700 1 -- 172.21.15.7:0/3420760654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30009ae0 con 0x7fef381594c0 2023-10-06T10:59:48.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.770+0000 7fef35d9b700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef381590f0 0x7fef3815baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:48.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.771+0000 7fef36d9d700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef381594c0 0x7fef38157830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fef3806e960 tx=0x7fef30018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:48.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.771+0000 7fef267fc700 1 -- 172.21.15.7:0/3420760654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef300032f0 con 0x7fef381594c0 2023-10-06T10:59:48.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.771+0000 7fef267fc700 1 -- 172.21.15.7:0/3420760654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef30008e40 con 0x7fef381594c0 2023-10-06T10:59:48.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.771+0000 7fef3cae4700 1 -- 172.21.15.7:0/3420760654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef38158340 con 0x7fef381594c0 2023-10-06T10:59:48.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.771+0000 7fef267fc700 1 -- 172.21.15.7:0/3420760654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef300256b0 con 0x7fef381594c0 2023-10-06T10:59:48.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.771+0000 7fef3cae4700 1 -- 172.21.15.7:0/3420760654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef38159a00 con 0x7fef381594c0 2023-10-06T10:59:48.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.772+0000 7fef3cae4700 1 -- 172.21.15.7:0/3420760654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef38070480 con 0x7fef381594c0 2023-10-06T10:59:48.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.772+0000 7fef267fc700 1 -- 172.21.15.7:0/3420760654 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef30003040 con 0x7fef381594c0 2023-10-06T10:59:48.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.773+0000 7fef267fc700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fef18066f30 0x7fef180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:48.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.773+0000 7fef267fc700 1 -- 172.21.15.7:0/3420760654 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fef30085f60 con 0x7fef381594c0 2023-10-06T10:59:48.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.773+0000 7fef3659c700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fef18066f30 0x7fef180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:48.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.773+0000 7fef3659c700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fef18066f30 0x7fef180693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0037f0 tx=0x7fef2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:48.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.778+0000 7fef267fc700 1 -- 172.21.15.7:0/3420760654 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef30052e30 con 0x7fef381594c0 2023-10-06T10:59:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.981+0000 7fef3cae4700 1 -- 172.21.15.7:0/3420760654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef380ad380 con 0x7fef381594c0 2023-10-06T10:59:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.981+0000 7fef267fc700 1 -- 172.21.15.7:0/3420760654 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef30056450 con 0x7fef381594c0 2023-10-06T10:59:48.983 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-06T10:59:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.984+0000 7fef3cae4700 1 -- 172.21.15.7:0/3420760654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fef18066f30 msgr2=0x7fef180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.984+0000 7fef3cae4700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fef18066f30 0x7fef180693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0037f0 tx=0x7fef2c009040 comp rx=0 tx=0).stop 2023-10-06T10:59:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.984+0000 7fef3cae4700 1 -- 172.21.15.7:0/3420760654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef381594c0 msgr2=0x7fef38157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.984+0000 7fef3cae4700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef381594c0 0x7fef38157830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fef3806e960 tx=0x7fef30018000 comp rx=0 tx=0).stop 2023-10-06T10:59:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.984+0000 7fef3cae4700 1 -- 172.21.15.7:0/3420760654 shutdown_connections 2023-10-06T10:59:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.984+0000 7fef3cae4700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fef18066f30 0x7fef180693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.984+0000 7fef3cae4700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef381594c0 0x7fef38157830 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.984+0000 7fef3cae4700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef380afbf0 0x7fef3815c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.984+0000 7fef3cae4700 1 --2- 172.21.15.7:0/3420760654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef381590f0 0x7fef3815baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.984+0000 7fef3cae4700 1 -- 172.21.15.7:0/3420760654 >> 172.21.15.7:0/3420760654 conn(0x7fef380cce30 msgr2=0x7fef38152640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.984+0000 7fef3cae4700 1 -- 172.21.15.7:0/3420760654 shutdown_connections 2023-10-06T10:59:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:48.984+0000 7fef3cae4700 1 -- 172.21.15.7:0/3420760654 wait complete. 2023-10-06T10:59:48.999 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T10:59:49.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.132+0000 7f40c27d4700 1 Processor -- start 2023-10-06T10:59:49.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.132+0000 7f40c27d4700 1 -- start start 2023-10-06T10:59:49.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.133+0000 7f40c27d4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40bc15a200 0x7f40bc15a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.133+0000 7f40c27d4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc0cb110 con 0x7f40bc06ad30 2023-10-06T10:59:49.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.133+0000 7f40c27d4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc067800 con 0x7f40bc0ae130 2023-10-06T10:59:49.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.133+0000 7f40c27d4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc06c070 con 0x7f40bc15a200 2023-10-06T10:59:49.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.133+0000 7f40bb7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f40bc06ad30 0x7f40bc0670f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56576/0 (socket says 172.21.15.7:56576) 2023-10-06T10:59:49.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.133+0000 7f40bb7fe700 1 -- 172.21.15.7:0/291985084 learned_addr learned my addr 172.21.15.7:0/291985084 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:49.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.133+0000 7f40bbfff700 1 --2- 172.21.15.7:0/291985084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40bc15a200 0x7f40bc15a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.133+0000 7f40baffd700 1 -- 172.21.15.7:0/291985084 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521846766 0 0) 0x7f40bc0cb110 con 0x7f40bc06ad30 2023-10-06T10:59:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.133+0000 7f40baffd700 1 -- 172.21.15.7:0/291985084 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40a4003570 con 0x7f40bc06ad30 2023-10-06T10:59:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.134+0000 7f40baffd700 1 -- 172.21.15.7:0/291985084 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046369425 0 0) 0x7f40bc067800 con 0x7f40bc0ae130 2023-10-06T10:59:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.134+0000 7f40baffd700 1 -- 172.21.15.7:0/291985084 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40bc0cb110 con 0x7f40bc0ae130 2023-10-06T10:59:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.134+0000 7f40bbfff700 1 -- 172.21.15.7:0/291985084 >> v1:172.21.15.50:6789/0 conn(0x7f40bc0ae130 legacy=0x7f40bc0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.134+0000 7f40bbfff700 1 -- 172.21.15.7:0/291985084 >> v1:172.21.15.7:6789/0 conn(0x7f40bc06ad30 legacy=0x7f40bc0670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.134+0000 7f40baffd700 1 -- 172.21.15.7:0/291985084 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 384039433 0 0) 0x7f40a4003570 con 0x7f40bc06ad30 2023-10-06T10:59:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.134+0000 7f40bbfff700 1 -- 172.21.15.7:0/291985084 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc15ab10 con 0x7f40bc15a200 2023-10-06T10:59:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.134+0000 7f40bbfff700 1 --2- 172.21.15.7:0/291985084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40bc15a200 0x7f40bc15a5d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009910 tx=0x7f40ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b84855da48da6ae1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.134+0000 7f40baffd700 1 -- 172.21.15.7:0/291985084 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b0001470 con 0x7f40bc15a200 2023-10-06T10:59:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.134+0000 7f40baffd700 1 -- 172.21.15.7:0/291985084 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac011420 con 0x7f40bc15a200 2023-10-06T10:59:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.134+0000 7f40baffd700 1 -- 172.21.15.7:0/291985084 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac0117c0 con 0x7f40bc15a200 2023-10-06T10:59:49.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.135+0000 7f40c27d4700 1 -- 172.21.15.7:0/291985084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40bc15a200 msgr2=0x7f40bc15a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.135+0000 7f40c27d4700 1 --2- 172.21.15.7:0/291985084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40bc15a200 0x7f40bc15a5d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009910 tx=0x7f40ac0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.135+0000 7f40c27d4700 1 -- 172.21.15.7:0/291985084 shutdown_connections 2023-10-06T10:59:49.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.135+0000 7f40c27d4700 1 --2- 172.21.15.7:0/291985084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40bc15a200 0x7f40bc15a5d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.135+0000 7f40c27d4700 1 -- 172.21.15.7:0/291985084 >> 172.21.15.7:0/291985084 conn(0x7f40bc0cc560 msgr2=0x7f40bc0cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.135+0000 7f40c27d4700 1 -- 172.21.15.7:0/291985084 shutdown_connections 2023-10-06T10:59:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.135+0000 7f40c27d4700 1 -- 172.21.15.7:0/291985084 wait complete. 2023-10-06T10:59:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.136+0000 7f40c27d4700 1 Processor -- start 2023-10-06T10:59:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.136+0000 7f40c27d4700 1 -- start start 2023-10-06T10:59:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.137+0000 7f40c27d4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40bc06ad30 0x7f40bc14a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.137+0000 7f40c27d4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40bc0ae130 0x7f40bc15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.137+0000 7f40c27d4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40bc15a200 0x7f40bc0964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.137+0000 7f40c27d4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0ac410 con 0x7f40bc15a200 2023-10-06T10:59:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.137+0000 7f40c27d4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc15d920 con 0x7f40bc0ae130 2023-10-06T10:59:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.137+0000 7f40c27d4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc15dc00 con 0x7f40bc06ad30 2023-10-06T10:59:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.137+0000 7f40c0d71700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40bc15a200 0x7f40bc0964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.137+0000 7f40c0d71700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40bc15a200 0x7f40bc0964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35366/0 (socket says 172.21.15.7:35366) 2023-10-06T10:59:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.137+0000 7f40c0d71700 1 -- 172.21.15.7:0/3589553162 learned_addr learned my addr 172.21.15.7:0/3589553162 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.138+0000 7f40bbfff700 1 --2- 172.21.15.7:0/3589553162 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40bc06ad30 0x7f40bc14a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.138+0000 7f40bb7fe700 1 --2- 172.21.15.7:0/3589553162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40bc0ae130 0x7f40bc15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.138+0000 7f40c0d71700 1 -- 172.21.15.7:0/3589553162 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40bc06ad30 msgr2=0x7f40bc14a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.138+0000 7f40c0d71700 1 --2- 172.21.15.7:0/3589553162 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40bc06ad30 0x7f40bc14a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.138+0000 7f40c0d71700 1 -- 172.21.15.7:0/3589553162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40bc0ae130 msgr2=0x7f40bc15cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.138+0000 7f40c0d71700 1 --2- 172.21.15.7:0/3589553162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40bc0ae130 0x7f40bc15cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.138+0000 7f40c0d71700 1 -- 172.21.15.7:0/3589553162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac009420 con 0x7f40bc15a200 2023-10-06T10:59:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.138+0000 7f40c0d71700 1 --2- 172.21.15.7:0/3589553162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40bc15a200 0x7f40bc0964a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f40b400c910 tx=0x7f40b40027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.138+0000 7f40a3fff700 1 -- 172.21.15.7:0/3589553162 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b400a7e0 con 0x7f40bc15a200 2023-10-06T10:59:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.138+0000 7f40a3fff700 1 -- 172.21.15.7:0/3589553162 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b400a960 con 0x7f40bc15a200 2023-10-06T10:59:49.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.138+0000 7f40c27d4700 1 -- 172.21.15.7:0/3589553162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc0ac0a0 con 0x7f40bc15a200 2023-10-06T10:59:49.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.138+0000 7f40a3fff700 1 -- 172.21.15.7:0/3589553162 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b400ad20 con 0x7f40bc15a200 2023-10-06T10:59:49.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.138+0000 7f40c27d4700 1 -- 172.21.15.7:0/3589553162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc099740 con 0x7f40bc15a200 2023-10-06T10:59:49.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.139+0000 7f40c27d4700 1 -- 172.21.15.7:0/3589553162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc070480 con 0x7f40bc15a200 2023-10-06T10:59:49.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.140+0000 7f40a3fff700 1 -- 172.21.15.7:0/3589553162 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40b4012630 con 0x7f40bc15a200 2023-10-06T10:59:49.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.140+0000 7f40a3fff700 1 --2- 172.21.15.7:0/3589553162 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f40a8066f30 0x7f40a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.140+0000 7f40a3fff700 1 -- 172.21.15.7:0/3589553162 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f40b4084e30 con 0x7f40bc15a200 2023-10-06T10:59:49.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.140+0000 7f40bbfff700 1 --2- 172.21.15.7:0/3589553162 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f40a8066f30 0x7f40a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.141+0000 7f40bbfff700 1 --2- 172.21.15.7:0/3589553162 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f40a8066f30 0x7f40a80693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0030c0 tx=0x7f40ac016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:49.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.145+0000 7f40a3fff700 1 -- 172.21.15.7:0/3589553162 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40b4051c50 con 0x7f40bc15a200 2023-10-06T10:59:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.350+0000 7f40c27d4700 1 -- 172.21.15.7:0/3589553162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40bc06bbc0 con 0x7f40bc15a200 2023-10-06T10:59:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.350+0000 7f40a3fff700 1 -- 172.21.15.7:0/3589553162 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f40b4055270 con 0x7f40bc15a200 2023-10-06T10:59:49.352 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T10:59:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.353+0000 7f40c27d4700 1 -- 172.21.15.7:0/3589553162 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f40a8066f30 msgr2=0x7f40a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.353+0000 7f40c27d4700 1 --2- 172.21.15.7:0/3589553162 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f40a8066f30 0x7f40a80693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0030c0 tx=0x7f40ac016000 comp rx=0 tx=0).stop 2023-10-06T10:59:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.353+0000 7f40c27d4700 1 -- 172.21.15.7:0/3589553162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40bc15a200 msgr2=0x7f40bc0964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.353+0000 7f40c27d4700 1 --2- 172.21.15.7:0/3589553162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40bc15a200 0x7f40bc0964a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f40b400c910 tx=0x7f40b40027a0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.353+0000 7f40c27d4700 1 -- 172.21.15.7:0/3589553162 shutdown_connections 2023-10-06T10:59:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.353+0000 7f40c27d4700 1 --2- 172.21.15.7:0/3589553162 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f40a8066f30 0x7f40a80693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.353+0000 7f40c27d4700 1 --2- 172.21.15.7:0/3589553162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40bc15a200 0x7f40bc0964a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.353+0000 7f40c27d4700 1 --2- 172.21.15.7:0/3589553162 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40bc06ad30 0x7f40bc14a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.353+0000 7f40c27d4700 1 --2- 172.21.15.7:0/3589553162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40bc0ae130 0x7f40bc15cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.353+0000 7f40c27d4700 1 -- 172.21.15.7:0/3589553162 >> 172.21.15.7:0/3589553162 conn(0x7f40bc0cc560 msgr2=0x7f40bc0cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.353+0000 7f40c27d4700 1 -- 172.21.15.7:0/3589553162 shutdown_connections 2023-10-06T10:59:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.353+0000 7f40c27d4700 1 -- 172.21.15.7:0/3589553162 wait complete. 2023-10-06T10:59:49.368 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T10:59:49.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.502+0000 7ff0fe5ca700 1 Processor -- start 2023-10-06T10:59:49.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.502+0000 7ff0fe5ca700 1 -- start start 2023-10-06T10:59:49.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0fe5ca700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0f806ad30 0x7ff0f80670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0fe5ca700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff0f80ae130 0x7ff0f80ae590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0fe5ca700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f80aead0 con 0x7ff0f815a200 2023-10-06T10:59:49.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0fe5ca700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f80cb110 con 0x7ff0f80ae130 2023-10-06T10:59:49.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0fe5ca700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f806c070 con 0x7ff0f806ad30 2023-10-06T10:59:49.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0fcb67700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff0f80ae130 0x7ff0f80ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0f7fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff0f815a200 0x7ff0f815a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56592/0 (socket says 172.21.15.7:56592) 2023-10-06T10:59:49.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0f7fff700 1 -- 172.21.15.7:0/933926207 learned_addr learned my addr 172.21.15.7:0/933926207 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:49.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0f77fe700 1 --2- 172.21.15.7:0/933926207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0f806ad30 0x7ff0f80670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0fcb67700 1 -- 172.21.15.7:0/933926207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0f806ad30 msgr2=0x7ff0f80670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:49.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0fcb67700 1 --2- 172.21.15.7:0/933926207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0f806ad30 0x7ff0f80670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0fcb67700 1 -- 172.21.15.7:0/933926207 >> v1:172.21.15.7:6789/0 conn(0x7ff0f815a200 legacy=0x7ff0f815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0fcb67700 1 -- 172.21.15.7:0/933926207 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f80c90d0 con 0x7ff0f80ae130 2023-10-06T10:59:49.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0f6ffd700 1 -- 172.21.15.7:0/933926207 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455896329 0 0) 0x7ff0e8001110 con 0x7ff0f815a200 2023-10-06T10:59:49.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.503+0000 7ff0fcb67700 1 --2- 172.21.15.7:0/933926207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0f80ae130 0x7ff0f80ae590 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0009e60 tx=0x7ff0f0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76456345b1dd45cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:49.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.504+0000 7ff0f6ffd700 1 -- 172.21.15.7:0/933926207 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000e070 con 0x7ff0f80ae130 2023-10-06T10:59:49.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.504+0000 7ff0f6ffd700 1 -- 172.21.15.7:0/933926207 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f000bb60 con 0x7ff0f80ae130 2023-10-06T10:59:49.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.504+0000 7ff0f6ffd700 1 -- 172.21.15.7:0/933926207 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0012430 con 0x7ff0f80ae130 2023-10-06T10:59:49.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.504+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/933926207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0f80ae130 msgr2=0x7ff0f80ae590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.504+0000 7ff0fe5ca700 1 --2- 172.21.15.7:0/933926207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0f80ae130 0x7ff0f80ae590 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0009e60 tx=0x7ff0f0009780 comp rx=0 tx=0).stop 2023-10-06T10:59:49.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.504+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/933926207 shutdown_connections 2023-10-06T10:59:49.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.504+0000 7ff0fe5ca700 1 --2- 172.21.15.7:0/933926207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0f80ae130 0x7ff0f80ae590 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.504+0000 7ff0fe5ca700 1 --2- 172.21.15.7:0/933926207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0f806ad30 0x7ff0f80670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.504+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/933926207 >> 172.21.15.7:0/933926207 conn(0x7ff0f80cc560 msgr2=0x7ff0f80cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:49.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.504+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/933926207 shutdown_connections 2023-10-06T10:59:49.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.504+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/933926207 wait complete. 2023-10-06T10:59:49.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.505+0000 7ff0fe5ca700 1 Processor -- start 2023-10-06T10:59:49.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.506+0000 7ff0fe5ca700 1 -- start start 2023-10-06T10:59:49.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.506+0000 7ff0fe5ca700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0f806ad30 0x7ff0f8097ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.506+0000 7ff0fe5ca700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0f80ae130 0x7ff0f8097040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.506+0000 7ff0fe5ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0f815a200 0x7ff0f80c1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.506+0000 7ff0fe5ca700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80c18b0 con 0x7ff0f80ae130 2023-10-06T10:59:49.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.506+0000 7ff0fe5ca700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80c2380 con 0x7ff0f815a200 2023-10-06T10:59:49.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.506+0000 7ff0fe5ca700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f8096bb0 con 0x7ff0f806ad30 2023-10-06T10:59:49.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.506+0000 7ff0f77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0f80ae130 0x7ff0f8097040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0f77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0f80ae130 0x7ff0f8097040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35390/0 (socket says 172.21.15.7:35390) 2023-10-06T10:59:49.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0f77fe700 1 -- 172.21.15.7:0/1698691731 learned_addr learned my addr 172.21.15.7:0/1698691731 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0f7fff700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0f806ad30 0x7ff0f8097ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0fcb67700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0f815a200 0x7ff0f80c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0f77fe700 1 -- 172.21.15.7:0/1698691731 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0f806ad30 msgr2=0x7ff0f8097ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0f77fe700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0f806ad30 0x7ff0f8097ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0f77fe700 1 -- 172.21.15.7:0/1698691731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0f815a200 msgr2=0x7ff0f80c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0f77fe700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0f815a200 0x7ff0f80c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0f77fe700 1 -- 172.21.15.7:0/1698691731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f0009a20 con 0x7ff0f80ae130 2023-10-06T10:59:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0f7fff700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0f806ad30 0x7ff0f8097ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0fcb67700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0f815a200 0x7ff0f80c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0f77fe700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0f80ae130 0x7ff0f8097040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00e930 tx=0x7ff0ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0dffff700 1 -- 172.21.15.7:0/1698691731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec00eed0 con 0x7ff0f80ae130 2023-10-06T10:59:49.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0dffff700 1 -- 172.21.15.7:0/1698691731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec00c850 con 0x7ff0f80ae130 2023-10-06T10:59:49.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/1698691731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f8098570 con 0x7ff0f80ae130 2023-10-06T10:59:49.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0dffff700 1 -- 172.21.15.7:0/1698691731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec00cbf0 con 0x7ff0f80ae130 2023-10-06T10:59:49.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.507+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/1698691731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f80c20a0 con 0x7ff0f80ae130 2023-10-06T10:59:49.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.508+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/1698691731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f8096d20 con 0x7ff0f80ae130 2023-10-06T10:59:49.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.509+0000 7ff0dffff700 1 -- 172.21.15.7:0/1698691731 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0ec013470 con 0x7ff0f80ae130 2023-10-06T10:59:49.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.509+0000 7ff0dffff700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0e4066f30 0x7ff0e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.509+0000 7ff0dffff700 1 -- 172.21.15.7:0/1698691731 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff0ec084cb0 con 0x7ff0f80ae130 2023-10-06T10:59:49.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.509+0000 7ff0f7fff700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0e4066f30 0x7ff0e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.510+0000 7ff0f7fff700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0e4066f30 0x7ff0e40693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8001940 tx=0x7ff0e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:49.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.514+0000 7ff0dffff700 1 -- 172.21.15.7:0/1698691731 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0ec051a30 con 0x7ff0f80ae130 2023-10-06T10:59:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.714+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/1698691731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff0f8070480 con 0x7ff0f80ae130 2023-10-06T10:59:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.715+0000 7ff0dffff700 1 -- 172.21.15.7:0/1698691731 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff0ec0170a0 con 0x7ff0f80ae130 2023-10-06T10:59:49.717 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-06T10:59:49.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.717+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/1698691731 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0e4066f30 msgr2=0x7ff0e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.717+0000 7ff0fe5ca700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0e4066f30 0x7ff0e40693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8001940 tx=0x7ff0e8009040 comp rx=0 tx=0).stop 2023-10-06T10:59:49.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.717+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/1698691731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0f80ae130 msgr2=0x7ff0f8097040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.717+0000 7ff0fe5ca700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0f80ae130 0x7ff0f8097040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00e930 tx=0x7ff0ec0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.717+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/1698691731 shutdown_connections 2023-10-06T10:59:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.717+0000 7ff0fe5ca700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0e4066f30 0x7ff0e40693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.717+0000 7ff0fe5ca700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0f815a200 0x7ff0f80c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.717+0000 7ff0fe5ca700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0f806ad30 0x7ff0f8097ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.717+0000 7ff0fe5ca700 1 --2- 172.21.15.7:0/1698691731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0f80ae130 0x7ff0f8097040 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.717+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/1698691731 >> 172.21.15.7:0/1698691731 conn(0x7ff0f80cc560 msgr2=0x7ff0f80682a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.717+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/1698691731 shutdown_connections 2023-10-06T10:59:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.717+0000 7ff0fe5ca700 1 -- 172.21.15.7:0/1698691731 wait complete. 2023-10-06T10:59:49.732 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T10:59:49.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.865+0000 7fea6c8c0700 1 Processor -- start 2023-10-06T10:59:49.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.865+0000 7fea6c8c0700 1 -- start start 2023-10-06T10:59:49.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.866+0000 7fea6c8c0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea680a7100 0x7fea680ac590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.866+0000 7fea6c8c0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6806b1e0 con 0x7fea680acad0 2023-10-06T10:59:49.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.866+0000 7fea6c8c0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6806b4c0 con 0x7fea680a6d30 2023-10-06T10:59:49.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.866+0000 7fea6c8c0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea680acf70 con 0x7fea680a7100 2023-10-06T10:59:49.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.866+0000 7fea66d9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fea680acad0 0x7fea68067ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56604/0 (socket says 172.21.15.7:56604) 2023-10-06T10:59:49.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.866+0000 7fea66d9d700 1 -- 172.21.15.7:0/3148623868 learned_addr learned my addr 172.21.15.7:0/3148623868 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:49.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.866+0000 7fea65d9b700 1 --2- 172.21.15.7:0/3148623868 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea680a7100 0x7fea680ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.866+0000 7fea6559a700 1 -- 172.21.15.7:0/3148623868 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265039371 0 0) 0x7fea6806b1e0 con 0x7fea680acad0 2023-10-06T10:59:49.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.866+0000 7fea6559a700 1 -- 172.21.15.7:0/3148623868 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea50003570 con 0x7fea680acad0 2023-10-06T10:59:49.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.866+0000 7fea6559a700 1 -- 172.21.15.7:0/3148623868 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712584639 0 0) 0x7fea6806b4c0 con 0x7fea680a6d30 2023-10-06T10:59:49.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.866+0000 7fea6559a700 1 -- 172.21.15.7:0/3148623868 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea6806b1e0 con 0x7fea680a6d30 2023-10-06T10:59:49.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.867+0000 7fea65d9b700 1 -- 172.21.15.7:0/3148623868 >> v1:172.21.15.50:6789/0 conn(0x7fea680a6d30 legacy=0x7fea680ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.867+0000 7fea65d9b700 1 -- 172.21.15.7:0/3148623868 >> v1:172.21.15.7:6789/0 conn(0x7fea680acad0 legacy=0x7fea68067ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.867+0000 7fea65d9b700 1 -- 172.21.15.7:0/3148623868 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6806b7a0 con 0x7fea680a7100 2023-10-06T10:59:49.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.867+0000 7fea65d9b700 1 --2- 172.21.15.7:0/3148623868 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea680a7100 0x7fea680ac590 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009910 tx=0x7fea5c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d8ec149382df2b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:49.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.867+0000 7fea6559a700 1 -- 172.21.15.7:0/3148623868 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c011630 con 0x7fea680a7100 2023-10-06T10:59:49.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.867+0000 7fea6559a700 1 -- 172.21.15.7:0/3148623868 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c011790 con 0x7fea680a7100 2023-10-06T10:59:49.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.867+0000 7fea6559a700 1 -- 172.21.15.7:0/3148623868 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c011b30 con 0x7fea680a7100 2023-10-06T10:59:49.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.867+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3148623868 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea680a7100 msgr2=0x7fea680ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.867+0000 7fea6c8c0700 1 --2- 172.21.15.7:0/3148623868 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea680a7100 0x7fea680ac590 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009910 tx=0x7fea5c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.868+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3148623868 shutdown_connections 2023-10-06T10:59:49.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.868+0000 7fea6c8c0700 1 --2- 172.21.15.7:0/3148623868 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea680a7100 0x7fea680ac590 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.868+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3148623868 >> 172.21.15.7:0/3148623868 conn(0x7fea680cc560 msgr2=0x7fea680cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:49.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.868+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3148623868 shutdown_connections 2023-10-06T10:59:49.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.868+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3148623868 wait complete. 2023-10-06T10:59:49.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.869+0000 7fea6c8c0700 1 Processor -- start 2023-10-06T10:59:49.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.869+0000 7fea6c8c0700 1 -- start start 2023-10-06T10:59:49.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea6c8c0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea680a6d30 0x7fea68156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea6c8c0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea680a7100 0x7fea680abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea6c8c0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea680acad0 0x7fea680ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea6c8c0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea68169530 con 0x7fea680acad0 2023-10-06T10:59:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea6c8c0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea680984e0 con 0x7fea680a7100 2023-10-06T10:59:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea6c8c0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea680987c0 con 0x7fea680a6d30 2023-10-06T10:59:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea66d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea680acad0 0x7fea680ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea66d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea680acad0 0x7fea680ac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35398/0 (socket says 172.21.15.7:35398) 2023-10-06T10:59:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea66d9d700 1 -- 172.21.15.7:0/3640110528 learned_addr learned my addr 172.21.15.7:0/3640110528 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea6659c700 1 --2- 172.21.15.7:0/3640110528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea680a6d30 0x7fea68156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea65d9b700 1 --2- 172.21.15.7:0/3640110528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea680a7100 0x7fea680abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea66d9d700 1 -- 172.21.15.7:0/3640110528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea680a6d30 msgr2=0x7fea68156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea66d9d700 1 --2- 172.21.15.7:0/3640110528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea680a6d30 0x7fea68156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea66d9d700 1 -- 172.21.15.7:0/3640110528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea680a7100 msgr2=0x7fea680abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:49.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea66d9d700 1 --2- 172.21.15.7:0/3640110528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea680a7100 0x7fea680abdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:49.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea66d9d700 1 -- 172.21.15.7:0/3640110528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c009420 con 0x7fea680acad0 2023-10-06T10:59:49.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.870+0000 7fea66d9d700 1 --2- 172.21.15.7:0/3640110528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea680acad0 0x7fea680ac2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fea6000cbc0 tx=0x7fea60001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:49.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.871+0000 7fea567fc700 1 -- 172.21.15.7:0/3640110528 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6000a7e0 con 0x7fea680acad0 2023-10-06T10:59:49.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.871+0000 7fea567fc700 1 -- 172.21.15.7:0/3640110528 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6000a960 con 0x7fea680acad0 2023-10-06T10:59:49.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.871+0000 7fea567fc700 1 -- 172.21.15.7:0/3640110528 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6000ad20 con 0x7fea680acad0 2023-10-06T10:59:49.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.871+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3640110528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea68098aa0 con 0x7fea680acad0 2023-10-06T10:59:49.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.871+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3640110528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea68157030 con 0x7fea680acad0 2023-10-06T10:59:49.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.872+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3640110528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea681696a0 con 0x7fea680acad0 2023-10-06T10:59:49.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.872+0000 7fea567fc700 1 -- 172.21.15.7:0/3640110528 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea60007300 con 0x7fea680acad0 2023-10-06T10:59:49.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.873+0000 7fea567fc700 1 --2- 172.21.15.7:0/3640110528 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fea48066f30 0x7fea480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:49.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.873+0000 7fea567fc700 1 -- 172.21.15.7:0/3640110528 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fea60084c20 con 0x7fea680acad0 2023-10-06T10:59:49.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.873+0000 7fea6659c700 1 --2- 172.21.15.7:0/3640110528 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fea48066f30 0x7fea480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:49.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.873+0000 7fea6659c700 1 --2- 172.21.15.7:0/3640110528 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fea48066f30 0x7fea480693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea58007fd0 tx=0x7fea58007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:49.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:49.877+0000 7fea567fc700 1 -- 172.21.15.7:0/3640110528 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea681696a0 con 0x7fea680acad0 2023-10-06T10:59:50.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.077+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3640110528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fea681696a0 con 0x7fea680acad0 2023-10-06T10:59:50.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.077+0000 7fea567fc700 1 -- 172.21.15.7:0/3640110528 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fea681696a0 con 0x7fea680acad0 2023-10-06T10:59:50.079 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T10:59:50.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.079+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3640110528 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fea48066f30 msgr2=0x7fea480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.079+0000 7fea6c8c0700 1 --2- 172.21.15.7:0/3640110528 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fea48066f30 0x7fea480693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea58007fd0 tx=0x7fea58007d50 comp rx=0 tx=0).stop 2023-10-06T10:59:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.079+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3640110528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea680acad0 msgr2=0x7fea680ac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.079+0000 7fea6c8c0700 1 --2- 172.21.15.7:0/3640110528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea680acad0 0x7fea680ac2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fea6000cbc0 tx=0x7fea60001a40 comp rx=0 tx=0).stop 2023-10-06T10:59:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.079+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3640110528 shutdown_connections 2023-10-06T10:59:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.079+0000 7fea6c8c0700 1 --2- 172.21.15.7:0/3640110528 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fea48066f30 0x7fea480693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.079+0000 7fea6c8c0700 1 --2- 172.21.15.7:0/3640110528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea680acad0 0x7fea680ac2f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.079+0000 7fea6c8c0700 1 --2- 172.21.15.7:0/3640110528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fea680a6d30 0x7fea68156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.079+0000 7fea6c8c0700 1 --2- 172.21.15.7:0/3640110528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea680a7100 0x7fea680abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.079+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3640110528 >> 172.21.15.7:0/3640110528 conn(0x7fea680cc560 msgr2=0x7fea680b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.080+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3640110528 shutdown_connections 2023-10-06T10:59:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.080+0000 7fea6c8c0700 1 -- 172.21.15.7:0/3640110528 wait complete. 2023-10-06T10:59:50.094 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:50.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.225+0000 7f5bbcdec700 1 Processor -- start 2023-10-06T10:59:50.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.225+0000 7f5bbcdec700 1 -- start start 2023-10-06T10:59:50.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.226+0000 7f5bbcdec700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5bb8158120 0x7f5bb80c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.226+0000 7f5bbcdec700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5bb80c8ba0 0x7f5bb80ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.226+0000 7f5bbcdec700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb80cbd10 con 0x7f5bb80cac60 2023-10-06T10:59:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.226+0000 7f5bbcdec700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb80cb9e0 con 0x7f5bb8158120 2023-10-06T10:59:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.226+0000 7f5bbcdec700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb80c9300 con 0x7f5bb80c8ba0 2023-10-06T10:59:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.226+0000 7f5bb659c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5bb8158120 0x7f5bb80c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.226+0000 7f5bb659c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5bb8158120 0x7f5bb80c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35202/0 (socket says 172.21.15.7:35202) 2023-10-06T10:59:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.226+0000 7f5bb659c700 1 -- 172.21.15.7:0/2466440101 learned_addr learned my addr 172.21.15.7:0/2466440101 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.226+0000 7f5bb5d9b700 1 --2- 172.21.15.7:0/2466440101 >> v2:172.21.15.50:3300/0 conn(0x7f5bb80c8ba0 0x7f5bb80ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.227+0000 7f5bb659c700 1 -- 172.21.15.7:0/2466440101 >> v2:172.21.15.50:3300/0 conn(0x7f5bb80c8ba0 msgr2=0x7f5bb80ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.227+0000 7f5bb659c700 1 --2- 172.21.15.7:0/2466440101 >> v2:172.21.15.50:3300/0 conn(0x7f5bb80c8ba0 0x7f5bb80ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.227+0000 7f5bb659c700 1 -- 172.21.15.7:0/2466440101 >> v1:172.21.15.50:6789/0 conn(0x7f5bb80cac60 legacy=0x7f5bb815ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.227+0000 7f5bb659c700 1 -- 172.21.15.7:0/2466440101 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb80c95e0 con 0x7f5bb8158120 2023-10-06T10:59:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.227+0000 7f5bb659c700 1 --2- 172.21.15.7:0/2466440101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb8158120 0x7f5bb80c8660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5bb806bf60 tx=0x7f5ba8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3d33f97b4d2505 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:50.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.227+0000 7f5bb559a700 1 -- 172.21.15.7:0/2466440101 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8005c10 con 0x7f5bb8158120 2023-10-06T10:59:50.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.227+0000 7f5bb559a700 1 -- 172.21.15.7:0/2466440101 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba8005d70 con 0x7f5bb8158120 2023-10-06T10:59:50.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.227+0000 7f5bb559a700 1 -- 172.21.15.7:0/2466440101 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba800b880 con 0x7f5bb8158120 2023-10-06T10:59:50.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.228+0000 7f5bbcdec700 1 -- 172.21.15.7:0/2466440101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb8158120 msgr2=0x7f5bb80c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.228+0000 7f5bbcdec700 1 --2- 172.21.15.7:0/2466440101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb8158120 0x7f5bb80c8660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5bb806bf60 tx=0x7f5ba8009220 comp rx=0 tx=0).stop 2023-10-06T10:59:50.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.228+0000 7f5bbcdec700 1 -- 172.21.15.7:0/2466440101 shutdown_connections 2023-10-06T10:59:50.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.228+0000 7f5bbcdec700 1 --2- 172.21.15.7:0/2466440101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb8158120 0x7f5bb80c8660 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.228+0000 7f5bbcdec700 1 --2- 172.21.15.7:0/2466440101 >> v2:172.21.15.50:3300/0 conn(0x7f5bb80c8ba0 0x7f5bb80ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.228+0000 7f5bbcdec700 1 -- 172.21.15.7:0/2466440101 >> 172.21.15.7:0/2466440101 conn(0x7f5bb8087920 msgr2=0x7f5bb8097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:50.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.228+0000 7f5bbcdec700 1 -- 172.21.15.7:0/2466440101 shutdown_connections 2023-10-06T10:59:50.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.228+0000 7f5bbcdec700 1 -- 172.21.15.7:0/2466440101 wait complete. 2023-10-06T10:59:50.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.229+0000 7f5bbcdec700 1 Processor -- start 2023-10-06T10:59:50.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.229+0000 7f5bbcdec700 1 -- start start 2023-10-06T10:59:50.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bbcdec700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bb80c8ba0 0x7f5bb80c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bbcdec700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb80cac60 0x7f5bb80af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bbcdec700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb8158120 0x7f5bb8150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bbcdec700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80c4f60 con 0x7f5bb8158120 2023-10-06T10:59:50.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bbcdec700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80afda0 con 0x7f5bb80cac60 2023-10-06T10:59:50.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bbcdec700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80c51d0 con 0x7f5bb80c8ba0 2023-10-06T10:59:50.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bb6d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb8158120 0x7f5bb8150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bb6d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb8158120 0x7f5bb8150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35208/0 (socket says 172.21.15.7:35208) 2023-10-06T10:59:50.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bb6d9d700 1 -- 172.21.15.7:0/4035544303 learned_addr learned my addr 172.21.15.7:0/4035544303 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:50.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bb5d9b700 1 --2- 172.21.15.7:0/4035544303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb80cac60 0x7f5bb80af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bb659c700 1 --2- 172.21.15.7:0/4035544303 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bb80c8ba0 0x7f5bb80c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bb6d9d700 1 -- 172.21.15.7:0/4035544303 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bb80c8ba0 msgr2=0x7f5bb80c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bb6d9d700 1 --2- 172.21.15.7:0/4035544303 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bb80c8ba0 0x7f5bb80c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bb6d9d700 1 -- 172.21.15.7:0/4035544303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb80cac60 msgr2=0x7f5bb80af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bb6d9d700 1 --2- 172.21.15.7:0/4035544303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb80cac60 0x7f5bb80af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bb6d9d700 1 -- 172.21.15.7:0/4035544303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba8009480 con 0x7f5bb8158120 2023-10-06T10:59:50.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.230+0000 7f5bb6d9d700 1 --2- 172.21.15.7:0/4035544303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb8158120 0x7f5bb8150370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000c8e0 tx=0x7f5bb0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:50.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.231+0000 7f5ba67fc700 1 -- 172.21.15.7:0/4035544303 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0012630 con 0x7f5bb8158120 2023-10-06T10:59:50.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.231+0000 7f5ba67fc700 1 -- 172.21.15.7:0/4035544303 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0012790 con 0x7f5bb8158120 2023-10-06T10:59:50.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.231+0000 7f5bbcdec700 1 -- 172.21.15.7:0/4035544303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb80c54b0 con 0x7f5bb8158120 2023-10-06T10:59:50.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.231+0000 7f5ba67fc700 1 -- 172.21.15.7:0/4035544303 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0012b50 con 0x7f5bb8158120 2023-10-06T10:59:50.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.231+0000 7f5bbcdec700 1 -- 172.21.15.7:0/4035544303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb81508b0 con 0x7f5bb8158120 2023-10-06T10:59:50.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.232+0000 7f5bbcdec700 1 -- 172.21.15.7:0/4035544303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb80c59d0 con 0x7f5bb8158120 2023-10-06T10:59:50.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.233+0000 7f5ba67fc700 1 -- 172.21.15.7:0/4035544303 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bb0024420 con 0x7f5bb8158120 2023-10-06T10:59:50.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.233+0000 7f5ba67fc700 1 --2- 172.21.15.7:0/4035544303 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5b98066f30 0x7f5b980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.233+0000 7f5ba67fc700 1 -- 172.21.15.7:0/4035544303 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5bb0085160 con 0x7f5bb8158120 2023-10-06T10:59:50.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.233+0000 7f5bb659c700 1 --2- 172.21.15.7:0/4035544303 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5b98066f30 0x7f5b980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.234+0000 7f5bb659c700 1 --2- 172.21.15.7:0/4035544303 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5b98066f30 0x7f5b980693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009260 tx=0x7f5ba8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:50.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.237+0000 7f5ba67fc700 1 -- 172.21.15.7:0/4035544303 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bb0052000 con 0x7f5bb8158120 2023-10-06T10:59:50.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.443+0000 7f5bbcdec700 1 -- 172.21.15.7:0/4035544303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bb80c59d0 con 0x7f5bb8158120 2023-10-06T10:59:50.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.444+0000 7f5ba67fc700 1 -- 172.21.15.7:0/4035544303 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f5bb80c59d0 con 0x7f5bb8158120 2023-10-06T10:59:50.447 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:50.447 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:06.934264+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:50.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.447+0000 7f5bbcdec700 1 -- 172.21.15.7:0/4035544303 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5b98066f30 msgr2=0x7f5b980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.447+0000 7f5bbcdec700 1 --2- 172.21.15.7:0/4035544303 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5b98066f30 0x7f5b980693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009260 tx=0x7f5ba8016000 comp rx=0 tx=0).stop 2023-10-06T10:59:50.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.447+0000 7f5bbcdec700 1 -- 172.21.15.7:0/4035544303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb8158120 msgr2=0x7f5bb8150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.447+0000 7f5bbcdec700 1 --2- 172.21.15.7:0/4035544303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb8158120 0x7f5bb8150370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000c8e0 tx=0x7f5bb0001710 comp rx=0 tx=0).stop 2023-10-06T10:59:50.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.447+0000 7f5bbcdec700 1 -- 172.21.15.7:0/4035544303 shutdown_connections 2023-10-06T10:59:50.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.447+0000 7f5bbcdec700 1 --2- 172.21.15.7:0/4035544303 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5b98066f30 0x7f5b980693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.447+0000 7f5bbcdec700 1 --2- 172.21.15.7:0/4035544303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb8158120 0x7f5bb8150370 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.447+0000 7f5bbcdec700 1 --2- 172.21.15.7:0/4035544303 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bb80c8ba0 0x7f5bb80c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.447+0000 7f5bbcdec700 1 --2- 172.21.15.7:0/4035544303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb80cac60 0x7f5bb80af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.447+0000 7f5bbcdec700 1 -- 172.21.15.7:0/4035544303 >> 172.21.15.7:0/4035544303 conn(0x7f5bb8087920 msgr2=0x7f5bb80cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.447+0000 7f5bbcdec700 1 -- 172.21.15.7:0/4035544303 shutdown_connections 2023-10-06T10:59:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.447+0000 7f5bbcdec700 1 -- 172.21.15.7:0/4035544303 wait complete. 2023-10-06T10:59:50.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T10:58:55.224661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T10:58:56.032929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T10:58:59.772827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T10:59:00.802230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T10:59:04.512252+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T10:59:50.463 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T10:59:50.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.595+0000 7f3533d35700 1 Processor -- start 2023-10-06T10:59:50.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.596+0000 7f3533d35700 1 -- start start 2023-10-06T10:59:50.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.596+0000 7f3533d35700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f352c0cbf20 0x7f352c0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.596+0000 7f3533d35700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352c0c8fe0 con 0x7f352c0cc2f0 2023-10-06T10:59:50.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.596+0000 7f3533d35700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352c0c92c0 con 0x7f352c0cb2b0 2023-10-06T10:59:50.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.596+0000 7f3533d35700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352c0ca790 con 0x7f352c0cbf20 2023-10-06T10:59:50.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.597+0000 7f3531ad1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f352c0cbf20 0x7f352c0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.597+0000 7f35312d0700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f352c0cc2f0 0x7f352c0ca080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47746/0 (socket says 172.21.15.7:47746) 2023-10-06T10:59:50.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.597+0000 7f35312d0700 1 -- 172.21.15.7:0/274974163 learned_addr learned my addr 172.21.15.7:0/274974163 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:50.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.597+0000 7f3531ad1700 1 -- 172.21.15.7:0/274974163 >> v1:172.21.15.50:6789/0 conn(0x7f352c0cb2b0 legacy=0x7f352c158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.597+0000 7f3531ad1700 1 -- 172.21.15.7:0/274974163 >> v1:172.21.15.7:6789/0 conn(0x7f352c0cc2f0 legacy=0x7f352c0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.597+0000 7f3531ad1700 1 -- 172.21.15.7:0/274974163 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c0c95a0 con 0x7f352c0cbf20 2023-10-06T10:59:50.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.597+0000 7f3530acf700 1 -- 172.21.15.7:0/274974163 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269551266 0 0) 0x7f352c0c8fe0 con 0x7f352c0cc2f0 2023-10-06T10:59:50.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.597+0000 7f3531ad1700 1 --2- 172.21.15.7:0/274974163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f352c0cbf20 0x7f352c0c8920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f35280098e0 tx=0x7f35280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ecca93e61c4ab48 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:50.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.597+0000 7f3530acf700 1 -- 172.21.15.7:0/274974163 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528009e80 con 0x7f352c0cbf20 2023-10-06T10:59:50.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.597+0000 7f3530acf700 1 -- 172.21.15.7:0/274974163 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352800b860 con 0x7f352c0cbf20 2023-10-06T10:59:50.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.597+0000 7f3530acf700 1 -- 172.21.15.7:0/274974163 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352800bbe0 con 0x7f352c0cbf20 2023-10-06T10:59:50.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.598+0000 7f3533d35700 1 -- 172.21.15.7:0/274974163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f352c0cbf20 msgr2=0x7f352c0c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.598+0000 7f3533d35700 1 --2- 172.21.15.7:0/274974163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f352c0cbf20 0x7f352c0c8920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f35280098e0 tx=0x7f35280091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.598+0000 7f3533d35700 1 -- 172.21.15.7:0/274974163 shutdown_connections 2023-10-06T10:59:50.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.598+0000 7f3533d35700 1 --2- 172.21.15.7:0/274974163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f352c0cbf20 0x7f352c0c8920 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.598+0000 7f3533d35700 1 -- 172.21.15.7:0/274974163 >> 172.21.15.7:0/274974163 conn(0x7f352c0afc90 msgr2=0x7f352c0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:50.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.598+0000 7f3533d35700 1 -- 172.21.15.7:0/274974163 shutdown_connections 2023-10-06T10:59:50.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.598+0000 7f3533d35700 1 -- 172.21.15.7:0/274974163 wait complete. 2023-10-06T10:59:50.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.600+0000 7f3533d35700 1 Processor -- start 2023-10-06T10:59:50.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.600+0000 7f3533d35700 1 -- start start 2023-10-06T10:59:50.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f3533d35700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f352c0cb2b0 0x7f352c153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f3533d35700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f352c0cbf20 0x7f352c0c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f3533d35700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f352c0cc2f0 0x7f352c096930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f3533d35700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c0c4020 con 0x7f352c0cbf20 2023-10-06T10:59:50.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f3533d35700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c0c2180 con 0x7f352c0cc2f0 2023-10-06T10:59:50.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f3533d35700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c0c0b90 con 0x7f352c0cb2b0 2023-10-06T10:59:50.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f35312d0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f352c0cbf20 0x7f352c0c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f35312d0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f352c0cbf20 0x7f352c0c51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35232/0 (socket says 172.21.15.7:35232) 2023-10-06T10:59:50.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f35312d0700 1 -- 172.21.15.7:0/1111782223 learned_addr learned my addr 172.21.15.7:0/1111782223 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:50.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f3531ad1700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f352c0cb2b0 0x7f352c153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f35322d2700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f352c0cc2f0 0x7f352c096930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f35312d0700 1 -- 172.21.15.7:0/1111782223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f352c0cb2b0 msgr2=0x7f352c153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f35312d0700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f352c0cb2b0 0x7f352c153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f35312d0700 1 -- 172.21.15.7:0/1111782223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f352c0cc2f0 msgr2=0x7f352c096930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f35312d0700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f352c0cc2f0 0x7f352c096930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f35312d0700 1 -- 172.21.15.7:0/1111782223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528009420 con 0x7f352c0cbf20 2023-10-06T10:59:50.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f3531ad1700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f352c0cb2b0 0x7f352c153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:50.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.601+0000 7f35322d2700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f352c0cc2f0 0x7f352c096930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.602+0000 7f35312d0700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f352c0cbf20 0x7f352c0c51d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f351c00c560 tx=0x7f351c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.602+0000 7f3521ffb700 1 -- 172.21.15.7:0/1111782223 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c005b30 con 0x7f352c0cbf20 2023-10-06T10:59:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.602+0000 7f3521ffb700 1 -- 172.21.15.7:0/1111782223 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c005c90 con 0x7f352c0cbf20 2023-10-06T10:59:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.602+0000 7f3533d35700 1 -- 172.21.15.7:0/1111782223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352c0c18e0 con 0x7f352c0cbf20 2023-10-06T10:59:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.602+0000 7f3521ffb700 1 -- 172.21.15.7:0/1111782223 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c007320 con 0x7f352c0cbf20 2023-10-06T10:59:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.602+0000 7f3533d35700 1 -- 172.21.15.7:0/1111782223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352c0c1ea0 con 0x7f352c0cbf20 2023-10-06T10:59:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.603+0000 7f3533d35700 1 -- 172.21.15.7:0/1111782223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352c0c3dd0 con 0x7f352c0cbf20 2023-10-06T10:59:50.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.604+0000 7f3521ffb700 1 -- 172.21.15.7:0/1111782223 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f351c01b3b0 con 0x7f352c0cbf20 2023-10-06T10:59:50.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.604+0000 7f3521ffb700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3510066f30 0x7f35100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.604+0000 7f3521ffb700 1 -- 172.21.15.7:0/1111782223 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f351c083f30 con 0x7f352c0cbf20 2023-10-06T10:59:50.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.604+0000 7f3531ad1700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3510066f30 0x7f35100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.605+0000 7f3531ad1700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3510066f30 0x7f35100693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f35280093f0 tx=0x7f3528017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:50.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.609+0000 7f3521ffb700 1 -- 172.21.15.7:0/1111782223 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f351c050d50 con 0x7f352c0cbf20 2023-10-06T10:59:50.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.811+0000 7f3533d35700 1 -- 172.21.15.7:0/1111782223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f352c0c4160 con 0x7f352c0cbf20 2023-10-06T10:59:50.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.812+0000 7f3521ffb700 1 -- 172.21.15.7:0/1111782223 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f351c017020 con 0x7f352c0cbf20 2023-10-06T10:59:50.814 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-10-06T10:59:50.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.814+0000 7f3533d35700 1 -- 172.21.15.7:0/1111782223 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3510066f30 msgr2=0x7f35100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.814+0000 7f3533d35700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3510066f30 0x7f35100693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f35280093f0 tx=0x7f3528017000 comp rx=0 tx=0).stop 2023-10-06T10:59:50.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.814+0000 7f3533d35700 1 -- 172.21.15.7:0/1111782223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f352c0cbf20 msgr2=0x7f352c0c51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.814+0000 7f3533d35700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f352c0cbf20 0x7f352c0c51d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f351c00c560 tx=0x7f351c000fe0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.814+0000 7f3533d35700 1 -- 172.21.15.7:0/1111782223 shutdown_connections 2023-10-06T10:59:50.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.814+0000 7f3533d35700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3510066f30 0x7f35100693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.814+0000 7f3533d35700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f352c0cc2f0 0x7f352c096930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.814+0000 7f3533d35700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f352c0cb2b0 0x7f352c153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.814+0000 7f3533d35700 1 --2- 172.21.15.7:0/1111782223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f352c0cbf20 0x7f352c0c51d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.814+0000 7f3533d35700 1 -- 172.21.15.7:0/1111782223 >> 172.21.15.7:0/1111782223 conn(0x7f352c0afc90 msgr2=0x7f352c063220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:50.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.814+0000 7f3533d35700 1 -- 172.21.15.7:0/1111782223 shutdown_connections 2023-10-06T10:59:50.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.814+0000 7f3533d35700 1 -- 172.21.15.7:0/1111782223 wait complete. 2023-10-06T10:59:50.829 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T10:59:50.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.963+0000 7f246dc28700 1 Processor -- start 2023-10-06T10:59:50.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.963+0000 7f246dc28700 1 -- start start 2023-10-06T10:59:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.964+0000 7f246dc28700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2468140620 0x7f24680cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.964+0000 7f246dc28700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f24680b14c0 0x7f24680acb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.964+0000 7f246dc28700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24680ac670 con 0x7f24680ab5a0 2023-10-06T10:59:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.964+0000 7f246dc28700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24680aba60 con 0x7f24680b14c0 2023-10-06T10:59:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.964+0000 7f246dc28700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24680abd40 con 0x7f2468140620 2023-10-06T10:59:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.964+0000 7f2467fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f24680b14c0 0x7f24680acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.964+0000 7f2467fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f24680b14c0 0x7f24680acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35238/0 (socket says 172.21.15.7:35238) 2023-10-06T10:59:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.964+0000 7f2467fff700 1 -- 172.21.15.7:0/4250879455 learned_addr learned my addr 172.21.15.7:0/4250879455 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.964+0000 7f24677fe700 1 --2- 172.21.15.7:0/4250879455 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2468140620 0x7f24680cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.964+0000 7f2467fff700 1 -- 172.21.15.7:0/4250879455 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2468140620 msgr2=0x7f24680cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.964+0000 7f2467fff700 1 --2- 172.21.15.7:0/4250879455 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2468140620 0x7f24680cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.964+0000 7f2467fff700 1 -- 172.21.15.7:0/4250879455 >> v1:172.21.15.50:6789/0 conn(0x7f24680ab5a0 legacy=0x7f24680b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.964+0000 7f2467fff700 1 -- 172.21.15.7:0/4250879455 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24680ac020 con 0x7f24680b14c0 2023-10-06T10:59:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.965+0000 7f2467fff700 1 --2- 172.21.15.7:0/4250879455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24680b14c0 0x7f24680acb00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2460009f20 tx=0x7f2460009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a3d49e832bfae5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.965+0000 7f24667fc700 1 -- 172.21.15.7:0/4250879455 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246000e070 con 0x7f24680b14c0 2023-10-06T10:59:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.965+0000 7f24667fc700 1 -- 172.21.15.7:0/4250879455 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246000ba80 con 0x7f24680b14c0 2023-10-06T10:59:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.965+0000 7f24667fc700 1 -- 172.21.15.7:0/4250879455 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600092e0 con 0x7f24680b14c0 2023-10-06T10:59:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.965+0000 7f246dc28700 1 -- 172.21.15.7:0/4250879455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24680b14c0 msgr2=0x7f24680acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.965+0000 7f246dc28700 1 --2- 172.21.15.7:0/4250879455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24680b14c0 0x7f24680acb00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2460009f20 tx=0x7f2460009840 comp rx=0 tx=0).stop 2023-10-06T10:59:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.966+0000 7f246dc28700 1 -- 172.21.15.7:0/4250879455 shutdown_connections 2023-10-06T10:59:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.966+0000 7f246dc28700 1 --2- 172.21.15.7:0/4250879455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24680b14c0 0x7f24680acb00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.966+0000 7f246dc28700 1 --2- 172.21.15.7:0/4250879455 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2468140620 0x7f24680cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.966+0000 7f246dc28700 1 -- 172.21.15.7:0/4250879455 >> 172.21.15.7:0/4250879455 conn(0x7f246806ea40 msgr2=0x7f24680670f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.966+0000 7f246dc28700 1 -- 172.21.15.7:0/4250879455 shutdown_connections 2023-10-06T10:59:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.966+0000 7f246dc28700 1 -- 172.21.15.7:0/4250879455 wait complete. 2023-10-06T10:59:50.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.967+0000 7f246dc28700 1 Processor -- start 2023-10-06T10:59:50.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.967+0000 7f246dc28700 1 -- start start 2023-10-06T10:59:50.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f246dc28700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f24680ab5a0 0x7f24680a9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f246dc28700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24680b14c0 0x7f24681678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f246dc28700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2468140620 0x7f246813df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f246dc28700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24681690a0 con 0x7f2468140620 2023-10-06T10:59:50.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f246dc28700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2468168a70 con 0x7f24680b14c0 2023-10-06T10:59:50.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f246dc28700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24681683b0 con 0x7f24680ab5a0 2023-10-06T10:59:50.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f24677fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f24680ab5a0 0x7f24680a9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f24677fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f24680ab5a0 0x7f24680a9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:44304/0 (socket says 172.21.15.7:44304) 2023-10-06T10:59:50.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f24677fe700 1 -- 172.21.15.7:0/1875703311 learned_addr learned my addr 172.21.15.7:0/1875703311 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:50.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f2466ffd700 1 --2- 172.21.15.7:0/1875703311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24680b14c0 0x7f24681678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f2467fff700 1 --2- 172.21.15.7:0/1875703311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2468140620 0x7f246813df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f24677fe700 1 -- 172.21.15.7:0/1875703311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24680b14c0 msgr2=0x7f24681678a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f24677fe700 1 --2- 172.21.15.7:0/1875703311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24680b14c0 0x7f24681678a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f24677fe700 1 -- 172.21.15.7:0/1875703311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2468140620 msgr2=0x7f246813df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:50.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f24677fe700 1 --2- 172.21.15.7:0/1875703311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2468140620 0x7f246813df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:50.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.968+0000 7f24677fe700 1 -- 172.21.15.7:0/1875703311 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2460009ae0 con 0x7f24680ab5a0 2023-10-06T10:59:50.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.969+0000 7f24677fe700 1 --2- 172.21.15.7:0/1875703311 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f24680ab5a0 0x7f24680a9a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f245800d8c0 tx=0x7f2458008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:50.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.969+0000 7f244f7fe700 1 -- 172.21.15.7:0/1875703311 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24580125f0 con 0x7f24680ab5a0 2023-10-06T10:59:50.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.969+0000 7f244f7fe700 1 -- 172.21.15.7:0/1875703311 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2458012750 con 0x7f24680ab5a0 2023-10-06T10:59:50.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.969+0000 7f246dc28700 1 -- 172.21.15.7:0/1875703311 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2468168690 con 0x7f24680ab5a0 2023-10-06T10:59:50.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.969+0000 7f244f7fe700 1 -- 172.21.15.7:0/1875703311 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2458012af0 con 0x7f24680ab5a0 2023-10-06T10:59:50.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.969+0000 7f246dc28700 1 -- 172.21.15.7:0/1875703311 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246816b0d0 con 0x7f24680ab5a0 2023-10-06T10:59:50.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.970+0000 7f246dc28700 1 -- 172.21.15.7:0/1875703311 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2468070480 con 0x7f24680ab5a0 2023-10-06T10:59:50.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.971+0000 7f244f7fe700 1 -- 172.21.15.7:0/1875703311 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f245801e460 con 0x7f24680ab5a0 2023-10-06T10:59:50.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.971+0000 7f244f7fe700 1 --2- 172.21.15.7:0/1875703311 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2454066f30 0x7f24540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:50.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.971+0000 7f244f7fe700 1 -- 172.21.15.7:0/1875703311 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f2458085430 con 0x7f24680ab5a0 2023-10-06T10:59:50.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.971+0000 7f2466ffd700 1 --2- 172.21.15.7:0/1875703311 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2454066f30 0x7f24540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:50.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.972+0000 7f2466ffd700 1 --2- 172.21.15.7:0/1875703311 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2454066f30 0x7f24540693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f24680ab990 tx=0x7f245c007f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:50.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:50.976+0000 7f244f7fe700 1 -- 172.21.15.7:0/1875703311 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2458052170 con 0x7f24680ab5a0 2023-10-06T10:59:51.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.177+0000 7f246dc28700 1 -- 172.21.15.7:0/1875703311 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24680c9820 con 0x7f24680ab5a0 2023-10-06T10:59:51.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.178+0000 7f244f7fe700 1 -- 172.21.15.7:0/1875703311 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2458055790 con 0x7f24680ab5a0 2023-10-06T10:59:51.180 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-06T10:59:51.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.181+0000 7f246dc28700 1 -- 172.21.15.7:0/1875703311 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2454066f30 msgr2=0x7f24540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:51.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.181+0000 7f246dc28700 1 --2- 172.21.15.7:0/1875703311 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2454066f30 0x7f24540693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f24680ab990 tx=0x7f245c007f10 comp rx=0 tx=0).stop 2023-10-06T10:59:51.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.181+0000 7f246dc28700 1 -- 172.21.15.7:0/1875703311 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f24680ab5a0 msgr2=0x7f24680a9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:51.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.181+0000 7f246dc28700 1 --2- 172.21.15.7:0/1875703311 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f24680ab5a0 0x7f24680a9a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f245800d8c0 tx=0x7f2458008040 comp rx=0 tx=0).stop 2023-10-06T10:59:51.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.181+0000 7f246dc28700 1 -- 172.21.15.7:0/1875703311 shutdown_connections 2023-10-06T10:59:51.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.181+0000 7f246dc28700 1 --2- 172.21.15.7:0/1875703311 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2454066f30 0x7f24540693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.181+0000 7f246dc28700 1 --2- 172.21.15.7:0/1875703311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2468140620 0x7f246813df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.181+0000 7f246dc28700 1 --2- 172.21.15.7:0/1875703311 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f24680ab5a0 0x7f24680a9a40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.181+0000 7f246dc28700 1 --2- 172.21.15.7:0/1875703311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24680b14c0 0x7f24681678a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.181+0000 7f246dc28700 1 -- 172.21.15.7:0/1875703311 >> 172.21.15.7:0/1875703311 conn(0x7f246806ea40 msgr2=0x7f24680aa900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.181+0000 7f246dc28700 1 -- 172.21.15.7:0/1875703311 shutdown_connections 2023-10-06T10:59:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.181+0000 7f246dc28700 1 -- 172.21.15.7:0/1875703311 wait complete. 2023-10-06T10:59:51.195 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T10:59:51.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.329+0000 7f0cc9d93700 1 Processor -- start 2023-10-06T10:59:51.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.329+0000 7f0cc9d93700 1 -- start start 2023-10-06T10:59:51.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc9d93700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cc40cbf20 0x7f0cc40c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:51.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc9d93700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0cc40cc2f0 0x7f0cc40cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:51.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc9d93700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0cc40ca080 0x7f0cc4158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:51.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc9d93700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc40cb7f0 con 0x7f0cc40ca080 2023-10-06T10:59:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc9d93700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc40c8fe0 con 0x7f0cc40cbf20 2023-10-06T10:59:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc9d93700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc40c92c0 con 0x7f0cc40cc2f0 2023-10-06T10:59:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc3fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0cc40ca080 0x7f0cc4158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc3fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0cc40ca080 0x7f0cc4158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35254/0 (socket says 172.21.15.7:35254) 2023-10-06T10:59:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc3fff700 1 -- 172.21.15.7:0/4083528637 learned_addr learned my addr 172.21.15.7:0/4083528637 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc2ffd700 1 --2- 172.21.15.7:0/4083528637 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0cc40cc2f0 0x7f0cc40cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc37fe700 1 --2- 172.21.15.7:0/4083528637 >> v2:172.21.15.50:3300/0 conn(0x7f0cc40cbf20 0x7f0cc40c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc3fff700 1 -- 172.21.15.7:0/4083528637 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0cc40cc2f0 msgr2=0x7f0cc40cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc3fff700 1 --2- 172.21.15.7:0/4083528637 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0cc40cc2f0 0x7f0cc40cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc3fff700 1 -- 172.21.15.7:0/4083528637 >> v2:172.21.15.50:3300/0 conn(0x7f0cc40cbf20 msgr2=0x7f0cc40c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc3fff700 1 --2- 172.21.15.7:0/4083528637 >> v2:172.21.15.50:3300/0 conn(0x7f0cc40cbf20 0x7f0cc40c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc3fff700 1 -- 172.21.15.7:0/4083528637 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc40c95a0 con 0x7f0cc40ca080 2023-10-06T10:59:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.330+0000 7f0cc2ffd700 1 --2- 172.21.15.7:0/4083528637 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0cc40cc2f0 0x7f0cc40cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.331+0000 7f0cc3fff700 1 --2- 172.21.15.7:0/4083528637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc40ca080 0x7f0cc4158ea0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0cc406de70 tx=0x7f0cbc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a1783b75359ac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.331+0000 7f0cc27fc700 1 -- 172.21.15.7:0/4083528637 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc00e070 con 0x7f0cc40ca080 2023-10-06T10:59:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.331+0000 7f0cc27fc700 1 -- 172.21.15.7:0/4083528637 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc00ba50 con 0x7f0cc40ca080 2023-10-06T10:59:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.331+0000 7f0cc27fc700 1 -- 172.21.15.7:0/4083528637 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc0092e0 con 0x7f0cc40ca080 2023-10-06T10:59:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.331+0000 7f0cc9d93700 1 -- 172.21.15.7:0/4083528637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc40ca080 msgr2=0x7f0cc4158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.331+0000 7f0cc9d93700 1 --2- 172.21.15.7:0/4083528637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc40ca080 0x7f0cc4158ea0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0cc406de70 tx=0x7f0cbc009840 comp rx=0 tx=0).stop 2023-10-06T10:59:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.332+0000 7f0cc9d93700 1 -- 172.21.15.7:0/4083528637 shutdown_connections 2023-10-06T10:59:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.332+0000 7f0cc9d93700 1 --2- 172.21.15.7:0/4083528637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc40ca080 0x7f0cc4158ea0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.332+0000 7f0cc9d93700 1 --2- 172.21.15.7:0/4083528637 >> v2:172.21.15.50:3300/0 conn(0x7f0cc40cbf20 0x7f0cc40c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.332+0000 7f0cc9d93700 1 --2- 172.21.15.7:0/4083528637 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0cc40cc2f0 0x7f0cc40cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.332+0000 7f0cc9d93700 1 -- 172.21.15.7:0/4083528637 >> 172.21.15.7:0/4083528637 conn(0x7f0cc40afc90 msgr2=0x7f0cc40b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:51.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.332+0000 7f0cc9d93700 1 -- 172.21.15.7:0/4083528637 shutdown_connections 2023-10-06T10:59:51.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.332+0000 7f0cc9d93700 1 -- 172.21.15.7:0/4083528637 wait complete. 2023-10-06T10:59:51.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.333+0000 7f0cc9d93700 1 Processor -- start 2023-10-06T10:59:51.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.333+0000 7f0cc9d93700 1 -- start start 2023-10-06T10:59:51.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc9d93700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc40ca080 0x7f0cc4155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:51.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc9d93700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0cc40cbf20 0x7f0cc40c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:51.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc9d93700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc40cc2f0 0x7f0cc40c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:51.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc9d93700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc40c18a0 con 0x7f0cc40cc2f0 2023-10-06T10:59:51.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc9d93700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc40c0c90 con 0x7f0cc40ca080 2023-10-06T10:59:51.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc9d93700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc40c0f70 con 0x7f0cc40cbf20 2023-10-06T10:59:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc40cc2f0 0x7f0cc40c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc40cc2f0 0x7f0cc40c2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35262/0 (socket says 172.21.15.7:35262) 2023-10-06T10:59:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc3fff700 1 -- 172.21.15.7:0/2499225637 learned_addr learned my addr 172.21.15.7:0/2499225637 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc37fe700 1 --2- 172.21.15.7:0/2499225637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc40ca080 0x7f0cc4155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc2ffd700 1 --2- 172.21.15.7:0/2499225637 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0cc40cbf20 0x7f0cc40c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc3fff700 1 -- 172.21.15.7:0/2499225637 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0cc40cbf20 msgr2=0x7f0cc40c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc3fff700 1 --2- 172.21.15.7:0/2499225637 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0cc40cbf20 0x7f0cc40c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc3fff700 1 -- 172.21.15.7:0/2499225637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc40ca080 msgr2=0x7f0cc4155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc3fff700 1 --2- 172.21.15.7:0/2499225637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc40ca080 0x7f0cc4155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.334+0000 7f0cc3fff700 1 -- 172.21.15.7:0/2499225637 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc009ae0 con 0x7f0cc40cc2f0 2023-10-06T10:59:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.335+0000 7f0cc3fff700 1 --2- 172.21.15.7:0/2499225637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc40cc2f0 0x7f0cc40c2270 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0cc406e0b0 tx=0x7f0cbc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.335+0000 7f0cbb7fe700 1 -- 172.21.15.7:0/2499225637 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc0032f0 con 0x7f0cc40cc2f0 2023-10-06T10:59:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.335+0000 7f0cbb7fe700 1 -- 172.21.15.7:0/2499225637 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc008e40 con 0x7f0cc40cc2f0 2023-10-06T10:59:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.335+0000 7f0cc9d93700 1 -- 172.21.15.7:0/2499225637 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc40c1250 con 0x7f0cc40cc2f0 2023-10-06T10:59:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.335+0000 7f0cbb7fe700 1 -- 172.21.15.7:0/2499225637 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc0266b0 con 0x7f0cc40cc2f0 2023-10-06T10:59:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.335+0000 7f0cc9d93700 1 -- 172.21.15.7:0/2499225637 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc4155d90 con 0x7f0cc40cc2f0 2023-10-06T10:59:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.336+0000 7f0cc9d93700 1 -- 172.21.15.7:0/2499225637 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc40c1a50 con 0x7f0cc40cc2f0 2023-10-06T10:59:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.336+0000 7f0cbb7fe700 1 -- 172.21.15.7:0/2499225637 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0cbc003040 con 0x7f0cc40cc2f0 2023-10-06T10:59:51.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.337+0000 7f0cbb7fe700 1 --2- 172.21.15.7:0/2499225637 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0ca4066f30 0x7f0ca40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:51.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.337+0000 7f0cbb7fe700 1 -- 172.21.15.7:0/2499225637 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f0cbc0869c0 con 0x7f0cc40cc2f0 2023-10-06T10:59:51.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.337+0000 7f0cc37fe700 1 --2- 172.21.15.7:0/2499225637 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0ca4066f30 0x7f0ca40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:51.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.337+0000 7f0cc37fe700 1 --2- 172.21.15.7:0/2499225637 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0ca4066f30 0x7f0ca40693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4006fd0 tx=0x7f0cb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:51.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.341+0000 7f0cbb7fe700 1 -- 172.21.15.7:0/2499225637 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cc40c1a50 con 0x7f0cc40cc2f0 2023-10-06T10:59:51.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.542+0000 7f0cc9d93700 1 -- 172.21.15.7:0/2499225637 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0cc4070480 con 0x7f0cc40cc2f0 2023-10-06T10:59:51.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.543+0000 7f0cbb7fe700 1 -- 172.21.15.7:0/2499225637 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0cbc0537a0 con 0x7f0cc40cc2f0 2023-10-06T10:59:51.544 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T10:59:51.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.545+0000 7f0cc9d93700 1 -- 172.21.15.7:0/2499225637 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0ca4066f30 msgr2=0x7f0ca40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:51.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.545+0000 7f0cc9d93700 1 --2- 172.21.15.7:0/2499225637 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0ca4066f30 0x7f0ca40693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4006fd0 tx=0x7f0cb4008040 comp rx=0 tx=0).stop 2023-10-06T10:59:51.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.545+0000 7f0cc9d93700 1 -- 172.21.15.7:0/2499225637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc40cc2f0 msgr2=0x7f0cc40c2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:51.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.545+0000 7f0cc9d93700 1 --2- 172.21.15.7:0/2499225637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc40cc2f0 0x7f0cc40c2270 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0cc406e0b0 tx=0x7f0cbc018000 comp rx=0 tx=0).stop 2023-10-06T10:59:51.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.545+0000 7f0cc9d93700 1 -- 172.21.15.7:0/2499225637 shutdown_connections 2023-10-06T10:59:51.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.545+0000 7f0cc9d93700 1 --2- 172.21.15.7:0/2499225637 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0ca4066f30 0x7f0ca40693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.545+0000 7f0cc9d93700 1 --2- 172.21.15.7:0/2499225637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc40cc2f0 0x7f0cc40c2270 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.545+0000 7f0cc9d93700 1 --2- 172.21.15.7:0/2499225637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc40ca080 0x7f0cc4155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.545+0000 7f0cc9d93700 1 --2- 172.21.15.7:0/2499225637 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0cc40cbf20 0x7f0cc40c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.545+0000 7f0cc9d93700 1 -- 172.21.15.7:0/2499225637 >> 172.21.15.7:0/2499225637 conn(0x7f0cc40afc90 msgr2=0x7f0cc40697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:51.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.545+0000 7f0cc9d93700 1 -- 172.21.15.7:0/2499225637 shutdown_connections 2023-10-06T10:59:51.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.545+0000 7f0cc9d93700 1 -- 172.21.15.7:0/2499225637 wait complete. 2023-10-06T10:59:51.560 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T10:59:51.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.698+0000 7fb3dab70700 1 Processor -- start 2023-10-06T10:59:51.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.698+0000 7fb3dab70700 1 -- start start 2023-10-06T10:59:51.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.699+0000 7fb3dab70700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb3d40cbf20 0x7fb3d40c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:51.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.699+0000 7fb3dab70700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3d40cc2f0 0x7fb3d40cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:51.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.699+0000 7fb3dab70700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3d40ca080 0x7fb3d4158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:51.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.699+0000 7fb3dab70700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d40cb7f0 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.699+0000 7fb3dab70700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d40c8fe0 con 0x7fb3d40ca080 2023-10-06T10:59:51.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.699+0000 7fb3dab70700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40c92c0 con 0x7fb3d40cbf20 2023-10-06T10:59:51.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.699+0000 7fb3d3fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3d40cc2f0 0x7fb3d40cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:51.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.699+0000 7fb3d3fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3d40cc2f0 0x7fb3d40cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35280/0 (socket says 172.21.15.7:35280) 2023-10-06T10:59:51.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.699+0000 7fb3d3fff700 1 -- 172.21.15.7:0/1890104410 learned_addr learned my addr 172.21.15.7:0/1890104410 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:51.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.699+0000 7fb3d910d700 1 --2- 172.21.15.7:0/1890104410 >> v2:172.21.15.50:3300/0 conn(0x7fb3d40ca080 0x7fb3d4158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:51.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.699+0000 7fb3d890c700 1 --2- 172.21.15.7:0/1890104410 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb3d40cbf20 0x7fb3d40c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:51.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.700+0000 7fb3d3fff700 1 -- 172.21.15.7:0/1890104410 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb3d40cbf20 msgr2=0x7fb3d40c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:51.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.700+0000 7fb3d3fff700 1 --2- 172.21.15.7:0/1890104410 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb3d40cbf20 0x7fb3d40c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.700+0000 7fb3d3fff700 1 -- 172.21.15.7:0/1890104410 >> v2:172.21.15.50:3300/0 conn(0x7fb3d40ca080 msgr2=0x7fb3d4158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:51.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.700+0000 7fb3d3fff700 1 --2- 172.21.15.7:0/1890104410 >> v2:172.21.15.50:3300/0 conn(0x7fb3d40ca080 0x7fb3d4158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.700+0000 7fb3d3fff700 1 -- 172.21.15.7:0/1890104410 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d40c95a0 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.700+0000 7fb3d3fff700 1 --2- 172.21.15.7:0/1890104410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d40cc2f0 0x7fb3d40cb2b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb3d406ecb0 tx=0x7fb3c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2a57736f00616 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:51.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.700+0000 7fb3d37fe700 1 -- 172.21.15.7:0/1890104410 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000b860 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.700+0000 7fb3d37fe700 1 -- 172.21.15.7:0/1890104410 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c000b9c0 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.700+0000 7fb3d37fe700 1 -- 172.21.15.7:0/1890104410 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000bd60 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.701+0000 7fb3dab70700 1 -- 172.21.15.7:0/1890104410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d40cc2f0 msgr2=0x7fb3d40cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:51.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.701+0000 7fb3dab70700 1 --2- 172.21.15.7:0/1890104410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d40cc2f0 0x7fb3d40cb2b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb3d406ecb0 tx=0x7fb3c0009250 comp rx=0 tx=0).stop 2023-10-06T10:59:51.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.701+0000 7fb3dab70700 1 -- 172.21.15.7:0/1890104410 shutdown_connections 2023-10-06T10:59:51.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.701+0000 7fb3dab70700 1 --2- 172.21.15.7:0/1890104410 >> v2:172.21.15.50:3300/0 conn(0x7fb3d40ca080 0x7fb3d4158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.701+0000 7fb3dab70700 1 --2- 172.21.15.7:0/1890104410 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb3d40cbf20 0x7fb3d40c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.701+0000 7fb3dab70700 1 --2- 172.21.15.7:0/1890104410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d40cc2f0 0x7fb3d40cb2b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.701+0000 7fb3dab70700 1 -- 172.21.15.7:0/1890104410 >> 172.21.15.7:0/1890104410 conn(0x7fb3d40afc90 msgr2=0x7fb3d40b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:51.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.701+0000 7fb3dab70700 1 -- 172.21.15.7:0/1890104410 shutdown_connections 2023-10-06T10:59:51.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.701+0000 7fb3dab70700 1 -- 172.21.15.7:0/1890104410 wait complete. 2023-10-06T10:59:51.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.703+0000 7fb3dab70700 1 Processor -- start 2023-10-06T10:59:51.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.703+0000 7fb3dab70700 1 -- start start 2023-10-06T10:59:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3dab70700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3d40ca080 0x7fb3d40c2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3dab70700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb3d40cbf20 0x7fb3d40c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3dab70700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d40cc2f0 0x7fb3d41561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3dab70700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40c1a20 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3dab70700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40c4f40 con 0x7fb3d40ca080 2023-10-06T10:59:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3dab70700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40c3660 con 0x7fb3d40cbf20 2023-10-06T10:59:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3d910d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d40cc2f0 0x7fb3d41561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3d910d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d40cc2f0 0x7fb3d41561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35284/0 (socket says 172.21.15.7:35284) 2023-10-06T10:59:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3d910d700 1 -- 172.21.15.7:0/1306927752 learned_addr learned my addr 172.21.15.7:0/1306927752 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3d890c700 1 --2- 172.21.15.7:0/1306927752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3d40ca080 0x7fb3d40c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:51.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3d3fff700 1 --2- 172.21.15.7:0/1306927752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb3d40cbf20 0x7fb3d40c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:51.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3d910d700 1 -- 172.21.15.7:0/1306927752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb3d40cbf20 msgr2=0x7fb3d40c14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:51.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3d910d700 1 --2- 172.21.15.7:0/1306927752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb3d40cbf20 0x7fb3d40c14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3d910d700 1 -- 172.21.15.7:0/1306927752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3d40ca080 msgr2=0x7fb3d40c2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:51.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3d910d700 1 --2- 172.21.15.7:0/1306927752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3d40ca080 0x7fb3d40c2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3d910d700 1 -- 172.21.15.7:0/1306927752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c00094f0 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.704+0000 7fb3d910d700 1 --2- 172.21.15.7:0/1306927752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d40cc2f0 0x7fb3d41561d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009fd0 tx=0x7fb3cc009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:51.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.705+0000 7fb3d0ff9700 1 -- 172.21.15.7:0/1306927752 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00ebf0 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.705+0000 7fb3d0ff9700 1 -- 172.21.15.7:0/1306927752 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc00ed50 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.705+0000 7fb3dab70700 1 -- 172.21.15.7:0/1306927752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d4156710 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.705+0000 7fb3d0ff9700 1 -- 172.21.15.7:0/1306927752 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc014670 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.705+0000 7fb3dab70700 1 -- 172.21.15.7:0/1306927752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d40c30a0 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.706+0000 7fb3dab70700 1 -- 172.21.15.7:0/1306927752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d4070480 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.706+0000 7fb3d0ff9700 1 -- 172.21.15.7:0/1306927752 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3cc0149e0 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.707+0000 7fb3d0ff9700 1 --2- 172.21.15.7:0/1306927752 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb3b8066f30 0x7fb3b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:51.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.707+0000 7fb3d0ff9700 1 -- 172.21.15.7:0/1306927752 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb3cc085060 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.707+0000 7fb3d890c700 1 --2- 172.21.15.7:0/1306927752 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb3b8066f30 0x7fb3b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:51.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.707+0000 7fb3d890c700 1 --2- 172.21.15.7:0/1306927752 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb3b8066f30 0x7fb3b80693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8006fd0 tx=0x7fb3c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.711+0000 7fb3d0ff9700 1 -- 172.21.15.7:0/1306927752 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3cc051e40 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.913+0000 7fb3dab70700 1 -- 172.21.15.7:0/1306927752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3d40c9880 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.914+0000 7fb3d0ff9700 1 -- 172.21.15.7:0/1306927752 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb3cc055460 con 0x7fb3d40cc2f0 2023-10-06T10:59:51.916 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-06T10:59:51.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.916+0000 7fb3dab70700 1 -- 172.21.15.7:0/1306927752 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb3b8066f30 msgr2=0x7fb3b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:51.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.916+0000 7fb3dab70700 1 --2- 172.21.15.7:0/1306927752 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb3b8066f30 0x7fb3b80693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8006fd0 tx=0x7fb3c8008040 comp rx=0 tx=0).stop 2023-10-06T10:59:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.916+0000 7fb3dab70700 1 -- 172.21.15.7:0/1306927752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d40cc2f0 msgr2=0x7fb3d41561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.916+0000 7fb3dab70700 1 --2- 172.21.15.7:0/1306927752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d40cc2f0 0x7fb3d41561d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009fd0 tx=0x7fb3cc009900 comp rx=0 tx=0).stop 2023-10-06T10:59:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.916+0000 7fb3dab70700 1 -- 172.21.15.7:0/1306927752 shutdown_connections 2023-10-06T10:59:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.916+0000 7fb3dab70700 1 --2- 172.21.15.7:0/1306927752 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb3b8066f30 0x7fb3b80693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.916+0000 7fb3dab70700 1 --2- 172.21.15.7:0/1306927752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d40cc2f0 0x7fb3d41561d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.916+0000 7fb3dab70700 1 --2- 172.21.15.7:0/1306927752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3d40ca080 0x7fb3d40c2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.916+0000 7fb3dab70700 1 --2- 172.21.15.7:0/1306927752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb3d40cbf20 0x7fb3d40c14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.916+0000 7fb3dab70700 1 -- 172.21.15.7:0/1306927752 >> 172.21.15.7:0/1306927752 conn(0x7fb3d40afc90 msgr2=0x7fb3d4157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.916+0000 7fb3dab70700 1 -- 172.21.15.7:0/1306927752 shutdown_connections 2023-10-06T10:59:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:51.916+0000 7fb3dab70700 1 -- 172.21.15.7:0/1306927752 wait complete. 2023-10-06T10:59:51.931 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T10:59:52.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.064+0000 7fcd05a58700 1 Processor -- start 2023-10-06T10:59:52.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.064+0000 7fcd05a58700 1 -- start start 2023-10-06T10:59:52.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.065+0000 7fcd05a58700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd00159890 0x7fcd000cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.065+0000 7fcd05a58700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd000cf870 con 0x7fcd000af440 2023-10-06T10:59:52.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.065+0000 7fcd05a58700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd000cecf0 con 0x7fcd001594c0 2023-10-06T10:59:52.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.065+0000 7fcd05a58700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd000b1030 con 0x7fcd00159890 2023-10-06T10:59:52.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.065+0000 7fccfe7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcd000af440 0x7fcd000caff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47754/0 (socket says 172.21.15.7:47754) 2023-10-06T10:59:52.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.065+0000 7fccfe7fc700 1 -- 172.21.15.7:0/155512811 learned_addr learned my addr 172.21.15.7:0/155512811 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:52.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.065+0000 7fccff7fe700 1 --2- 172.21.15.7:0/155512811 >> v2:172.21.15.50:3300/0 conn(0x7fcd00159890 0x7fcd000cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.066+0000 7fccfdffb700 1 -- 172.21.15.7:0/155512811 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705088424 0 0) 0x7fcd000cf870 con 0x7fcd000af440 2023-10-06T10:59:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.066+0000 7fccfdffb700 1 -- 172.21.15.7:0/155512811 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce8003570 con 0x7fcd000af440 2023-10-06T10:59:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.066+0000 7fccff7fe700 1 -- 172.21.15.7:0/155512811 >> v1:172.21.15.50:6789/0 conn(0x7fcd001594c0 legacy=0x7fcd000aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.066+0000 7fccfdffb700 1 -- 172.21.15.7:0/155512811 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1925368361 0 0) 0x7fcce8003570 con 0x7fcd000af440 2023-10-06T10:59:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.066+0000 7fccff7fe700 1 -- 172.21.15.7:0/155512811 >> v1:172.21.15.7:6789/0 conn(0x7fcd000af440 legacy=0x7fcd000caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.066+0000 7fccff7fe700 1 -- 172.21.15.7:0/155512811 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd000cef40 con 0x7fcd00159890 2023-10-06T10:59:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.066+0000 7fccff7fe700 1 --2- 172.21.15.7:0/155512811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159890 0x7fcd000cb700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009e60 tx=0x7fccf8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a653d1b9f88f8591 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.066+0000 7fccfdffb700 1 -- 172.21.15.7:0/155512811 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf800e070 con 0x7fcd00159890 2023-10-06T10:59:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.066+0000 7fccfdffb700 1 -- 172.21.15.7:0/155512811 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf800b850 con 0x7fcd00159890 2023-10-06T10:59:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.066+0000 7fccfdffb700 1 -- 172.21.15.7:0/155512811 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0001470 con 0x7fcd00159890 2023-10-06T10:59:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.067+0000 7fcd05a58700 1 -- 172.21.15.7:0/155512811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159890 msgr2=0x7fcd000cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.067+0000 7fcd05a58700 1 --2- 172.21.15.7:0/155512811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159890 0x7fcd000cb700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009e60 tx=0x7fccf8009780 comp rx=0 tx=0).stop 2023-10-06T10:59:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.067+0000 7fcd05a58700 1 -- 172.21.15.7:0/155512811 shutdown_connections 2023-10-06T10:59:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.067+0000 7fcd05a58700 1 --2- 172.21.15.7:0/155512811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159890 0x7fcd000cb700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.067+0000 7fcd05a58700 1 -- 172.21.15.7:0/155512811 >> 172.21.15.7:0/155512811 conn(0x7fcd00067bc0 msgr2=0x7fcd000d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:52.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.067+0000 7fcd05a58700 1 -- 172.21.15.7:0/155512811 shutdown_connections 2023-10-06T10:59:52.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.067+0000 7fcd05a58700 1 -- 172.21.15.7:0/155512811 wait complete. 2023-10-06T10:59:52.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.068+0000 7fcd05a58700 1 Processor -- start 2023-10-06T10:59:52.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.068+0000 7fcd05a58700 1 -- start start 2023-10-06T10:59:52.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.069+0000 7fcd05a58700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd000af440 0x7fcd000b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.069+0000 7fcd05a58700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd001594c0 0x7fcd00143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.069+0000 7fcd05a58700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159890 0x7fcd000b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.069+0000 7fcd05a58700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000b5090 con 0x7fcd000af440 2023-10-06T10:59:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.069+0000 7fcd05a58700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd00154530 con 0x7fcd00159890 2023-10-06T10:59:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.069+0000 7fcd05a58700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000b4480 con 0x7fcd001594c0 2023-10-06T10:59:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.069+0000 7fccfeffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd000af440 0x7fcd000b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.069+0000 7fccfeffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd000af440 0x7fcd000b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35298/0 (socket says 172.21.15.7:35298) 2023-10-06T10:59:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.069+0000 7fccfeffd700 1 -- 172.21.15.7:0/1800109101 learned_addr learned my addr 172.21.15.7:0/1800109101 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.069+0000 7fccff7fe700 1 --2- 172.21.15.7:0/1800109101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159890 0x7fcd000b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.069+0000 7fccfe7fc700 1 --2- 172.21.15.7:0/1800109101 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd001594c0 0x7fcd00143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.070+0000 7fccfeffd700 1 -- 172.21.15.7:0/1800109101 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd001594c0 msgr2=0x7fcd00143cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.070+0000 7fccfeffd700 1 --2- 172.21.15.7:0/1800109101 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd001594c0 0x7fcd00143cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.070+0000 7fccfeffd700 1 -- 172.21.15.7:0/1800109101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159890 msgr2=0x7fcd000b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.070+0000 7fccfeffd700 1 --2- 172.21.15.7:0/1800109101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159890 0x7fcd000b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.070+0000 7fccfeffd700 1 -- 172.21.15.7:0/1800109101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8009a20 con 0x7fcd000af440 2023-10-06T10:59:52.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.070+0000 7fccfeffd700 1 --2- 172.21.15.7:0/1800109101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd000af440 0x7fcd000b5520 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fccf400c590 tx=0x7fccf400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:52.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.070+0000 7fcce6ffd700 1 -- 172.21.15.7:0/1800109101 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4011590 con 0x7fcd000af440 2023-10-06T10:59:52.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.070+0000 7fcce6ffd700 1 -- 172.21.15.7:0/1800109101 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4011710 con 0x7fcd000af440 2023-10-06T10:59:52.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.070+0000 7fcd05a58700 1 -- 172.21.15.7:0/1800109101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd000b4760 con 0x7fcd000af440 2023-10-06T10:59:52.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.070+0000 7fcce6ffd700 1 -- 172.21.15.7:0/1800109101 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4011ad0 con 0x7fcd000af440 2023-10-06T10:59:52.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.070+0000 7fcd05a58700 1 -- 172.21.15.7:0/1800109101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd000b4d20 con 0x7fcd000af440 2023-10-06T10:59:52.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.071+0000 7fcd05a58700 1 -- 172.21.15.7:0/1800109101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd000b5370 con 0x7fcd000af440 2023-10-06T10:59:52.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.072+0000 7fcce6ffd700 1 -- 172.21.15.7:0/1800109101 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fccf401b3b0 con 0x7fcd000af440 2023-10-06T10:59:52.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.072+0000 7fcce6ffd700 1 --2- 172.21.15.7:0/1800109101 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fccec066f30 0x7fccec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.072+0000 7fcce6ffd700 1 -- 172.21.15.7:0/1800109101 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fccf4083f00 con 0x7fcd000af440 2023-10-06T10:59:52.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.072+0000 7fccfe7fc700 1 --2- 172.21.15.7:0/1800109101 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fccec066f30 0x7fccec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.073+0000 7fccfe7fc700 1 --2- 172.21.15.7:0/1800109101 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fccec066f30 0x7fccec0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcd0016ce60 tx=0x7fccf0000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:52.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.077+0000 7fcce6ffd700 1 -- 172.21.15.7:0/1800109101 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccf4050ce0 con 0x7fcd000af440 2023-10-06T10:59:52.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.278+0000 7fcd05a58700 1 -- 172.21.15.7:0/1800109101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcd00070480 con 0x7fcd000af440 2023-10-06T10:59:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.279+0000 7fcce6ffd700 1 -- 172.21.15.7:0/1800109101 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fccf4017070 con 0x7fcd000af440 2023-10-06T10:59:52.281 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T10:59:52.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.281+0000 7fcd05a58700 1 -- 172.21.15.7:0/1800109101 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fccec066f30 msgr2=0x7fccec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.281+0000 7fcd05a58700 1 --2- 172.21.15.7:0/1800109101 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fccec066f30 0x7fccec0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcd0016ce60 tx=0x7fccf0000bc0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.281+0000 7fcd05a58700 1 -- 172.21.15.7:0/1800109101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd000af440 msgr2=0x7fcd000b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.281+0000 7fcd05a58700 1 --2- 172.21.15.7:0/1800109101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd000af440 0x7fcd000b5520 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fccf400c590 tx=0x7fccf400c8a0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.281+0000 7fcd05a58700 1 -- 172.21.15.7:0/1800109101 shutdown_connections 2023-10-06T10:59:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.281+0000 7fcd05a58700 1 --2- 172.21.15.7:0/1800109101 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fccec066f30 0x7fccec0693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.281+0000 7fcd05a58700 1 --2- 172.21.15.7:0/1800109101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd000af440 0x7fcd000b5520 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.281+0000 7fcd05a58700 1 --2- 172.21.15.7:0/1800109101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159890 0x7fcd000b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.281+0000 7fcd05a58700 1 --2- 172.21.15.7:0/1800109101 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd001594c0 0x7fcd00143cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.281+0000 7fcd05a58700 1 -- 172.21.15.7:0/1800109101 >> 172.21.15.7:0/1800109101 conn(0x7fcd00067bc0 msgr2=0x7fcd001586a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.282+0000 7fcd05a58700 1 -- 172.21.15.7:0/1800109101 shutdown_connections 2023-10-06T10:59:52.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.282+0000 7fcd05a58700 1 -- 172.21.15.7:0/1800109101 wait complete. 2023-10-06T10:59:52.297 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.427+0000 7f859fd6e700 1 Processor -- start 2023-10-06T10:59:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.428+0000 7f859fd6e700 1 -- start start 2023-10-06T10:59:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859fd6e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f85981590d0 0x7f8598069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859fd6e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f859806a0f0 0x7f859815ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859fd6e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f859815d350 0x7f8598067980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859fd6e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859815d7b0 con 0x7f85981590d0 2023-10-06T10:59:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859fd6e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85980694d0 con 0x7f859806a0f0 2023-10-06T10:59:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859fd6e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8598068ba0 con 0x7f859815d350 2023-10-06T10:59:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859db0a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f85981590d0 0x7f8598069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859db0a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f85981590d0 0x7f8598069bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35302/0 (socket says 172.21.15.7:35302) 2023-10-06T10:59:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859db0a700 1 -- 172.21.15.7:0/3893995083 learned_addr learned my addr 172.21.15.7:0/3893995083 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859d309700 1 --2- 172.21.15.7:0/3893995083 >> v2:172.21.15.50:3300/0 conn(0x7f859806a0f0 0x7f859815ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859e30b700 1 --2- 172.21.15.7:0/3893995083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f859815d350 0x7f8598067980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859db0a700 1 -- 172.21.15.7:0/3893995083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f859815d350 msgr2=0x7f8598067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859db0a700 1 --2- 172.21.15.7:0/3893995083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f859815d350 0x7f8598067980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859db0a700 1 -- 172.21.15.7:0/3893995083 >> v2:172.21.15.50:3300/0 conn(0x7f859806a0f0 msgr2=0x7f859815ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859db0a700 1 --2- 172.21.15.7:0/3893995083 >> v2:172.21.15.50:3300/0 conn(0x7f859806a0f0 0x7f859815ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859db0a700 1 -- 172.21.15.7:0/3893995083 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8598068e80 con 0x7f85981590d0 2023-10-06T10:59:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.429+0000 7f859db0a700 1 --2- 172.21.15.7:0/3893995083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85981590d0 0x7f8598069bb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f859806e180 tx=0x7f8594009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30074a8c9d4226ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.430+0000 7f859cb08700 1 -- 172.21.15.7:0/3893995083 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859400b860 con 0x7f85981590d0 2023-10-06T10:59:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.430+0000 7f859cb08700 1 -- 172.21.15.7:0/3893995083 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859400b9c0 con 0x7f85981590d0 2023-10-06T10:59:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.430+0000 7f859cb08700 1 -- 172.21.15.7:0/3893995083 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859400bd60 con 0x7f85981590d0 2023-10-06T10:59:52.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.430+0000 7f859fd6e700 1 -- 172.21.15.7:0/3893995083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85981590d0 msgr2=0x7f8598069bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.430+0000 7f859fd6e700 1 --2- 172.21.15.7:0/3893995083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85981590d0 0x7f8598069bb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f859806e180 tx=0x7f8594009250 comp rx=0 tx=0).stop 2023-10-06T10:59:52.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.430+0000 7f859fd6e700 1 -- 172.21.15.7:0/3893995083 shutdown_connections 2023-10-06T10:59:52.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.430+0000 7f859fd6e700 1 --2- 172.21.15.7:0/3893995083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f859815d350 0x7f8598067980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.430+0000 7f859fd6e700 1 --2- 172.21.15.7:0/3893995083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85981590d0 0x7f8598069bb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.430+0000 7f859fd6e700 1 --2- 172.21.15.7:0/3893995083 >> v2:172.21.15.50:3300/0 conn(0x7f859806a0f0 0x7f859815ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.430+0000 7f859fd6e700 1 -- 172.21.15.7:0/3893995083 >> 172.21.15.7:0/3893995083 conn(0x7f8598096160 msgr2=0x7f85980afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.430+0000 7f859fd6e700 1 -- 172.21.15.7:0/3893995083 shutdown_connections 2023-10-06T10:59:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.430+0000 7f859fd6e700 1 -- 172.21.15.7:0/3893995083 wait complete. 2023-10-06T10:59:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.431+0000 7f859fd6e700 1 Processor -- start 2023-10-06T10:59:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.432+0000 7f859fd6e700 1 -- start start 2023-10-06T10:59:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.432+0000 7f859fd6e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f859806a0f0 0x7f8598098be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.432+0000 7f859fd6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85981590d0 0x7f8598099bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.432+0000 7f859fd6e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f859815d350 0x7f859815a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.432+0000 7f859fd6e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859809a9c0 con 0x7f859815d350 2023-10-06T10:59:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.432+0000 7f859fd6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8598156360 con 0x7f85981590d0 2023-10-06T10:59:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.432+0000 7f859fd6e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859809a110 con 0x7f859806a0f0 2023-10-06T10:59:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.432+0000 7f859e30b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f859815d350 0x7f859815a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.432+0000 7f859e30b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f859815d350 0x7f859815a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35322/0 (socket says 172.21.15.7:35322) 2023-10-06T10:59:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.432+0000 7f859e30b700 1 -- 172.21.15.7:0/2253299160 learned_addr learned my addr 172.21.15.7:0/2253299160 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.433+0000 7f859db0a700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f859806a0f0 0x7f8598098be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.433+0000 7f859d309700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85981590d0 0x7f8598099bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.433+0000 7f859e30b700 1 -- 172.21.15.7:0/2253299160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f859806a0f0 msgr2=0x7f8598098be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.433+0000 7f859e30b700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f859806a0f0 0x7f8598098be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.433+0000 7f859e30b700 1 -- 172.21.15.7:0/2253299160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85981590d0 msgr2=0x7f8598099bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.433+0000 7f859e30b700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85981590d0 0x7f8598099bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.433+0000 7f859e30b700 1 -- 172.21.15.7:0/2253299160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85940094f0 con 0x7f859815d350 2023-10-06T10:59:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.433+0000 7f859d309700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85981590d0 0x7f8598099bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.433+0000 7f859e30b700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f859815d350 0x7f859815a130 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8590009fa0 tx=0x7f8590009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.433+0000 7f858dffb700 1 -- 172.21.15.7:0/2253299160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859000ec70 con 0x7f859815d350 2023-10-06T10:59:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.433+0000 7f858dffb700 1 -- 172.21.15.7:0/2253299160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859000edd0 con 0x7f859815d350 2023-10-06T10:59:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.433+0000 7f859fd6e700 1 -- 172.21.15.7:0/2253299160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8598155a50 con 0x7f859815d350 2023-10-06T10:59:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.433+0000 7f858dffb700 1 -- 172.21.15.7:0/2253299160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8590014670 con 0x7f859815d350 2023-10-06T10:59:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.433+0000 7f859fd6e700 1 -- 172.21.15.7:0/2253299160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8598155d90 con 0x7f859815d350 2023-10-06T10:59:52.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.435+0000 7f859fd6e700 1 -- 172.21.15.7:0/2253299160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8598070480 con 0x7f859815d350 2023-10-06T10:59:52.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.435+0000 7f858dffb700 1 -- 172.21.15.7:0/2253299160 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85900149e0 con 0x7f859815d350 2023-10-06T10:59:52.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.435+0000 7f858dffb700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f857c066f30 0x7f857c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.435+0000 7f858dffb700 1 -- 172.21.15.7:0/2253299160 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f8590085100 con 0x7f859815d350 2023-10-06T10:59:52.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.435+0000 7f859db0a700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f857c066f30 0x7f857c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.436+0000 7f859db0a700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f857c066f30 0x7f857c0693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f859806e180 tx=0x7f8594017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:52.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.440+0000 7f858dffb700 1 -- 172.21.15.7:0/2253299160 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8590051ee0 con 0x7f859815d350 2023-10-06T10:59:52.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.647+0000 7f859fd6e700 1 -- 172.21.15.7:0/2253299160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8598069160 con 0x7f859815d350 2023-10-06T10:59:52.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.648+0000 7f858dffb700 1 -- 172.21.15.7:0/2253299160 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18802 (secure 0 0 0) 0x7f8590055500 con 0x7f859815d350 2023-10-06T10:59:52.650 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:52.650 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:51.626116+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:52.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.650+0000 7f859fd6e700 1 -- 172.21.15.7:0/2253299160 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f857c066f30 msgr2=0x7f857c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.650+0000 7f859fd6e700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f857c066f30 0x7f857c0693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f859806e180 tx=0x7f8594017000 comp rx=0 tx=0).stop 2023-10-06T10:59:52.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.650+0000 7f859fd6e700 1 -- 172.21.15.7:0/2253299160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f859815d350 msgr2=0x7f859815a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.650+0000 7f859fd6e700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f859815d350 0x7f859815a130 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8590009fa0 tx=0x7f8590009900 comp rx=0 tx=0).stop 2023-10-06T10:59:52.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.650+0000 7f859fd6e700 1 -- 172.21.15.7:0/2253299160 shutdown_connections 2023-10-06T10:59:52.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.650+0000 7f859fd6e700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f857c066f30 0x7f857c0693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.650+0000 7f859fd6e700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f859815d350 0x7f859815a130 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.650+0000 7f859fd6e700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f859806a0f0 0x7f8598098be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.650+0000 7f859fd6e700 1 --2- 172.21.15.7:0/2253299160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85981590d0 0x7f8598099bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.650+0000 7f859fd6e700 1 -- 172.21.15.7:0/2253299160 >> 172.21.15.7:0/2253299160 conn(0x7f8598096160 msgr2=0x7f85980acb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:52.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.650+0000 7f859fd6e700 1 -- 172.21.15.7:0/2253299160 shutdown_connections 2023-10-06T10:59:52.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.650+0000 7f859fd6e700 1 -- 172.21.15.7:0/2253299160 wait complete. 2023-10-06T10:59:52.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T10:58:55.224661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T10:58:56.032929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T10:58:59.772827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T10:59:00.802230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T10:59:04.512252+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T10:59:52.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T10:59:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.801+0000 7fe664293700 1 Processor -- start 2023-10-06T10:59:52.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.801+0000 7fe664293700 1 -- start start 2023-10-06T10:59:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe664293700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe65c0a6d30 0x7fe65c0ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe664293700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe65c0acca0 0x7fe65c067ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe664293700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c06b1e0 con 0x7fe65c0aeb50 2023-10-06T10:59:52.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe664293700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65c06b4c0 con 0x7fe65c0a6d30 2023-10-06T10:59:52.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe664293700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65c06b7a0 con 0x7fe65c0acca0 2023-10-06T10:59:52.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe66202f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe65c0a6d30 0x7fe65c0ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe66202f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe65c0a6d30 0x7fe65c0ae610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35324/0 (socket says 172.21.15.7:35324) 2023-10-06T10:59:52.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe66202f700 1 -- 172.21.15.7:0/1217070998 learned_addr learned my addr 172.21.15.7:0/1217070998 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:52.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe662830700 1 --2- 172.21.15.7:0/1217070998 >> v2:172.21.15.50:3300/0 conn(0x7fe65c0acca0 0x7fe65c067ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe66202f700 1 -- 172.21.15.7:0/1217070998 >> v2:172.21.15.50:3300/0 conn(0x7fe65c0acca0 msgr2=0x7fe65c067ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:52.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe66202f700 1 --2- 172.21.15.7:0/1217070998 >> v2:172.21.15.50:3300/0 conn(0x7fe65c0acca0 0x7fe65c067ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe66202f700 1 -- 172.21.15.7:0/1217070998 >> v1:172.21.15.50:6789/0 conn(0x7fe65c0aeb50 legacy=0x7fe65c0ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe66202f700 1 -- 172.21.15.7:0/1217070998 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c06ba80 con 0x7fe65c0a6d30 2023-10-06T10:59:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe66202f700 1 --2- 172.21.15.7:0/1217070998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c0a6d30 0x7fe65c0ae610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe65c15cd50 tx=0x7fe658009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb6ca59f4655ddb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.802+0000 7fe66102d700 1 -- 172.21.15.7:0/1217070998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe658009e70 con 0x7fe65c0a6d30 2023-10-06T10:59:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.803+0000 7fe66102d700 1 -- 172.21.15.7:0/1217070998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65800b860 con 0x7fe65c0a6d30 2023-10-06T10:59:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.803+0000 7fe66102d700 1 -- 172.21.15.7:0/1217070998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65800bc00 con 0x7fe65c0a6d30 2023-10-06T10:59:52.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.803+0000 7fe664293700 1 -- 172.21.15.7:0/1217070998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c0a6d30 msgr2=0x7fe65c0ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.803+0000 7fe664293700 1 --2- 172.21.15.7:0/1217070998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c0a6d30 0x7fe65c0ae610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe65c15cd50 tx=0x7fe658009250 comp rx=0 tx=0).stop 2023-10-06T10:59:52.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.803+0000 7fe664293700 1 -- 172.21.15.7:0/1217070998 shutdown_connections 2023-10-06T10:59:52.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.803+0000 7fe664293700 1 --2- 172.21.15.7:0/1217070998 >> v2:172.21.15.50:3300/0 conn(0x7fe65c0acca0 0x7fe65c067ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.803+0000 7fe664293700 1 --2- 172.21.15.7:0/1217070998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c0a6d30 0x7fe65c0ae610 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.803+0000 7fe664293700 1 -- 172.21.15.7:0/1217070998 >> 172.21.15.7:0/1217070998 conn(0x7fe65c0cc560 msgr2=0x7fe65c0cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:52.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.803+0000 7fe664293700 1 -- 172.21.15.7:0/1217070998 shutdown_connections 2023-10-06T10:59:52.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.803+0000 7fe664293700 1 -- 172.21.15.7:0/1217070998 wait complete. 2023-10-06T10:59:52.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.805+0000 7fe664293700 1 Processor -- start 2023-10-06T10:59:52.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.805+0000 7fe664293700 1 -- start start 2023-10-06T10:59:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.806+0000 7fe664293700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe65c0a6d30 0x7fe65c0974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.806+0000 7fe664293700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe65c0acca0 0x7fe65c148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.806+0000 7fe664293700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c0aeb50 0x7fe65c095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.806+0000 7fe664293700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c096450 con 0x7fe65c0aeb50 2023-10-06T10:59:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.806+0000 7fe664293700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c096730 con 0x7fe65c0acca0 2023-10-06T10:59:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.806+0000 7fe664293700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c096a10 con 0x7fe65c0a6d30 2023-10-06T10:59:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.806+0000 7fe662830700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c0aeb50 0x7fe65c095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.806+0000 7fe662830700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c0aeb50 0x7fe65c095a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35332/0 (socket says 172.21.15.7:35332) 2023-10-06T10:59:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.806+0000 7fe662830700 1 -- 172.21.15.7:0/2767641247 learned_addr learned my addr 172.21.15.7:0/2767641247 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.806+0000 7fe66182e700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe65c0acca0 0x7fe65c148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.806+0000 7fe66202f700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe65c0a6d30 0x7fe65c0974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.807+0000 7fe662830700 1 -- 172.21.15.7:0/2767641247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe65c0a6d30 msgr2=0x7fe65c0974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.807+0000 7fe662830700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe65c0a6d30 0x7fe65c0974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.807+0000 7fe662830700 1 -- 172.21.15.7:0/2767641247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe65c0acca0 msgr2=0x7fe65c148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.807+0000 7fe662830700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe65c0acca0 0x7fe65c148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.807+0000 7fe662830700 1 -- 172.21.15.7:0/2767641247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6580094f0 con 0x7fe65c0aeb50 2023-10-06T10:59:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.807+0000 7fe66202f700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe65c0a6d30 0x7fe65c0974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.807+0000 7fe662830700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c0aeb50 0x7fe65c095a70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe654009ef0 tx=0x7fe65400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.807+0000 7fe64e7fc700 1 -- 172.21.15.7:0/2767641247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65400cc50 con 0x7fe65c0aeb50 2023-10-06T10:59:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.807+0000 7fe64e7fc700 1 -- 172.21.15.7:0/2767641247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65400f040 con 0x7fe65c0aeb50 2023-10-06T10:59:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.807+0000 7fe64e7fc700 1 -- 172.21.15.7:0/2767641247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe654014480 con 0x7fe65c0aeb50 2023-10-06T10:59:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.807+0000 7fe664293700 1 -- 172.21.15.7:0/2767641247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c096cf0 con 0x7fe65c0aeb50 2023-10-06T10:59:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.807+0000 7fe664293700 1 -- 172.21.15.7:0/2767641247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c097a30 con 0x7fe65c0aeb50 2023-10-06T10:59:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.808+0000 7fe664293700 1 -- 172.21.15.7:0/2767641247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65c070480 con 0x7fe65c0aeb50 2023-10-06T10:59:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.809+0000 7fe64e7fc700 1 -- 172.21.15.7:0/2767641247 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe654014830 con 0x7fe65c0aeb50 2023-10-06T10:59:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.809+0000 7fe64e7fc700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe640066f30 0x7fe6400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.809+0000 7fe64e7fc700 1 -- 172.21.15.7:0/2767641247 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fe654085d00 con 0x7fe65c0aeb50 2023-10-06T10:59:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.809+0000 7fe66202f700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe640066f30 0x7fe6400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.810+0000 7fe66202f700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe640066f30 0x7fe6400693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe65c15cd50 tx=0x7fe658017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:52.813+0000 7fe64e7fc700 1 -- 172.21.15.7:0/2767641247 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe654052b60 con 0x7fe65c0aeb50 2023-10-06T10:59:53.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.013+0000 7fe664293700 1 -- 172.21.15.7:0/2767641247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe65c06ad90 con 0x7fe65c0aeb50 2023-10-06T10:59:53.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.013+0000 7fe64e7fc700 1 -- 172.21.15.7:0/2767641247 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe6540180a0 con 0x7fe65c0aeb50 2023-10-06T10:59:53.015 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-10-06T10:59:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.015+0000 7fe664293700 1 -- 172.21.15.7:0/2767641247 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe640066f30 msgr2=0x7fe6400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.015+0000 7fe664293700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe640066f30 0x7fe6400693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe65c15cd50 tx=0x7fe658017000 comp rx=0 tx=0).stop 2023-10-06T10:59:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.015+0000 7fe664293700 1 -- 172.21.15.7:0/2767641247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c0aeb50 msgr2=0x7fe65c095a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.015+0000 7fe664293700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c0aeb50 0x7fe65c095a70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe654009ef0 tx=0x7fe65400b040 comp rx=0 tx=0).stop 2023-10-06T10:59:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.015+0000 7fe664293700 1 -- 172.21.15.7:0/2767641247 shutdown_connections 2023-10-06T10:59:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.015+0000 7fe664293700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe640066f30 0x7fe6400693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.015+0000 7fe664293700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c0aeb50 0x7fe65c095a70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.015+0000 7fe664293700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe65c0a6d30 0x7fe65c0974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.015+0000 7fe664293700 1 --2- 172.21.15.7:0/2767641247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe65c0acca0 0x7fe65c148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.015+0000 7fe664293700 1 -- 172.21.15.7:0/2767641247 >> 172.21.15.7:0/2767641247 conn(0x7fe65c0cc560 msgr2=0x7fe65c158a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:53.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.016+0000 7fe664293700 1 -- 172.21.15.7:0/2767641247 shutdown_connections 2023-10-06T10:59:53.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.016+0000 7fe664293700 1 -- 172.21.15.7:0/2767641247 wait complete. 2023-10-06T10:59:53.031 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T10:59:53.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.164+0000 7f72f619d700 1 Processor -- start 2023-10-06T10:59:53.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.164+0000 7f72f619d700 1 -- start start 2023-10-06T10:59:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.165+0000 7f72f619d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f72f00acca0 0x7f72f01641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.165+0000 7f72f619d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f006b1e0 con 0x7f72f00a7100 2023-10-06T10:59:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.165+0000 7f72f619d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f006b4c0 con 0x7f72f00a6d30 2023-10-06T10:59:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.165+0000 7f72f619d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f006b7a0 con 0x7f72f00acca0 2023-10-06T10:59:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.165+0000 7f72eeffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f72f00a7100 0x7f72f00ac590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47764/0 (socket says 172.21.15.7:47764) 2023-10-06T10:59:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.165+0000 7f72eeffd700 1 -- 172.21.15.7:0/264385387 learned_addr learned my addr 172.21.15.7:0/264385387 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.165+0000 7f72effff700 1 --2- 172.21.15.7:0/264385387 >> v2:172.21.15.50:3300/0 conn(0x7f72f00acca0 0x7f72f01641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.165+0000 7f72ee7fc700 1 -- 172.21.15.7:0/264385387 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222906046 0 0) 0x7f72f006b1e0 con 0x7f72f00a7100 2023-10-06T10:59:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.165+0000 7f72ee7fc700 1 -- 172.21.15.7:0/264385387 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72dc003570 con 0x7f72f00a7100 2023-10-06T10:59:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.166+0000 7f72effff700 1 -- 172.21.15.7:0/264385387 >> v1:172.21.15.50:6789/0 conn(0x7f72f00a6d30 legacy=0x7f72f00ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.166+0000 7f72effff700 1 -- 172.21.15.7:0/264385387 >> v1:172.21.15.7:6789/0 conn(0x7f72f00a7100 legacy=0x7f72f00ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.166+0000 7f72effff700 1 -- 172.21.15.7:0/264385387 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f006ba80 con 0x7f72f00acca0 2023-10-06T10:59:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.166+0000 7f72effff700 1 --2- 172.21.15.7:0/264385387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72f00acca0 0x7f72f01641b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009e60 tx=0x7f72e8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db9ce376c3c31728 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.166+0000 7f72ee7fc700 1 -- 172.21.15.7:0/264385387 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e800e070 con 0x7f72f00acca0 2023-10-06T10:59:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.166+0000 7f72ee7fc700 1 -- 172.21.15.7:0/264385387 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e800bb60 con 0x7f72f00acca0 2023-10-06T10:59:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.166+0000 7f72ee7fc700 1 -- 172.21.15.7:0/264385387 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8012430 con 0x7f72f00acca0 2023-10-06T10:59:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.167+0000 7f72f619d700 1 -- 172.21.15.7:0/264385387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72f00acca0 msgr2=0x7f72f01641b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.167+0000 7f72f619d700 1 --2- 172.21.15.7:0/264385387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72f00acca0 0x7f72f01641b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009e60 tx=0x7f72e8009780 comp rx=0 tx=0).stop 2023-10-06T10:59:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.167+0000 7f72f619d700 1 -- 172.21.15.7:0/264385387 shutdown_connections 2023-10-06T10:59:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.167+0000 7f72f619d700 1 --2- 172.21.15.7:0/264385387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72f00acca0 0x7f72f01641b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.167+0000 7f72f619d700 1 -- 172.21.15.7:0/264385387 >> 172.21.15.7:0/264385387 conn(0x7f72f00cc560 msgr2=0x7f72f00cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:53.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.167+0000 7f72f619d700 1 -- 172.21.15.7:0/264385387 shutdown_connections 2023-10-06T10:59:53.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.167+0000 7f72f619d700 1 -- 172.21.15.7:0/264385387 wait complete. 2023-10-06T10:59:53.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.168+0000 7f72f619d700 1 Processor -- start 2023-10-06T10:59:53.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.168+0000 7f72f619d700 1 -- start start 2023-10-06T10:59:53.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72f619d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72f00a6d30 0x7f72f014e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72f619d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f72f00a7100 0x7f72f00679f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72f619d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72f00acca0 0x7f72f0067f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72f619d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f016d800 con 0x7f72f00acca0 2023-10-06T10:59:53.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72f619d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f016da50 con 0x7f72f00a6d30 2023-10-06T10:59:53.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72f619d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f016dd30 con 0x7f72f00a7100 2023-10-06T10:59:53.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72effff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72f00acca0 0x7f72f0067f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72effff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72f00acca0 0x7f72f0067f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35342/0 (socket says 172.21.15.7:35342) 2023-10-06T10:59:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72effff700 1 -- 172.21.15.7:0/35611531 learned_addr learned my addr 172.21.15.7:0/35611531 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72eeffd700 1 --2- 172.21.15.7:0/35611531 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f72f00a7100 0x7f72f00679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72ef7fe700 1 --2- 172.21.15.7:0/35611531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72f00a6d30 0x7f72f014e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72effff700 1 -- 172.21.15.7:0/35611531 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f72f00a7100 msgr2=0x7f72f00679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72effff700 1 --2- 172.21.15.7:0/35611531 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f72f00a7100 0x7f72f00679f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72effff700 1 -- 172.21.15.7:0/35611531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72f00a6d30 msgr2=0x7f72f014e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72effff700 1 --2- 172.21.15.7:0/35611531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72f00a6d30 0x7f72f014e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.169+0000 7f72effff700 1 -- 172.21.15.7:0/35611531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8009a20 con 0x7f72f00acca0 2023-10-06T10:59:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.170+0000 7f72effff700 1 --2- 172.21.15.7:0/35611531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72f00acca0 0x7f72f0067f30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f72e8013000 tx=0x7f72e8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.170+0000 7f72e77fe700 1 -- 172.21.15.7:0/35611531 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8027470 con 0x7f72f00acca0 2023-10-06T10:59:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.170+0000 7f72e77fe700 1 -- 172.21.15.7:0/35611531 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e80275d0 con 0x7f72f00acca0 2023-10-06T10:59:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.170+0000 7f72f619d700 1 -- 172.21.15.7:0/35611531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f016e010 con 0x7f72f00acca0 2023-10-06T10:59:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.170+0000 7f72e77fe700 1 -- 172.21.15.7:0/35611531 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8027990 con 0x7f72f00acca0 2023-10-06T10:59:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.170+0000 7f72f619d700 1 -- 172.21.15.7:0/35611531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f0095a70 con 0x7f72f00acca0 2023-10-06T10:59:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.171+0000 7f72f619d700 1 -- 172.21.15.7:0/35611531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f016e530 con 0x7f72f00acca0 2023-10-06T10:59:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.171+0000 7f72e77fe700 1 -- 172.21.15.7:0/35611531 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72e8024070 con 0x7f72f00acca0 2023-10-06T10:59:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.172+0000 7f72e77fe700 1 --2- 172.21.15.7:0/35611531 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f72d0066f30 0x7f72d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.172+0000 7f72e77fe700 1 -- 172.21.15.7:0/35611531 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f72e80872b0 con 0x7f72f00acca0 2023-10-06T10:59:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.172+0000 7f72ef7fe700 1 --2- 172.21.15.7:0/35611531 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f72d0066f30 0x7f72d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.172+0000 7f72ef7fe700 1 --2- 172.21.15.7:0/35611531 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f72d0066f30 0x7f72d00693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f72f00686b0 tx=0x7f72e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.176+0000 7f72e77fe700 1 -- 172.21.15.7:0/35611531 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72f016e530 con 0x7f72f00acca0 2023-10-06T10:59:53.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.379+0000 7f72f619d700 1 -- 172.21.15.7:0/35611531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72f016e530 con 0x7f72f00acca0 2023-10-06T10:59:53.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.379+0000 7f72e77fe700 1 -- 172.21.15.7:0/35611531 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72f016e530 con 0x7f72f00acca0 2023-10-06T10:59:53.381 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-06T10:59:53.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.381+0000 7f72f619d700 1 -- 172.21.15.7:0/35611531 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f72d0066f30 msgr2=0x7f72d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.381+0000 7f72f619d700 1 --2- 172.21.15.7:0/35611531 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f72d0066f30 0x7f72d00693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f72f00686b0 tx=0x7f72e0009040 comp rx=0 tx=0).stop 2023-10-06T10:59:53.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.381+0000 7f72f619d700 1 -- 172.21.15.7:0/35611531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72f00acca0 msgr2=0x7f72f0067f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.381+0000 7f72f619d700 1 --2- 172.21.15.7:0/35611531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72f00acca0 0x7f72f0067f30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f72e8013000 tx=0x7f72e8019000 comp rx=0 tx=0).stop 2023-10-06T10:59:53.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.382+0000 7f72f619d700 1 -- 172.21.15.7:0/35611531 shutdown_connections 2023-10-06T10:59:53.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.382+0000 7f72f619d700 1 --2- 172.21.15.7:0/35611531 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f72d0066f30 0x7f72d00693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.382+0000 7f72f619d700 1 --2- 172.21.15.7:0/35611531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72f00acca0 0x7f72f0067f30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.382+0000 7f72f619d700 1 --2- 172.21.15.7:0/35611531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72f00a6d30 0x7f72f014e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.382+0000 7f72f619d700 1 --2- 172.21.15.7:0/35611531 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f72f00a7100 0x7f72f00679f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.382+0000 7f72f619d700 1 -- 172.21.15.7:0/35611531 >> 172.21.15.7:0/35611531 conn(0x7f72f00cc560 msgr2=0x7f72f01588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:53.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.382+0000 7f72f619d700 1 -- 172.21.15.7:0/35611531 shutdown_connections 2023-10-06T10:59:53.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.382+0000 7f72f619d700 1 -- 172.21.15.7:0/35611531 wait complete. 2023-10-06T10:59:53.397 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T10:59:53.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.530+0000 7f21e2737700 1 Processor -- start 2023-10-06T10:59:53.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.531+0000 7f21e2737700 1 -- start start 2023-10-06T10:59:53.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.531+0000 7f21e2737700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21dc0ae430 0x7f21dc0b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.531+0000 7f21e2737700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21dc0b0540 0x7f21dc06c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.531+0000 7f21e2737700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21dc06cb90 con 0x7f21dc06c770 2023-10-06T10:59:53.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.531+0000 7f21e2737700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21dc0af590 con 0x7f21dc0b0540 2023-10-06T10:59:53.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.531+0000 7f21e2737700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc15bc60 con 0x7f21dc0ae430 2023-10-06T10:59:53.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21e0cd4700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f21dc06c770 0x7f21dc06db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47780/0 (socket says 172.21.15.7:47780) 2023-10-06T10:59:53.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21e0cd4700 1 -- 172.21.15.7:0/680862331 learned_addr learned my addr 172.21.15.7:0/680862331 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:53.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21dbfff700 1 --2- 172.21.15.7:0/680862331 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21dc0ae430 0x7f21dc0b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21db7fe700 1 --2- 172.21.15.7:0/680862331 >> v2:172.21.15.50:3300/0 conn(0x7f21dc0b0540 0x7f21dc06c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 -- 172.21.15.7:0/680862331 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428645813 0 0) 0x7f21dc06cb90 con 0x7f21dc06c770 2023-10-06T10:59:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 -- 172.21.15.7:0/680862331 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21c4003570 con 0x7f21dc06c770 2023-10-06T10:59:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 -- 172.21.15.7:0/680862331 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2460412149 0 0) 0x7f21c4003570 con 0x7f21dc06c770 2023-10-06T10:59:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 -- 172.21.15.7:0/680862331 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21dc0ae430 msgr2=0x7f21dc0b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 --2- 172.21.15.7:0/680862331 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21dc0ae430 0x7f21dc0b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 -- 172.21.15.7:0/680862331 >> v2:172.21.15.50:3300/0 conn(0x7f21dc0b0540 msgr2=0x7f21dc06c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 --2- 172.21.15.7:0/680862331 >> v2:172.21.15.50:3300/0 conn(0x7f21dc0b0540 0x7f21dc06c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 -- 172.21.15.7:0/680862331 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc15b050 con 0x7f21dc06c770 2023-10-06T10:59:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 -- 172.21.15.7:0/680862331 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f21d40017f0 con 0x7f21dc06c770 2023-10-06T10:59:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21db7fe700 1 --2- 172.21.15.7:0/680862331 >> v2:172.21.15.50:3300/0 conn(0x7f21dc0b0540 0x7f21dc06c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:59:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21dbfff700 1 --2- 172.21.15.7:0/680862331 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21dc0ae430 0x7f21dc0b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:59:53.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 -- 172.21.15.7:0/680862331 >> v1:172.21.15.7:6789/0 conn(0x7f21dc06c770 legacy=0x7f21dc06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 --2- 172.21.15.7:0/680862331 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21dc0ae430 0x7f21c4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 --2- 172.21.15.7:0/680862331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21c4003fa0 0x7f21c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 --2- 172.21.15.7:0/680862331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4004d50 0x7f21c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 -- 172.21.15.7:0/680862331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc0af590 con 0x7f21c4004d50 2023-10-06T10:59:53.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 -- 172.21.15.7:0/680862331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc15bc60 con 0x7f21c4003fa0 2023-10-06T10:59:53.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21daffd700 1 -- 172.21.15.7:0/680862331 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c400ba60 con 0x7f21dc0ae430 2023-10-06T10:59:53.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.532+0000 7f21e0cd4700 1 --2- 172.21.15.7:0/680862331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4004d50 0x7f21c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.533+0000 7f21dbfff700 1 --2- 172.21.15.7:0/680862331 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21dc0ae430 0x7f21c4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.533+0000 7f21db7fe700 1 --2- 172.21.15.7:0/680862331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21c4003fa0 0x7f21c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.533+0000 7f21e0cd4700 1 -- 172.21.15.7:0/680862331 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21dc0ae430 msgr2=0x7f21c4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.533+0000 7f21e0cd4700 1 --2- 172.21.15.7:0/680862331 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21dc0ae430 0x7f21c4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.533+0000 7f21e0cd4700 1 -- 172.21.15.7:0/680862331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21c4003fa0 msgr2=0x7f21c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.533+0000 7f21e0cd4700 1 --2- 172.21.15.7:0/680862331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21c4003fa0 0x7f21c4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.533+0000 7f21e0cd4700 1 -- 172.21.15.7:0/680862331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc009420 con 0x7f21c4004d50 2023-10-06T10:59:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.533+0000 7f21e0cd4700 1 --2- 172.21.15.7:0/680862331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4004d50 0x7f21c40051c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f21d400a970 tx=0x7f21d4002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2165c3b4bab8d81 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.533+0000 7f21daffd700 1 -- 172.21.15.7:0/680862331 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d40070d0 con 0x7f21c4004d50 2023-10-06T10:59:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.533+0000 7f21daffd700 1 -- 172.21.15.7:0/680862331 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d4007270 con 0x7f21c4004d50 2023-10-06T10:59:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.533+0000 7f21daffd700 1 -- 172.21.15.7:0/680862331 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4007630 con 0x7f21c4004d50 2023-10-06T10:59:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.534+0000 7f21e2737700 1 -- 172.21.15.7:0/680862331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4004d50 msgr2=0x7f21c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.534+0000 7f21e2737700 1 --2- 172.21.15.7:0/680862331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4004d50 0x7f21c40051c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f21d400a970 tx=0x7f21d4002210 comp rx=0 tx=0).stop 2023-10-06T10:59:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.534+0000 7f21e0cd4700 1 -- 172.21.15.7:0/680862331 reap_dead start 2023-10-06T10:59:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.534+0000 7f21e2737700 1 -- 172.21.15.7:0/680862331 shutdown_connections 2023-10-06T10:59:53.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.534+0000 7f21e2737700 1 -- 172.21.15.7:0/680862331 >> 172.21.15.7:0/680862331 conn(0x7f21dc0cded0 msgr2=0x7f21dc0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:53.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.534+0000 7f21e2737700 1 -- 172.21.15.7:0/680862331 shutdown_connections 2023-10-06T10:59:53.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.534+0000 7f21e2737700 1 -- 172.21.15.7:0/680862331 wait complete. 2023-10-06T10:59:53.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.535+0000 7f21e2737700 1 Processor -- start 2023-10-06T10:59:53.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.535+0000 7f21e2737700 1 -- start start 2023-10-06T10:59:53.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21e2737700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc16c3c0 0x7f21dc16a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21e2737700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21dc16c790 0x7f21dc0c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21e2737700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21dc0b2a90 0x7f21dc0b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21e2737700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc0b3430 con 0x7f21dc16c3c0 2023-10-06T10:59:53.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21e2737700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc0c4680 con 0x7f21dc16c790 2023-10-06T10:59:53.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21e2737700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc0c37b0 con 0x7f21dc0b2a90 2023-10-06T10:59:53.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21dbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc16c3c0 0x7f21dc16a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21dbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc16c3c0 0x7f21dc16a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35356/0 (socket says 172.21.15.7:35356) 2023-10-06T10:59:53.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21dbfff700 1 -- 172.21.15.7:0/3039783048 learned_addr learned my addr 172.21.15.7:0/3039783048 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:53.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21e0cd4700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21dc0b2a90 0x7f21dc0b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21db7fe700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21dc16c790 0x7f21dc0c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21dbfff700 1 -- 172.21.15.7:0/3039783048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21dc0b2a90 msgr2=0x7f21dc0b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21dbfff700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21dc0b2a90 0x7f21dc0b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21dbfff700 1 -- 172.21.15.7:0/3039783048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21dc16c790 msgr2=0x7f21dc0c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21dbfff700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21dc16c790 0x7f21dc0c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.536+0000 7f21dbfff700 1 -- 172.21.15.7:0/3039783048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc0c3a70 con 0x7f21dc16c3c0 2023-10-06T10:59:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.537+0000 7f21db7fe700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21dc16c790 0x7f21dc0c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T10:59:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.537+0000 7f21dbfff700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc16c3c0 0x7f21dc16a0c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f21cc011d70 tx=0x7f21cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.537+0000 7f21c3fff700 1 -- 172.21.15.7:0/3039783048 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc00fcd0 con 0x7f21dc16c3c0 2023-10-06T10:59:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.537+0000 7f21c3fff700 1 -- 172.21.15.7:0/3039783048 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21cc00fe30 con 0x7f21dc16c3c0 2023-10-06T10:59:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.537+0000 7f21c3fff700 1 -- 172.21.15.7:0/3039783048 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc01d6b0 con 0x7f21dc16c3c0 2023-10-06T10:59:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.537+0000 7f21e2737700 1 -- 172.21.15.7:0/3039783048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21dc0c3d50 con 0x7f21dc16c3c0 2023-10-06T10:59:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.537+0000 7f21e2737700 1 -- 172.21.15.7:0/3039783048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21dc0c4310 con 0x7f21dc16c3c0 2023-10-06T10:59:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.538+0000 7f21e2737700 1 -- 172.21.15.7:0/3039783048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21dc070480 con 0x7f21dc16c3c0 2023-10-06T10:59:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.538+0000 7f21c3fff700 1 -- 172.21.15.7:0/3039783048 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21cc01daa0 con 0x7f21dc16c3c0 2023-10-06T10:59:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.539+0000 7f21c3fff700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f21c8066f30 0x7f21c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.539+0000 7f21c3fff700 1 -- 172.21.15.7:0/3039783048 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f21cc018070 con 0x7f21dc16c3c0 2023-10-06T10:59:53.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.539+0000 7f21db7fe700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f21c8066f30 0x7f21c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.539+0000 7f21db7fe700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f21c8066f30 0x7f21c80693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0c3060 tx=0x7f21d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:53.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.544+0000 7f21c3fff700 1 -- 172.21.15.7:0/3039783048 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21cc0526f0 con 0x7f21dc16c3c0 2023-10-06T10:59:53.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.748+0000 7f21e2737700 1 -- 172.21.15.7:0/3039783048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21dc15ad90 con 0x7f21dc16c3c0 2023-10-06T10:59:53.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.748+0000 7f21c3fff700 1 -- 172.21.15.7:0/3039783048 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21cc055d10 con 0x7f21dc16c3c0 2023-10-06T10:59:53.750 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T10:59:53.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.750+0000 7f21e2737700 1 -- 172.21.15.7:0/3039783048 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f21c8066f30 msgr2=0x7f21c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.750+0000 7f21e2737700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f21c8066f30 0x7f21c80693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0c3060 tx=0x7f21d0008040 comp rx=0 tx=0).stop 2023-10-06T10:59:53.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.750+0000 7f21e2737700 1 -- 172.21.15.7:0/3039783048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc16c3c0 msgr2=0x7f21dc16a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.750+0000 7f21e2737700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc16c3c0 0x7f21dc16a0c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f21cc011d70 tx=0x7f21cc0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.750+0000 7f21e2737700 1 -- 172.21.15.7:0/3039783048 shutdown_connections 2023-10-06T10:59:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.750+0000 7f21e2737700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f21c8066f30 0x7f21c80693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.750+0000 7f21e2737700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc16c3c0 0x7f21dc16a0c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.750+0000 7f21e2737700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21dc0b2a90 0x7f21dc0b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.750+0000 7f21e2737700 1 --2- 172.21.15.7:0/3039783048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21dc16c790 0x7f21dc0c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.750+0000 7f21e2737700 1 -- 172.21.15.7:0/3039783048 >> 172.21.15.7:0/3039783048 conn(0x7f21dc0cded0 msgr2=0x7f21dc0c8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.750+0000 7f21e2737700 1 -- 172.21.15.7:0/3039783048 shutdown_connections 2023-10-06T10:59:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.750+0000 7f21e2737700 1 -- 172.21.15.7:0/3039783048 wait complete. 2023-10-06T10:59:53.765 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T10:59:53.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.898+0000 7f21c2551700 1 Processor -- start 2023-10-06T10:59:53.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.898+0000 7f21c2551700 1 -- start start 2023-10-06T10:59:53.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.899+0000 7f21c2551700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21bc06c480 0x7f21bc0c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.899+0000 7f21c2551700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21bc06c850 0x7f21bc158d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.899+0000 7f21c2551700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21bc1592b0 0x7f21bc0690f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.899+0000 7f21c2551700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc0c8510 con 0x7f21bc06c480 2023-10-06T10:59:53.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.899+0000 7f21c2551700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc069e20 con 0x7f21bc1592b0 2023-10-06T10:59:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.899+0000 7f21c2551700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0c87b0 con 0x7f21bc06c850 2023-10-06T10:59:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.900+0000 7f21bbfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21bc06c480 0x7f21bc0c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.900+0000 7f21bbfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21bc06c480 0x7f21bc0c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35358/0 (socket says 172.21.15.7:35358) 2023-10-06T10:59:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.900+0000 7f21bbfff700 1 -- 172.21.15.7:0/1176533927 learned_addr learned my addr 172.21.15.7:0/1176533927 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.900+0000 7f21c0aee700 1 --2- 172.21.15.7:0/1176533927 >> v2:172.21.15.50:3300/0 conn(0x7f21bc1592b0 0x7f21bc0690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.900+0000 7f21bb7fe700 1 --2- 172.21.15.7:0/1176533927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21bc06c850 0x7f21bc158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.900+0000 7f21bbfff700 1 -- 172.21.15.7:0/1176533927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21bc06c850 msgr2=0x7f21bc158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.900+0000 7f21bbfff700 1 --2- 172.21.15.7:0/1176533927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21bc06c850 0x7f21bc158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.900+0000 7f21bbfff700 1 -- 172.21.15.7:0/1176533927 >> v2:172.21.15.50:3300/0 conn(0x7f21bc1592b0 msgr2=0x7f21bc0690f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.900+0000 7f21bbfff700 1 --2- 172.21.15.7:0/1176533927 >> v2:172.21.15.50:3300/0 conn(0x7f21bc1592b0 0x7f21bc0690f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.900+0000 7f21bbfff700 1 -- 172.21.15.7:0/1176533927 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc0c8a90 con 0x7f21bc06c480 2023-10-06T10:59:53.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.900+0000 7f21bbfff700 1 --2- 172.21.15.7:0/1176533927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21bc06c480 0x7f21bc0c8fb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f21bc087200 tx=0x7f21ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725e2765bd62530b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:53.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.900+0000 7f21baffd700 1 -- 172.21.15.7:0/1176533927 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00b640 con 0x7f21bc06c480 2023-10-06T10:59:53.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.900+0000 7f21baffd700 1 -- 172.21.15.7:0/1176533927 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac00b7a0 con 0x7f21bc06c480 2023-10-06T10:59:53.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.900+0000 7f21baffd700 1 -- 172.21.15.7:0/1176533927 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00bb60 con 0x7f21bc06c480 2023-10-06T10:59:53.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.901+0000 7f21c2551700 1 -- 172.21.15.7:0/1176533927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21bc06c480 msgr2=0x7f21bc0c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.901+0000 7f21c2551700 1 --2- 172.21.15.7:0/1176533927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21bc06c480 0x7f21bc0c8fb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f21bc087200 tx=0x7f21ac009250 comp rx=0 tx=0).stop 2023-10-06T10:59:53.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.901+0000 7f21c2551700 1 -- 172.21.15.7:0/1176533927 shutdown_connections 2023-10-06T10:59:53.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.901+0000 7f21c2551700 1 --2- 172.21.15.7:0/1176533927 >> v2:172.21.15.50:3300/0 conn(0x7f21bc1592b0 0x7f21bc0690f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.901+0000 7f21c2551700 1 --2- 172.21.15.7:0/1176533927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21bc06c480 0x7f21bc0c8fb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.901+0000 7f21c2551700 1 --2- 172.21.15.7:0/1176533927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21bc06c850 0x7f21bc158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.901+0000 7f21c2551700 1 -- 172.21.15.7:0/1176533927 >> 172.21.15.7:0/1176533927 conn(0x7f21bc0cded0 msgr2=0x7f21bc0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:53.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.901+0000 7f21c2551700 1 -- 172.21.15.7:0/1176533927 shutdown_connections 2023-10-06T10:59:53.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.901+0000 7f21c2551700 1 -- 172.21.15.7:0/1176533927 wait complete. 2023-10-06T10:59:53.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.902+0000 7f21c2551700 1 Processor -- start 2023-10-06T10:59:53.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.902+0000 7f21c2551700 1 -- start start 2023-10-06T10:59:53.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.903+0000 7f21c2551700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21bc06c480 0x7f21bc0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.903+0000 7f21c2551700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21bc06c850 0x7f21bc0c1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.903+0000 7f21c2551700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21bc1592b0 0x7f21bc1694c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.903+0000 7f21c2551700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc169ff0 con 0x7f21bc06c850 2023-10-06T10:59:53.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.903+0000 7f21c2551700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc16a2d0 con 0x7f21bc06c480 2023-10-06T10:59:53.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.903+0000 7f21c2551700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0c6090 con 0x7f21bc1592b0 2023-10-06T10:59:53.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.903+0000 7f21bb7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21bc06c850 0x7f21bc0c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.903+0000 7f21bb7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21bc06c850 0x7f21bc0c1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35368/0 (socket says 172.21.15.7:35368) 2023-10-06T10:59:53.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.903+0000 7f21bb7fe700 1 -- 172.21.15.7:0/871337613 learned_addr learned my addr 172.21.15.7:0/871337613 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:53.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.903+0000 7f21c0aee700 1 --2- 172.21.15.7:0/871337613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21bc1592b0 0x7f21bc1694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.904+0000 7f21bbfff700 1 --2- 172.21.15.7:0/871337613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21bc06c480 0x7f21bc0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.904+0000 7f21bb7fe700 1 -- 172.21.15.7:0/871337613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21bc1592b0 msgr2=0x7f21bc1694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.904+0000 7f21bb7fe700 1 --2- 172.21.15.7:0/871337613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21bc1592b0 0x7f21bc1694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.904+0000 7f21bb7fe700 1 -- 172.21.15.7:0/871337613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21bc06c480 msgr2=0x7f21bc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:53.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.904+0000 7f21bb7fe700 1 --2- 172.21.15.7:0/871337613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21bc06c480 0x7f21bc0b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:53.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.904+0000 7f21bb7fe700 1 -- 172.21.15.7:0/871337613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac0094f0 con 0x7f21bc06c850 2023-10-06T10:59:53.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.904+0000 7f21bb7fe700 1 --2- 172.21.15.7:0/871337613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21bc06c850 0x7f21bc0c1930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21b000ec80 tx=0x7f21b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:53.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.904+0000 7f21a3fff700 1 -- 172.21.15.7:0/871337613 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000c9d0 con 0x7f21bc06c850 2023-10-06T10:59:53.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.904+0000 7f21a3fff700 1 -- 172.21.15.7:0/871337613 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b000cb30 con 0x7f21bc06c850 2023-10-06T10:59:53.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.904+0000 7f21c2551700 1 -- 172.21.15.7:0/871337613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21bc0c6370 con 0x7f21bc06c850 2023-10-06T10:59:53.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.904+0000 7f21a3fff700 1 -- 172.21.15.7:0/871337613 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0013470 con 0x7f21bc06c850 2023-10-06T10:59:53.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.904+0000 7f21c2551700 1 -- 172.21.15.7:0/871337613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21bc0c5d40 con 0x7f21bc06c850 2023-10-06T10:59:53.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.905+0000 7f21c2551700 1 -- 172.21.15.7:0/871337613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21bc070480 con 0x7f21bc06c850 2023-10-06T10:59:53.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.906+0000 7f21a3fff700 1 -- 172.21.15.7:0/871337613 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21b0013820 con 0x7f21bc06c850 2023-10-06T10:59:53.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.906+0000 7f21a3fff700 1 --2- 172.21.15.7:0/871337613 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f21a8066f30 0x7f21a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:53.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.906+0000 7f21bbfff700 1 --2- 172.21.15.7:0/871337613 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f21a8066f30 0x7f21a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:53.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.906+0000 7f21a3fff700 1 -- 172.21.15.7:0/871337613 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f21b0084d50 con 0x7f21bc06c850 2023-10-06T10:59:53.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.907+0000 7f21bbfff700 1 --2- 172.21.15.7:0/871337613 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f21a8066f30 0x7f21a80693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21bc087200 tx=0x7f21ac017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:53.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:53.911+0000 7f21a3fff700 1 -- 172.21.15.7:0/871337613 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21b0088030 con 0x7f21bc06c850 2023-10-06T10:59:54.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.113+0000 7f21c2551700 1 -- 172.21.15.7:0/871337613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21bc068c00 con 0x7f21bc06c850 2023-10-06T10:59:54.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.114+0000 7f21a3fff700 1 -- 172.21.15.7:0/871337613 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f21b0051b30 con 0x7f21bc06c850 2023-10-06T10:59:54.116 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-06T10:59:54.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.116+0000 7f21c2551700 1 -- 172.21.15.7:0/871337613 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f21a8066f30 msgr2=0x7f21a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:54.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.116+0000 7f21c2551700 1 --2- 172.21.15.7:0/871337613 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f21a8066f30 0x7f21a80693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21bc087200 tx=0x7f21ac017000 comp rx=0 tx=0).stop 2023-10-06T10:59:54.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.116+0000 7f21c2551700 1 -- 172.21.15.7:0/871337613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21bc06c850 msgr2=0x7f21bc0c1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:54.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.116+0000 7f21c2551700 1 --2- 172.21.15.7:0/871337613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21bc06c850 0x7f21bc0c1930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21b000ec80 tx=0x7f21b00091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.116+0000 7f21c2551700 1 -- 172.21.15.7:0/871337613 shutdown_connections 2023-10-06T10:59:54.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.116+0000 7f21c2551700 1 --2- 172.21.15.7:0/871337613 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f21a8066f30 0x7f21a80693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.116+0000 7f21c2551700 1 --2- 172.21.15.7:0/871337613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21bc1592b0 0x7f21bc1694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.116+0000 7f21c2551700 1 --2- 172.21.15.7:0/871337613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21bc06c480 0x7f21bc0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.116+0000 7f21c2551700 1 --2- 172.21.15.7:0/871337613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21bc06c850 0x7f21bc0c1930 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.116+0000 7f21c2551700 1 -- 172.21.15.7:0/871337613 >> 172.21.15.7:0/871337613 conn(0x7f21bc0cded0 msgr2=0x7f21bc0adc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:54.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.116+0000 7f21c2551700 1 -- 172.21.15.7:0/871337613 shutdown_connections 2023-10-06T10:59:54.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.116+0000 7f21c2551700 1 -- 172.21.15.7:0/871337613 wait complete. 2023-10-06T10:59:54.131 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T10:59:54.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.264+0000 7f1e8e05c700 1 Processor -- start 2023-10-06T10:59:54.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.264+0000 7f1e8e05c700 1 -- start start 2023-10-06T10:59:54.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.264+0000 7f1e8e05c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1e88069150 0x7f1e880aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:54.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.265+0000 7f1e8e05c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880afa10 con 0x7f1e880af220 2023-10-06T10:59:54.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.265+0000 7f1e8e05c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880afdc0 con 0x7f1e88069520 2023-10-06T10:59:54.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.265+0000 7f1e8e05c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e880af730 con 0x7f1e88069150 2023-10-06T10:59:54.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.265+0000 7f1e877fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1e88069150 0x7f1e880aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:54.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.265+0000 7f1e86ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1e880af220 0x7f1e88158fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47794/0 (socket says 172.21.15.7:47794) 2023-10-06T10:59:54.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.265+0000 7f1e86ffd700 1 -- 172.21.15.7:0/882245569 learned_addr learned my addr 172.21.15.7:0/882245569 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:54.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.265+0000 7f1e877fe700 1 -- 172.21.15.7:0/882245569 >> v1:172.21.15.50:6789/0 conn(0x7f1e88069520 legacy=0x7f1e880ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:54.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.265+0000 7f1e877fe700 1 -- 172.21.15.7:0/882245569 >> v1:172.21.15.7:6789/0 conn(0x7f1e880af220 legacy=0x7f1e88158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:54.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.265+0000 7f1e877fe700 1 -- 172.21.15.7:0/882245569 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e880cde00 con 0x7f1e88069150 2023-10-06T10:59:54.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.265+0000 7f1e867fc700 1 -- 172.21.15.7:0/882245569 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145375904 0 0) 0x7f1e880afa10 con 0x7f1e880af220 2023-10-06T10:59:54.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.265+0000 7f1e877fe700 1 --2- 172.21.15.7:0/882245569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e88069150 0x7f1e880aece0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1e780098e0 tx=0x7f1e780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9398ec50eb24255b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:54.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.265+0000 7f1e867fc700 1 -- 172.21.15.7:0/882245569 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78009e80 con 0x7f1e88069150 2023-10-06T10:59:54.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.265+0000 7f1e867fc700 1 -- 172.21.15.7:0/882245569 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7800b860 con 0x7f1e88069150 2023-10-06T10:59:54.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.266+0000 7f1e867fc700 1 -- 172.21.15.7:0/882245569 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7800bbe0 con 0x7f1e88069150 2023-10-06T10:59:54.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.266+0000 7f1e8e05c700 1 -- 172.21.15.7:0/882245569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e88069150 msgr2=0x7f1e880aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:54.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.266+0000 7f1e8e05c700 1 --2- 172.21.15.7:0/882245569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e88069150 0x7f1e880aece0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1e780098e0 tx=0x7f1e780091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.266+0000 7f1e8e05c700 1 -- 172.21.15.7:0/882245569 shutdown_connections 2023-10-06T10:59:54.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.266+0000 7f1e8e05c700 1 --2- 172.21.15.7:0/882245569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e88069150 0x7f1e880aece0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.266+0000 7f1e8e05c700 1 -- 172.21.15.7:0/882245569 >> 172.21.15.7:0/882245569 conn(0x7f1e88067bc0 msgr2=0x7f1e880d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:54.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.266+0000 7f1e8e05c700 1 -- 172.21.15.7:0/882245569 shutdown_connections 2023-10-06T10:59:54.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.266+0000 7f1e8e05c700 1 -- 172.21.15.7:0/882245569 wait complete. 2023-10-06T10:59:54.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.268+0000 7f1e8e05c700 1 Processor -- start 2023-10-06T10:59:54.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.268+0000 7f1e8e05c700 1 -- start start 2023-10-06T10:59:54.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.269+0000 7f1e8e05c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e88069150 0x7f1e881579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:54.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.269+0000 7f1e8e05c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e88069520 0x7f1e8816de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:54.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.269+0000 7f1e8e05c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e880af220 0x7f1e880cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:54.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.269+0000 7f1e8e05c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8816b140 con 0x7f1e88069150 2023-10-06T10:59:54.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.269+0000 7f1e8e05c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8816ae60 con 0x7f1e880af220 2023-10-06T10:59:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.269+0000 7f1e8e05c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88156ef0 con 0x7f1e88069520 2023-10-06T10:59:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.269+0000 7f1e877fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e88069150 0x7f1e881579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.269+0000 7f1e877fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e88069150 0x7f1e881579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35382/0 (socket says 172.21.15.7:35382) 2023-10-06T10:59:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.269+0000 7f1e877fe700 1 -- 172.21.15.7:0/3953326082 learned_addr learned my addr 172.21.15.7:0/3953326082 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.269+0000 7f1e86ffd700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e88069520 0x7f1e8816de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.270+0000 7f1e87fff700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e880af220 0x7f1e880cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.270+0000 7f1e877fe700 1 -- 172.21.15.7:0/3953326082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e88069520 msgr2=0x7f1e8816de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.270+0000 7f1e877fe700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e88069520 0x7f1e8816de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.270+0000 7f1e877fe700 1 -- 172.21.15.7:0/3953326082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e880af220 msgr2=0x7f1e880cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.270+0000 7f1e877fe700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e880af220 0x7f1e880cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.270+0000 7f1e877fe700 1 -- 172.21.15.7:0/3953326082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e78009420 con 0x7f1e88069150 2023-10-06T10:59:54.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.270+0000 7f1e86ffd700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e88069520 0x7f1e8816de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:54.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.270+0000 7f1e87fff700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e880af220 0x7f1e880cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:54.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.270+0000 7f1e877fe700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e88069150 0x7f1e881579d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1e88068a50 tx=0x7f1e78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:54.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.270+0000 7f1e6f7fe700 1 -- 172.21.15.7:0/3953326082 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78011420 con 0x7f1e88069150 2023-10-06T10:59:54.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.270+0000 7f1e6f7fe700 1 -- 172.21.15.7:0/3953326082 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e78011580 con 0x7f1e88069150 2023-10-06T10:59:54.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.270+0000 7f1e8e05c700 1 -- 172.21.15.7:0/3953326082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e881571d0 con 0x7f1e88069150 2023-10-06T10:59:54.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.270+0000 7f1e6f7fe700 1 -- 172.21.15.7:0/3953326082 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78011920 con 0x7f1e88069150 2023-10-06T10:59:54.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.270+0000 7f1e8e05c700 1 -- 172.21.15.7:0/3953326082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8816e380 con 0x7f1e88069150 2023-10-06T10:59:54.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.271+0000 7f1e8e05c700 1 -- 172.21.15.7:0/3953326082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e88156d50 con 0x7f1e88069150 2023-10-06T10:59:54.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.272+0000 7f1e6f7fe700 1 -- 172.21.15.7:0/3953326082 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e78011c90 con 0x7f1e88069150 2023-10-06T10:59:54.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.272+0000 7f1e6f7fe700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1e74066f30 0x7f1e740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:54.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.272+0000 7f1e6f7fe700 1 -- 172.21.15.7:0/3953326082 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f1e78086550 con 0x7f1e88069150 2023-10-06T10:59:54.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.272+0000 7f1e86ffd700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1e74066f30 0x7f1e740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:54.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.273+0000 7f1e86ffd700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1e74066f30 0x7f1e740693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1e88167cf0 tx=0x7f1e7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:54.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.277+0000 7f1e6f7fe700 1 -- 172.21.15.7:0/3953326082 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e88156d50 con 0x7f1e88069150 2023-10-06T10:59:54.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.478+0000 7f1e8e05c700 1 -- 172.21.15.7:0/3953326082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1e88156d50 con 0x7f1e88069150 2023-10-06T10:59:54.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.478+0000 7f1e6f7fe700 1 -- 172.21.15.7:0/3953326082 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1e88156d50 con 0x7f1e88069150 2023-10-06T10:59:54.480 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T10:59:54.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.480+0000 7f1e8e05c700 1 -- 172.21.15.7:0/3953326082 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1e74066f30 msgr2=0x7f1e740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:54.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.480+0000 7f1e8e05c700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1e74066f30 0x7f1e740693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1e88167cf0 tx=0x7f1e7c009040 comp rx=0 tx=0).stop 2023-10-06T10:59:54.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.480+0000 7f1e8e05c700 1 -- 172.21.15.7:0/3953326082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e88069150 msgr2=0x7f1e881579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:54.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.480+0000 7f1e8e05c700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e88069150 0x7f1e881579d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1e88068a50 tx=0x7f1e78017000 comp rx=0 tx=0).stop 2023-10-06T10:59:54.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.480+0000 7f1e8e05c700 1 -- 172.21.15.7:0/3953326082 shutdown_connections 2023-10-06T10:59:54.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.480+0000 7f1e8e05c700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1e74066f30 0x7f1e740693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.480+0000 7f1e8e05c700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e88069150 0x7f1e881579d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.480+0000 7f1e8e05c700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e880af220 0x7f1e880cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.480+0000 7f1e8e05c700 1 --2- 172.21.15.7:0/3953326082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e88069520 0x7f1e8816de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.480+0000 7f1e8e05c700 1 -- 172.21.15.7:0/3953326082 >> 172.21.15.7:0/3953326082 conn(0x7f1e88067bc0 msgr2=0x7f1e88158540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:54.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.480+0000 7f1e8e05c700 1 -- 172.21.15.7:0/3953326082 shutdown_connections 2023-10-06T10:59:54.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.481+0000 7f1e8e05c700 1 -- 172.21.15.7:0/3953326082 wait complete. 2023-10-06T10:59:54.529 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2023-10-06T10:59:54.529 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-10-06T10:59:54.529 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-10-06T10:59:54.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.663+0000 7f5473376700 1 Processor -- start 2023-10-06T10:59:54.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.664+0000 7f5473376700 1 -- start start 2023-10-06T10:59:54.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.664+0000 7f5473376700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f546c158120 0x7f546c0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:54.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.664+0000 7f5473376700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f546c0c8ba0 0x7f546c0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:54.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.664+0000 7f5473376700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546c0cbd10 con 0x7f546c0cac60 2023-10-06T10:59:54.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5473376700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546c0cb9e0 con 0x7f546c0c8ba0 2023-10-06T10:59:54.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5473376700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546c0c9300 con 0x7f546c158120 2023-10-06T10:59:54.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5470911700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f546c0c8ba0 0x7f546c0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:54.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5470911700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f546c0c8ba0 0x7f546c0ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35388/0 (socket says 172.21.15.7:35388) 2023-10-06T10:59:54.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5470911700 1 -- 172.21.15.7:0/3217683069 learned_addr learned my addr 172.21.15.7:0/3217683069 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:54.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5471112700 1 --2- 172.21.15.7:0/3217683069 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f546c158120 0x7f546c0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:54.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5470911700 1 -- 172.21.15.7:0/3217683069 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f546c158120 msgr2=0x7f546c0c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:54.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5470911700 1 --2- 172.21.15.7:0/3217683069 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f546c158120 0x7f546c0c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5470911700 1 -- 172.21.15.7:0/3217683069 >> v1:172.21.15.50:6789/0 conn(0x7f546c0cac60 legacy=0x7f546c15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:54.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5470911700 1 -- 172.21.15.7:0/3217683069 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c0c95e0 con 0x7f546c0c8ba0 2023-10-06T10:59:54.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5471112700 1 --2- 172.21.15.7:0/3217683069 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f546c158120 0x7f546c0c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:54.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5470911700 1 --2- 172.21.15.7:0/3217683069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c0c8ba0 0x7f546c0ca720 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f545c0099b0 tx=0x7f545c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc958291052e231 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:54.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5463fff700 1 -- 172.21.15.7:0/3217683069 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c00b860 con 0x7f546c0c8ba0 2023-10-06T10:59:54.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5463fff700 1 -- 172.21.15.7:0/3217683069 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c00b9c0 con 0x7f546c0c8ba0 2023-10-06T10:59:54.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.665+0000 7f5463fff700 1 -- 172.21.15.7:0/3217683069 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c00bd60 con 0x7f546c0c8ba0 2023-10-06T10:59:54.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.666+0000 7f5473376700 1 -- 172.21.15.7:0/3217683069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c0c8ba0 msgr2=0x7f546c0ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:54.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.666+0000 7f5473376700 1 --2- 172.21.15.7:0/3217683069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c0c8ba0 0x7f546c0ca720 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f545c0099b0 tx=0x7f545c009250 comp rx=0 tx=0).stop 2023-10-06T10:59:54.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.666+0000 7f5473376700 1 -- 172.21.15.7:0/3217683069 shutdown_connections 2023-10-06T10:59:54.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.666+0000 7f5473376700 1 --2- 172.21.15.7:0/3217683069 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f546c158120 0x7f546c0c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.666+0000 7f5473376700 1 --2- 172.21.15.7:0/3217683069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c0c8ba0 0x7f546c0ca720 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.666+0000 7f5473376700 1 -- 172.21.15.7:0/3217683069 >> 172.21.15.7:0/3217683069 conn(0x7f546c087920 msgr2=0x7f546c097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:54.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.666+0000 7f5473376700 1 -- 172.21.15.7:0/3217683069 shutdown_connections 2023-10-06T10:59:54.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.666+0000 7f5473376700 1 -- 172.21.15.7:0/3217683069 wait complete. 2023-10-06T10:59:54.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.667+0000 7f5473376700 1 Processor -- start 2023-10-06T10:59:54.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.667+0000 7f5473376700 1 -- start start 2023-10-06T10:59:54.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.668+0000 7f5473376700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f546c0c8ba0 0x7f546c167f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:54.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.668+0000 7f5473376700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c0cac60 0x7f546c0c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:54.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.668+0000 7f5473376700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f546c158120 0x7f546c0c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:54.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.668+0000 7f5473376700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c0c6780 con 0x7f546c0cac60 2023-10-06T10:59:54.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.668+0000 7f5473376700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c0c4580 con 0x7f546c0c8ba0 2023-10-06T10:59:54.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.668+0000 7f5473376700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546c0c5e90 con 0x7f546c158120 2023-10-06T10:59:54.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f5470911700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c0cac60 0x7f546c0c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:54.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f5470911700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c0cac60 0x7f546c0c4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35394/0 (socket says 172.21.15.7:35394) 2023-10-06T10:59:54.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f5470911700 1 -- 172.21.15.7:0/3354450399 learned_addr learned my addr 172.21.15.7:0/3354450399 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:54.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f5471112700 1 --2- 172.21.15.7:0/3354450399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f546c0c8ba0 0x7f546c167f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:54.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f5471913700 1 --2- 172.21.15.7:0/3354450399 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f546c158120 0x7f546c0c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:54.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f5470911700 1 -- 172.21.15.7:0/3354450399 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f546c158120 msgr2=0x7f546c0c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:54.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f5470911700 1 --2- 172.21.15.7:0/3354450399 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f546c158120 0x7f546c0c16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f5470911700 1 -- 172.21.15.7:0/3354450399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f546c0c8ba0 msgr2=0x7f546c167f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:54.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f5470911700 1 --2- 172.21.15.7:0/3354450399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f546c0c8ba0 0x7f546c167f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:54.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f5470911700 1 -- 172.21.15.7:0/3354450399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c0094f0 con 0x7f546c0cac60 2023-10-06T10:59:54.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f5470911700 1 --2- 172.21.15.7:0/3354450399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c0cac60 0x7f546c0c4040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f545c009290 tx=0x7f545c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:54.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f54617fa700 1 -- 172.21.15.7:0/3354450399 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c011e40 con 0x7f546c0cac60 2023-10-06T10:59:54.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f54617fa700 1 -- 172.21.15.7:0/3354450399 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c01f070 con 0x7f546c0cac60 2023-10-06T10:59:54.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f5473376700 1 -- 172.21.15.7:0/3354450399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546c0c4800 con 0x7f546c0cac60 2023-10-06T10:59:54.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f54617fa700 1 -- 172.21.15.7:0/3354450399 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c0266d0 con 0x7f546c0cac60 2023-10-06T10:59:54.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.669+0000 7f5473376700 1 -- 172.21.15.7:0/3354450399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546c0c6410 con 0x7f546c0cac60 2023-10-06T10:59:54.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.671+0000 7f5456ffd700 1 -- 172.21.15.7:0/3354450399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54440052b0 con 0x7f546c0cac60 2023-10-06T10:59:54.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.671+0000 7f54617fa700 1 -- 172.21.15.7:0/3354450399 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f545c01a430 con 0x7f546c0cac60 2023-10-06T10:59:54.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.671+0000 7f54617fa700 1 --2- 172.21.15.7:0/3354450399 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5450066f30 0x7f54500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:54.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.671+0000 7f54617fa700 1 -- 172.21.15.7:0/3354450399 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f545c021070 con 0x7f546c0cac60 2023-10-06T10:59:54.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.672+0000 7f5471112700 1 --2- 172.21.15.7:0/3354450399 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5450066f30 0x7f54500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:54.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.672+0000 7f5471112700 1 --2- 172.21.15.7:0/3354450399 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5450066f30 0x7f54500693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f546c0addb0 tx=0x7f5468008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:54.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.676+0000 7f54617fa700 1 -- 172.21.15.7:0/3354450399 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f545c053580 con 0x7f546c0cac60 2023-10-06T10:59:54.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:54.963+0000 7f5456ffd700 1 -- 172.21.15.7:0/3354450399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f5444005560 con 0x7f546c0cac60 2023-10-06T10:59:55.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.644+0000 7f54617fa700 1 -- 172.21.15.7:0/3354450399 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v65) v1 ==== 150+0+0 (secure 0 0 0) 0x7f545c056ba0 con 0x7f546c0cac60 2023-10-06T10:59:55.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.647+0000 7f5456ffd700 1 -- 172.21.15.7:0/3354450399 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5450066f30 msgr2=0x7f54500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:55.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.647+0000 7f5456ffd700 1 --2- 172.21.15.7:0/3354450399 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5450066f30 0x7f54500693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f546c0addb0 tx=0x7f5468008040 comp rx=0 tx=0).stop 2023-10-06T10:59:55.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.647+0000 7f5456ffd700 1 -- 172.21.15.7:0/3354450399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c0cac60 msgr2=0x7f546c0c4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:55.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.647+0000 7f5456ffd700 1 --2- 172.21.15.7:0/3354450399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c0cac60 0x7f546c0c4040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f545c009290 tx=0x7f545c017000 comp rx=0 tx=0).stop 2023-10-06T10:59:55.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.647+0000 7f5456ffd700 1 -- 172.21.15.7:0/3354450399 shutdown_connections 2023-10-06T10:59:55.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.647+0000 7f5456ffd700 1 --2- 172.21.15.7:0/3354450399 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5450066f30 0x7f54500693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:55.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.647+0000 7f5456ffd700 1 --2- 172.21.15.7:0/3354450399 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f546c158120 0x7f546c0c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:55.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.647+0000 7f5456ffd700 1 --2- 172.21.15.7:0/3354450399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f546c0c8ba0 0x7f546c167f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:55.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.647+0000 7f5456ffd700 1 --2- 172.21.15.7:0/3354450399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c0cac60 0x7f546c0c4040 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:55.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.647+0000 7f5456ffd700 1 -- 172.21.15.7:0/3354450399 >> 172.21.15.7:0/3354450399 conn(0x7f546c087920 msgr2=0x7f546c0cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:55.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.647+0000 7f5456ffd700 1 -- 172.21.15.7:0/3354450399 shutdown_connections 2023-10-06T10:59:55.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.647+0000 7f5456ffd700 1 -- 172.21.15.7:0/3354450399 wait complete. 2023-10-06T10:59:55.664 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T10:59:55.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.803+0000 7f93e5d98700 1 Processor -- start 2023-10-06T10:59:55.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.803+0000 7f93e5d98700 1 -- start start 2023-10-06T10:59:55.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.804+0000 7f93e5d98700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93e00cbf20 0x7f93e00c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:55.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.804+0000 7f93e5d98700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93e00cb2b0 0x7f93e0158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:55.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.804+0000 7f93e5d98700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e00c8fe0 con 0x7f93e00cc2f0 2023-10-06T10:59:55.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.804+0000 7f93e5d98700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e00ca790 con 0x7f93e00cb2b0 2023-10-06T10:59:55.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.804+0000 7f93e5d98700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00c92c0 con 0x7f93e00cbf20 2023-10-06T10:59:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.804+0000 7f93deffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f93e00cc2f0 0x7f93e00ca080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47810/0 (socket says 172.21.15.7:47810) 2023-10-06T10:59:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.804+0000 7f93deffd700 1 -- 172.21.15.7:0/508720585 learned_addr learned my addr 172.21.15.7:0/508720585 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.804+0000 7f93df7fe700 1 --2- 172.21.15.7:0/508720585 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93e00cbf20 0x7f93e00c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.804+0000 7f93dffff700 1 --2- 172.21.15.7:0/508720585 >> v2:172.21.15.50:3300/0 conn(0x7f93e00cb2b0 0x7f93e0158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.805+0000 7f93de7fc700 1 -- 172.21.15.7:0/508720585 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144867459 0 0) 0x7f93e00c8fe0 con 0x7f93e00cc2f0 2023-10-06T10:59:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.805+0000 7f93de7fc700 1 -- 172.21.15.7:0/508720585 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93c8003570 con 0x7f93e00cc2f0 2023-10-06T10:59:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.805+0000 7f93dffff700 1 -- 172.21.15.7:0/508720585 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93e00cbf20 msgr2=0x7f93e00c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.805+0000 7f93dffff700 1 --2- 172.21.15.7:0/508720585 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93e00cbf20 0x7f93e00c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.805+0000 7f93dffff700 1 -- 172.21.15.7:0/508720585 >> v1:172.21.15.7:6789/0 conn(0x7f93e00cc2f0 legacy=0x7f93e00ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.805+0000 7f93de7fc700 1 -- 172.21.15.7:0/508720585 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1949517639 0 0) 0x7f93c8003570 con 0x7f93e00cc2f0 2023-10-06T10:59:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.805+0000 7f93dffff700 1 -- 172.21.15.7:0/508720585 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e00c95a0 con 0x7f93e00cb2b0 2023-10-06T10:59:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.805+0000 7f93df7fe700 1 --2- 172.21.15.7:0/508720585 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93e00cbf20 0x7f93e00c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:59:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.805+0000 7f93dffff700 1 --2- 172.21.15.7:0/508720585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e00cb2b0 0x7f93e0158ea0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009e60 tx=0x7f93d8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc0e43c8a8d24131 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.805+0000 7f93de7fc700 1 -- 172.21.15.7:0/508720585 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800e070 con 0x7f93e00cb2b0 2023-10-06T10:59:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.805+0000 7f93de7fc700 1 -- 172.21.15.7:0/508720585 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d800bab0 con 0x7f93e00cb2b0 2023-10-06T10:59:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.805+0000 7f93de7fc700 1 -- 172.21.15.7:0/508720585 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800be70 con 0x7f93e00cb2b0 2023-10-06T10:59:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.806+0000 7f93e5d98700 1 -- 172.21.15.7:0/508720585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e00cb2b0 msgr2=0x7f93e0158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.806+0000 7f93e5d98700 1 --2- 172.21.15.7:0/508720585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e00cb2b0 0x7f93e0158ea0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009e60 tx=0x7f93d8009780 comp rx=0 tx=0).stop 2023-10-06T10:59:55.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.806+0000 7f93e5d98700 1 -- 172.21.15.7:0/508720585 shutdown_connections 2023-10-06T10:59:55.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.806+0000 7f93e5d98700 1 --2- 172.21.15.7:0/508720585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e00cb2b0 0x7f93e0158ea0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:55.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.806+0000 7f93e5d98700 1 --2- 172.21.15.7:0/508720585 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93e00cbf20 0x7f93e00c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:55.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.806+0000 7f93e5d98700 1 -- 172.21.15.7:0/508720585 >> 172.21.15.7:0/508720585 conn(0x7f93e00afc90 msgr2=0x7f93e00b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:55.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.806+0000 7f93e5d98700 1 -- 172.21.15.7:0/508720585 shutdown_connections 2023-10-06T10:59:55.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.806+0000 7f93e5d98700 1 -- 172.21.15.7:0/508720585 wait complete. 2023-10-06T10:59:55.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.807+0000 7f93e5d98700 1 Processor -- start 2023-10-06T10:59:55.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.808+0000 7f93e5d98700 1 -- start start 2023-10-06T10:59:55.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.808+0000 7f93e5d98700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93e00cb2b0 0x7f93e00c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:55.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.808+0000 7f93e5d98700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93e00cbf20 0x7f93e0156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:55.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.808+0000 7f93e5d98700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e00cc2f0 0x7f93e00c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:55.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.808+0000 7f93e5d98700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00c6c10 con 0x7f93e00cb2b0 2023-10-06T10:59:55.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.808+0000 7f93e5d98700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e0169b90 con 0x7f93e00cc2f0 2023-10-06T10:59:55.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.808+0000 7f93e5d98700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00c6970 con 0x7f93e00cbf20 2023-10-06T10:59:55.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.808+0000 7f93df7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93e00cb2b0 0x7f93e00c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:55.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.808+0000 7f93df7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93e00cb2b0 0x7f93e00c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35396/0 (socket says 172.21.15.7:35396) 2023-10-06T10:59:55.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.808+0000 7f93df7fe700 1 -- 172.21.15.7:0/2725918735 learned_addr learned my addr 172.21.15.7:0/2725918735 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:55.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.809+0000 7f93deffd700 1 --2- 172.21.15.7:0/2725918735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93e00cbf20 0x7f93e0156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:55.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.809+0000 7f93dffff700 1 --2- 172.21.15.7:0/2725918735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e00cc2f0 0x7f93e00c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:55.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.809+0000 7f93df7fe700 1 -- 172.21.15.7:0/2725918735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93e00cbf20 msgr2=0x7f93e0156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:55.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.809+0000 7f93df7fe700 1 --2- 172.21.15.7:0/2725918735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93e00cbf20 0x7f93e0156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:55.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.809+0000 7f93df7fe700 1 -- 172.21.15.7:0/2725918735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e00cc2f0 msgr2=0x7f93e00c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:55.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.809+0000 7f93df7fe700 1 --2- 172.21.15.7:0/2725918735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e00cc2f0 0x7f93e00c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:55.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.809+0000 7f93df7fe700 1 -- 172.21.15.7:0/2725918735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d0009420 con 0x7f93e00cb2b0 2023-10-06T10:59:55.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.809+0000 7f93df7fe700 1 --2- 172.21.15.7:0/2725918735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93e00cb2b0 0x7f93e00c6430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f93d000ec80 tx=0x7f93d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:55.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.809+0000 7f93c77fe700 1 -- 172.21.15.7:0/2725918735 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000c9d0 con 0x7f93e00cb2b0 2023-10-06T10:59:55.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.809+0000 7f93c77fe700 1 -- 172.21.15.7:0/2725918735 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d000cb30 con 0x7f93e00cb2b0 2023-10-06T10:59:55.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.809+0000 7f93c77fe700 1 -- 172.21.15.7:0/2725918735 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000ceb0 con 0x7f93e00cb2b0 2023-10-06T10:59:55.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.809+0000 7f93e5d98700 1 -- 172.21.15.7:0/2725918735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d8009a20 con 0x7f93e00cb2b0 2023-10-06T10:59:55.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.809+0000 7f93e5d98700 1 -- 172.21.15.7:0/2725918735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e0169e30 con 0x7f93e00cb2b0 2023-10-06T10:59:55.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.810+0000 7f93e5d98700 1 -- 172.21.15.7:0/2725918735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e0070480 con 0x7f93e00cb2b0 2023-10-06T10:59:55.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.811+0000 7f93c77fe700 1 -- 172.21.15.7:0/2725918735 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93d0013680 con 0x7f93e00cb2b0 2023-10-06T10:59:55.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.811+0000 7f93c77fe700 1 --2- 172.21.15.7:0/2725918735 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f93cc066f30 0x7f93cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:55.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.811+0000 7f93c77fe700 1 -- 172.21.15.7:0/2725918735 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f93d0084eb0 con 0x7f93e00cb2b0 2023-10-06T10:59:55.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.811+0000 7f93deffd700 1 --2- 172.21.15.7:0/2725918735 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f93cc066f30 0x7f93cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:55.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.812+0000 7f93deffd700 1 --2- 172.21.15.7:0/2725918735 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f93cc066f30 0x7f93cc0693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f93e00c0b30 tx=0x7f93d4007c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:55.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:55.816+0000 7f93c77fe700 1 -- 172.21.15.7:0/2725918735 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93d0051bf0 con 0x7f93e00cb2b0 2023-10-06T10:59:56.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.017+0000 7f93e5d98700 1 -- 172.21.15.7:0/2725918735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f93e00c9880 con 0x7f93e00cb2b0 2023-10-06T10:59:56.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.020+0000 7f93c77fe700 1 -- 172.21.15.7:0/2725918735 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f93d0055210 con 0x7f93e00cb2b0 2023-10-06T10:59:56.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.023+0000 7f93e5d98700 1 -- 172.21.15.7:0/2725918735 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f93cc066f30 msgr2=0x7f93cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:56.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.023+0000 7f93e5d98700 1 --2- 172.21.15.7:0/2725918735 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f93cc066f30 0x7f93cc0693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f93e00c0b30 tx=0x7f93d4007c60 comp rx=0 tx=0).stop 2023-10-06T10:59:56.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.023+0000 7f93e5d98700 1 -- 172.21.15.7:0/2725918735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93e00cb2b0 msgr2=0x7f93e00c6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:56.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.023+0000 7f93e5d98700 1 --2- 172.21.15.7:0/2725918735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93e00cb2b0 0x7f93e00c6430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f93d000ec80 tx=0x7f93d00091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:56.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.023+0000 7f93e5d98700 1 -- 172.21.15.7:0/2725918735 shutdown_connections 2023-10-06T10:59:56.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.023+0000 7f93e5d98700 1 --2- 172.21.15.7:0/2725918735 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f93cc066f30 0x7f93cc0693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:56.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.023+0000 7f93e5d98700 1 --2- 172.21.15.7:0/2725918735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93e00cb2b0 0x7f93e00c6430 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:56.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.023+0000 7f93e5d98700 1 --2- 172.21.15.7:0/2725918735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e00cc2f0 0x7f93e00c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:56.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.023+0000 7f93e5d98700 1 --2- 172.21.15.7:0/2725918735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93e00cbf20 0x7f93e0156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:56.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.023+0000 7f93e5d98700 1 -- 172.21.15.7:0/2725918735 >> 172.21.15.7:0/2725918735 conn(0x7f93e00afc90 msgr2=0x7f93e0156ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:56.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.023+0000 7f93e5d98700 1 -- 172.21.15.7:0/2725918735 shutdown_connections 2023-10-06T10:59:56.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.023+0000 7f93e5d98700 1 -- 172.21.15.7:0/2725918735 wait complete. 2023-10-06T10:59:56.038 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T10:59:56.038 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T10:59:56.086 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T10:59:56.135 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T10:59:56.135 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2023-10-06T10:59:56.136 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T10:59:56.136 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T10:59:56.184 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T10:59:56.184 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T10:59:56.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:56.184 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T10:59:56.257 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-10-06T10:59:56.257 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T10:59:56.257 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-06T10:59:56.308 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T10:59:56.309 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T10:59:56.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:56.309 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T10:59:56.385 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2023-10-06T10:59:56.385 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T10:59:56.385 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-06T10:59:56.435 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T10:59:56.435 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T10:59:56.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:56.435 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T10:59:56.500 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-10-06T10:59:56.500 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T10:59:56.501 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-06T10:59:56.547 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T10:59:56.548 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T10:59:56.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T10:59:56.548 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T10:59:56.611 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T10:59:56.611 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T10:59:56.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.750+0000 7eff689b2700 1 Processor -- start 2023-10-06T10:59:56.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.750+0000 7eff689b2700 1 -- start start 2023-10-06T10:59:56.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff689b2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff640aea10 0x7eff640afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:56.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff689b2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff640ac8d0 0x7eff640acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:56.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff689b2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff640a69a0 0x7eff640a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:56.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff689b2700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff640ad290 con 0x7eff640aea10 2023-10-06T10:59:56.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff689b2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff640a7320 con 0x7eff640ac8d0 2023-10-06T10:59:56.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff689b2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff640aede0 con 0x7eff640a69a0 2023-10-06T10:59:56.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff6259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff640aea10 0x7eff640afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:56.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff6259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff640aea10 0x7eff640afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35412/0 (socket says 172.21.15.7:35412) 2023-10-06T10:59:56.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff6259c700 1 -- 172.21.15.7:0/1975412921 learned_addr learned my addr 172.21.15.7:0/1975412921 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:56.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff62d9d700 1 --2- 172.21.15.7:0/1975412921 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff640a69a0 0x7eff640a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:56.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff61d9b700 1 --2- 172.21.15.7:0/1975412921 >> v2:172.21.15.50:3300/0 conn(0x7eff640ac8d0 0x7eff640acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:56.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff6259c700 1 -- 172.21.15.7:0/1975412921 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff640a69a0 msgr2=0x7eff640a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:56.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff6259c700 1 --2- 172.21.15.7:0/1975412921 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff640a69a0 0x7eff640a6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:56.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff6259c700 1 -- 172.21.15.7:0/1975412921 >> v2:172.21.15.50:3300/0 conn(0x7eff640ac8d0 msgr2=0x7eff640acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:56.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff6259c700 1 --2- 172.21.15.7:0/1975412921 >> v2:172.21.15.50:3300/0 conn(0x7eff640ac8d0 0x7eff640acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:56.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.751+0000 7eff6259c700 1 -- 172.21.15.7:0/1975412921 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff640ad560 con 0x7eff640aea10 2023-10-06T10:59:56.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.752+0000 7eff6259c700 1 --2- 172.21.15.7:0/1975412921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff640aea10 0x7eff640afb40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff6406ede0 tx=0x7eff5400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578a10777457496f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:56.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.752+0000 7eff6159a700 1 -- 172.21.15.7:0/1975412921 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5400dc50 con 0x7eff640aea10 2023-10-06T10:59:56.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.752+0000 7eff6159a700 1 -- 172.21.15.7:0/1975412921 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5400ddb0 con 0x7eff640aea10 2023-10-06T10:59:56.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.752+0000 7eff6159a700 1 -- 172.21.15.7:0/1975412921 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff540196d0 con 0x7eff640aea10 2023-10-06T10:59:56.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.752+0000 7eff689b2700 1 -- 172.21.15.7:0/1975412921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff640aea10 msgr2=0x7eff640afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:56.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.752+0000 7eff689b2700 1 --2- 172.21.15.7:0/1975412921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff640aea10 0x7eff640afb40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff6406ede0 tx=0x7eff5400b4f0 comp rx=0 tx=0).stop 2023-10-06T10:59:56.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.752+0000 7eff689b2700 1 -- 172.21.15.7:0/1975412921 shutdown_connections 2023-10-06T10:59:56.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.752+0000 7eff689b2700 1 --2- 172.21.15.7:0/1975412921 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff640a69a0 0x7eff640a6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:56.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.752+0000 7eff689b2700 1 --2- 172.21.15.7:0/1975412921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff640aea10 0x7eff640afb40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:56.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.752+0000 7eff689b2700 1 --2- 172.21.15.7:0/1975412921 >> v2:172.21.15.50:3300/0 conn(0x7eff640ac8d0 0x7eff640acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:56.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.752+0000 7eff689b2700 1 -- 172.21.15.7:0/1975412921 >> 172.21.15.7:0/1975412921 conn(0x7eff64095a70 msgr2=0x7eff640af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:56.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.752+0000 7eff689b2700 1 -- 172.21.15.7:0/1975412921 shutdown_connections 2023-10-06T10:59:56.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.752+0000 7eff689b2700 1 -- 172.21.15.7:0/1975412921 wait complete. 2023-10-06T10:59:56.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.753+0000 7eff689b2700 1 Processor -- start 2023-10-06T10:59:56.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.754+0000 7eff689b2700 1 -- start start 2023-10-06T10:59:56.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.754+0000 7eff689b2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff640a69a0 0x7eff640a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:56.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.754+0000 7eff689b2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff640ac8d0 0x7eff64169400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:56.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.754+0000 7eff689b2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff640aea10 0x7eff641561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:56.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.754+0000 7eff689b2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff640a9410 con 0x7eff640a69a0 2023-10-06T10:59:56.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.754+0000 7eff689b2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff640a9990 con 0x7eff640ac8d0 2023-10-06T10:59:56.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.754+0000 7eff689b2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff640a9c70 con 0x7eff640aea10 2023-10-06T10:59:56.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.754+0000 7eff6259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff640a69a0 0x7eff640a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:56.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.754+0000 7eff6259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff640a69a0 0x7eff640a8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35416/0 (socket says 172.21.15.7:35416) 2023-10-06T10:59:56.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.754+0000 7eff6259c700 1 -- 172.21.15.7:0/2376845189 learned_addr learned my addr 172.21.15.7:0/2376845189 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:56.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.755+0000 7eff61d9b700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff640ac8d0 0x7eff64169400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:56.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.755+0000 7eff62d9d700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff640aea10 0x7eff641561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:56.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.755+0000 7eff6259c700 1 -- 172.21.15.7:0/2376845189 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff640aea10 msgr2=0x7eff641561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:56.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.755+0000 7eff6259c700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff640aea10 0x7eff641561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:56.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.755+0000 7eff6259c700 1 -- 172.21.15.7:0/2376845189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff640ac8d0 msgr2=0x7eff64169400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:56.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.755+0000 7eff6259c700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff640ac8d0 0x7eff64169400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:56.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.755+0000 7eff6259c700 1 -- 172.21.15.7:0/2376845189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5400b790 con 0x7eff640a69a0 2023-10-06T10:59:56.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.755+0000 7eff62d9d700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff640aea10 0x7eff641561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:56.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.755+0000 7eff6259c700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff640a69a0 0x7eff640a8ed0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff6406d380 tx=0x7eff5401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:56.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.755+0000 7eff527fc700 1 -- 172.21.15.7:0/2376845189 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff54010680 con 0x7eff640a69a0 2023-10-06T10:59:56.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.755+0000 7eff527fc700 1 -- 172.21.15.7:0/2376845189 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff540107e0 con 0x7eff640a69a0 2023-10-06T10:59:56.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.755+0000 7eff689b2700 1 -- 172.21.15.7:0/2376845189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff640a9f50 con 0x7eff640a69a0 2023-10-06T10:59:56.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.755+0000 7eff527fc700 1 -- 172.21.15.7:0/2376845189 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff54010ba0 con 0x7eff640a69a0 2023-10-06T10:59:56.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.755+0000 7eff689b2700 1 -- 172.21.15.7:0/2376845189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff640aa510 con 0x7eff640a69a0 2023-10-06T10:59:56.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.756+0000 7eff689b2700 1 -- 172.21.15.7:0/2376845189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff64070480 con 0x7eff640a69a0 2023-10-06T10:59:56.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.757+0000 7eff527fc700 1 -- 172.21.15.7:0/2376845189 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff5402c430 con 0x7eff640a69a0 2023-10-06T10:59:56.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.757+0000 7eff527fc700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7eff44066f30 0x7eff440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:56.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.757+0000 7eff527fc700 1 -- 172.21.15.7:0/2376845189 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7eff54014070 con 0x7eff640a69a0 2023-10-06T10:59:56.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.757+0000 7eff61d9b700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7eff44066f30 0x7eff440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:56.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.758+0000 7eff61d9b700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7eff44066f30 0x7eff440693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff6406b600 tx=0x7eff58008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:56.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:56.761+0000 7eff527fc700 1 -- 172.21.15.7:0/2376845189 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff54053490 con 0x7eff640a69a0 2023-10-06T10:59:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.006+0000 7eff689b2700 1 -- 172.21.15.7:0/2376845189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff640682b0 con 0x7eff640a69a0 2023-10-06T10:59:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.007+0000 7eff527fc700 1 -- 172.21.15.7:0/2376845189 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4581 (secure 0 0 0) 0x7eff54056ab0 con 0x7eff640a69a0 2023-10-06T10:59:57.009 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:57.009 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/941534596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":941534596},{"type":"v1","addr":"172.21.15.50:6835","nonce":941534596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3152699387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3152699387},{"type":"v1","addr":"172.21.15.50:6834","nonce":3152699387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/271704556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":271704556},{"type":"v1","addr":"172.21.15.7:6837","nonce":271704556}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T10:59:01.833627+0000","modified":"2023-10-06T10:59:21.515113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3123178887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3123178887},{"type":"v1","addr":"172.21.15.7:6836","nonce":3123178887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T10:59:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.009+0000 7eff689b2700 1 -- 172.21.15.7:0/2376845189 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7eff44066f30 msgr2=0x7eff440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.009+0000 7eff689b2700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7eff44066f30 0x7eff440693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff6406b600 tx=0x7eff58008040 comp rx=0 tx=0).stop 2023-10-06T10:59:57.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.009+0000 7eff689b2700 1 -- 172.21.15.7:0/2376845189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff640a69a0 msgr2=0x7eff640a8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.009+0000 7eff689b2700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff640a69a0 0x7eff640a8ed0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff6406d380 tx=0x7eff5401b000 comp rx=0 tx=0).stop 2023-10-06T10:59:57.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.009+0000 7eff689b2700 1 -- 172.21.15.7:0/2376845189 shutdown_connections 2023-10-06T10:59:57.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.009+0000 7eff689b2700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7eff44066f30 0x7eff440693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.009+0000 7eff689b2700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff640a69a0 0x7eff640a8ed0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.009+0000 7eff689b2700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff640aea10 0x7eff641561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.009+0000 7eff689b2700 1 --2- 172.21.15.7:0/2376845189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff640ac8d0 0x7eff64169400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.009+0000 7eff689b2700 1 -- 172.21.15.7:0/2376845189 >> 172.21.15.7:0/2376845189 conn(0x7eff64095a70 msgr2=0x7eff640af310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:57.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.009+0000 7eff689b2700 1 -- 172.21.15.7:0/2376845189 shutdown_connections 2023-10-06T10:59:57.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.009+0000 7eff689b2700 1 -- 172.21.15.7:0/2376845189 wait complete. 2023-10-06T10:59:57.013 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2023-10-06T10:59:57.025 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:57.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.154+0000 7f2f27d09700 1 Processor -- start 2023-10-06T10:59:57.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.154+0000 7f2f27d09700 1 -- start start 2023-10-06T10:59:57.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.155+0000 7f2f27d09700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f2015d4d0 0x7f2f201612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.155+0000 7f2f27d09700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f20161800 0x7f2f2015d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.155+0000 7f2f27d09700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f2015dde0 0x7f2f2015e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.155+0000 7f2f27d09700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f20162130 con 0x7f2f20161800 2023-10-06T10:59:57.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.155+0000 7f2f27d09700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f20161c70 con 0x7f2f2015dde0 2023-10-06T10:59:57.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.155+0000 7f2f27d09700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2006a1f0 con 0x7f2f2015d4d0 2023-10-06T10:59:57.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.155+0000 7f2f252a4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f20161800 0x7f2f2015d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.155+0000 7f2f252a4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f20161800 0x7f2f2015d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35430/0 (socket says 172.21.15.7:35430) 2023-10-06T10:59:57.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.156+0000 7f2f252a4700 1 -- 172.21.15.7:0/2849763866 learned_addr learned my addr 172.21.15.7:0/2849763866 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:57.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.156+0000 7f2f25aa5700 1 --2- 172.21.15.7:0/2849763866 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f2015d4d0 0x7f2f201612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.156+0000 7f2f262a6700 1 --2- 172.21.15.7:0/2849763866 >> v2:172.21.15.50:3300/0 conn(0x7f2f2015dde0 0x7f2f2015e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.156+0000 7f2f252a4700 1 -- 172.21.15.7:0/2849763866 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f2015d4d0 msgr2=0x7f2f201612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:57.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.156+0000 7f2f252a4700 1 --2- 172.21.15.7:0/2849763866 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f2015d4d0 0x7f2f201612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.156+0000 7f2f252a4700 1 -- 172.21.15.7:0/2849763866 >> v2:172.21.15.50:3300/0 conn(0x7f2f2015dde0 msgr2=0x7f2f2015e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:57.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.156+0000 7f2f252a4700 1 --2- 172.21.15.7:0/2849763866 >> v2:172.21.15.50:3300/0 conn(0x7f2f2015dde0 0x7f2f2015e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.156+0000 7f2f252a4700 1 -- 172.21.15.7:0/2849763866 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200695e0 con 0x7f2f20161800 2023-10-06T10:59:57.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.156+0000 7f2f252a4700 1 --2- 172.21.15.7:0/2849763866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f20161800 0x7f2f2015d8a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2f200cdf10 tx=0x7f2f14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b704d4d8605b0c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:57.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.156+0000 7f2f24aa3700 1 -- 172.21.15.7:0/2849763866 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1400b640 con 0x7f2f20161800 2023-10-06T10:59:57.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.156+0000 7f2f24aa3700 1 -- 172.21.15.7:0/2849763866 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1400b7a0 con 0x7f2f20161800 2023-10-06T10:59:57.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.156+0000 7f2f24aa3700 1 -- 172.21.15.7:0/2849763866 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1400bb60 con 0x7f2f20161800 2023-10-06T10:59:57.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.157+0000 7f2f27d09700 1 -- 172.21.15.7:0/2849763866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f20161800 msgr2=0x7f2f2015d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.157+0000 7f2f27d09700 1 --2- 172.21.15.7:0/2849763866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f20161800 0x7f2f2015d8a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2f200cdf10 tx=0x7f2f14009250 comp rx=0 tx=0).stop 2023-10-06T10:59:57.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.157+0000 7f2f27d09700 1 -- 172.21.15.7:0/2849763866 shutdown_connections 2023-10-06T10:59:57.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.157+0000 7f2f27d09700 1 --2- 172.21.15.7:0/2849763866 >> v2:172.21.15.50:3300/0 conn(0x7f2f2015dde0 0x7f2f2015e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.157+0000 7f2f27d09700 1 --2- 172.21.15.7:0/2849763866 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f2015d4d0 0x7f2f201612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.157+0000 7f2f27d09700 1 --2- 172.21.15.7:0/2849763866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f20161800 0x7f2f2015d8a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.157+0000 7f2f27d09700 1 -- 172.21.15.7:0/2849763866 >> 172.21.15.7:0/2849763866 conn(0x7f2f20096160 msgr2=0x7f2f200afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:57.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.157+0000 7f2f27d09700 1 -- 172.21.15.7:0/2849763866 shutdown_connections 2023-10-06T10:59:57.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.157+0000 7f2f27d09700 1 -- 172.21.15.7:0/2849763866 wait complete. 2023-10-06T10:59:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.158+0000 7f2f27d09700 1 Processor -- start 2023-10-06T10:59:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.158+0000 7f2f27d09700 1 -- start start 2023-10-06T10:59:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f27d09700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f2015d4d0 0x7f2f2016d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f27d09700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2015dde0 0x7f2f20156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f27d09700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20161800 0x7f2f200ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f27d09700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f20170ce0 con 0x7f2f2015dde0 2023-10-06T10:59:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f27d09700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200986a0 con 0x7f2f20161800 2023-10-06T10:59:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f27d09700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200977e0 con 0x7f2f2015d4d0 2023-10-06T10:59:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f252a4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2015dde0 0x7f2f20156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f252a4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2015dde0 0x7f2f20156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35432/0 (socket says 172.21.15.7:35432) 2023-10-06T10:59:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f252a4700 1 -- 172.21.15.7:0/3945002520 learned_addr learned my addr 172.21.15.7:0/3945002520 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f25aa5700 1 --2- 172.21.15.7:0/3945002520 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f2015d4d0 0x7f2f2016d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f262a6700 1 --2- 172.21.15.7:0/3945002520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20161800 0x7f2f200ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f252a4700 1 -- 172.21.15.7:0/3945002520 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f2015d4d0 msgr2=0x7f2f2016d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f252a4700 1 --2- 172.21.15.7:0/3945002520 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f2015d4d0 0x7f2f2016d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f252a4700 1 -- 172.21.15.7:0/3945002520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20161800 msgr2=0x7f2f200ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f252a4700 1 --2- 172.21.15.7:0/3945002520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20161800 0x7f2f200ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.159+0000 7f2f252a4700 1 -- 172.21.15.7:0/3945002520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f140094f0 con 0x7f2f2015dde0 2023-10-06T10:59:57.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.160+0000 7f2f252a4700 1 --2- 172.21.15.7:0/3945002520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2015dde0 0x7f2f20156ce0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2f14006fd0 tx=0x7f2f14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:57.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.160+0000 7f2f11ffb700 1 -- 172.21.15.7:0/3945002520 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14000d10 con 0x7f2f2015dde0 2023-10-06T10:59:57.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.160+0000 7f2f11ffb700 1 -- 172.21.15.7:0/3945002520 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1400bb20 con 0x7f2f2015dde0 2023-10-06T10:59:57.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.160+0000 7f2f11ffb700 1 -- 172.21.15.7:0/3945002520 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14011670 con 0x7f2f2015dde0 2023-10-06T10:59:57.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.160+0000 7f2f27d09700 1 -- 172.21.15.7:0/3945002520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f20097ac0 con 0x7f2f2015dde0 2023-10-06T10:59:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.160+0000 7f2f27d09700 1 -- 172.21.15.7:0/3945002520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f20098bd0 con 0x7f2f2015dde0 2023-10-06T10:59:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.161+0000 7f2f27d09700 1 -- 172.21.15.7:0/3945002520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f20098df0 con 0x7f2f2015dde0 2023-10-06T10:59:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.162+0000 7f2f11ffb700 1 -- 172.21.15.7:0/3945002520 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f140119e0 con 0x7f2f2015dde0 2023-10-06T10:59:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.162+0000 7f2f11ffb700 1 --2- 172.21.15.7:0/3945002520 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2f04066f30 0x7f2f040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.162+0000 7f2f11ffb700 1 -- 172.21.15.7:0/3945002520 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f2f140860e0 con 0x7f2f2015dde0 2023-10-06T10:59:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.162+0000 7f2f25aa5700 1 --2- 172.21.15.7:0/3945002520 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2f04066f30 0x7f2f040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.163+0000 7f2f25aa5700 1 --2- 172.21.15.7:0/3945002520 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2f04066f30 0x7f2f040693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c009d40 tx=0x7f2f1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:57.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.167+0000 7f2f11ffb700 1 -- 172.21.15.7:0/3945002520 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f14052ec0 con 0x7f2f2015dde0 2023-10-06T10:59:57.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.370+0000 7f2f27d09700 1 -- 172.21.15.7:0/3945002520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f20070480 con 0x7f2f2015dde0 2023-10-06T10:59:57.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.371+0000 7f2f11ffb700 1 -- 172.21.15.7:0/3945002520 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18802 (secure 0 0 0) 0x7f2f140564e0 con 0x7f2f2015dde0 2023-10-06T10:59:57.373 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:57.373 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:51.626116+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.374+0000 7f2f27d09700 1 -- 172.21.15.7:0/3945002520 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2f04066f30 msgr2=0x7f2f040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.374+0000 7f2f27d09700 1 --2- 172.21.15.7:0/3945002520 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2f04066f30 0x7f2f040693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c009d40 tx=0x7f2f1c008040 comp rx=0 tx=0).stop 2023-10-06T10:59:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.374+0000 7f2f27d09700 1 -- 172.21.15.7:0/3945002520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2015dde0 msgr2=0x7f2f20156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.374+0000 7f2f27d09700 1 --2- 172.21.15.7:0/3945002520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2015dde0 0x7f2f20156ce0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2f14006fd0 tx=0x7f2f14017000 comp rx=0 tx=0).stop 2023-10-06T10:59:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.374+0000 7f2f27d09700 1 -- 172.21.15.7:0/3945002520 shutdown_connections 2023-10-06T10:59:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.374+0000 7f2f27d09700 1 --2- 172.21.15.7:0/3945002520 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2f04066f30 0x7f2f040693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.374+0000 7f2f27d09700 1 --2- 172.21.15.7:0/3945002520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20161800 0x7f2f200ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.374+0000 7f2f27d09700 1 --2- 172.21.15.7:0/3945002520 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f2015d4d0 0x7f2f2016d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.374+0000 7f2f27d09700 1 --2- 172.21.15.7:0/3945002520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2015dde0 0x7f2f20156ce0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.374+0000 7f2f27d09700 1 -- 172.21.15.7:0/3945002520 >> 172.21.15.7:0/3945002520 conn(0x7f2f20096160 msgr2=0x7f2f2015e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:57.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.374+0000 7f2f27d09700 1 -- 172.21.15.7:0/3945002520 shutdown_connections 2023-10-06T10:59:57.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.374+0000 7f2f27d09700 1 -- 172.21.15.7:0/3945002520 wait complete. 2023-10-06T10:59:57.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T10:58:55.224661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T10:58:56.032929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T10:58:59.772827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T10:59:00.802230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T10:59:04.512252+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T10:59:57.389 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T10:59:57.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.524+0000 7f2e28513700 1 Processor -- start 2023-10-06T10:59:57.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.524+0000 7f2e28513700 1 -- start start 2023-10-06T10:59:57.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.525+0000 7f2e28513700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e200cab40 0x7f2e200694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.525+0000 7f2e28513700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e200caf10 0x7f2e200b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.525+0000 7f2e28513700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e200699e0 con 0x7f2e200b2260 2023-10-06T10:59:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.525+0000 7f2e28513700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e20069dd0 con 0x7f2e200caf10 2023-10-06T10:59:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.525+0000 7f2e28513700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2006a070 con 0x7f2e200cab40 2023-10-06T10:59:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.525+0000 7f2e25aae700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e200caf10 0x7f2e200b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.525+0000 7f2e25aae700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e200caf10 0x7f2e200b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35442/0 (socket says 172.21.15.7:35442) 2023-10-06T10:59:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.525+0000 7f2e25aae700 1 -- 172.21.15.7:0/898396716 learned_addr learned my addr 172.21.15.7:0/898396716 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.525+0000 7f2e262af700 1 --2- 172.21.15.7:0/898396716 >> v2:172.21.15.50:3300/0 conn(0x7f2e200cab40 0x7f2e200694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.526+0000 7f2e25aae700 1 -- 172.21.15.7:0/898396716 >> v2:172.21.15.50:3300/0 conn(0x7f2e200cab40 msgr2=0x7f2e200694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.526+0000 7f2e25aae700 1 --2- 172.21.15.7:0/898396716 >> v2:172.21.15.50:3300/0 conn(0x7f2e200cab40 0x7f2e200694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.526+0000 7f2e25aae700 1 -- 172.21.15.7:0/898396716 >> v1:172.21.15.50:6789/0 conn(0x7f2e200b2260 legacy=0x7f2e20159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.526+0000 7f2e25aae700 1 -- 172.21.15.7:0/898396716 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2006a350 con 0x7f2e200caf10 2023-10-06T10:59:57.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.526+0000 7f2e25aae700 1 --2- 172.21.15.7:0/898396716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200caf10 0x7f2e200b1d20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2e2006de70 tx=0x7f2e1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b24363d60607e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:57.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.526+0000 7f2e252ad700 1 -- 172.21.15.7:0/898396716 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c009e70 con 0x7f2e200caf10 2023-10-06T10:59:57.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.526+0000 7f2e252ad700 1 -- 172.21.15.7:0/898396716 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c00b860 con 0x7f2e200caf10 2023-10-06T10:59:57.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.526+0000 7f2e252ad700 1 -- 172.21.15.7:0/898396716 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c00bc00 con 0x7f2e200caf10 2023-10-06T10:59:57.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.526+0000 7f2e28513700 1 -- 172.21.15.7:0/898396716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200caf10 msgr2=0x7f2e200b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.526+0000 7f2e28513700 1 --2- 172.21.15.7:0/898396716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200caf10 0x7f2e200b1d20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2e2006de70 tx=0x7f2e1c009250 comp rx=0 tx=0).stop 2023-10-06T10:59:57.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.527+0000 7f2e28513700 1 -- 172.21.15.7:0/898396716 shutdown_connections 2023-10-06T10:59:57.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.527+0000 7f2e28513700 1 --2- 172.21.15.7:0/898396716 >> v2:172.21.15.50:3300/0 conn(0x7f2e200cab40 0x7f2e200694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.527+0000 7f2e28513700 1 --2- 172.21.15.7:0/898396716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200caf10 0x7f2e200b1d20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.527+0000 7f2e28513700 1 -- 172.21.15.7:0/898396716 >> 172.21.15.7:0/898396716 conn(0x7f2e200afc90 msgr2=0x7f2e200b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:57.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.527+0000 7f2e28513700 1 -- 172.21.15.7:0/898396716 shutdown_connections 2023-10-06T10:59:57.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.527+0000 7f2e28513700 1 -- 172.21.15.7:0/898396716 wait complete. 2023-10-06T10:59:57.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.528+0000 7f2e28513700 1 Processor -- start 2023-10-06T10:59:57.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.528+0000 7f2e28513700 1 -- start start 2023-10-06T10:59:57.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e28513700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200b2260 0x7f2e201678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e28513700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2e200cab40 0x7f2e200c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e28513700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e200caf10 0x7f2e200c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e28513700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e20168b10 con 0x7f2e200b2260 2023-10-06T10:59:57.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e28513700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e20167f00 con 0x7f2e200caf10 2023-10-06T10:59:57.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e28513700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e201681e0 con 0x7f2e200cab40 2023-10-06T10:59:57.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e262af700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200b2260 0x7f2e201678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e262af700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200b2260 0x7f2e201678d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35448/0 (socket says 172.21.15.7:35448) 2023-10-06T10:59:57.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e262af700 1 -- 172.21.15.7:0/492354811 learned_addr learned my addr 172.21.15.7:0/492354811 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:57.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e25aae700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2e200cab40 0x7f2e200c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e26ab0700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e200caf10 0x7f2e200c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e262af700 1 -- 172.21.15.7:0/492354811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2e200cab40 msgr2=0x7f2e200c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e262af700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2e200cab40 0x7f2e200c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e262af700 1 -- 172.21.15.7:0/492354811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e200caf10 msgr2=0x7f2e200c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e262af700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e200caf10 0x7f2e200c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e262af700 1 -- 172.21.15.7:0/492354811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c0094f0 con 0x7f2e200b2260 2023-10-06T10:59:57.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e26ab0700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e200caf10 0x7f2e200c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:57.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e262af700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200b2260 0x7f2e201678d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400ec80 tx=0x7f2e140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:57.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.529+0000 7f2e127fc700 1 -- 172.21.15.7:0/492354811 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1400c850 con 0x7f2e200b2260 2023-10-06T10:59:57.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.530+0000 7f2e127fc700 1 -- 172.21.15.7:0/492354811 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1400c9b0 con 0x7f2e200b2260 2023-10-06T10:59:57.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.530+0000 7f2e28513700 1 -- 172.21.15.7:0/492354811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e201684c0 con 0x7f2e200b2260 2023-10-06T10:59:57.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.530+0000 7f2e127fc700 1 -- 172.21.15.7:0/492354811 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1400cd50 con 0x7f2e200b2260 2023-10-06T10:59:57.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.530+0000 7f2e28513700 1 -- 172.21.15.7:0/492354811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2016b090 con 0x7f2e200b2260 2023-10-06T10:59:57.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.531+0000 7f2e28513700 1 -- 172.21.15.7:0/492354811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e20168f00 con 0x7f2e200b2260 2023-10-06T10:59:57.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.531+0000 7f2e127fc700 1 -- 172.21.15.7:0/492354811 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e14013680 con 0x7f2e200b2260 2023-10-06T10:59:57.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.532+0000 7f2e127fc700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2e04066f30 0x7f2e040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.532+0000 7f2e25aae700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2e04066f30 0x7f2e040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.532+0000 7f2e127fc700 1 -- 172.21.15.7:0/492354811 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f2e14084c80 con 0x7f2e200b2260 2023-10-06T10:59:57.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.532+0000 7f2e25aae700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2e04066f30 0x7f2e040693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2e2006de70 tx=0x7f2e1c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:57.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.536+0000 7f2e127fc700 1 -- 172.21.15.7:0/492354811 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e14051a60 con 0x7f2e200b2260 2023-10-06T10:59:57.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.739+0000 7f2e28513700 1 -- 172.21.15.7:0/492354811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2e20070480 con 0x7f2e200b2260 2023-10-06T10:59:57.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.740+0000 7f2e127fc700 1 -- 172.21.15.7:0/492354811 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2e14055080 con 0x7f2e200b2260 2023-10-06T10:59:57.742 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-10-06T10:59:57.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.742+0000 7f2e28513700 1 -- 172.21.15.7:0/492354811 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2e04066f30 msgr2=0x7f2e040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.742+0000 7f2e28513700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2e04066f30 0x7f2e040693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2e2006de70 tx=0x7f2e1c017000 comp rx=0 tx=0).stop 2023-10-06T10:59:57.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.742+0000 7f2e28513700 1 -- 172.21.15.7:0/492354811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200b2260 msgr2=0x7f2e201678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.742+0000 7f2e28513700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200b2260 0x7f2e201678d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400ec80 tx=0x7f2e140091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.742+0000 7f2e28513700 1 -- 172.21.15.7:0/492354811 shutdown_connections 2023-10-06T10:59:57.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.742+0000 7f2e28513700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2e04066f30 0x7f2e040693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.742+0000 7f2e28513700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200b2260 0x7f2e201678d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.742+0000 7f2e28513700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e200caf10 0x7f2e200c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.742+0000 7f2e28513700 1 --2- 172.21.15.7:0/492354811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2e200cab40 0x7f2e200c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.742+0000 7f2e28513700 1 -- 172.21.15.7:0/492354811 >> 172.21.15.7:0/492354811 conn(0x7f2e200afc90 msgr2=0x7f2e20150370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:57.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.742+0000 7f2e28513700 1 -- 172.21.15.7:0/492354811 shutdown_connections 2023-10-06T10:59:57.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.742+0000 7f2e28513700 1 -- 172.21.15.7:0/492354811 wait complete. 2023-10-06T10:59:57.757 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T10:59:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.891+0000 7f407ef4b700 1 Processor -- start 2023-10-06T10:59:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.891+0000 7f407ef4b700 1 -- start start 2023-10-06T10:59:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f407ef4b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f40780a6d30 0x7f40780ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f407ef4b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f40780aeb50 0x7f40780ac590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f407ef4b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40780a7100 0x7f40780acad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f407ef4b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407806b1e0 con 0x7f40780aeb50 2023-10-06T10:59:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f407ef4b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407806b4c0 con 0x7f40780a6d30 2023-10-06T10:59:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f407ef4b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407806b7a0 con 0x7f40780a7100 2023-10-06T10:59:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f4077fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f40780aeb50 0x7f40780ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f4077fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f40780aeb50 0x7f40780ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35458/0 (socket says 172.21.15.7:35458) 2023-10-06T10:59:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f4077fff700 1 -- 172.21.15.7:0/1566879704 learned_addr learned my addr 172.21.15.7:0/1566879704 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f407d4e8700 1 --2- 172.21.15.7:0/1566879704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40780a7100 0x7f40780acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f407cce7700 1 --2- 172.21.15.7:0/1566879704 >> v2:172.21.15.50:3300/0 conn(0x7f40780a6d30 0x7f40780ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f4077fff700 1 -- 172.21.15.7:0/1566879704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40780a7100 msgr2=0x7f40780acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f4077fff700 1 --2- 172.21.15.7:0/1566879704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40780a7100 0x7f40780acad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f4077fff700 1 -- 172.21.15.7:0/1566879704 >> v2:172.21.15.50:3300/0 conn(0x7f40780a6d30 msgr2=0x7f40780ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f4077fff700 1 --2- 172.21.15.7:0/1566879704 >> v2:172.21.15.50:3300/0 conn(0x7f40780a6d30 0x7f40780ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.892+0000 7f4077fff700 1 -- 172.21.15.7:0/1566879704 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407806ba80 con 0x7f40780aeb50 2023-10-06T10:59:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.893+0000 7f4077fff700 1 --2- 172.21.15.7:0/1566879704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40780aeb50 0x7f40780ac590 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f407806f9f0 tx=0x7f4064009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225c8fea4c66fe2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.893+0000 7f40777fe700 1 -- 172.21.15.7:0/1566879704 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406400b860 con 0x7f40780aeb50 2023-10-06T10:59:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.893+0000 7f40777fe700 1 -- 172.21.15.7:0/1566879704 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406400b9c0 con 0x7f40780aeb50 2023-10-06T10:59:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.893+0000 7f40777fe700 1 -- 172.21.15.7:0/1566879704 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406400bd60 con 0x7f40780aeb50 2023-10-06T10:59:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.893+0000 7f407ef4b700 1 -- 172.21.15.7:0/1566879704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40780aeb50 msgr2=0x7f40780ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.893+0000 7f407ef4b700 1 --2- 172.21.15.7:0/1566879704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40780aeb50 0x7f40780ac590 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f407806f9f0 tx=0x7f4064009250 comp rx=0 tx=0).stop 2023-10-06T10:59:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.893+0000 7f407ef4b700 1 -- 172.21.15.7:0/1566879704 shutdown_connections 2023-10-06T10:59:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.893+0000 7f407ef4b700 1 --2- 172.21.15.7:0/1566879704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40780a7100 0x7f40780acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.893+0000 7f407ef4b700 1 --2- 172.21.15.7:0/1566879704 >> v2:172.21.15.50:3300/0 conn(0x7f40780a6d30 0x7f40780ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.893+0000 7f407ef4b700 1 --2- 172.21.15.7:0/1566879704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40780aeb50 0x7f40780ac590 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.893+0000 7f407ef4b700 1 -- 172.21.15.7:0/1566879704 >> 172.21.15.7:0/1566879704 conn(0x7f40780cc560 msgr2=0x7f40780cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.893+0000 7f407ef4b700 1 -- 172.21.15.7:0/1566879704 shutdown_connections 2023-10-06T10:59:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.894+0000 7f407ef4b700 1 -- 172.21.15.7:0/1566879704 wait complete. 2023-10-06T10:59:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.895+0000 7f407ef4b700 1 Processor -- start 2023-10-06T10:59:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.895+0000 7f407ef4b700 1 -- start start 2023-10-06T10:59:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f407ef4b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40780a6d30 0x7f40780988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f407ef4b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40780a7100 0x7f407814a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f407ef4b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40780aeb50 0x7f4078095eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f407ef4b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407816ddb0 con 0x7f40780a7100 2023-10-06T10:59:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f407ef4b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407814af20 con 0x7f40780aeb50 2023-10-06T10:59:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f407ef4b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4078098f60 con 0x7f40780a6d30 2023-10-06T10:59:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f4077fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40780a7100 0x7f407814a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f4077fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40780a7100 0x7f407814a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35464/0 (socket says 172.21.15.7:35464) 2023-10-06T10:59:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f4077fff700 1 -- 172.21.15.7:0/711468523 learned_addr learned my addr 172.21.15.7:0/711468523 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f407cce7700 1 --2- 172.21.15.7:0/711468523 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40780a6d30 0x7f40780988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f407d4e8700 1 --2- 172.21.15.7:0/711468523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40780aeb50 0x7f4078095eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f4077fff700 1 -- 172.21.15.7:0/711468523 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40780a6d30 msgr2=0x7f40780988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f4077fff700 1 --2- 172.21.15.7:0/711468523 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40780a6d30 0x7f40780988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f4077fff700 1 -- 172.21.15.7:0/711468523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40780aeb50 msgr2=0x7f4078095eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f4077fff700 1 --2- 172.21.15.7:0/711468523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40780aeb50 0x7f4078095eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f4077fff700 1 -- 172.21.15.7:0/711468523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40640094f0 con 0x7f40780a7100 2023-10-06T10:59:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.896+0000 7f4077fff700 1 --2- 172.21.15.7:0/711468523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40780a7100 0x7f407814a9e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f407806fa20 tx=0x7f4064017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.897+0000 7f4074ff9700 1 -- 172.21.15.7:0/711468523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064011e40 con 0x7f40780a7100 2023-10-06T10:59:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.897+0000 7f4074ff9700 1 -- 172.21.15.7:0/711468523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406401a450 con 0x7f40780a7100 2023-10-06T10:59:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.897+0000 7f407ef4b700 1 -- 172.21.15.7:0/711468523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4078099240 con 0x7f40780a7100 2023-10-06T10:59:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.897+0000 7f4074ff9700 1 -- 172.21.15.7:0/711468523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406401a810 con 0x7f40780a7100 2023-10-06T10:59:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.897+0000 7f407ef4b700 1 -- 172.21.15.7:0/711468523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40780963f0 con 0x7f40780a7100 2023-10-06T10:59:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.898+0000 7f407ef4b700 1 -- 172.21.15.7:0/711468523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407816df20 con 0x7f40780a7100 2023-10-06T10:59:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.898+0000 7f4074ff9700 1 -- 172.21.15.7:0/711468523 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f406401abc0 con 0x7f40780a7100 2023-10-06T10:59:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.898+0000 7f4074ff9700 1 --2- 172.21.15.7:0/711468523 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f405c066f30 0x7f405c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.899+0000 7f4074ff9700 1 -- 172.21.15.7:0/711468523 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f4064086420 con 0x7f40780a7100 2023-10-06T10:59:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.899+0000 7f407cce7700 1 --2- 172.21.15.7:0/711468523 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f405c066f30 0x7f405c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.899+0000 7f407cce7700 1 --2- 172.21.15.7:0/711468523 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f405c066f30 0x7f405c0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f406c006fd0 tx=0x7f406c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:57.903+0000 7f4074ff9700 1 -- 172.21.15.7:0/711468523 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4064053200 con 0x7f40780a7100 2023-10-06T10:59:58.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.106+0000 7f407ef4b700 1 -- 172.21.15.7:0/711468523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4078070480 con 0x7f40780a7100 2023-10-06T10:59:58.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.106+0000 7f4074ff9700 1 -- 172.21.15.7:0/711468523 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4064056820 con 0x7f40780a7100 2023-10-06T10:59:58.108 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-06T10:59:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.108+0000 7f407ef4b700 1 -- 172.21.15.7:0/711468523 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f405c066f30 msgr2=0x7f405c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.108+0000 7f407ef4b700 1 --2- 172.21.15.7:0/711468523 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f405c066f30 0x7f405c0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f406c006fd0 tx=0x7f406c008040 comp rx=0 tx=0).stop 2023-10-06T10:59:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.108+0000 7f407ef4b700 1 -- 172.21.15.7:0/711468523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40780a7100 msgr2=0x7f407814a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.108+0000 7f407ef4b700 1 --2- 172.21.15.7:0/711468523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40780a7100 0x7f407814a9e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f407806fa20 tx=0x7f4064017000 comp rx=0 tx=0).stop 2023-10-06T10:59:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.109+0000 7f407ef4b700 1 -- 172.21.15.7:0/711468523 shutdown_connections 2023-10-06T10:59:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.109+0000 7f407ef4b700 1 --2- 172.21.15.7:0/711468523 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f405c066f30 0x7f405c0693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.109+0000 7f407ef4b700 1 --2- 172.21.15.7:0/711468523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40780aeb50 0x7f4078095eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.109+0000 7f407ef4b700 1 --2- 172.21.15.7:0/711468523 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40780a6d30 0x7f40780988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.109+0000 7f407ef4b700 1 --2- 172.21.15.7:0/711468523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40780a7100 0x7f407814a9e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.109+0000 7f407ef4b700 1 -- 172.21.15.7:0/711468523 >> 172.21.15.7:0/711468523 conn(0x7f40780cc560 msgr2=0x7f40780b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.109+0000 7f407ef4b700 1 -- 172.21.15.7:0/711468523 shutdown_connections 2023-10-06T10:59:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.109+0000 7f407ef4b700 1 -- 172.21.15.7:0/711468523 wait complete. 2023-10-06T10:59:58.124 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T10:59:58.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.258+0000 7f17b6673700 1 Processor -- start 2023-10-06T10:59:58.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.258+0000 7f17b6673700 1 -- start start 2023-10-06T10:59:58.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.259+0000 7f17b6673700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17b00cbdd0 0x7f17b00c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.259+0000 7f17b6673700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f17b00acab0 0x7f17b00acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.259+0000 7f17b6673700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b0068070 con 0x7f17b006b8e0 2023-10-06T10:59:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.259+0000 7f17b6673700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b00adb60 con 0x7f17b00acab0 2023-10-06T10:59:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.259+0000 7f17b6673700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00ad880 con 0x7f17b00cbdd0 2023-10-06T10:59:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.259+0000 7f17af7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f17b00acab0 0x7f17b00acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.259+0000 7f17af7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f17b00acab0 0x7f17b00acfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35472/0 (socket says 172.21.15.7:35472) 2023-10-06T10:59:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.259+0000 7f17af7fe700 1 -- 172.21.15.7:0/2500081012 learned_addr learned my addr 172.21.15.7:0/2500081012 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.259+0000 7f17affff700 1 --2- 172.21.15.7:0/2500081012 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17b00cbdd0 0x7f17b00c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.259+0000 7f17af7fe700 1 -- 172.21.15.7:0/2500081012 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17b00cbdd0 msgr2=0x7f17b00c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.259+0000 7f17af7fe700 1 --2- 172.21.15.7:0/2500081012 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17b00cbdd0 0x7f17b00c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.259+0000 7f17af7fe700 1 -- 172.21.15.7:0/2500081012 >> v1:172.21.15.50:6789/0 conn(0x7f17b006b8e0 legacy=0x7f17b0068500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.259+0000 7f17af7fe700 1 -- 172.21.15.7:0/2500081012 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b0067a20 con 0x7f17b00acab0 2023-10-06T10:59:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.259+0000 7f17af7fe700 1 --2- 172.21.15.7:0/2500081012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17b00acab0 0x7f17b00acfc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f17a40099b0 tx=0x7f17a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6a9a7c2de0daea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:58.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.260+0000 7f17aeffd700 1 -- 172.21.15.7:0/2500081012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a400b8f0 con 0x7f17b00acab0 2023-10-06T10:59:58.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.260+0000 7f17aeffd700 1 -- 172.21.15.7:0/2500081012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a400ba50 con 0x7f17b00acab0 2023-10-06T10:59:58.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.260+0000 7f17aeffd700 1 -- 172.21.15.7:0/2500081012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a400bdf0 con 0x7f17b00acab0 2023-10-06T10:59:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.260+0000 7f17b6673700 1 -- 172.21.15.7:0/2500081012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17b00acab0 msgr2=0x7f17b00acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.260+0000 7f17b6673700 1 --2- 172.21.15.7:0/2500081012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17b00acab0 0x7f17b00acfc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f17a40099b0 tx=0x7f17a4009250 comp rx=0 tx=0).stop 2023-10-06T10:59:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.260+0000 7f17b6673700 1 -- 172.21.15.7:0/2500081012 shutdown_connections 2023-10-06T10:59:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.260+0000 7f17b6673700 1 --2- 172.21.15.7:0/2500081012 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17b00cbdd0 0x7f17b00c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.260+0000 7f17b6673700 1 --2- 172.21.15.7:0/2500081012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17b00acab0 0x7f17b00acfc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.260+0000 7f17b6673700 1 -- 172.21.15.7:0/2500081012 >> 172.21.15.7:0/2500081012 conn(0x7f17b00cc560 msgr2=0x7f17b00cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.260+0000 7f17b6673700 1 -- 172.21.15.7:0/2500081012 shutdown_connections 2023-10-06T10:59:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.260+0000 7f17b6673700 1 -- 172.21.15.7:0/2500081012 wait complete. 2023-10-06T10:59:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.262+0000 7f17b6673700 1 Processor -- start 2023-10-06T10:59:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.262+0000 7f17b6673700 1 -- start start 2023-10-06T10:59:58.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.263+0000 7f17b6673700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17b006b8e0 0x7f17b00c2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.263+0000 7f17b6673700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b00acab0 0x7f17b0157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.263+0000 7f17b6673700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17b00cbdd0 0x7f17b0068400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.263+0000 7f17b6673700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00c1300 con 0x7f17b006b8e0 2023-10-06T10:59:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.263+0000 7f17b6673700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00c2850 con 0x7f17b00acab0 2023-10-06T10:59:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.263+0000 7f17b6673700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00c1550 con 0x7f17b00cbdd0 2023-10-06T10:59:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.263+0000 7f17affff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17b006b8e0 0x7f17b00c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.263+0000 7f17affff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17b006b8e0 0x7f17b00c2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35484/0 (socket says 172.21.15.7:35484) 2023-10-06T10:59:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.263+0000 7f17affff700 1 -- 172.21.15.7:0/540875762 learned_addr learned my addr 172.21.15.7:0/540875762 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.264+0000 7f17af7fe700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b00acab0 0x7f17b0157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.264+0000 7f17b4c10700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17b00cbdd0 0x7f17b0068400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.264+0000 7f17affff700 1 -- 172.21.15.7:0/540875762 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17b00cbdd0 msgr2=0x7f17b0068400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.264+0000 7f17affff700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17b00cbdd0 0x7f17b0068400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.264+0000 7f17affff700 1 -- 172.21.15.7:0/540875762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b00acab0 msgr2=0x7f17b0157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.264+0000 7f17affff700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b00acab0 0x7f17b0157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.264+0000 7f17affff700 1 -- 172.21.15.7:0/540875762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a40094f0 con 0x7f17b006b8e0 2023-10-06T10:59:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.264+0000 7f17b4c10700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17b00cbdd0 0x7f17b0068400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T10:59:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.264+0000 7f17affff700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17b006b8e0 0x7f17b00c2310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f17a000d890 tx=0x7f17a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.264+0000 7f1797fff700 1 -- 172.21.15.7:0/540875762 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a00125f0 con 0x7f17b006b8e0 2023-10-06T10:59:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.264+0000 7f1797fff700 1 -- 172.21.15.7:0/540875762 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a0012750 con 0x7f17b006b8e0 2023-10-06T10:59:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.264+0000 7f17b6673700 1 -- 172.21.15.7:0/540875762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b00c1830 con 0x7f17b006b8e0 2023-10-06T10:59:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.264+0000 7f1797fff700 1 -- 172.21.15.7:0/540875762 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0012ad0 con 0x7f17b006b8e0 2023-10-06T10:59:58.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.264+0000 7f17b6673700 1 -- 172.21.15.7:0/540875762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b00c1df0 con 0x7f17b006b8e0 2023-10-06T10:59:58.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.265+0000 7f17b6673700 1 -- 172.21.15.7:0/540875762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b00c1fe0 con 0x7f17b006b8e0 2023-10-06T10:59:58.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.266+0000 7f1797fff700 1 -- 172.21.15.7:0/540875762 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17a001e460 con 0x7f17b006b8e0 2023-10-06T10:59:58.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.266+0000 7f1797fff700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f179c066f30 0x7f179c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.266+0000 7f1797fff700 1 -- 172.21.15.7:0/540875762 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f17a0085080 con 0x7f17b006b8e0 2023-10-06T10:59:58.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.266+0000 7f17af7fe700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f179c066f30 0x7f179c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.267+0000 7f17af7fe700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f179c066f30 0x7f179c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f17a40099b0 tx=0x7f17a4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:58.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.271+0000 7f1797fff700 1 -- 172.21.15.7:0/540875762 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17a0051dc0 con 0x7f17b006b8e0 2023-10-06T10:59:58.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.474+0000 7f17b6673700 1 -- 172.21.15.7:0/540875762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17b0070480 con 0x7f17b006b8e0 2023-10-06T10:59:58.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.474+0000 7f1797fff700 1 -- 172.21.15.7:0/540875762 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f17a00553e0 con 0x7f17b006b8e0 2023-10-06T10:59:58.476 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T10:59:58.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.476+0000 7f17b6673700 1 -- 172.21.15.7:0/540875762 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f179c066f30 msgr2=0x7f179c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.476+0000 7f17b6673700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f179c066f30 0x7f179c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f17a40099b0 tx=0x7f17a4017000 comp rx=0 tx=0).stop 2023-10-06T10:59:58.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.476+0000 7f17b6673700 1 -- 172.21.15.7:0/540875762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17b006b8e0 msgr2=0x7f17b00c2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.476+0000 7f17b6673700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17b006b8e0 0x7f17b00c2310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f17a000d890 tx=0x7f17a0008040 comp rx=0 tx=0).stop 2023-10-06T10:59:58.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.476+0000 7f17b6673700 1 -- 172.21.15.7:0/540875762 shutdown_connections 2023-10-06T10:59:58.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.476+0000 7f17b6673700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f179c066f30 0x7f179c0693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.476+0000 7f17b6673700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17b006b8e0 0x7f17b00c2310 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.476+0000 7f17b6673700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17b00cbdd0 0x7f17b0068400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.476+0000 7f17b6673700 1 --2- 172.21.15.7:0/540875762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b00acab0 0x7f17b0157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.476+0000 7f17b6673700 1 -- 172.21.15.7:0/540875762 >> 172.21.15.7:0/540875762 conn(0x7f17b00cc560 msgr2=0x7f17b00abff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:58.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.476+0000 7f17b6673700 1 -- 172.21.15.7:0/540875762 shutdown_connections 2023-10-06T10:59:58.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.476+0000 7f17b6673700 1 -- 172.21.15.7:0/540875762 wait complete. 2023-10-06T10:59:58.492 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T10:59:58.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.625+0000 7f50279a3700 1 Processor -- start 2023-10-06T10:59:58.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.626+0000 7f50279a3700 1 -- start start 2023-10-06T10:59:58.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.627+0000 7f50279a3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f50200cd680 0x7f5020156a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.627+0000 7f50279a3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f502015b360 0x7f5020156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.627+0000 7f50279a3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502015bb80 con 0x7f502006dac0 2023-10-06T10:59:58.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.627+0000 7f50279a3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50200c92c0 con 0x7f502015b360 2023-10-06T10:59:58.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.627+0000 7f50279a3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50200cc1e0 con 0x7f50200cd680 2023-10-06T10:59:58.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.627+0000 7f502573f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f502006dac0 0x7f502015ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47818/0 (socket says 172.21.15.7:47818) 2023-10-06T10:59:58.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.627+0000 7f502573f700 1 -- 172.21.15.7:0/2915057142 learned_addr learned my addr 172.21.15.7:0/2915057142 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:58.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.627+0000 7f5024f3e700 1 --2- 172.21.15.7:0/2915057142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f50200cd680 0x7f5020156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.627+0000 7f5025f40700 1 --2- 172.21.15.7:0/2915057142 >> v2:172.21.15.50:3300/0 conn(0x7f502015b360 0x7f5020156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.627+0000 7f5013fff700 1 -- 172.21.15.7:0/2915057142 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199816785 0 0) 0x7f502015bb80 con 0x7f502006dac0 2023-10-06T10:59:58.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.627+0000 7f5013fff700 1 -- 172.21.15.7:0/2915057142 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f500c003570 con 0x7f502006dac0 2023-10-06T10:59:58.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.627+0000 7f5013fff700 1 -- 172.21.15.7:0/2915057142 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3924926110 0 0) 0x7f500c003570 con 0x7f502006dac0 2023-10-06T10:59:58.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5013fff700 1 -- 172.21.15.7:0/2915057142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f50200cd680 msgr2=0x7f5020156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:58.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5013fff700 1 --2- 172.21.15.7:0/2915057142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f50200cd680 0x7f5020156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5013fff700 1 -- 172.21.15.7:0/2915057142 >> v2:172.21.15.50:3300/0 conn(0x7f502015b360 msgr2=0x7f5020156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:58.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5013fff700 1 --2- 172.21.15.7:0/2915057142 >> v2:172.21.15.50:3300/0 conn(0x7f502015b360 0x7f5020156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5013fff700 1 -- 172.21.15.7:0/2915057142 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502015b8a0 con 0x7f502006dac0 2023-10-06T10:59:58.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5013fff700 1 -- 172.21.15.7:0/2915057142 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f5014001470 con 0x7f502006dac0 2023-10-06T10:59:58.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5013fff700 1 -- 172.21.15.7:0/2915057142 >> v1:172.21.15.7:6789/0 conn(0x7f502006dac0 legacy=0x7f502015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5013fff700 1 --2- 172.21.15.7:0/2915057142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500c003a60 0x7f500c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5013fff700 1 --2- 172.21.15.7:0/2915057142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f50200cd680 0x7f500c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5013fff700 1 --2- 172.21.15.7:0/2915057142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f500c004d50 0x7f500c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5013fff700 1 -- 172.21.15.7:0/2915057142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50200c92c0 con 0x7f500c004d50 2023-10-06T10:59:58.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5013fff700 1 -- 172.21.15.7:0/2915057142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50200cc1e0 con 0x7f500c003a60 2023-10-06T10:59:58.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5013fff700 1 -- 172.21.15.7:0/2915057142 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c00ba60 con 0x7f50200cd680 2023-10-06T10:59:58.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5025f40700 1 --2- 172.21.15.7:0/2915057142 >> v2:172.21.15.50:3300/0 conn(0x7f502015b360 0x7f5020156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:59:58.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5024f3e700 1 --2- 172.21.15.7:0/2915057142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f50200cd680 0x7f500c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5025f40700 1 --2- 172.21.15.7:0/2915057142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f500c004d50 0x7f500c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f502573f700 1 --2- 172.21.15.7:0/2915057142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500c003a60 0x7f500c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5025f40700 1 -- 172.21.15.7:0/2915057142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f50200cd680 msgr2=0x7f500c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:58.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5025f40700 1 --2- 172.21.15.7:0/2915057142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f50200cd680 0x7f500c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5025f40700 1 -- 172.21.15.7:0/2915057142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500c003a60 msgr2=0x7f500c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:58.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5025f40700 1 --2- 172.21.15.7:0/2915057142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500c003a60 0x7f500c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5025f40700 1 -- 172.21.15.7:0/2915057142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c003570 con 0x7f500c004d50 2023-10-06T10:59:58.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.628+0000 7f5025f40700 1 --2- 172.21.15.7:0/2915057142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f500c004d50 0x7f500c0051c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f501800e3c0 tx=0x7f501800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565159f3148cb861 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:58.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.629+0000 7f5013fff700 1 -- 172.21.15.7:0/2915057142 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501800ec10 con 0x7f500c004d50 2023-10-06T10:59:58.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.629+0000 7f5013fff700 1 -- 172.21.15.7:0/2915057142 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501800f040 con 0x7f500c004d50 2023-10-06T10:59:58.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.629+0000 7f5013fff700 1 -- 172.21.15.7:0/2915057142 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018014480 con 0x7f500c004d50 2023-10-06T10:59:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.629+0000 7f50279a3700 1 -- 172.21.15.7:0/2915057142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f500c004d50 msgr2=0x7f500c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.629+0000 7f50279a3700 1 --2- 172.21.15.7:0/2915057142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f500c004d50 0x7f500c0051c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f501800e3c0 tx=0x7f501800b040 comp rx=0 tx=0).stop 2023-10-06T10:59:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.629+0000 7f5025f40700 1 -- 172.21.15.7:0/2915057142 reap_dead start 2023-10-06T10:59:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.629+0000 7f50279a3700 1 -- 172.21.15.7:0/2915057142 shutdown_connections 2023-10-06T10:59:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.629+0000 7f50279a3700 1 -- 172.21.15.7:0/2915057142 >> 172.21.15.7:0/2915057142 conn(0x7f502006cd00 msgr2=0x7f50200cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.629+0000 7f50279a3700 1 -- 172.21.15.7:0/2915057142 shutdown_connections 2023-10-06T10:59:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.629+0000 7f50279a3700 1 -- 172.21.15.7:0/2915057142 wait complete. 2023-10-06T10:59:58.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.630+0000 7f50279a3700 1 Processor -- start 2023-10-06T10:59:58.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.630+0000 7f50279a3700 1 -- start start 2023-10-06T10:59:58.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.631+0000 7f50279a3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5020142860 0x7f50201684c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.631+0000 7f50279a3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50200b0420 0x7f50201672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.631+0000 7f50279a3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5020142c30 0x7f50201545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.631+0000 7f50279a3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50200adcd0 con 0x7f5020142860 2023-10-06T10:59:58.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.631+0000 7f50279a3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50200adfb0 con 0x7f50200b0420 2023-10-06T10:59:58.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.631+0000 7f50279a3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5020167b90 con 0x7f5020142c30 2023-10-06T10:59:58.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.631+0000 7f502573f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5020142860 0x7f50201684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f502573f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5020142860 0x7f50201684c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35504/0 (socket says 172.21.15.7:35504) 2023-10-06T10:59:58.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f502573f700 1 -- 172.21.15.7:0/710940772 learned_addr learned my addr 172.21.15.7:0/710940772 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:58.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f502573f700 1 -- 172.21.15.7:0/710940772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5020142c30 msgr2=0x7f50201545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f5024f3e700 1 --2- 172.21.15.7:0/710940772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50200b0420 0x7f50201672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f5025f40700 1 --2- 172.21.15.7:0/710940772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5020142c30 0x7f50201545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f502573f700 1 --2- 172.21.15.7:0/710940772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5020142c30 0x7f50201545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f502573f700 1 -- 172.21.15.7:0/710940772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50200b0420 msgr2=0x7f50201672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f502573f700 1 --2- 172.21.15.7:0/710940772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50200b0420 0x7f50201672c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f502573f700 1 -- 172.21.15.7:0/710940772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020167e70 con 0x7f5020142860 2023-10-06T10:59:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f502573f700 1 --2- 172.21.15.7:0/710940772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5020142860 0x7f50201684c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5014007390 tx=0x7f5014001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f50117fa700 1 -- 172.21.15.7:0/710940772 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501400f8d0 con 0x7f5020142860 2023-10-06T10:59:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f50117fa700 1 -- 172.21.15.7:0/710940772 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501400fa30 con 0x7f5020142860 2023-10-06T10:59:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f50117fa700 1 -- 172.21.15.7:0/710940772 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501400fdf0 con 0x7f5020142860 2023-10-06T10:59:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f50279a3700 1 -- 172.21.15.7:0/710940772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5020168150 con 0x7f5020142860 2023-10-06T10:59:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.632+0000 7f50279a3700 1 -- 172.21.15.7:0/710940772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5020167800 con 0x7f5020142860 2023-10-06T10:59:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.633+0000 7f50279a3700 1 -- 172.21.15.7:0/710940772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5020070480 con 0x7f5020142860 2023-10-06T10:59:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.634+0000 7f50117fa700 1 -- 172.21.15.7:0/710940772 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50140135c0 con 0x7f5020142860 2023-10-06T10:59:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.634+0000 7f50117fa700 1 --2- 172.21.15.7:0/710940772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5004066f30 0x7f50040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.634+0000 7f50117fa700 1 -- 172.21.15.7:0/710940772 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f50140848c0 con 0x7f5020142860 2023-10-06T10:59:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.634+0000 7f5024f3e700 1 --2- 172.21.15.7:0/710940772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5004066f30 0x7f50040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.635+0000 7f5024f3e700 1 --2- 172.21.15.7:0/710940772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5004066f30 0x7f50040693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5020156550 tx=0x7f501c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:58.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.639+0000 7f50117fa700 1 -- 172.21.15.7:0/710940772 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50140516a0 con 0x7f5020142860 2023-10-06T10:59:58.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.840+0000 7f50279a3700 1 -- 172.21.15.7:0/710940772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50200cbb90 con 0x7f5020142860 2023-10-06T10:59:58.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.840+0000 7f50117fa700 1 -- 172.21.15.7:0/710940772 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f501401a020 con 0x7f5020142860 2023-10-06T10:59:58.842 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-06T10:59:58.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.843+0000 7f50279a3700 1 -- 172.21.15.7:0/710940772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5004066f30 msgr2=0x7f50040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.843+0000 7f50279a3700 1 --2- 172.21.15.7:0/710940772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5004066f30 0x7f50040693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5020156550 tx=0x7f501c008040 comp rx=0 tx=0).stop 2023-10-06T10:59:58.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.843+0000 7f50279a3700 1 -- 172.21.15.7:0/710940772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5020142860 msgr2=0x7f50201684c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.843+0000 7f50279a3700 1 --2- 172.21.15.7:0/710940772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5020142860 0x7f50201684c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5014007390 tx=0x7f5014001e50 comp rx=0 tx=0).stop 2023-10-06T10:59:58.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.843+0000 7f50279a3700 1 -- 172.21.15.7:0/710940772 shutdown_connections 2023-10-06T10:59:58.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.843+0000 7f50279a3700 1 --2- 172.21.15.7:0/710940772 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f5004066f30 0x7f50040693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.843+0000 7f50279a3700 1 --2- 172.21.15.7:0/710940772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5020142860 0x7f50201684c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.843+0000 7f50279a3700 1 --2- 172.21.15.7:0/710940772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5020142c30 0x7f50201545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.843+0000 7f50279a3700 1 --2- 172.21.15.7:0/710940772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50200b0420 0x7f50201672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.843+0000 7f50279a3700 1 -- 172.21.15.7:0/710940772 >> 172.21.15.7:0/710940772 conn(0x7f502006cd00 msgr2=0x7f50201551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:58.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.843+0000 7f50279a3700 1 -- 172.21.15.7:0/710940772 shutdown_connections 2023-10-06T10:59:58.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.843+0000 7f50279a3700 1 -- 172.21.15.7:0/710940772 wait complete. 2023-10-06T10:59:58.858 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T10:59:58.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.991+0000 7f4eb259e700 1 Processor -- start 2023-10-06T10:59:58.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.991+0000 7f4eb259e700 1 -- start start 2023-10-06T10:59:58.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.992+0000 7f4eb259e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4eac0b01c0 0x7f4eac0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.992+0000 7f4eb259e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4eac0c91c0 0x7f4eac0cca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:58.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.992+0000 7f4eb259e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eac0cedc0 con 0x7f4eac0b0590 2023-10-06T10:59:58.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.992+0000 7f4eb259e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac0c9720 con 0x7f4eac0b01c0 2023-10-06T10:59:58.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.992+0000 7f4eb259e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac0c9a00 con 0x7f4eac0c91c0 2023-10-06T10:59:58.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.992+0000 7f4eabfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4eac0b01c0 0x7f4eac0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.992+0000 7f4eabfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4eac0b01c0 0x7f4eac0cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35516/0 (socket says 172.21.15.7:35516) 2023-10-06T10:59:58.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.992+0000 7f4eabfff700 1 -- 172.21.15.7:0/3956312095 learned_addr learned my addr 172.21.15.7:0/3956312095 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:58.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.992+0000 7f4eb0b3b700 1 --2- 172.21.15.7:0/3956312095 >> v2:172.21.15.50:3300/0 conn(0x7f4eac0c91c0 0x7f4eac0cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:58.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.992+0000 7f4eabfff700 1 -- 172.21.15.7:0/3956312095 >> v2:172.21.15.50:3300/0 conn(0x7f4eac0c91c0 msgr2=0x7f4eac0cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:58.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.992+0000 7f4eabfff700 1 --2- 172.21.15.7:0/3956312095 >> v2:172.21.15.50:3300/0 conn(0x7f4eac0c91c0 0x7f4eac0cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.992+0000 7f4eabfff700 1 -- 172.21.15.7:0/3956312095 >> v1:172.21.15.50:6789/0 conn(0x7f4eac0b0590 legacy=0x7f4eac0c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:58.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.992+0000 7f4eabfff700 1 -- 172.21.15.7:0/3956312095 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0c9ce0 con 0x7f4eac0b01c0 2023-10-06T10:59:58.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.993+0000 7f4eabfff700 1 --2- 172.21.15.7:0/3956312095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac0b01c0 0x7f4eac0cc500 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0b0a00 tx=0x7f4e9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a021eddea68a4f43 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:58.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.993+0000 7f4eaaffd700 1 -- 172.21.15.7:0/3956312095 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c00b820 con 0x7f4eac0b01c0 2023-10-06T10:59:58.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.993+0000 7f4eaaffd700 1 -- 172.21.15.7:0/3956312095 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c00b980 con 0x7f4eac0b01c0 2023-10-06T10:59:58.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.993+0000 7f4eaaffd700 1 -- 172.21.15.7:0/3956312095 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c00bd20 con 0x7f4eac0b01c0 2023-10-06T10:59:58.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.993+0000 7f4eb259e700 1 -- 172.21.15.7:0/3956312095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac0b01c0 msgr2=0x7f4eac0cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:58.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.993+0000 7f4eb259e700 1 --2- 172.21.15.7:0/3956312095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac0b01c0 0x7f4eac0cc500 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0b0a00 tx=0x7f4e9c009250 comp rx=0 tx=0).stop 2023-10-06T10:59:58.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.993+0000 7f4eb259e700 1 -- 172.21.15.7:0/3956312095 shutdown_connections 2023-10-06T10:59:58.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.993+0000 7f4eb259e700 1 --2- 172.21.15.7:0/3956312095 >> v2:172.21.15.50:3300/0 conn(0x7f4eac0c91c0 0x7f4eac0cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.993+0000 7f4eb259e700 1 --2- 172.21.15.7:0/3956312095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac0b01c0 0x7f4eac0cc500 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:58.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.993+0000 7f4eb259e700 1 -- 172.21.15.7:0/3956312095 >> 172.21.15.7:0/3956312095 conn(0x7f4eac06cd00 msgr2=0x7f4eac0cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:58.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.993+0000 7f4eb259e700 1 -- 172.21.15.7:0/3956312095 shutdown_connections 2023-10-06T10:59:58.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.993+0000 7f4eb259e700 1 -- 172.21.15.7:0/3956312095 wait complete. 2023-10-06T10:59:59.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.995+0000 7f4eb259e700 1 Processor -- start 2023-10-06T10:59:59.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.995+0000 7f4eb259e700 1 -- start start 2023-10-06T10:59:59.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb259e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4eac0b01c0 0x7f4eac145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb259e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4eac0b0590 0x7f4eac15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb259e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac0c91c0 0x7f4eac069440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb259e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac155960 con 0x7f4eac0c91c0 2023-10-06T10:59:59.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb259e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac145f70 con 0x7f4eac0b01c0 2023-10-06T10:59:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb259e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac15af30 con 0x7f4eac0b0590 2023-10-06T10:59:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb0b3b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac0c91c0 0x7f4eac069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eabfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4eac0b01c0 0x7f4eac145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb0b3b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac0c91c0 0x7f4eac069440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35526/0 (socket says 172.21.15.7:35526) 2023-10-06T10:59:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eabfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4eac0b01c0 0x7f4eac145a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:48900/0 (socket says 172.21.15.7:48900) 2023-10-06T10:59:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb0b3b700 1 -- 172.21.15.7:0/3144197227 learned_addr learned my addr 172.21.15.7:0/3144197227 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eab7fe700 1 --2- 172.21.15.7:0/3144197227 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4eac0b0590 0x7f4eac15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb0b3b700 1 -- 172.21.15.7:0/3144197227 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4eac0b0590 msgr2=0x7f4eac15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb0b3b700 1 --2- 172.21.15.7:0/3144197227 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4eac0b0590 0x7f4eac15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb0b3b700 1 -- 172.21.15.7:0/3144197227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4eac0b01c0 msgr2=0x7f4eac145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb0b3b700 1 --2- 172.21.15.7:0/3144197227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4eac0b01c0 0x7f4eac145a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb0b3b700 1 -- 172.21.15.7:0/3144197227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c0094f0 con 0x7f4eac0c91c0 2023-10-06T10:59:59.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eabfff700 1 --2- 172.21.15.7:0/3144197227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4eac0b01c0 0x7f4eac145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T10:59:59.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.996+0000 7f4eb0b3b700 1 --2- 172.21.15.7:0/3144197227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac0c91c0 0x7f4eac069440 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4007f20 tx=0x7f4ea4009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:59.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.997+0000 7f4e93fff700 1 -- 172.21.15.7:0/3144197227 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea400eb90 con 0x7f4eac0c91c0 2023-10-06T10:59:59.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.997+0000 7f4e93fff700 1 -- 172.21.15.7:0/3144197227 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea400ed10 con 0x7f4eac0c91c0 2023-10-06T10:59:59.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.997+0000 7f4eb259e700 1 -- 172.21.15.7:0/3144197227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac15b210 con 0x7f4eac0c91c0 2023-10-06T10:59:59.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.997+0000 7f4e93fff700 1 -- 172.21.15.7:0/3144197227 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4014670 con 0x7f4eac0c91c0 2023-10-06T10:59:59.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.997+0000 7f4eb259e700 1 -- 172.21.15.7:0/3144197227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac15b7d0 con 0x7f4eac0c91c0 2023-10-06T10:59:59.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.998+0000 7f4eb259e700 1 -- 172.21.15.7:0/3144197227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eac070480 con 0x7f4eac0c91c0 2023-10-06T10:59:59.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.998+0000 7f4e93fff700 1 -- 172.21.15.7:0/3144197227 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ea40149e0 con 0x7f4eac0c91c0 2023-10-06T10:59:59.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.998+0000 7f4e93fff700 1 --2- 172.21.15.7:0/3144197227 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4e98066f30 0x7f4e980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.999+0000 7f4e93fff700 1 -- 172.21.15.7:0/3144197227 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f4ea4084ff0 con 0x7f4eac0c91c0 2023-10-06T10:59:59.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.999+0000 7f4eabfff700 1 --2- 172.21.15.7:0/3144197227 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4e98066f30 0x7f4e980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:58.999+0000 7f4eabfff700 1 --2- 172.21.15.7:0/3144197227 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4e98066f30 0x7f4e980693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0b0a00 tx=0x7f4e9c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:59.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.003+0000 7f4e93fff700 1 -- 172.21.15.7:0/3144197227 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ea4051d70 con 0x7f4eac0c91c0 2023-10-06T10:59:59.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.205+0000 7f4eb259e700 1 -- 172.21.15.7:0/3144197227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4eac0c9fc0 con 0x7f4eac0c91c0 2023-10-06T10:59:59.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.206+0000 7f4e93fff700 1 -- 172.21.15.7:0/3144197227 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4ea4055390 con 0x7f4eac0c91c0 2023-10-06T10:59:59.208 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T10:59:59.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.208+0000 7f4eb259e700 1 -- 172.21.15.7:0/3144197227 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4e98066f30 msgr2=0x7f4e980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.208+0000 7f4eb259e700 1 --2- 172.21.15.7:0/3144197227 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4e98066f30 0x7f4e980693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0b0a00 tx=0x7f4e9c016000 comp rx=0 tx=0).stop 2023-10-06T10:59:59.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.208+0000 7f4eb259e700 1 -- 172.21.15.7:0/3144197227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac0c91c0 msgr2=0x7f4eac069440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.208+0000 7f4eb259e700 1 --2- 172.21.15.7:0/3144197227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac0c91c0 0x7f4eac069440 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4007f20 tx=0x7f4ea4009860 comp rx=0 tx=0).stop 2023-10-06T10:59:59.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.208+0000 7f4eb259e700 1 -- 172.21.15.7:0/3144197227 shutdown_connections 2023-10-06T10:59:59.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.208+0000 7f4eb259e700 1 --2- 172.21.15.7:0/3144197227 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4e98066f30 0x7f4e980693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.208+0000 7f4eb259e700 1 --2- 172.21.15.7:0/3144197227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac0c91c0 0x7f4eac069440 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.208+0000 7f4eb259e700 1 --2- 172.21.15.7:0/3144197227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4eac0b01c0 0x7f4eac145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.208+0000 7f4eb259e700 1 --2- 172.21.15.7:0/3144197227 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4eac0b0590 0x7f4eac15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.208+0000 7f4eb259e700 1 -- 172.21.15.7:0/3144197227 >> 172.21.15.7:0/3144197227 conn(0x7f4eac06cd00 msgr2=0x7f4eac0c2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:59.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.208+0000 7f4eb259e700 1 -- 172.21.15.7:0/3144197227 shutdown_connections 2023-10-06T10:59:59.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.208+0000 7f4eb259e700 1 -- 172.21.15.7:0/3144197227 wait complete. 2023-10-06T10:59:59.223 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T10:59:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.353+0000 7f7902c05700 1 Processor -- start 2023-10-06T10:59:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.353+0000 7f7902c05700 1 -- start start 2023-10-06T10:59:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.355+0000 7f7902c05700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78fc0a6c60 0x7f78fc0a7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.355+0000 7f7902c05700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78fc0c8af0 0x7f78fc0ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.355+0000 7f7902c05700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc0caa70 con 0x7f78fc0afb40 2023-10-06T10:59:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.355+0000 7f7902c05700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78fc0ad7f0 con 0x7f78fc0a6c60 2023-10-06T10:59:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.355+0000 7f7902c05700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0ca460 con 0x7f78fc0c8af0 2023-10-06T10:59:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.355+0000 7f79009a1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78fc0a6c60 0x7f78fc0a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.355+0000 7f78fbfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78fc0c8af0 0x7f78fc0ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.355+0000 7f79009a1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78fc0a6c60 0x7f78fc0a7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:48902/0 (socket says 172.21.15.7:48902) 2023-10-06T10:59:59.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.355+0000 7f79009a1700 1 -- 172.21.15.7:0/2224328524 learned_addr learned my addr 172.21.15.7:0/2224328524 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:59.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.355+0000 7f79011a2700 1 --1- 172.21.15.7:0/2224328524 >> v1:172.21.15.50:6789/0 conn(0x7f78fc0afb40 0x7f78fc0abe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:59152/0 (socket says 172.21.15.7:59152) 2023-10-06T10:59:59.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.355+0000 7f79009a1700 1 -- 172.21.15.7:0/2224328524 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78fc0c8af0 msgr2=0x7f78fc0ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:59.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.355+0000 7f79009a1700 1 --2- 172.21.15.7:0/2224328524 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78fc0c8af0 0x7f78fc0ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.355+0000 7f79009a1700 1 -- 172.21.15.7:0/2224328524 >> v1:172.21.15.50:6789/0 conn(0x7f78fc0afb40 legacy=0x7f78fc0abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.355+0000 7f79009a1700 1 -- 172.21.15.7:0/2224328524 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0ad9f0 con 0x7f78fc0a6c60 2023-10-06T10:59:59.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.356+0000 7f79009a1700 1 --2- 172.21.15.7:0/2224328524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78fc0a6c60 0x7f78fc0a7030 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0099b0 tx=0x7f78ec009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7869dc3bfa4e211a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:59.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.356+0000 7f78fb7fe700 1 -- 172.21.15.7:0/2224328524 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec009ea0 con 0x7f78fc0a6c60 2023-10-06T10:59:59.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.356+0000 7f78fb7fe700 1 -- 172.21.15.7:0/2224328524 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec00b860 con 0x7f78fc0a6c60 2023-10-06T10:59:59.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.356+0000 7f78fb7fe700 1 -- 172.21.15.7:0/2224328524 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec00bc00 con 0x7f78fc0a6c60 2023-10-06T10:59:59.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.356+0000 7f7902c05700 1 -- 172.21.15.7:0/2224328524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78fc0a6c60 msgr2=0x7f78fc0a7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.356+0000 7f7902c05700 1 --2- 172.21.15.7:0/2224328524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78fc0a6c60 0x7f78fc0a7030 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0099b0 tx=0x7f78ec009250 comp rx=0 tx=0).stop 2023-10-06T10:59:59.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.356+0000 7f7902c05700 1 -- 172.21.15.7:0/2224328524 shutdown_connections 2023-10-06T10:59:59.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.356+0000 7f7902c05700 1 --2- 172.21.15.7:0/2224328524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78fc0a6c60 0x7f78fc0a7030 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.356+0000 7f7902c05700 1 --2- 172.21.15.7:0/2224328524 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78fc0c8af0 0x7f78fc0ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.356+0000 7f7902c05700 1 -- 172.21.15.7:0/2224328524 >> 172.21.15.7:0/2224328524 conn(0x7f78fc095a70 msgr2=0x7f78fc0af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:59.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.356+0000 7f7902c05700 1 -- 172.21.15.7:0/2224328524 shutdown_connections 2023-10-06T10:59:59.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.357+0000 7f7902c05700 1 -- 172.21.15.7:0/2224328524 wait complete. 2023-10-06T10:59:59.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.358+0000 7f7902c05700 1 Processor -- start 2023-10-06T10:59:59.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.358+0000 7f7902c05700 1 -- start start 2023-10-06T10:59:59.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.359+0000 7f7902c05700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78fc0a6c60 0x7f78fc165520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.359+0000 7f7902c05700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78fc0afb40 0x7f78fc098370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.359+0000 7f7902c05700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78fc0c8af0 0x7f78fc155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.359+0000 7f7902c05700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc165e30 con 0x7f78fc0c8af0 2023-10-06T10:59:59.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.359+0000 7f7902c05700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc166110 con 0x7f78fc0a6c60 2023-10-06T10:59:59.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.359+0000 7f7902c05700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc1663f0 con 0x7f78fc0afb40 2023-10-06T10:59:59.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.359+0000 7f79011a2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78fc0c8af0 0x7f78fc155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f79011a2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78fc0c8af0 0x7f78fc155bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35532/0 (socket says 172.21.15.7:35532) 2023-10-06T10:59:59.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f79011a2700 1 -- 172.21.15.7:0/1622177901 learned_addr learned my addr 172.21.15.7:0/1622177901 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:59.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f79009a1700 1 --2- 172.21.15.7:0/1622177901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78fc0a6c60 0x7f78fc165520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f78fbfff700 1 --2- 172.21.15.7:0/1622177901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78fc0afb40 0x7f78fc098370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f79011a2700 1 -- 172.21.15.7:0/1622177901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78fc0afb40 msgr2=0x7f78fc098370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f79011a2700 1 --2- 172.21.15.7:0/1622177901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78fc0afb40 0x7f78fc098370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f79011a2700 1 -- 172.21.15.7:0/1622177901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78fc0a6c60 msgr2=0x7f78fc165520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f79011a2700 1 --2- 172.21.15.7:0/1622177901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78fc0a6c60 0x7f78fc165520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f79011a2700 1 -- 172.21.15.7:0/1622177901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec0094f0 con 0x7f78fc0c8af0 2023-10-06T10:59:59.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f79011a2700 1 --2- 172.21.15.7:0/1622177901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78fc0c8af0 0x7f78fc155bd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f78f400cd00 tx=0x7f78f4001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:59.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f78f8ff9700 1 -- 172.21.15.7:0/1622177901 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4005df0 con 0x7f78fc0c8af0 2023-10-06T10:59:59.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f78f8ff9700 1 -- 172.21.15.7:0/1622177901 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f400a960 con 0x7f78fc0c8af0 2023-10-06T10:59:59.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f78f8ff9700 1 -- 172.21.15.7:0/1622177901 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f400ad00 con 0x7f78fc0c8af0 2023-10-06T10:59:59.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f7902c05700 1 -- 172.21.15.7:0/1622177901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc0a9c20 con 0x7f78fc0c8af0 2023-10-06T10:59:59.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.360+0000 7f7902c05700 1 -- 172.21.15.7:0/1622177901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc0a9840 con 0x7f78fc0c8af0 2023-10-06T10:59:59.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.361+0000 7f7902c05700 1 -- 172.21.15.7:0/1622177901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc070480 con 0x7f78fc0c8af0 2023-10-06T10:59:59.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.362+0000 7f78f8ff9700 1 -- 172.21.15.7:0/1622177901 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78f4007300 con 0x7f78fc0c8af0 2023-10-06T10:59:59.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.362+0000 7f78f8ff9700 1 --2- 172.21.15.7:0/1622177901 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f78dc066f30 0x7f78dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.362+0000 7f78f8ff9700 1 -- 172.21.15.7:0/1622177901 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f78f4084c20 con 0x7f78fc0c8af0 2023-10-06T10:59:59.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.362+0000 7f79009a1700 1 --2- 172.21.15.7:0/1622177901 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f78dc066f30 0x7f78dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.363+0000 7f79009a1700 1 --2- 172.21.15.7:0/1622177901 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f78dc066f30 0x7f78dc0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0099b0 tx=0x7f78ec017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:59.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.367+0000 7f78f8ff9700 1 -- 172.21.15.7:0/1622177901 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78f4051960 con 0x7f78fc0c8af0 2023-10-06T10:59:59.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.614+0000 7f7902c05700 1 -- 172.21.15.7:0/1622177901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78fc0ca700 con 0x7f78fc0c8af0 2023-10-06T10:59:59.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.615+0000 7f78f8ff9700 1 -- 172.21.15.7:0/1622177901 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4581 (secure 0 0 0) 0x7f78f400ae60 con 0x7f78fc0c8af0 2023-10-06T10:59:59.617 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:59.617 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/941534596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":941534596},{"type":"v1","addr":"172.21.15.50:6835","nonce":941534596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3152699387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3152699387},{"type":"v1","addr":"172.21.15.50:6834","nonce":3152699387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/271704556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":271704556},{"type":"v1","addr":"172.21.15.7:6837","nonce":271704556}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T10:59:01.833627+0000","modified":"2023-10-06T10:59:21.515113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3123178887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3123178887},{"type":"v1","addr":"172.21.15.7:6836","nonce":3123178887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T10:59:59.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.617+0000 7f7902c05700 1 -- 172.21.15.7:0/1622177901 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f78dc066f30 msgr2=0x7f78dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.617+0000 7f7902c05700 1 --2- 172.21.15.7:0/1622177901 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f78dc066f30 0x7f78dc0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0099b0 tx=0x7f78ec017000 comp rx=0 tx=0).stop 2023-10-06T10:59:59.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.617+0000 7f7902c05700 1 -- 172.21.15.7:0/1622177901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78fc0c8af0 msgr2=0x7f78fc155bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.617+0000 7f7902c05700 1 --2- 172.21.15.7:0/1622177901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78fc0c8af0 0x7f78fc155bd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f78f400cd00 tx=0x7f78f4001b10 comp rx=0 tx=0).stop 2023-10-06T10:59:59.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.617+0000 7f7902c05700 1 -- 172.21.15.7:0/1622177901 shutdown_connections 2023-10-06T10:59:59.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.617+0000 7f7902c05700 1 --2- 172.21.15.7:0/1622177901 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f78dc066f30 0x7f78dc0693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.617+0000 7f7902c05700 1 --2- 172.21.15.7:0/1622177901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78fc0c8af0 0x7f78fc155bd0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.617+0000 7f7902c05700 1 --2- 172.21.15.7:0/1622177901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78fc0a6c60 0x7f78fc165520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.617+0000 7f7902c05700 1 --2- 172.21.15.7:0/1622177901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78fc0afb40 0x7f78fc098370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.617+0000 7f7902c05700 1 -- 172.21.15.7:0/1622177901 >> 172.21.15.7:0/1622177901 conn(0x7f78fc095a70 msgr2=0x7f78fc1565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:59.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.617+0000 7f7902c05700 1 -- 172.21.15.7:0/1622177901 shutdown_connections 2023-10-06T10:59:59.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.617+0000 7f7902c05700 1 -- 172.21.15.7:0/1622177901 wait complete. 2023-10-06T10:59:59.620 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2023-10-06T10:59:59.632 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T10:59:59.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.763+0000 7f6f1dcaa700 1 Processor -- start 2023-10-06T10:59:59.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.763+0000 7f6f1dcaa700 1 -- start start 2023-10-06T10:59:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f1dcaa700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f18159240 0x7f6f1815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f1dcaa700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6f1815ced0 0x7f6f1815d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f1dcaa700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f1815b210 con 0x7f6f180cc8e0 2023-10-06T10:59:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f1dcaa700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f18068a90 con 0x7f6f1815ced0 2023-10-06T10:59:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f1dcaa700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180698b0 con 0x7f6f18159240 2023-10-06T10:59:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f16ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6f1815ced0 0x7f6f1815d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f17fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6f180cc8e0 0x7f6f180ccd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47830/0 (socket says 172.21.15.7:47830) 2023-10-06T10:59:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f17fff700 1 -- 172.21.15.7:0/2677274316 learned_addr learned my addr 172.21.15.7:0/2677274316 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T10:59:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f177fe700 1 --2- 172.21.15.7:0/2677274316 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f18159240 0x7f6f1815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f16ffd700 1 -- 172.21.15.7:0/2677274316 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f18159240 msgr2=0x7f6f1815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T10:59:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f16ffd700 1 --2- 172.21.15.7:0/2677274316 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f18159240 0x7f6f1815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f16ffd700 1 -- 172.21.15.7:0/2677274316 >> v1:172.21.15.7:6789/0 conn(0x7f6f180cc8e0 legacy=0x7f6f180ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f16ffd700 1 -- 172.21.15.7:0/2677274316 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1815d880 con 0x7f6f1815ced0 2023-10-06T10:59:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f167fc700 1 -- 172.21.15.7:0/2677274316 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856570483 0 0) 0x7f6f1815b210 con 0x7f6f180cc8e0 2023-10-06T10:59:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.764+0000 7f6f16ffd700 1 --2- 172.21.15.7:0/2677274316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f1815ced0 0x7f6f1815d340 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0098e0 tx=0x7f6f0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fee12210e32ecc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.765+0000 7f6f167fc700 1 -- 172.21.15.7:0/2677274316 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00b640 con 0x7f6f1815ced0 2023-10-06T10:59:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.765+0000 7f6f167fc700 1 -- 172.21.15.7:0/2677274316 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c00b7a0 con 0x7f6f1815ced0 2023-10-06T10:59:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.765+0000 7f6f167fc700 1 -- 172.21.15.7:0/2677274316 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00bb40 con 0x7f6f1815ced0 2023-10-06T10:59:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.765+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/2677274316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f1815ced0 msgr2=0x7f6f1815d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.765+0000 7f6f1dcaa700 1 --2- 172.21.15.7:0/2677274316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f1815ced0 0x7f6f1815d340 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0098e0 tx=0x7f6f0c0091a0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.765+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/2677274316 shutdown_connections 2023-10-06T10:59:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.765+0000 7f6f1dcaa700 1 --2- 172.21.15.7:0/2677274316 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f18159240 0x7f6f1815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.765+0000 7f6f1dcaa700 1 --2- 172.21.15.7:0/2677274316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f1815ced0 0x7f6f1815d340 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.765+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/2677274316 >> 172.21.15.7:0/2677274316 conn(0x7f6f18087920 msgr2=0x7f6f18097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.765+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/2677274316 shutdown_connections 2023-10-06T10:59:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.765+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/2677274316 wait complete. 2023-10-06T10:59:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.767+0000 7f6f1dcaa700 1 Processor -- start 2023-10-06T10:59:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.767+0000 7f6f1dcaa700 1 -- start start 2023-10-06T10:59:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.767+0000 7f6f1dcaa700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f180cc8e0 0x7f6f1816a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.767+0000 7f6f1dcaa700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f18159240 0x7f6f180b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.767+0000 7f6f1dcaa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f1815ced0 0x7f6f180c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.767+0000 7f6f1dcaa700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180b3bf0 con 0x7f6f180cc8e0 2023-10-06T10:59:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.767+0000 7f6f1dcaa700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180c7be0 con 0x7f6f1815ced0 2023-10-06T10:59:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.767+0000 7f6f1dcaa700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180b28f0 con 0x7f6f18159240 2023-10-06T10:59:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6f177fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f180cc8e0 0x7f6f1816a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6f177fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f180cc8e0 0x7f6f1816a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35554/0 (socket says 172.21.15.7:35554) 2023-10-06T10:59:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6f177fe700 1 -- 172.21.15.7:0/1218037035 learned_addr learned my addr 172.21.15.7:0/1218037035 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T10:59:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6f16ffd700 1 --2- 172.21.15.7:0/1218037035 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f18159240 0x7f6f180b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6f17fff700 1 --2- 172.21.15.7:0/1218037035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f1815ced0 0x7f6f180c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6f177fe700 1 -- 172.21.15.7:0/1218037035 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f18159240 msgr2=0x7f6f180b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6f177fe700 1 --2- 172.21.15.7:0/1218037035 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f18159240 0x7f6f180b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6f177fe700 1 -- 172.21.15.7:0/1218037035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f1815ced0 msgr2=0x7f6f180c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6f177fe700 1 --2- 172.21.15.7:0/1218037035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f1815ced0 0x7f6f180c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6f177fe700 1 -- 172.21.15.7:0/1218037035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c009420 con 0x7f6f180cc8e0 2023-10-06T10:59:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6f177fe700 1 --2- 172.21.15.7:0/1218037035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f180cc8e0 0x7f6f1816a340 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800ec80 tx=0x7f6f08009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6eff7fe700 1 -- 172.21.15.7:0/1218037035 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0800c9d0 con 0x7f6f180cc8e0 2023-10-06T10:59:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6eff7fe700 1 -- 172.21.15.7:0/1218037035 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0800cb30 con 0x7f6f180cc8e0 2023-10-06T10:59:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/1218037035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f180b2bd0 con 0x7f6f180cc8e0 2023-10-06T10:59:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6eff7fe700 1 -- 172.21.15.7:0/1218037035 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08013470 con 0x7f6f180cc8e0 2023-10-06T10:59:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.768+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/1218037035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f180b3190 con 0x7f6f180cc8e0 2023-10-06T10:59:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.769+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/1218037035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f18070480 con 0x7f6f180cc8e0 2023-10-06T10:59:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.770+0000 7f6eff7fe700 1 -- 172.21.15.7:0/1218037035 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f08013860 con 0x7f6f180cc8e0 2023-10-06T10:59:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.770+0000 7f6eff7fe700 1 --2- 172.21.15.7:0/1218037035 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6f04066f30 0x7f6f040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T10:59:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.770+0000 7f6eff7fe700 1 -- 172.21.15.7:0/1218037035 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f6f08085110 con 0x7f6f180cc8e0 2023-10-06T10:59:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.770+0000 7f6f16ffd700 1 --2- 172.21.15.7:0/1218037035 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6f04066f30 0x7f6f040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T10:59:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.771+0000 7f6f16ffd700 1 --2- 172.21.15.7:0/1218037035 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6f04066f30 0x7f6f040693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0091e0 tx=0x7f6f0c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T10:59:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.775+0000 7f6eff7fe700 1 -- 172.21.15.7:0/1218037035 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f08051ef0 con 0x7f6f180cc8e0 2023-10-06T10:59:59.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.976+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/1218037035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f18068ca0 con 0x7f6f180cc8e0 2023-10-06T10:59:59.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.977+0000 7f6eff7fe700 1 -- 172.21.15.7:0/1218037035 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18802 (secure 0 0 0) 0x7f6f08055510 con 0x7f6f180cc8e0 2023-10-06T10:59:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T10:59:59.980 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:51.626116+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T10:59:59.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.979+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/1218037035 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6f04066f30 msgr2=0x7f6f040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.979+0000 7f6f1dcaa700 1 --2- 172.21.15.7:0/1218037035 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6f04066f30 0x7f6f040693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0091e0 tx=0x7f6f0c017000 comp rx=0 tx=0).stop 2023-10-06T10:59:59.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.979+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/1218037035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f180cc8e0 msgr2=0x7f6f1816a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T10:59:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.979+0000 7f6f1dcaa700 1 --2- 172.21.15.7:0/1218037035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f180cc8e0 0x7f6f1816a340 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800ec80 tx=0x7f6f08009120 comp rx=0 tx=0).stop 2023-10-06T10:59:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.979+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/1218037035 shutdown_connections 2023-10-06T10:59:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.979+0000 7f6f1dcaa700 1 --2- 172.21.15.7:0/1218037035 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6f04066f30 0x7f6f040693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.979+0000 7f6f1dcaa700 1 --2- 172.21.15.7:0/1218037035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f180cc8e0 0x7f6f1816a340 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.979+0000 7f6f1dcaa700 1 --2- 172.21.15.7:0/1218037035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f1815ced0 0x7f6f180c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.979+0000 7f6f1dcaa700 1 --2- 172.21.15.7:0/1218037035 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f18159240 0x7f6f180b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T10:59:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.979+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/1218037035 >> 172.21.15.7:0/1218037035 conn(0x7f6f18087920 msgr2=0x7f6f1815bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T10:59:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.980+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/1218037035 shutdown_connections 2023-10-06T10:59:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T10:59:59.980+0000 7f6f1dcaa700 1 -- 172.21.15.7:0/1218037035 wait complete. 2023-10-06T10:59:59.995 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T10:59:59.995 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:00:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.127+0000 7fbefcaf6700 1 Processor -- start 2023-10-06T11:00:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.127+0000 7fbefcaf6700 1 -- start start 2023-10-06T11:00:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.128+0000 7fbefcaf6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbef8158120 0x7fbef80c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.128+0000 7fbefcaf6700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef80cbd10 con 0x7fbef80cae30 2023-10-06T11:00:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.128+0000 7fbefcaf6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef80cb9e0 con 0x7fbef80c8ba0 2023-10-06T11:00:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.128+0000 7fbefcaf6700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef80c9300 con 0x7fbef8158120 2023-10-06T11:00:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.128+0000 7fbef659c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbef8158120 0x7fbef80c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.128+0000 7fbef6d9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbef80cae30 0x7fbef80cc1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35134/0 (socket says 172.21.15.7:35134) 2023-10-06T11:00:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.128+0000 7fbef659c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbef8158120 0x7fbef80c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47068/0 (socket says 172.21.15.7:47068) 2023-10-06T11:00:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.128+0000 7fbef6d9d700 1 -- 172.21.15.7:0/1884652516 learned_addr learned my addr 172.21.15.7:0/1884652516 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.129+0000 7fbef659c700 1 -- 172.21.15.7:0/1884652516 >> v1:172.21.15.50:6789/0 conn(0x7fbef80c8ba0 legacy=0x7fbef80ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.129+0000 7fbef659c700 1 -- 172.21.15.7:0/1884652516 >> v1:172.21.15.7:6789/0 conn(0x7fbef80cae30 legacy=0x7fbef80cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.129+0000 7fbef659c700 1 -- 172.21.15.7:0/1884652516 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef80c95e0 con 0x7fbef8158120 2023-10-06T11:00:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.129+0000 7fbef659c700 1 --2- 172.21.15.7:0/1884652516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbef8158120 0x7fbef80c8660 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbee80098d0 tx=0x7fbee8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc159d89ee179bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.129+0000 7fbef559a700 1 -- 172.21.15.7:0/1884652516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8009e70 con 0x7fbef8158120 2023-10-06T11:00:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.129+0000 7fbef559a700 1 -- 172.21.15.7:0/1884652516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee8005c10 con 0x7fbef8158120 2023-10-06T11:00:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.129+0000 7fbef559a700 1 -- 172.21.15.7:0/1884652516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee800b650 con 0x7fbef8158120 2023-10-06T11:00:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.130+0000 7fbefcaf6700 1 -- 172.21.15.7:0/1884652516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbef8158120 msgr2=0x7fbef80c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.130+0000 7fbefcaf6700 1 --2- 172.21.15.7:0/1884652516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbef8158120 0x7fbef80c8660 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbee80098d0 tx=0x7fbee8009120 comp rx=0 tx=0).stop 2023-10-06T11:00:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.130+0000 7fbefcaf6700 1 -- 172.21.15.7:0/1884652516 shutdown_connections 2023-10-06T11:00:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.130+0000 7fbefcaf6700 1 --2- 172.21.15.7:0/1884652516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbef8158120 0x7fbef80c8660 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.130+0000 7fbefcaf6700 1 -- 172.21.15.7:0/1884652516 >> 172.21.15.7:0/1884652516 conn(0x7fbef8087920 msgr2=0x7fbef8097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.130+0000 7fbefcaf6700 1 -- 172.21.15.7:0/1884652516 shutdown_connections 2023-10-06T11:00:00.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.130+0000 7fbefcaf6700 1 -- 172.21.15.7:0/1884652516 wait complete. 2023-10-06T11:00:00.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.131+0000 7fbefcaf6700 1 Processor -- start 2023-10-06T11:00:00.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.131+0000 7fbefcaf6700 1 -- start start 2023-10-06T11:00:00.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.132+0000 7fbefcaf6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbef80c8ba0 0x7fbef8150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.132+0000 7fbefcaf6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80cae30 0x7fbef8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.132+0000 7fbefcaf6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbef8158120 0x7fbef80af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.132+0000 7fbefcaf6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80ae6a0 con 0x7fbef8158120 2023-10-06T11:00:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.132+0000 7fbefcaf6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80aec60 con 0x7fbef80cae30 2023-10-06T11:00:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.132+0000 7fbefcaf6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8069990 con 0x7fbef80c8ba0 2023-10-06T11:00:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.132+0000 7fbef6d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbef8158120 0x7fbef80af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.132+0000 7fbef6d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbef8158120 0x7fbef80af0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47076/0 (socket says 172.21.15.7:47076) 2023-10-06T11:00:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.132+0000 7fbef6d9d700 1 -- 172.21.15.7:0/94979086 learned_addr learned my addr 172.21.15.7:0/94979086 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.132+0000 7fbef659c700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbef80c8ba0 0x7fbef8150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.132+0000 7fbef5d9b700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80cae30 0x7fbef8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.133+0000 7fbef6d9d700 1 -- 172.21.15.7:0/94979086 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbef80c8ba0 msgr2=0x7fbef8150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.133+0000 7fbef6d9d700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbef80c8ba0 0x7fbef8150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.133+0000 7fbef6d9d700 1 -- 172.21.15.7:0/94979086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80cae30 msgr2=0x7fbef8069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.133+0000 7fbef6d9d700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80cae30 0x7fbef8069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.133+0000 7fbef6d9d700 1 -- 172.21.15.7:0/94979086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee80093c0 con 0x7fbef8158120 2023-10-06T11:00:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.133+0000 7fbef5d9b700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80cae30 0x7fbef8069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.133+0000 7fbef6d9d700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbef8158120 0x7fbef80af0f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbef000cc70 tx=0x7fbef0001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.133+0000 7fbeee7fc700 1 -- 172.21.15.7:0/94979086 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000a8a0 con 0x7fbef8158120 2023-10-06T11:00:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.133+0000 7fbeee7fc700 1 -- 172.21.15.7:0/94979086 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef000aa00 con 0x7fbef8158120 2023-10-06T11:00:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.133+0000 7fbeee7fc700 1 -- 172.21.15.7:0/94979086 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000adc0 con 0x7fbef8158120 2023-10-06T11:00:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.133+0000 7fbefcaf6700 1 -- 172.21.15.7:0/94979086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef806a660 con 0x7fbef8158120 2023-10-06T11:00:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.133+0000 7fbefcaf6700 1 -- 172.21.15.7:0/94979086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef80ae8f0 con 0x7fbef8158120 2023-10-06T11:00:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.134+0000 7fbefcaf6700 1 -- 172.21.15.7:0/94979086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef8070480 con 0x7fbef8158120 2023-10-06T11:00:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.135+0000 7fbeee7fc700 1 -- 172.21.15.7:0/94979086 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbef0007300 con 0x7fbef8158120 2023-10-06T11:00:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.135+0000 7fbeee7fc700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbed8066f30 0x7fbed80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.135+0000 7fbeee7fc700 1 -- 172.21.15.7:0/94979086 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fbef0084d10 con 0x7fbef8158120 2023-10-06T11:00:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.135+0000 7fbef659c700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbed8066f30 0x7fbed80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.136+0000 7fbef659c700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbed8066f30 0x7fbed80693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009160 tx=0x7fbee8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:00.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.139+0000 7fbeee7fc700 1 -- 172.21.15.7:0/94979086 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbef0051b70 con 0x7fbef8158120 2023-10-06T11:00:00.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.387+0000 7fbefcaf6700 1 -- 172.21.15.7:0/94979086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbef80aeda0 con 0x7fbef8158120 2023-10-06T11:00:00.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.388+0000 7fbeee7fc700 1 -- 172.21.15.7:0/94979086 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4581 (secure 0 0 0) 0x7fbef0055190 con 0x7fbef8158120 2023-10-06T11:00:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:00.390 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/941534596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":941534596},{"type":"v1","addr":"172.21.15.50:6835","nonce":941534596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3152699387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3152699387},{"type":"v1","addr":"172.21.15.50:6834","nonce":3152699387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/271704556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":271704556},{"type":"v1","addr":"172.21.15.7:6837","nonce":271704556}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T10:59:01.833627+0000","modified":"2023-10-06T10:59:21.515113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3123178887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3123178887},{"type":"v1","addr":"172.21.15.7:6836","nonce":3123178887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:00:00.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.390+0000 7fbefcaf6700 1 -- 172.21.15.7:0/94979086 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbed8066f30 msgr2=0x7fbed80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.390+0000 7fbefcaf6700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbed8066f30 0x7fbed80693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009160 tx=0x7fbee8016000 comp rx=0 tx=0).stop 2023-10-06T11:00:00.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.390+0000 7fbefcaf6700 1 -- 172.21.15.7:0/94979086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbef8158120 msgr2=0x7fbef80af0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.390+0000 7fbefcaf6700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbef8158120 0x7fbef80af0f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbef000cc70 tx=0x7fbef0001a50 comp rx=0 tx=0).stop 2023-10-06T11:00:00.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.390+0000 7fbefcaf6700 1 -- 172.21.15.7:0/94979086 shutdown_connections 2023-10-06T11:00:00.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.390+0000 7fbefcaf6700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbed8066f30 0x7fbed80693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.390+0000 7fbefcaf6700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbef8158120 0x7fbef80af0f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.390+0000 7fbefcaf6700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbef80c8ba0 0x7fbef8150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.390+0000 7fbefcaf6700 1 --2- 172.21.15.7:0/94979086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80cae30 0x7fbef8069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.390+0000 7fbefcaf6700 1 -- 172.21.15.7:0/94979086 >> 172.21.15.7:0/94979086 conn(0x7fbef8087920 msgr2=0x7fbef80aafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.390+0000 7fbefcaf6700 1 -- 172.21.15.7:0/94979086 shutdown_connections 2023-10-06T11:00:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.390+0000 7fbefcaf6700 1 -- 172.21.15.7:0/94979086 wait complete. 2023-10-06T11:00:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2023-10-06T11:00:00.405 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:00:00.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.536+0000 7f85e9c35700 1 Processor -- start 2023-10-06T11:00:00.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.537+0000 7f85e9c35700 1 -- start start 2023-10-06T11:00:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.537+0000 7f85e9c35700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85e4159360 0x7f85e40afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.537+0000 7f85e9c35700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f85e40ac7f0 0x7f85e40a6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.537+0000 7f85e9c35700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85e40a6ec0 0x7f85e40670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.537+0000 7f85e9c35700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e40aeba0 con 0x7f85e40ac7f0 2023-10-06T11:00:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.537+0000 7f85e9c35700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e40a7310 con 0x7f85e40a6ec0 2023-10-06T11:00:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.537+0000 7f85e9c35700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e4159730 con 0x7f85e4159360 2023-10-06T11:00:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.538+0000 7f85e2ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f85e40ac7f0 0x7f85e40a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.538+0000 7f85e2ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f85e40ac7f0 0x7f85e40a6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47086/0 (socket says 172.21.15.7:47086) 2023-10-06T11:00:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.538+0000 7f85e2ffd700 1 -- 172.21.15.7:0/344234683 learned_addr learned my addr 172.21.15.7:0/344234683 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.538+0000 7f85e37fe700 1 --2- 172.21.15.7:0/344234683 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85e4159360 0x7f85e40afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.538+0000 7f85e3fff700 1 --2- 172.21.15.7:0/344234683 >> v2:172.21.15.50:3300/0 conn(0x7f85e40a6ec0 0x7f85e40670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.538+0000 7f85e2ffd700 1 -- 172.21.15.7:0/344234683 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85e4159360 msgr2=0x7f85e40afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.538+0000 7f85e2ffd700 1 --2- 172.21.15.7:0/344234683 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85e4159360 0x7f85e40afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.538+0000 7f85e2ffd700 1 -- 172.21.15.7:0/344234683 >> v2:172.21.15.50:3300/0 conn(0x7f85e40a6ec0 msgr2=0x7f85e40670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.538+0000 7f85e2ffd700 1 --2- 172.21.15.7:0/344234683 >> v2:172.21.15.50:3300/0 conn(0x7f85e40a6ec0 0x7f85e40670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.538+0000 7f85e2ffd700 1 -- 172.21.15.7:0/344234683 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e40ae270 con 0x7f85e40ac7f0 2023-10-06T11:00:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.538+0000 7f85e2ffd700 1 --2- 172.21.15.7:0/344234683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85e40ac7f0 0x7f85e40a6980 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f85e40a7530 tx=0x7f85cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad60dda9af708e87 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:00.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.538+0000 7f85e27fc700 1 -- 172.21.15.7:0/344234683 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00b860 con 0x7f85e40ac7f0 2023-10-06T11:00:00.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.538+0000 7f85e27fc700 1 -- 172.21.15.7:0/344234683 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc00b9c0 con 0x7f85e40ac7f0 2023-10-06T11:00:00.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.538+0000 7f85e27fc700 1 -- 172.21.15.7:0/344234683 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00bd60 con 0x7f85e40ac7f0 2023-10-06T11:00:00.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.539+0000 7f85e9c35700 1 -- 172.21.15.7:0/344234683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85e40ac7f0 msgr2=0x7f85e40a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.539+0000 7f85e9c35700 1 --2- 172.21.15.7:0/344234683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85e40ac7f0 0x7f85e40a6980 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f85e40a7530 tx=0x7f85cc009250 comp rx=0 tx=0).stop 2023-10-06T11:00:00.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.539+0000 7f85e9c35700 1 -- 172.21.15.7:0/344234683 shutdown_connections 2023-10-06T11:00:00.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.539+0000 7f85e9c35700 1 --2- 172.21.15.7:0/344234683 >> v2:172.21.15.50:3300/0 conn(0x7f85e40a6ec0 0x7f85e40670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.539+0000 7f85e9c35700 1 --2- 172.21.15.7:0/344234683 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85e4159360 0x7f85e40afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.539+0000 7f85e9c35700 1 --2- 172.21.15.7:0/344234683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85e40ac7f0 0x7f85e40a6980 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.539+0000 7f85e9c35700 1 -- 172.21.15.7:0/344234683 >> 172.21.15.7:0/344234683 conn(0x7f85e4095a70 msgr2=0x7f85e40af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:00.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.539+0000 7f85e9c35700 1 -- 172.21.15.7:0/344234683 shutdown_connections 2023-10-06T11:00:00.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.539+0000 7f85e9c35700 1 -- 172.21.15.7:0/344234683 wait complete. 2023-10-06T11:00:00.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.540+0000 7f85e9c35700 1 Processor -- start 2023-10-06T11:00:00.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.541+0000 7f85e9c35700 1 -- start start 2023-10-06T11:00:00.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.541+0000 7f85e9c35700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85e40a6ec0 0x7f85e4068380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.541+0000 7f85e9c35700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e40ac7f0 0x7f85e416a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.541+0000 7f85e9c35700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85e4159360 0x7f85e4159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.541+0000 7f85e9c35700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e414d370 con 0x7f85e40a6ec0 2023-10-06T11:00:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.541+0000 7f85e9c35700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e414d650 con 0x7f85e40ac7f0 2023-10-06T11:00:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.541+0000 7f85e9c35700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e414d930 con 0x7f85e4159360 2023-10-06T11:00:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.541+0000 7f85e37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85e40a6ec0 0x7f85e4068380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.541+0000 7f85e37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85e40a6ec0 0x7f85e4068380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47100/0 (socket says 172.21.15.7:47100) 2023-10-06T11:00:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.541+0000 7f85e37fe700 1 -- 172.21.15.7:0/2105490934 learned_addr learned my addr 172.21.15.7:0/2105490934 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85e2ffd700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e40ac7f0 0x7f85e416a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85e3fff700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85e4159360 0x7f85e4159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85e37fe700 1 -- 172.21.15.7:0/2105490934 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85e4159360 msgr2=0x7f85e4159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85e37fe700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85e4159360 0x7f85e4159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85e37fe700 1 -- 172.21.15.7:0/2105490934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e40ac7f0 msgr2=0x7f85e416a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85e37fe700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e40ac7f0 0x7f85e416a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85e37fe700 1 -- 172.21.15.7:0/2105490934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc0094f0 con 0x7f85e40a6ec0 2023-10-06T11:00:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85e3fff700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85e4159360 0x7f85e4159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85e2ffd700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e40ac7f0 0x7f85e416a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85e37fe700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85e40a6ec0 0x7f85e4068380 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f85d400d860 tx=0x7f85d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85db7fe700 1 -- 172.21.15.7:0/2105490934 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d40125f0 con 0x7f85e40a6ec0 2023-10-06T11:00:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85db7fe700 1 -- 172.21.15.7:0/2105490934 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d4012750 con 0x7f85e40a6ec0 2023-10-06T11:00:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85e9c35700 1 -- 172.21.15.7:0/2105490934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e4169d00 con 0x7f85e40a6ec0 2023-10-06T11:00:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85db7fe700 1 -- 172.21.15.7:0/2105490934 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4012b10 con 0x7f85e40a6ec0 2023-10-06T11:00:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.542+0000 7f85e9c35700 1 -- 172.21.15.7:0/2105490934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e40688c0 con 0x7f85e40a6ec0 2023-10-06T11:00:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.543+0000 7f85e9c35700 1 -- 172.21.15.7:0/2105490934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e4070480 con 0x7f85e40a6ec0 2023-10-06T11:00:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.544+0000 7f85db7fe700 1 -- 172.21.15.7:0/2105490934 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85d401e460 con 0x7f85e40a6ec0 2023-10-06T11:00:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.544+0000 7f85db7fe700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f85c4066f30 0x7f85c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.544+0000 7f85db7fe700 1 -- 172.21.15.7:0/2105490934 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f85d4085080 con 0x7f85e40a6ec0 2023-10-06T11:00:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.544+0000 7f85e2ffd700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f85c4066f30 0x7f85c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.545+0000 7f85e2ffd700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f85c4066f30 0x7f85c40693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f85e40a7530 tx=0x7f85cc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:00.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.549+0000 7f85db7fe700 1 -- 172.21.15.7:0/2105490934 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85d40558f0 con 0x7f85e40a6ec0 2023-10-06T11:00:00.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.800+0000 7f85e9c35700 1 -- 172.21.15.7:0/2105490934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85e40ae550 con 0x7f85e40a6ec0 2023-10-06T11:00:00.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.800+0000 7f85db7fe700 1 -- 172.21.15.7:0/2105490934 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4581 (secure 0 0 0) 0x7f85d4055480 con 0x7f85e40a6ec0 2023-10-06T11:00:00.802 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:00.802 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/941534596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":941534596},{"type":"v1","addr":"172.21.15.50:6835","nonce":941534596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3152699387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3152699387},{"type":"v1","addr":"172.21.15.50:6834","nonce":3152699387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/271704556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":271704556},{"type":"v1","addr":"172.21.15.7:6837","nonce":271704556}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T10:59:01.833627+0000","modified":"2023-10-06T10:59:21.515113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3123178887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3123178887},{"type":"v1","addr":"172.21.15.7:6836","nonce":3123178887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:00:00.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.802+0000 7f85e9c35700 1 -- 172.21.15.7:0/2105490934 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f85c4066f30 msgr2=0x7f85c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.802+0000 7f85e9c35700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f85c4066f30 0x7f85c40693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f85e40a7530 tx=0x7f85cc017000 comp rx=0 tx=0).stop 2023-10-06T11:00:00.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.802+0000 7f85e9c35700 1 -- 172.21.15.7:0/2105490934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85e40a6ec0 msgr2=0x7f85e4068380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.802+0000 7f85e9c35700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85e40a6ec0 0x7f85e4068380 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f85d400d860 tx=0x7f85d4008040 comp rx=0 tx=0).stop 2023-10-06T11:00:00.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.802+0000 7f85e9c35700 1 -- 172.21.15.7:0/2105490934 shutdown_connections 2023-10-06T11:00:00.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.802+0000 7f85e9c35700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f85c4066f30 0x7f85c40693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.802+0000 7f85e9c35700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85e40a6ec0 0x7f85e4068380 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.802+0000 7f85e9c35700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85e4159360 0x7f85e4159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.802+0000 7f85e9c35700 1 --2- 172.21.15.7:0/2105490934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e40ac7f0 0x7f85e416a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.803+0000 7f85e9c35700 1 -- 172.21.15.7:0/2105490934 >> 172.21.15.7:0/2105490934 conn(0x7f85e4095a70 msgr2=0x7f85e415faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:00.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.803+0000 7f85e9c35700 1 -- 172.21.15.7:0/2105490934 shutdown_connections 2023-10-06T11:00:00.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.803+0000 7f85e9c35700 1 -- 172.21.15.7:0/2105490934 wait complete. 2023-10-06T11:00:00.806 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2023-10-06T11:00:00.818 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:00:00.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.947+0000 7fb1ba687700 1 Processor -- start 2023-10-06T11:00:00.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.947+0000 7fb1ba687700 1 -- start start 2023-10-06T11:00:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.948+0000 7fb1ba687700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1b4159240 0x7fb1b415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.948+0000 7fb1ba687700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1b415ced0 0x7fb1b415d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.948+0000 7fb1ba687700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b415b210 con 0x7fb1b40cc8e0 2023-10-06T11:00:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.948+0000 7fb1ba687700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b4068a90 con 0x7fb1b415ced0 2023-10-06T11:00:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.948+0000 7fb1ba687700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40698b0 con 0x7fb1b4159240 2023-10-06T11:00:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.948+0000 7fb1b37fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1b415ced0 0x7fb1b415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.949+0000 7fb1b37fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1b415ced0 0x7fb1b415d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47106/0 (socket says 172.21.15.7:47106) 2023-10-06T11:00:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.949+0000 7fb1b37fe700 1 -- 172.21.15.7:0/1116215948 learned_addr learned my addr 172.21.15.7:0/1116215948 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.949+0000 7fb1b3fff700 1 --2- 172.21.15.7:0/1116215948 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1b4159240 0x7fb1b415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.949+0000 7fb1b37fe700 1 -- 172.21.15.7:0/1116215948 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1b4159240 msgr2=0x7fb1b415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.949+0000 7fb1b37fe700 1 --2- 172.21.15.7:0/1116215948 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1b4159240 0x7fb1b415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.949+0000 7fb1b37fe700 1 -- 172.21.15.7:0/1116215948 >> v1:172.21.15.50:6789/0 conn(0x7fb1b40cc8e0 legacy=0x7fb1b40ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.949+0000 7fb1b37fe700 1 -- 172.21.15.7:0/1116215948 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b415d880 con 0x7fb1b415ced0 2023-10-06T11:00:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.949+0000 7fb1b37fe700 1 --2- 172.21.15.7:0/1116215948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b415ced0 0x7fb1b415d340 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80099b0 tx=0x7fb1a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a80535d3625f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.949+0000 7fb1b2ffd700 1 -- 172.21.15.7:0/1116215948 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800b860 con 0x7fb1b415ced0 2023-10-06T11:00:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.949+0000 7fb1b2ffd700 1 -- 172.21.15.7:0/1116215948 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a800b9c0 con 0x7fb1b415ced0 2023-10-06T11:00:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.949+0000 7fb1b2ffd700 1 -- 172.21.15.7:0/1116215948 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800bd60 con 0x7fb1b415ced0 2023-10-06T11:00:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.950+0000 7fb1ba687700 1 -- 172.21.15.7:0/1116215948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b415ced0 msgr2=0x7fb1b415d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.950+0000 7fb1ba687700 1 --2- 172.21.15.7:0/1116215948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b415ced0 0x7fb1b415d340 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80099b0 tx=0x7fb1a8009250 comp rx=0 tx=0).stop 2023-10-06T11:00:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.950+0000 7fb1ba687700 1 -- 172.21.15.7:0/1116215948 shutdown_connections 2023-10-06T11:00:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.950+0000 7fb1ba687700 1 --2- 172.21.15.7:0/1116215948 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1b4159240 0x7fb1b415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.950+0000 7fb1ba687700 1 --2- 172.21.15.7:0/1116215948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b415ced0 0x7fb1b415d340 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.950+0000 7fb1ba687700 1 -- 172.21.15.7:0/1116215948 >> 172.21.15.7:0/1116215948 conn(0x7fb1b4087920 msgr2=0x7fb1b4097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:00.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.950+0000 7fb1ba687700 1 -- 172.21.15.7:0/1116215948 shutdown_connections 2023-10-06T11:00:00.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.950+0000 7fb1ba687700 1 -- 172.21.15.7:0/1116215948 wait complete. 2023-10-06T11:00:00.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.952+0000 7fb1ba687700 1 Processor -- start 2023-10-06T11:00:00.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.952+0000 7fb1ba687700 1 -- start start 2023-10-06T11:00:00.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1ba687700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1b40cc8e0 0x7fb1b406d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1ba687700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b4159240 0x7fb1b4154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1ba687700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b415ced0 0x7fb1b4154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1ba687700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40b1c80 con 0x7fb1b4159240 2023-10-06T11:00:00.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1ba687700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40c63a0 con 0x7fb1b415ced0 2023-10-06T11:00:00.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1ba687700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40c6960 con 0x7fb1b40cc8e0 2023-10-06T11:00:00.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1b37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b4159240 0x7fb1b4154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1b37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b4159240 0x7fb1b4154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47110/0 (socket says 172.21.15.7:47110) 2023-10-06T11:00:00.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1b37fe700 1 -- 172.21.15.7:0/3733480208 learned_addr learned my addr 172.21.15.7:0/3733480208 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:00.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1b3fff700 1 --2- 172.21.15.7:0/3733480208 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1b40cc8e0 0x7fb1b406d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1b8c24700 1 --2- 172.21.15.7:0/3733480208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b415ced0 0x7fb1b4154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1b37fe700 1 -- 172.21.15.7:0/3733480208 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1b40cc8e0 msgr2=0x7fb1b406d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1b37fe700 1 --2- 172.21.15.7:0/3733480208 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1b40cc8e0 0x7fb1b406d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1b37fe700 1 -- 172.21.15.7:0/3733480208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b415ced0 msgr2=0x7fb1b4154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:00.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1b37fe700 1 --2- 172.21.15.7:0/3733480208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b415ced0 0x7fb1b4154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:00.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.953+0000 7fb1b37fe700 1 -- 172.21.15.7:0/3733480208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a80094f0 con 0x7fb1b4159240 2023-10-06T11:00:00.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.954+0000 7fb1b37fe700 1 --2- 172.21.15.7:0/3733480208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b4159240 0x7fb1b4154590 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8006fd0 tx=0x7fb1a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:00.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.954+0000 7fb19bfff700 1 -- 172.21.15.7:0/3733480208 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8024440 con 0x7fb1b4159240 2023-10-06T11:00:00.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.954+0000 7fb19bfff700 1 -- 172.21.15.7:0/3733480208 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a80245c0 con 0x7fb1b4159240 2023-10-06T11:00:00.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.954+0000 7fb19bfff700 1 -- 172.21.15.7:0/3733480208 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8024980 con 0x7fb1b4159240 2023-10-06T11:00:00.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.954+0000 7fb1ba687700 1 -- 172.21.15.7:0/3733480208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b40b16c0 con 0x7fb1b4159240 2023-10-06T11:00:00.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.954+0000 7fb1ba687700 1 -- 172.21.15.7:0/3733480208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b40c65f0 con 0x7fb1b4159240 2023-10-06T11:00:00.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.955+0000 7fb1ba687700 1 -- 172.21.15.7:0/3733480208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b40c6af0 con 0x7fb1b4159240 2023-10-06T11:00:00.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.956+0000 7fb19bfff700 1 -- 172.21.15.7:0/3733480208 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1a801a420 con 0x7fb1b4159240 2023-10-06T11:00:00.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.956+0000 7fb19bfff700 1 --2- 172.21.15.7:0/3733480208 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb1a0066f30 0x7fb1a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:00.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.957+0000 7fb19bfff700 1 -- 172.21.15.7:0/3733480208 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb1a8086db0 con 0x7fb1b4159240 2023-10-06T11:00:00.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.957+0000 7fb1b3fff700 1 --2- 172.21.15.7:0/3733480208 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb1a0066f30 0x7fb1a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:00.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.957+0000 7fb1b3fff700 1 --2- 172.21.15.7:0/3733480208 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb1a0066f30 0x7fb1a00693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4006aa0 tx=0x7fb1a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:00.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:00.961+0000 7fb19bfff700 1 -- 172.21.15.7:0/3733480208 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1a8053b70 con 0x7fb1b4159240 2023-10-06T11:00:01.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.164+0000 7fb1ba687700 1 -- 172.21.15.7:0/3733480208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1b4070480 con 0x7fb1b4159240 2023-10-06T11:00:01.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.165+0000 7fb19bfff700 1 -- 172.21.15.7:0/3733480208 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18802 (secure 0 0 0) 0x7fb1a8057190 con 0x7fb1b4159240 2023-10-06T11:00:01.167 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:01.168 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T10:59:51.626116+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T10:58:59.772827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T10:59:00.802230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T10:59:04.512252+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:00:01.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.168+0000 7fb1ba687700 1 -- 172.21.15.7:0/3733480208 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb1a0066f30 msgr2=0x7fb1a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:01.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.168+0000 7fb1ba687700 1 --2- 172.21.15.7:0/3733480208 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb1a0066f30 0x7fb1a00693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4006aa0 tx=0x7fb1a4008040 comp rx=0 tx=0).stop 2023-10-06T11:00:01.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.168+0000 7fb1ba687700 1 -- 172.21.15.7:0/3733480208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b4159240 msgr2=0x7fb1b4154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:01.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.168+0000 7fb1ba687700 1 --2- 172.21.15.7:0/3733480208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b4159240 0x7fb1b4154590 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8006fd0 tx=0x7fb1a8017000 comp rx=0 tx=0).stop 2023-10-06T11:00:01.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.168+0000 7fb1ba687700 1 -- 172.21.15.7:0/3733480208 shutdown_connections 2023-10-06T11:00:01.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.168+0000 7fb1ba687700 1 --2- 172.21.15.7:0/3733480208 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb1a0066f30 0x7fb1a00693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.168+0000 7fb1ba687700 1 --2- 172.21.15.7:0/3733480208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b415ced0 0x7fb1b4154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.168+0000 7fb1ba687700 1 --2- 172.21.15.7:0/3733480208 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1b40cc8e0 0x7fb1b406d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.168+0000 7fb1ba687700 1 --2- 172.21.15.7:0/3733480208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b4159240 0x7fb1b4154590 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.168+0000 7fb1ba687700 1 -- 172.21.15.7:0/3733480208 >> 172.21.15.7:0/3733480208 conn(0x7fb1b4087920 msgr2=0x7fb1b4155ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:01.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.168+0000 7fb1ba687700 1 -- 172.21.15.7:0/3733480208 shutdown_connections 2023-10-06T11:00:01.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.168+0000 7fb1ba687700 1 -- 172.21.15.7:0/3733480208 wait complete. 2023-10-06T11:00:01.183 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:00:01.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.314+0000 7eff1a6ac700 1 Processor -- start 2023-10-06T11:00:01.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.314+0000 7eff1a6ac700 1 -- start start 2023-10-06T11:00:01.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.315+0000 7eff1a6ac700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff14159240 0x7eff1415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:01.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.315+0000 7eff1a6ac700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1415b210 con 0x7eff140ccff0 2023-10-06T11:00:01.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.315+0000 7eff1a6ac700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff140698b0 con 0x7eff1415ced0 2023-10-06T11:00:01.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.315+0000 7eff1a6ac700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff14068a90 con 0x7eff14159240 2023-10-06T11:00:01.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.315+0000 7eff18c49700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7eff140ccff0 0x7eff14069d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35148/0 (socket says 172.21.15.7:35148) 2023-10-06T11:00:01.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.315+0000 7eff18c49700 1 -- 172.21.15.7:0/3391714598 learned_addr learned my addr 172.21.15.7:0/3391714598 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:01.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.315+0000 7eff13fff700 1 --2- 172.21.15.7:0/3391714598 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff14159240 0x7eff1415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:01.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.315+0000 7eff12ffd700 1 -- 172.21.15.7:0/3391714598 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174899018 0 0) 0x7eff1415b210 con 0x7eff140ccff0 2023-10-06T11:00:01.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.315+0000 7eff12ffd700 1 -- 172.21.15.7:0/3391714598 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff00003570 con 0x7eff140ccff0 2023-10-06T11:00:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.316+0000 7eff12ffd700 1 -- 172.21.15.7:0/3391714598 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151404191 0 0) 0x7eff140698b0 con 0x7eff1415ced0 2023-10-06T11:00:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.316+0000 7eff12ffd700 1 -- 172.21.15.7:0/3391714598 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff1415b210 con 0x7eff1415ced0 2023-10-06T11:00:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.316+0000 7eff12ffd700 1 -- 172.21.15.7:0/3391714598 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1490102659 0 0) 0x7eff00003570 con 0x7eff140ccff0 2023-10-06T11:00:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.316+0000 7eff13fff700 1 -- 172.21.15.7:0/3391714598 >> v1:172.21.15.50:6789/0 conn(0x7eff1415ced0 legacy=0x7eff140cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.316+0000 7eff13fff700 1 -- 172.21.15.7:0/3391714598 >> v1:172.21.15.7:6789/0 conn(0x7eff140ccff0 legacy=0x7eff14069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.316+0000 7eff13fff700 1 -- 172.21.15.7:0/3391714598 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14068ca0 con 0x7eff14159240 2023-10-06T11:00:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.316+0000 7eff13fff700 1 --2- 172.21.15.7:0/3391714598 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff14159240 0x7eff1415acd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efefc009900 tx=0x7efefc009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d92087c8e8e68a4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.316+0000 7eff12ffd700 1 -- 172.21.15.7:0/3391714598 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0017f0 con 0x7eff14159240 2023-10-06T11:00:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.316+0000 7eff12ffd700 1 -- 172.21.15.7:0/3391714598 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc011420 con 0x7eff14159240 2023-10-06T11:00:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.316+0000 7eff12ffd700 1 -- 172.21.15.7:0/3391714598 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc0117c0 con 0x7eff14159240 2023-10-06T11:00:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.317+0000 7eff1a6ac700 1 -- 172.21.15.7:0/3391714598 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff14159240 msgr2=0x7eff1415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.317+0000 7eff1a6ac700 1 --2- 172.21.15.7:0/3391714598 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff14159240 0x7eff1415acd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efefc009900 tx=0x7efefc009120 comp rx=0 tx=0).stop 2023-10-06T11:00:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.317+0000 7eff1a6ac700 1 -- 172.21.15.7:0/3391714598 shutdown_connections 2023-10-06T11:00:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.317+0000 7eff1a6ac700 1 --2- 172.21.15.7:0/3391714598 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff14159240 0x7eff1415acd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.317+0000 7eff1a6ac700 1 -- 172.21.15.7:0/3391714598 >> 172.21.15.7:0/3391714598 conn(0x7eff14087920 msgr2=0x7eff14097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.317+0000 7eff1a6ac700 1 -- 172.21.15.7:0/3391714598 shutdown_connections 2023-10-06T11:00:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.317+0000 7eff1a6ac700 1 -- 172.21.15.7:0/3391714598 wait complete. 2023-10-06T11:00:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.318+0000 7eff1a6ac700 1 Processor -- start 2023-10-06T11:00:01.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.318+0000 7eff1a6ac700 1 -- start start 2023-10-06T11:00:01.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.319+0000 7eff1a6ac700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff140ccff0 0x7eff1416d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:01.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.319+0000 7eff1a6ac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff14159240 0x7eff140c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:01.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.319+0000 7eff1a6ac700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff1415ced0 0x7eff14152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:01.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.319+0000 7eff1a6ac700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff140c4ff0 con 0x7eff140ccff0 2023-10-06T11:00:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.319+0000 7eff1a6ac700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1416d7c0 con 0x7eff14159240 2023-10-06T11:00:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.319+0000 7eff1a6ac700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1416daa0 con 0x7eff1415ced0 2023-10-06T11:00:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.319+0000 7eff13fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff140ccff0 0x7eff1416d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.319+0000 7eff13fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff140ccff0 0x7eff1416d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47124/0 (socket says 172.21.15.7:47124) 2023-10-06T11:00:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.319+0000 7eff13fff700 1 -- 172.21.15.7:0/2751587479 learned_addr learned my addr 172.21.15.7:0/2751587479 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.319+0000 7eff18c49700 1 --2- 172.21.15.7:0/2751587479 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff1415ced0 0x7eff14152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.319+0000 7eff137fe700 1 --2- 172.21.15.7:0/2751587479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff14159240 0x7eff140c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.319+0000 7eff13fff700 1 -- 172.21.15.7:0/2751587479 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff1415ced0 msgr2=0x7eff14152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.319+0000 7eff13fff700 1 --2- 172.21.15.7:0/2751587479 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff1415ced0 0x7eff14152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.320+0000 7eff13fff700 1 -- 172.21.15.7:0/2751587479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff14159240 msgr2=0x7eff140c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.320+0000 7eff13fff700 1 --2- 172.21.15.7:0/2751587479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff14159240 0x7eff140c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.320+0000 7eff13fff700 1 -- 172.21.15.7:0/2751587479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc0093c0 con 0x7eff140ccff0 2023-10-06T11:00:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.320+0000 7eff13fff700 1 --2- 172.21.15.7:0/2751587479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff140ccff0 0x7eff1416d1e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efefc009160 tx=0x7efefc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.320+0000 7eff0bfff700 1 -- 172.21.15.7:0/2751587479 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc01cc90 con 0x7eff140ccff0 2023-10-06T11:00:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.320+0000 7eff0bfff700 1 -- 172.21.15.7:0/2751587479 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc01cdf0 con 0x7eff140ccff0 2023-10-06T11:00:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.320+0000 7eff1a6ac700 1 -- 172.21.15.7:0/2751587479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1416dd80 con 0x7eff140ccff0 2023-10-06T11:00:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.320+0000 7eff0bfff700 1 -- 172.21.15.7:0/2751587479 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc01a6a0 con 0x7eff140ccff0 2023-10-06T11:00:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.320+0000 7eff1a6ac700 1 -- 172.21.15.7:0/2751587479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff140ca180 con 0x7eff140ccff0 2023-10-06T11:00:01.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.321+0000 7eff1a6ac700 1 -- 172.21.15.7:0/2751587479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff14070480 con 0x7eff140ccff0 2023-10-06T11:00:01.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.322+0000 7eff0bfff700 1 -- 172.21.15.7:0/2751587479 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efefc01aa90 con 0x7eff140ccff0 2023-10-06T11:00:01.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.322+0000 7eff0bfff700 1 --2- 172.21.15.7:0/2751587479 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efef4066f30 0x7efef40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:01.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.322+0000 7eff137fe700 1 --2- 172.21.15.7:0/2751587479 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efef4066f30 0x7efef40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:01.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.322+0000 7eff0bfff700 1 -- 172.21.15.7:0/2751587479 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7efefc086340 con 0x7eff140ccff0 2023-10-06T11:00:01.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.323+0000 7eff137fe700 1 --2- 172.21.15.7:0/2751587479 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efef4066f30 0x7efef40693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7eff140c6aa0 tx=0x7eff04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:01.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.327+0000 7eff0bfff700 1 -- 172.21.15.7:0/2751587479 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efefc053120 con 0x7eff140ccff0 2023-10-06T11:00:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.582+0000 7eff1a6ac700 1 -- 172.21.15.7:0/2751587479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7eff14068f80 con 0x7eff140ccff0 2023-10-06T11:00:01.584 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-06T11:00:01.583+0000 7f516a233700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:00:01.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.588+0000 7eff0bfff700 1 -- 172.21.15.7:0/2751587479 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7efefc056740 con 0x7eff140ccff0 2023-10-06T11:00:01.592 INFO:tasks.ceph.mds.a.smithi007.stderr: -4376> 2023-10-06T10:59:07.469+0000 7fee611ff700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:00:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.592+0000 7eff1a6ac700 1 -- 172.21.15.7:0/2751587479 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efef4066f30 msgr2=0x7efef40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.592+0000 7eff1a6ac700 1 --2- 172.21.15.7:0/2751587479 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efef4066f30 0x7efef40693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7eff140c6aa0 tx=0x7eff04009040 comp rx=0 tx=0).stop 2023-10-06T11:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.592+0000 7eff1a6ac700 1 -- 172.21.15.7:0/2751587479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff140ccff0 msgr2=0x7eff1416d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.592+0000 7eff1a6ac700 1 --2- 172.21.15.7:0/2751587479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff140ccff0 0x7eff1416d1e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efefc009160 tx=0x7efefc016000 comp rx=0 tx=0).stop 2023-10-06T11:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.592+0000 7eff1a6ac700 1 -- 172.21.15.7:0/2751587479 shutdown_connections 2023-10-06T11:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.592+0000 7eff1a6ac700 1 --2- 172.21.15.7:0/2751587479 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efef4066f30 0x7efef40693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.592+0000 7eff1a6ac700 1 --2- 172.21.15.7:0/2751587479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff140ccff0 0x7eff1416d1e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.592+0000 7eff1a6ac700 1 --2- 172.21.15.7:0/2751587479 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff1415ced0 0x7eff14152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.592+0000 7eff1a6ac700 1 --2- 172.21.15.7:0/2751587479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff14159240 0x7eff140c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.592+0000 7eff1a6ac700 1 -- 172.21.15.7:0/2751587479 >> 172.21.15.7:0/2751587479 conn(0x7eff14087920 msgr2=0x7eff1415c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.592+0000 7eff1a6ac700 1 -- 172.21.15.7:0/2751587479 shutdown_connections 2023-10-06T11:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.592+0000 7eff1a6ac700 1 -- 172.21.15.7:0/2751587479 wait complete. 2023-10-06T11:00:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:00:01.608 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:00:01.620 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-06T11:00:01.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.740+0000 7fc4ebcf5700 1 Processor -- start 2023-10-06T11:00:01.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.740+0000 7fc4ebcf5700 1 -- start start 2023-10-06T11:00:01.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.741+0000 7fc4ebcf5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4e40ad110 0x7fc4e406d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:01.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.741+0000 7fc4ebcf5700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e40ceed0 con 0x7fc4e406ddb0 2023-10-06T11:00:01.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.741+0000 7fc4ebcf5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e40ca3a0 con 0x7fc4e40c91c0 2023-10-06T11:00:01.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.741+0000 7fc4ebcf5700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e40c95b0 con 0x7fc4e40ad110 2023-10-06T11:00:01.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.741+0000 7fc4e9a91700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4e40ad110 0x7fc4e406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:01.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.741+0000 7fc4e9290700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc4e406ddb0 0x7fc4e40c8ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35162/0 (socket says 172.21.15.7:35162) 2023-10-06T11:00:01.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.741+0000 7fc4e9a91700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4e40ad110 0x7fc4e406d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47158/0 (socket says 172.21.15.7:47158) 2023-10-06T11:00:01.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.741+0000 7fc4e9290700 1 -- 172.21.15.7:0/410275057 learned_addr learned my addr 172.21.15.7:0/410275057 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:01.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.742+0000 7fc4e9a91700 1 -- 172.21.15.7:0/410275057 >> v1:172.21.15.50:6789/0 conn(0x7fc4e40c91c0 legacy=0x7fc4e4068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.742+0000 7fc4e9a91700 1 -- 172.21.15.7:0/410275057 >> v1:172.21.15.7:6789/0 conn(0x7fc4e406ddb0 legacy=0x7fc4e40c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.742+0000 7fc4e9a91700 1 -- 172.21.15.7:0/410275057 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e406e200 con 0x7fc4e40ad110 2023-10-06T11:00:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.742+0000 7fc4e8a8f700 1 -- 172.21.15.7:0/410275057 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408075434 0 0) 0x7fc4e40ceed0 con 0x7fc4e406ddb0 2023-10-06T11:00:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.742+0000 7fc4e9a91700 1 --2- 172.21.15.7:0/410275057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40ad110 0x7fc4e406d870 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80098e0 tx=0x7fc4d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725830ac2e68984 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.742+0000 7fc4e8a8f700 1 -- 172.21.15.7:0/410275057 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8009e80 con 0x7fc4e40ad110 2023-10-06T11:00:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.742+0000 7fc4e8a8f700 1 -- 172.21.15.7:0/410275057 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d800b860 con 0x7fc4e40ad110 2023-10-06T11:00:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.742+0000 7fc4e8a8f700 1 -- 172.21.15.7:0/410275057 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800bbe0 con 0x7fc4e40ad110 2023-10-06T11:00:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.743+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/410275057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40ad110 msgr2=0x7fc4e406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.743+0000 7fc4ebcf5700 1 --2- 172.21.15.7:0/410275057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40ad110 0x7fc4e406d870 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80098e0 tx=0x7fc4d80091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.743+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/410275057 shutdown_connections 2023-10-06T11:00:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.743+0000 7fc4ebcf5700 1 --2- 172.21.15.7:0/410275057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40ad110 0x7fc4e406d870 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.743+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/410275057 >> 172.21.15.7:0/410275057 conn(0x7fc4e406cd00 msgr2=0x7fc4e40cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.743+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/410275057 shutdown_connections 2023-10-06T11:00:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.743+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/410275057 wait complete. 2023-10-06T11:00:01.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.744+0000 7fc4ebcf5700 1 Processor -- start 2023-10-06T11:00:01.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.744+0000 7fc4ebcf5700 1 -- start start 2023-10-06T11:00:01.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ebcf5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc4e406ddb0 0x7fc4e40adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:01.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ebcf5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4e40ad110 0x7fc4e40b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:01.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ebcf5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40c91c0 0x7fc4e41591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:01.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ebcf5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e4171640 con 0x7fc4e40c91c0 2023-10-06T11:00:01.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ebcf5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e4171920 con 0x7fc4e40ad110 2023-10-06T11:00:01.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ebcf5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e4171c00 con 0x7fc4e406ddb0 2023-10-06T11:00:01.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ea292700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40c91c0 0x7fc4e41591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:01.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ea292700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40c91c0 0x7fc4e41591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47166/0 (socket says 172.21.15.7:47166) 2023-10-06T11:00:01.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ea292700 1 -- 172.21.15.7:0/3887377989 learned_addr learned my addr 172.21.15.7:0/3887377989 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4e9a91700 1 --2- 172.21.15.7:0/3887377989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc4e406ddb0 0x7fc4e40adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4e9290700 1 --2- 172.21.15.7:0/3887377989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4e40ad110 0x7fc4e40b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ea292700 1 -- 172.21.15.7:0/3887377989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc4e406ddb0 msgr2=0x7fc4e40adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ea292700 1 --2- 172.21.15.7:0/3887377989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc4e406ddb0 0x7fc4e40adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ea292700 1 -- 172.21.15.7:0/3887377989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4e40ad110 msgr2=0x7fc4e40b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ea292700 1 --2- 172.21.15.7:0/3887377989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4e40ad110 0x7fc4e40b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ea292700 1 -- 172.21.15.7:0/3887377989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d8009420 con 0x7fc4e40c91c0 2023-10-06T11:00:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.745+0000 7fc4ea292700 1 --2- 172.21.15.7:0/3887377989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40c91c0 0x7fc4e41591c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00c930 tx=0x7fc4dc0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.746+0000 7fc4d5ffb700 1 -- 172.21.15.7:0/3887377989 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc012630 con 0x7fc4e40c91c0 2023-10-06T11:00:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.746+0000 7fc4d5ffb700 1 -- 172.21.15.7:0/3887377989 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4dc0127d0 con 0x7fc4e40c91c0 2023-10-06T11:00:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.746+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/3887377989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e4171ee0 con 0x7fc4e40c91c0 2023-10-06T11:00:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.746+0000 7fc4d5ffb700 1 -- 172.21.15.7:0/3887377989 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc012b90 con 0x7fc4e40c91c0 2023-10-06T11:00:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.746+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/3887377989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e41724a0 con 0x7fc4e40c91c0 2023-10-06T11:00:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.747+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/3887377989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e4070480 con 0x7fc4e40c91c0 2023-10-06T11:00:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.747+0000 7fc4d5ffb700 1 -- 172.21.15.7:0/3887377989 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc4dc01a3b0 con 0x7fc4e40c91c0 2023-10-06T11:00:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.748+0000 7fc4d5ffb700 1 --2- 172.21.15.7:0/3887377989 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc4c8066f30 0x7fc4c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.748+0000 7fc4d5ffb700 1 -- 172.21.15.7:0/3887377989 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6953+0+0 (secure 0 0 0) 0x7fc4dc084690 con 0x7fc4e40c91c0 2023-10-06T11:00:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.748+0000 7fc4e9a91700 1 --2- 172.21.15.7:0/3887377989 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc4c8066f30 0x7fc4c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.748+0000 7fc4e9a91700 1 --2- 172.21.15.7:0/3887377989 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc4c8066f30 0x7fc4c80693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80091e0 tx=0x7fc4d8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.752+0000 7fc4d5ffb700 1 -- 172.21.15.7:0/3887377989 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4dc054eb0 con 0x7fc4e40c91c0 2023-10-06T11:00:01.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:01.997+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/3887377989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc4e40cd710 con 0x7fc4e40c91c0 2023-10-06T11:00:02.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.588+0000 7fc4d5ffb700 1 -- 172.21.15.7:0/3887377989 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc4dc054a40 con 0x7fc4e40c91c0 2023-10-06T11:00:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.591+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/3887377989 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc4c8066f30 msgr2=0x7fc4c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.591+0000 7fc4ebcf5700 1 --2- 172.21.15.7:0/3887377989 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc4c8066f30 0x7fc4c80693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80091e0 tx=0x7fc4d8016000 comp rx=0 tx=0).stop 2023-10-06T11:00:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.591+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/3887377989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40c91c0 msgr2=0x7fc4e41591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.591+0000 7fc4ebcf5700 1 --2- 172.21.15.7:0/3887377989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40c91c0 0x7fc4e41591c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00c930 tx=0x7fc4dc0026e0 comp rx=0 tx=0).stop 2023-10-06T11:00:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.591+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/3887377989 shutdown_connections 2023-10-06T11:00:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.591+0000 7fc4ebcf5700 1 --2- 172.21.15.7:0/3887377989 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc4c8066f30 0x7fc4c80693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.591+0000 7fc4ebcf5700 1 --2- 172.21.15.7:0/3887377989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40c91c0 0x7fc4e41591c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.591+0000 7fc4ebcf5700 1 --2- 172.21.15.7:0/3887377989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc4e406ddb0 0x7fc4e40adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.591+0000 7fc4ebcf5700 1 --2- 172.21.15.7:0/3887377989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4e40ad110 0x7fc4e40b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.591+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/3887377989 >> 172.21.15.7:0/3887377989 conn(0x7fc4e406cd00 msgr2=0x7fc4e4068b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.591+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/3887377989 shutdown_connections 2023-10-06T11:00:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.592+0000 7fc4ebcf5700 1 -- 172.21.15.7:0/3887377989 wait complete. 2023-10-06T11:00:02.609 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:00:02.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.789+0000 7f237349b700 1 Processor -- start 2023-10-06T11:00:02.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.790+0000 7f237349b700 1 -- start start 2023-10-06T11:00:02.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.790+0000 7f237349b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f236c155f70 0x7f236c0ac900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:02.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.790+0000 7f237349b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f236c0a9950 0x7f236c0a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:02.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.791+0000 7f237349b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236c069280 con 0x7f236c0ccd70 2023-10-06T11:00:02.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.791+0000 7f237349b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236c0aa680 con 0x7f236c155f70 2023-10-06T11:00:02.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.791+0000 7f237349b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0aa3a0 con 0x7f236c0a9950 2023-10-06T11:00:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.791+0000 7f2370a36700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f236c0a9950 0x7f236c0a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.791+0000 7f2371237700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f236c155f70 0x7f236c0ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.791+0000 7f2371237700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f236c155f70 0x7f236c0ac900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:46636/0 (socket says 172.21.15.7:46636) 2023-10-06T11:00:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.791+0000 7f2370a36700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f236c0a9950 0x7f236c0a9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:38140/0 (socket says 172.21.15.7:38140) 2023-10-06T11:00:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.791+0000 7f2371237700 1 -- 172.21.15.7:0/630346850 learned_addr learned my addr 172.21.15.7:0/630346850 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.791+0000 7f2370a36700 1 -- 172.21.15.7:0/630346850 >> v2:172.21.15.50:3300/0 conn(0x7f236c155f70 msgr2=0x7f236c0ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.791+0000 7f2370a36700 1 --2- 172.21.15.7:0/630346850 >> v2:172.21.15.50:3300/0 conn(0x7f236c155f70 0x7f236c0ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.791+0000 7f2370a36700 1 -- 172.21.15.7:0/630346850 >> v1:172.21.15.50:6789/0 conn(0x7f236c0ccd70 legacy=0x7f236c069710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.791+0000 7f2370a36700 1 -- 172.21.15.7:0/630346850 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c068c30 con 0x7f236c0a9950 2023-10-06T11:00:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.791+0000 7f2371237700 1 --2- 172.21.15.7:0/630346850 >> v2:172.21.15.50:3300/0 conn(0x7f236c155f70 0x7f236c0ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.792+0000 7f2370a36700 1 --2- 172.21.15.7:0/630346850 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f236c0a9950 0x7f236c0a9da0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f235c0098e0 tx=0x7f235c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad276b1f395cfce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:02.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.792+0000 7f2363fff700 1 -- 172.21.15.7:0/630346850 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00b640 con 0x7f236c0a9950 2023-10-06T11:00:02.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.792+0000 7f2363fff700 1 -- 172.21.15.7:0/630346850 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c00b7a0 con 0x7f236c0a9950 2023-10-06T11:00:02.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.792+0000 7f2363fff700 1 -- 172.21.15.7:0/630346850 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00bb40 con 0x7f236c0a9950 2023-10-06T11:00:02.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.792+0000 7f237349b700 1 -- 172.21.15.7:0/630346850 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f236c0a9950 msgr2=0x7f236c0a9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:02.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.792+0000 7f237349b700 1 --2- 172.21.15.7:0/630346850 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f236c0a9950 0x7f236c0a9da0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f235c0098e0 tx=0x7f235c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:02.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.792+0000 7f237349b700 1 -- 172.21.15.7:0/630346850 shutdown_connections 2023-10-06T11:00:02.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.792+0000 7f237349b700 1 --2- 172.21.15.7:0/630346850 >> v2:172.21.15.50:3300/0 conn(0x7f236c155f70 0x7f236c0ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.792+0000 7f237349b700 1 --2- 172.21.15.7:0/630346850 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f236c0a9950 0x7f236c0a9da0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.792+0000 7f237349b700 1 -- 172.21.15.7:0/630346850 >> 172.21.15.7:0/630346850 conn(0x7f236c096160 msgr2=0x7f236c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.793+0000 7f237349b700 1 -- 172.21.15.7:0/630346850 shutdown_connections 2023-10-06T11:00:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.793+0000 7f237349b700 1 -- 172.21.15.7:0/630346850 wait complete. 2023-10-06T11:00:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.794+0000 7f237349b700 1 Processor -- start 2023-10-06T11:00:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.794+0000 7f237349b700 1 -- start start 2023-10-06T11:00:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f237349b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f236c0a9950 0x7f236c13ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f237349b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f236c0ccd70 0x7f236c13e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f237349b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c155f70 0x7f236c158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f237349b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c1404c0 con 0x7f236c0a9950 2023-10-06T11:00:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f237349b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c157540 con 0x7f236c155f70 2023-10-06T11:00:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f237349b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c1583a0 con 0x7f236c0ccd70 2023-10-06T11:00:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f2371237700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f236c0a9950 0x7f236c13ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f2371237700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f236c0a9950 0x7f236c13ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47176/0 (socket says 172.21.15.7:47176) 2023-10-06T11:00:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f2371237700 1 -- 172.21.15.7:0/1172893351 learned_addr learned my addr 172.21.15.7:0/1172893351 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f2370a36700 1 --2- 172.21.15.7:0/1172893351 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f236c0ccd70 0x7f236c13e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f2371a38700 1 --2- 172.21.15.7:0/1172893351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c155f70 0x7f236c158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f2371237700 1 -- 172.21.15.7:0/1172893351 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f236c0ccd70 msgr2=0x7f236c13e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f2371237700 1 --2- 172.21.15.7:0/1172893351 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f236c0ccd70 0x7f236c13e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f2371237700 1 -- 172.21.15.7:0/1172893351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c155f70 msgr2=0x7f236c158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f2371237700 1 --2- 172.21.15.7:0/1172893351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c155f70 0x7f236c158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f2371237700 1 -- 172.21.15.7:0/1172893351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23680094f0 con 0x7f236c0a9950 2023-10-06T11:00:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.795+0000 7f2371237700 1 --2- 172.21.15.7:0/1172893351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f236c0a9950 0x7f236c13ff80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f236800ec50 tx=0x7f2368009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.796+0000 7f23617fa700 1 -- 172.21.15.7:0/1172893351 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236800c850 con 0x7f236c0a9950 2023-10-06T11:00:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.796+0000 7f23617fa700 1 -- 172.21.15.7:0/1172893351 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236800c9b0 con 0x7f236c0a9950 2023-10-06T11:00:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.796+0000 7f237349b700 1 -- 172.21.15.7:0/1172893351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235c009420 con 0x7f236c0a9950 2023-10-06T11:00:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.796+0000 7f23617fa700 1 -- 172.21.15.7:0/1172893351 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236800cd30 con 0x7f236c0a9950 2023-10-06T11:00:02.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.796+0000 7f237349b700 1 -- 172.21.15.7:0/1172893351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236c157840 con 0x7f236c0a9950 2023-10-06T11:00:02.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.797+0000 7f237349b700 1 -- 172.21.15.7:0/1172893351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236c158680 con 0x7f236c0a9950 2023-10-06T11:00:02.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.797+0000 7f23617fa700 1 -- 172.21.15.7:0/1172893351 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2368013680 con 0x7f236c0a9950 2023-10-06T11:00:02.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.798+0000 7f23617fa700 1 --2- 172.21.15.7:0/1172893351 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2350066f30 0x7f23500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:02.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.798+0000 7f23617fa700 1 -- 172.21.15.7:0/1172893351 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f2368084fe0 con 0x7f236c0a9950 2023-10-06T11:00:02.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.798+0000 7f2370a36700 1 --2- 172.21.15.7:0/1172893351 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2350066f30 0x7f23500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:02.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.798+0000 7f2370a36700 1 --2- 172.21.15.7:0/1172893351 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2350066f30 0x7f23500693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f235c0093f0 tx=0x7f235c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:02.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:02.802+0000 7f23617fa700 1 -- 172.21.15.7:0/1172893351 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2368051d70 con 0x7f236c0a9950 2023-10-06T11:00:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.006+0000 7f237349b700 1 -- 172.21.15.7:0/1172893351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f236c068f10 con 0x7f236c0a9950 2023-10-06T11:00:03.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.665+0000 7f23617fa700 1 -- 172.21.15.7:0/1172893351 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2368055390 con 0x7f236c0a9950 2023-10-06T11:00:03.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.670+0000 7f237349b700 1 -- 172.21.15.7:0/1172893351 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2350066f30 msgr2=0x7f23500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:03.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.670+0000 7f237349b700 1 --2- 172.21.15.7:0/1172893351 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2350066f30 0x7f23500693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f235c0093f0 tx=0x7f235c017000 comp rx=0 tx=0).stop 2023-10-06T11:00:03.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.670+0000 7f237349b700 1 -- 172.21.15.7:0/1172893351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f236c0a9950 msgr2=0x7f236c13ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:03.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.670+0000 7f237349b700 1 --2- 172.21.15.7:0/1172893351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f236c0a9950 0x7f236c13ff80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f236800ec50 tx=0x7f2368009250 comp rx=0 tx=0).stop 2023-10-06T11:00:03.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.671+0000 7f237349b700 1 -- 172.21.15.7:0/1172893351 shutdown_connections 2023-10-06T11:00:03.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.671+0000 7f237349b700 1 --2- 172.21.15.7:0/1172893351 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2350066f30 0x7f23500693e0 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f235c0093f0 tx=0x7f235c017000 comp rx=0 tx=0).stop 2023-10-06T11:00:03.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.671+0000 7f237349b700 1 --2- 172.21.15.7:0/1172893351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f236c0a9950 0x7f236c13ff80 secure :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f236800ec50 tx=0x7f2368009250 comp rx=0 tx=0).stop 2023-10-06T11:00:03.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.671+0000 7f237349b700 1 --2- 172.21.15.7:0/1172893351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c155f70 0x7f236c158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:03.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.671+0000 7f237349b700 1 --2- 172.21.15.7:0/1172893351 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f236c0ccd70 0x7f236c13e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:03.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.671+0000 7f237349b700 1 -- 172.21.15.7:0/1172893351 >> 172.21.15.7:0/1172893351 conn(0x7f236c096160 msgr2=0x7f236c0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:03.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.671+0000 7f237349b700 1 -- 172.21.15.7:0/1172893351 shutdown_connections 2023-10-06T11:00:03.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.672+0000 7f237349b700 1 -- 172.21.15.7:0/1172893351 wait complete. 2023-10-06T11:00:03.675 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:00:03.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:00:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.828+0000 7fef9b046700 1 Processor -- start 2023-10-06T11:00:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.828+0000 7fef9b046700 1 -- start start 2023-10-06T11:00:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.829+0000 7fef9b046700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef94151380 0x7fef940c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.829+0000 7fef9b046700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef94151750 0x7fef940ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.829+0000 7fef9b046700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef940c8fe0 con 0x7fef940cad10 2023-10-06T11:00:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.829+0000 7fef9b046700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef940c92a0 con 0x7fef94151750 2023-10-06T11:00:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.829+0000 7fef9b046700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef940c9580 con 0x7fef94151380 2023-10-06T11:00:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.829+0000 7fef93fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef94151750 0x7fef940ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.829+0000 7fef93fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef94151750 0x7fef940ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47188/0 (socket says 172.21.15.7:47188) 2023-10-06T11:00:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.829+0000 7fef93fff700 1 -- 172.21.15.7:0/1309995197 learned_addr learned my addr 172.21.15.7:0/1309995197 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.829+0000 7fef98de2700 1 --2- 172.21.15.7:0/1309995197 >> v2:172.21.15.50:3300/0 conn(0x7fef94151380 0x7fef940c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.830+0000 7fef93fff700 1 -- 172.21.15.7:0/1309995197 >> v2:172.21.15.50:3300/0 conn(0x7fef94151380 msgr2=0x7fef940c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.830+0000 7fef93fff700 1 --2- 172.21.15.7:0/1309995197 >> v2:172.21.15.50:3300/0 conn(0x7fef94151380 0x7fef940c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.830+0000 7fef93fff700 1 -- 172.21.15.7:0/1309995197 >> v1:172.21.15.50:6789/0 conn(0x7fef940cad10 legacy=0x7fef9415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.830+0000 7fef93fff700 1 -- 172.21.15.7:0/1309995197 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef940c9860 con 0x7fef94151750 2023-10-06T11:00:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.830+0000 7fef93fff700 1 --2- 172.21.15.7:0/1309995197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef94151750 0x7fef940ca7d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fef94088480 tx=0x7fef7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b190362e9f6c3844 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.830+0000 7fef937fe700 1 -- 172.21.15.7:0/1309995197 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00b860 con 0x7fef94151750 2023-10-06T11:00:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.830+0000 7fef937fe700 1 -- 172.21.15.7:0/1309995197 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c00b9c0 con 0x7fef94151750 2023-10-06T11:00:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.830+0000 7fef937fe700 1 -- 172.21.15.7:0/1309995197 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00bd60 con 0x7fef94151750 2023-10-06T11:00:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.831+0000 7fef9b046700 1 -- 172.21.15.7:0/1309995197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef94151750 msgr2=0x7fef940ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.831+0000 7fef9b046700 1 --2- 172.21.15.7:0/1309995197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef94151750 0x7fef940ca7d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fef94088480 tx=0x7fef7c009250 comp rx=0 tx=0).stop 2023-10-06T11:00:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.831+0000 7fef9b046700 1 -- 172.21.15.7:0/1309995197 shutdown_connections 2023-10-06T11:00:03.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.831+0000 7fef9b046700 1 --2- 172.21.15.7:0/1309995197 >> v2:172.21.15.50:3300/0 conn(0x7fef94151380 0x7fef940c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:03.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.831+0000 7fef9b046700 1 --2- 172.21.15.7:0/1309995197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef94151750 0x7fef940ca7d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:03.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.831+0000 7fef9b046700 1 -- 172.21.15.7:0/1309995197 >> 172.21.15.7:0/1309995197 conn(0x7fef94087920 msgr2=0x7fef94097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:03.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.831+0000 7fef9b046700 1 -- 172.21.15.7:0/1309995197 shutdown_connections 2023-10-06T11:00:03.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.831+0000 7fef9b046700 1 -- 172.21.15.7:0/1309995197 wait complete. 2023-10-06T11:00:03.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.832+0000 7fef9b046700 1 Processor -- start 2023-10-06T11:00:03.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.833+0000 7fef9b046700 1 -- start start 2023-10-06T11:00:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef9b046700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef940cad10 0x7fef94150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef9b046700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef94151380 0x7fef940c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef9b046700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef94151750 0x7fef940c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef9b046700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9415a9a0 con 0x7fef940cad10 2023-10-06T11:00:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef9b046700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef940c34e0 con 0x7fef94151380 2023-10-06T11:00:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef9b046700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef941509b0 con 0x7fef94151750 2023-10-06T11:00:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef98de2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef940cad10 0x7fef94150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef98de2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef940cad10 0x7fef94150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47190/0 (socket says 172.21.15.7:47190) 2023-10-06T11:00:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef98de2700 1 -- 172.21.15.7:0/1222028140 learned_addr learned my addr 172.21.15.7:0/1222028140 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef995e3700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef94151750 0x7fef940c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef93fff700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef94151380 0x7fef940c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef98de2700 1 -- 172.21.15.7:0/1222028140 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef94151750 msgr2=0x7fef940c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:03.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef98de2700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef94151750 0x7fef940c2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:03.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef98de2700 1 -- 172.21.15.7:0/1222028140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef94151380 msgr2=0x7fef940c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:03.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef98de2700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef94151380 0x7fef940c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:03.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef98de2700 1 -- 172.21.15.7:0/1222028140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c0094f0 con 0x7fef940cad10 2023-10-06T11:00:03.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef995e3700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef94151750 0x7fef940c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:03.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef93fff700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef94151380 0x7fef940c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:03.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef98de2700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef940cad10 0x7fef94150470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fef8400d890 tx=0x7fef84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:03.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef90ff9700 1 -- 172.21.15.7:0/1222028140 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8400b600 con 0x7fef940cad10 2023-10-06T11:00:03.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.834+0000 7fef90ff9700 1 -- 172.21.15.7:0/1222028140 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8400b760 con 0x7fef940cad10 2023-10-06T11:00:03.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.835+0000 7fef9b046700 1 -- 172.21.15.7:0/1222028140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef940c78d0 con 0x7fef940cad10 2023-10-06T11:00:03.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.835+0000 7fef90ff9700 1 -- 172.21.15.7:0/1222028140 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8400bae0 con 0x7fef940cad10 2023-10-06T11:00:03.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.835+0000 7fef9b046700 1 -- 172.21.15.7:0/1222028140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef940c7e90 con 0x7fef940cad10 2023-10-06T11:00:03.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.836+0000 7fef9b046700 1 -- 172.21.15.7:0/1222028140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9415a770 con 0x7fef940cad10 2023-10-06T11:00:03.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.836+0000 7fef90ff9700 1 -- 172.21.15.7:0/1222028140 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef8401e460 con 0x7fef940cad10 2023-10-06T11:00:03.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.836+0000 7fef90ff9700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fef74066f30 0x7fef740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:03.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.837+0000 7fef90ff9700 1 -- 172.21.15.7:0/1222028140 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6515+0+0 (secure 0 0 0) 0x7fef84084f10 con 0x7fef940cad10 2023-10-06T11:00:03.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.837+0000 7fef93fff700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fef74066f30 0x7fef740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:03.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.837+0000 7fef93fff700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fef74066f30 0x7fef740693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fef94088480 tx=0x7fef7c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:03.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:03.841+0000 7fef90ff9700 1 -- 172.21.15.7:0/1222028140 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef84051e50 con 0x7fef940cad10 2023-10-06T11:00:04.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.044+0000 7fef9b046700 1 -- 172.21.15.7:0/1222028140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef940c8080 con 0x7fef940cad10 2023-10-06T11:00:04.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.680+0000 7fef90ff9700 1 -- 172.21.15.7:0/1222028140 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7fef84055470 con 0x7fef940cad10 2023-10-06T11:00:04.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.685+0000 7fef9b046700 1 -- 172.21.15.7:0/1222028140 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fef74066f30 msgr2=0x7fef740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:04.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.685+0000 7fef9b046700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fef74066f30 0x7fef740693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fef94088480 tx=0x7fef7c017000 comp rx=0 tx=0).stop 2023-10-06T11:00:04.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.685+0000 7fef9b046700 1 -- 172.21.15.7:0/1222028140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef940cad10 msgr2=0x7fef94150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:04.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.685+0000 7fef9b046700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef940cad10 0x7fef94150470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fef8400d890 tx=0x7fef84008040 comp rx=0 tx=0).stop 2023-10-06T11:00:04.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.685+0000 7fef9b046700 1 -- 172.21.15.7:0/1222028140 shutdown_connections 2023-10-06T11:00:04.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.685+0000 7fef9b046700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fef74066f30 0x7fef740693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:04.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.685+0000 7fef9b046700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef940cad10 0x7fef94150470 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:04.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.685+0000 7fef9b046700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef94151750 0x7fef940c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:04.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.685+0000 7fef9b046700 1 --2- 172.21.15.7:0/1222028140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef94151380 0x7fef940c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:04.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.685+0000 7fef9b046700 1 -- 172.21.15.7:0/1222028140 >> 172.21.15.7:0/1222028140 conn(0x7fef94087920 msgr2=0x7fef9406c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:04.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.686+0000 7fef9b046700 1 -- 172.21.15.7:0/1222028140 shutdown_connections 2023-10-06T11:00:04.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.687+0000 7fef9b046700 1 -- 172.21.15.7:0/1222028140 wait complete. 2023-10-06T11:00:04.691 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-10-06T11:00:04.706 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-06T11:00:04.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.843+0000 7f6527067700 1 Processor -- start 2023-10-06T11:00:04.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.844+0000 7f6527067700 1 -- start start 2023-10-06T11:00:04.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.845+0000 7f6527067700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65200ccdd0 0x7f6520161f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:04.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.845+0000 7f6527067700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65200c8d70 con 0x7f6520151380 2023-10-06T11:00:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.845+0000 7f6527067700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65200c8fe0 con 0x7f6520151750 2023-10-06T11:00:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.845+0000 7f6527067700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65200c92a0 con 0x7f65200ccdd0 2023-10-06T11:00:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.845+0000 7f6524e03700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6520151380 0x7f65200c8660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35164/0 (socket says 172.21.15.7:35164) 2023-10-06T11:00:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.845+0000 7f6524e03700 1 -- 172.21.15.7:0/3090629070 learned_addr learned my addr 172.21.15.7:0/3090629070 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.845+0000 7f6525604700 1 --2- 172.21.15.7:0/3090629070 >> v2:172.21.15.7:3300/0 conn(0x7f65200ccdd0 0x7f6520161f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.845+0000 7f651f7fe700 1 -- 172.21.15.7:0/3090629070 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28572869 0 0) 0x7f65200c8d70 con 0x7f6520151380 2023-10-06T11:00:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.846+0000 7f651f7fe700 1 -- 172.21.15.7:0/3090629070 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6508003570 con 0x7f6520151380 2023-10-06T11:00:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.846+0000 7f6525604700 1 -- 172.21.15.7:0/3090629070 >> v1:172.21.15.50:6789/0 conn(0x7f6520151750 legacy=0x7f65200ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.846+0000 7f6525604700 1 -- 172.21.15.7:0/3090629070 >> v1:172.21.15.7:6789/0 conn(0x7f6520151380 legacy=0x7f65200c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.846+0000 7f651f7fe700 1 -- 172.21.15.7:0/3090629070 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991177182 0 0) 0x7f65200c8fe0 con 0x7f6520151750 2023-10-06T11:00:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.846+0000 7f6525604700 1 -- 172.21.15.7:0/3090629070 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65200c9580 con 0x7f65200ccdd0 2023-10-06T11:00:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.846+0000 7f6525604700 1 --2- 172.21.15.7:0/3090629070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65200ccdd0 0x7f6520161f70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6518009e60 tx=0x7f6518009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0180dcd3621d4d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.846+0000 7f651f7fe700 1 -- 172.21.15.7:0/3090629070 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651800e070 con 0x7f65200ccdd0 2023-10-06T11:00:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.846+0000 7f651f7fe700 1 -- 172.21.15.7:0/3090629070 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651800bb60 con 0x7f65200ccdd0 2023-10-06T11:00:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.846+0000 7f651f7fe700 1 -- 172.21.15.7:0/3090629070 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651800bee0 con 0x7f65200ccdd0 2023-10-06T11:00:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.847+0000 7f6527067700 1 -- 172.21.15.7:0/3090629070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65200ccdd0 msgr2=0x7f6520161f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.847+0000 7f6527067700 1 --2- 172.21.15.7:0/3090629070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65200ccdd0 0x7f6520161f70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6518009e60 tx=0x7f6518009780 comp rx=0 tx=0).stop 2023-10-06T11:00:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.847+0000 7f6527067700 1 -- 172.21.15.7:0/3090629070 shutdown_connections 2023-10-06T11:00:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.847+0000 7f6527067700 1 --2- 172.21.15.7:0/3090629070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65200ccdd0 0x7f6520161f70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.847+0000 7f6527067700 1 -- 172.21.15.7:0/3090629070 >> 172.21.15.7:0/3090629070 conn(0x7f6520087920 msgr2=0x7f6520097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.847+0000 7f6527067700 1 -- 172.21.15.7:0/3090629070 shutdown_connections 2023-10-06T11:00:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.847+0000 7f6527067700 1 -- 172.21.15.7:0/3090629070 wait complete. 2023-10-06T11:00:04.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.848+0000 7f6527067700 1 Processor -- start 2023-10-06T11:00:04.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.848+0000 7f6527067700 1 -- start start 2023-10-06T11:00:04.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.849+0000 7f6527067700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65200ccdd0 0x7f652016c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:04.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.849+0000 7f6527067700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6520151380 0x7f6520069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:04.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.849+0000 7f6527067700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6520151750 0x7f65200c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:04.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.849+0000 7f6527067700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6520069df0 con 0x7f6520151750 2023-10-06T11:00:04.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.849+0000 7f6527067700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652006a0d0 con 0x7f65200ccdd0 2023-10-06T11:00:04.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.849+0000 7f6527067700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652006a3b0 con 0x7f6520151380 2023-10-06T11:00:04.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.849+0000 7f6525604700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6520151750 0x7f65200c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:04.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.849+0000 7f6525604700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6520151750 0x7f65200c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47206/0 (socket says 172.21.15.7:47206) 2023-10-06T11:00:04.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.849+0000 7f6525604700 1 -- 172.21.15.7:0/1956416358 learned_addr learned my addr 172.21.15.7:0/1956416358 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:04.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.849+0000 7f6524e03700 1 --2- 172.21.15.7:0/1956416358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65200ccdd0 0x7f652016c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:04.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.849+0000 7f651ffff700 1 --2- 172.21.15.7:0/1956416358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6520151380 0x7f6520069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:04.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.850+0000 7f6525604700 1 -- 172.21.15.7:0/1956416358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6520151380 msgr2=0x7f6520069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:04.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.850+0000 7f6525604700 1 --2- 172.21.15.7:0/1956416358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6520151380 0x7f6520069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:04.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.850+0000 7f6525604700 1 -- 172.21.15.7:0/1956416358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65200ccdd0 msgr2=0x7f652016c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:04.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.850+0000 7f6525604700 1 --2- 172.21.15.7:0/1956416358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65200ccdd0 0x7f652016c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:04.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.850+0000 7f6525604700 1 -- 172.21.15.7:0/1956416358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6518009a20 con 0x7f6520151750 2023-10-06T11:00:04.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.850+0000 7f6525604700 1 --2- 172.21.15.7:0/1956416358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6520151750 0x7f65200c76a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f652006f860 tx=0x7f6518019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:04.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.850+0000 7f651cff9700 1 -- 172.21.15.7:0/1956416358 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6518012e90 con 0x7f6520151750 2023-10-06T11:00:04.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.850+0000 7f651cff9700 1 -- 172.21.15.7:0/1956416358 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6518027470 con 0x7f6520151750 2023-10-06T11:00:04.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.850+0000 7f6527067700 1 -- 172.21.15.7:0/1956416358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652006a690 con 0x7f6520151750 2023-10-06T11:00:04.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.850+0000 7f651cff9700 1 -- 172.21.15.7:0/1956416358 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6518027850 con 0x7f6520151750 2023-10-06T11:00:04.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.850+0000 7f6527067700 1 -- 172.21.15.7:0/1956416358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652016c5e0 con 0x7f6520151750 2023-10-06T11:00:04.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.851+0000 7f6527067700 1 -- 172.21.15.7:0/1956416358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6520070480 con 0x7f6520151750 2023-10-06T11:00:04.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.852+0000 7f651cff9700 1 -- 172.21.15.7:0/1956416358 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6518024070 con 0x7f6520151750 2023-10-06T11:00:04.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.852+0000 7f651cff9700 1 --2- 172.21.15.7:0/1956416358 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f650c066f30 0x7f650c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:04.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.852+0000 7f651cff9700 1 -- 172.21.15.7:0/1956416358 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6043+0+0 (secure 0 0 0) 0x7f6518086d40 con 0x7f6520151750 2023-10-06T11:00:04.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.852+0000 7f6524e03700 1 --2- 172.21.15.7:0/1956416358 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f650c066f30 0x7f650c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:04.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.853+0000 7f6524e03700 1 --2- 172.21.15.7:0/1956416358 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f650c066f30 0x7f650c0693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6510007fd0 tx=0x7f6510009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:04.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:04.857+0000 7f651cff9700 1 -- 172.21.15.7:0/1956416358 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6518053e60 con 0x7f6520151750 2023-10-06T11:00:05.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:05.068+0000 7f6527067700 1 -- 172.21.15.7:0/1956416358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f65200c9860 con 0x7f6520151750 2023-10-06T11:00:05.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:05.682+0000 7f651cff9700 1 -- 172.21.15.7:0/1956416358 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f651802c020 con 0x7f6520151750 2023-10-06T11:00:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:05.688+0000 7f6527067700 1 -- 172.21.15.7:0/1956416358 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f650c066f30 msgr2=0x7f650c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:05.688+0000 7f6527067700 1 --2- 172.21.15.7:0/1956416358 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f650c066f30 0x7f650c0693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6510007fd0 tx=0x7f6510009040 comp rx=0 tx=0).stop 2023-10-06T11:00:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:05.688+0000 7f6527067700 1 -- 172.21.15.7:0/1956416358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6520151750 msgr2=0x7f65200c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:05.688+0000 7f6527067700 1 --2- 172.21.15.7:0/1956416358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6520151750 0x7f65200c76a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f652006f860 tx=0x7f6518019000 comp rx=0 tx=0).stop 2023-10-06T11:00:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:05.688+0000 7f6527067700 1 -- 172.21.15.7:0/1956416358 shutdown_connections 2023-10-06T11:00:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:05.688+0000 7f6527067700 1 --2- 172.21.15.7:0/1956416358 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f650c066f30 0x7f650c0693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:05.688+0000 7f6527067700 1 --2- 172.21.15.7:0/1956416358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6520151750 0x7f65200c76a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:05.688+0000 7f6527067700 1 --2- 172.21.15.7:0/1956416358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65200ccdd0 0x7f652016c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:05.688+0000 7f6527067700 1 --2- 172.21.15.7:0/1956416358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6520151380 0x7f6520069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:05.688+0000 7f6527067700 1 -- 172.21.15.7:0/1956416358 >> 172.21.15.7:0/1956416358 conn(0x7f6520087920 msgr2=0x7f65200cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:05.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:05.691+0000 7f6527067700 1 -- 172.21.15.7:0/1956416358 shutdown_connections 2023-10-06T11:00:05.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:05.692+0000 7f6527067700 1 -- 172.21.15.7:0/1956416358 wait complete. 2023-10-06T11:00:05.696 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data_ec' removed 2023-10-06T11:00:05.711 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:00:05.711 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:00:05.711 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:00:05.711 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:00:05.712 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:00:05.712 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:00:05.712 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:00:05.712 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:00:05.712 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:00:05.712 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:00:05.713 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:00:05.713 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:00:05.713 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:00:05.713 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:00:05.713 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:00:05.713 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:00:05.723 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:00:05.723 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:00:05.724 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:00:05.724 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:00:05.725 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:00:05.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:00:05.767 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:00:05.767 DEBUG:teuthology.parallel:result is None 2023-10-06T11:00:05.768 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:00:05.768 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:00:05.769 DEBUG:teuthology.parallel:result is None 2023-10-06T11:00:05.769 DEBUG:teuthology.parallel:result is None 2023-10-06T11:00:05.860 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-06T11:00:05.870 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2023-10-06T11:00:05.870 INFO:tasks.ceph.mds.d.smithi050.stdout:starting mds.d at 2023-10-06T11:00:10.704 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:00:10.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:00:11.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-06T11:00:11.722 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:00:11.723 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:00:11.728 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:00:11.728 DEBUG:teuthology.parallel:result is None 2023-10-06T11:00:11.728 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:00:11.820 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-06T11:00:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.868+0000 7ff6ba736700 1 Processor -- start 2023-10-06T11:00:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.869+0000 7ff6ba736700 1 -- start start 2023-10-06T11:00:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.869+0000 7ff6ba736700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6b40ccda0 0x7ff6b40cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.869+0000 7ff6ba736700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6b40aaa40 0x7ff6b4155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.869+0000 7ff6ba736700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b4069110 con 0x7ff6b40ac8d0 2023-10-06T11:00:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.869+0000 7ff6ba736700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b4068b30 con 0x7ff6b40aaa40 2023-10-06T11:00:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.869+0000 7ff6ba736700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40aafb0 con 0x7ff6b40ccda0 2023-10-06T11:00:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.870+0000 7ff6b3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6b40ccda0 0x7ff6b40cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.870+0000 7ff6b8cd3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6b40aaa40 0x7ff6b4155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.870+0000 7ff6b8cd3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6b40aaa40 0x7ff6b4155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:49832/0 (socket says 172.21.15.7:49832) 2023-10-06T11:00:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.870+0000 7ff6b8cd3700 1 -- 172.21.15.7:0/2805009724 learned_addr learned my addr 172.21.15.7:0/2805009724 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.870+0000 7ff6b37fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff6b40ac8d0 0x7ff6b40aa330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:53758/0 (socket says 172.21.15.7:53758) 2023-10-06T11:00:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.870+0000 7ff6b3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6b40ccda0 0x7ff6b40cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:57450/0 (socket says 172.21.15.7:57450) 2023-10-06T11:00:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.870+0000 7ff6b8cd3700 1 -- 172.21.15.7:0/2805009724 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6b40ccda0 msgr2=0x7ff6b40cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.870+0000 7ff6b8cd3700 1 --2- 172.21.15.7:0/2805009724 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6b40ccda0 0x7ff6b40cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.870+0000 7ff6b8cd3700 1 -- 172.21.15.7:0/2805009724 >> v1:172.21.15.50:6789/0 conn(0x7ff6b40ac8d0 legacy=0x7ff6b40aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.870+0000 7ff6b8cd3700 1 -- 172.21.15.7:0/2805009724 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4068da0 con 0x7ff6b40aaa40 2023-10-06T11:00:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.870+0000 7ff6b2ffd700 1 -- 172.21.15.7:0/2805009724 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896991904 0 0) 0x7ff6b4069110 con 0x7ff6b40ac8d0 2023-10-06T11:00:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.870+0000 7ff6b8cd3700 1 --2- 172.21.15.7:0/2805009724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b40aaa40 0x7ff6b4155af0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009f20 tx=0x7ff6ac009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d67617886c38834 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.871+0000 7ff6b2ffd700 1 -- 172.21.15.7:0/2805009724 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00e070 con 0x7ff6b40aaa40 2023-10-06T11:00:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.871+0000 7ff6b2ffd700 1 -- 172.21.15.7:0/2805009724 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac00ba60 con 0x7ff6b40aaa40 2023-10-06T11:00:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.871+0000 7ff6b2ffd700 1 -- 172.21.15.7:0/2805009724 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0092e0 con 0x7ff6b40aaa40 2023-10-06T11:00:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.871+0000 7ff6ba736700 1 -- 172.21.15.7:0/2805009724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b40aaa40 msgr2=0x7ff6b4155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.871+0000 7ff6ba736700 1 --2- 172.21.15.7:0/2805009724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b40aaa40 0x7ff6b4155af0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009f20 tx=0x7ff6ac009840 comp rx=0 tx=0).stop 2023-10-06T11:00:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.871+0000 7ff6ba736700 1 -- 172.21.15.7:0/2805009724 shutdown_connections 2023-10-06T11:00:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.871+0000 7ff6ba736700 1 --2- 172.21.15.7:0/2805009724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b40aaa40 0x7ff6b4155af0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.871+0000 7ff6ba736700 1 --2- 172.21.15.7:0/2805009724 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6b40ccda0 0x7ff6b40cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.871+0000 7ff6ba736700 1 -- 172.21.15.7:0/2805009724 >> 172.21.15.7:0/2805009724 conn(0x7ff6b4096160 msgr2=0x7ff6b40afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.871+0000 7ff6ba736700 1 -- 172.21.15.7:0/2805009724 shutdown_connections 2023-10-06T11:00:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.871+0000 7ff6ba736700 1 -- 172.21.15.7:0/2805009724 wait complete. 2023-10-06T11:00:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.873+0000 7ff6ba736700 1 Processor -- start 2023-10-06T11:00:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.873+0000 7ff6ba736700 1 -- start start 2023-10-06T11:00:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6ba736700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b40aaa40 0x7ff6b4169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6ba736700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6b40ac8d0 0x7ff6b40cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6ba736700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6b40ccda0 0x7ff6b4159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6ba736700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b4166e60 con 0x7ff6b40ac8d0 2023-10-06T11:00:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6ba736700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b416a3f0 con 0x7ff6b40aaa40 2023-10-06T11:00:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6ba736700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b416a6d0 con 0x7ff6b40ccda0 2023-10-06T11:00:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6b37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6b40ac8d0 0x7ff6b40cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b40aaa40 0x7ff6b4169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6b37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6b40ac8d0 0x7ff6b40cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35194/0 (socket says 172.21.15.7:35194) 2023-10-06T11:00:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6b37fe700 1 -- 172.21.15.7:0/4233655668 learned_addr learned my addr 172.21.15.7:0/4233655668 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6b8cd3700 1 --2- 172.21.15.7:0/4233655668 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6b40ccda0 0x7ff6b4159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6b37fe700 1 -- 172.21.15.7:0/4233655668 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6b40ccda0 msgr2=0x7ff6b4159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6b37fe700 1 --2- 172.21.15.7:0/4233655668 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6b40ccda0 0x7ff6b4159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6b37fe700 1 -- 172.21.15.7:0/4233655668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b40aaa40 msgr2=0x7ff6b4169a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6b37fe700 1 --2- 172.21.15.7:0/4233655668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b40aaa40 0x7ff6b4169a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6b37fe700 1 -- 172.21.15.7:0/4233655668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac009ae0 con 0x7ff6b40ac8d0 2023-10-06T11:00:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6b3fff700 1 --2- 172.21.15.7:0/4233655668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b40aaa40 0x7ff6b4169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff6b37fe700 1 --2- 172.21.15.7:0/4233655668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6b40ac8d0 0x7ff6b40cc1b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80011e0 tx=0x7ff6a8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.874+0000 7ff69bfff700 1 -- 172.21.15.7:0/4233655668 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8005a70 con 0x7ff6b40ac8d0 2023-10-06T11:00:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.875+0000 7ff69bfff700 1 -- 172.21.15.7:0/4233655668 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a8005bd0 con 0x7ff6b40ac8d0 2023-10-06T11:00:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.875+0000 7ff69bfff700 1 -- 172.21.15.7:0/4233655668 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80070d0 con 0x7ff6b40ac8d0 2023-10-06T11:00:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.875+0000 7ff6ba736700 1 -- 172.21.15.7:0/4233655668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b416a9b0 con 0x7ff6b40ac8d0 2023-10-06T11:00:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.875+0000 7ff6ba736700 1 -- 172.21.15.7:0/4233655668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b416af70 con 0x7ff6b40ac8d0 2023-10-06T11:00:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.876+0000 7ff6ba736700 1 -- 172.21.15.7:0/4233655668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b4070480 con 0x7ff6b40ac8d0 2023-10-06T11:00:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.876+0000 7ff69bfff700 1 -- 172.21.15.7:0/4233655668 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6a8007480 con 0x7ff6b40ac8d0 2023-10-06T11:00:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.877+0000 7ff69bfff700 1 --2- 172.21.15.7:0/4233655668 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff6a0066f30 0x7ff6a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.877+0000 7ff69bfff700 1 -- 172.21.15.7:0/4233655668 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5612+0+0 (secure 0 0 0) 0x7ff6a8083920 con 0x7ff6b40ac8d0 2023-10-06T11:00:11.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.877+0000 7ff6b3fff700 1 --2- 172.21.15.7:0/4233655668 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff6a0066f30 0x7ff6a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:11.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.877+0000 7ff6b3fff700 1 --2- 172.21.15.7:0/4233655668 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff6a0066f30 0x7ff6a00693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400b240 tx=0x7ff6a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:11.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:11.881+0000 7ff69bfff700 1 -- 172.21.15.7:0/4233655668 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6a8050bf0 con 0x7ff6b40ac8d0 2023-10-06T11:00:12.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:12.100+0000 7ff6ba736700 1 -- 172.21.15.7:0/4233655668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff6b40cdb60 con 0x7ff6b40ac8d0 2023-10-06T11:00:13.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.714+0000 7ff69bfff700 1 -- 172.21.15.7:0/4233655668 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff6a8017020 con 0x7ff6b40ac8d0 2023-10-06T11:00:13.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.717+0000 7ff6ba736700 1 -- 172.21.15.7:0/4233655668 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff6a0066f30 msgr2=0x7ff6a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:13.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.717+0000 7ff6ba736700 1 --2- 172.21.15.7:0/4233655668 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff6a0066f30 0x7ff6a00693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400b240 tx=0x7ff6a4008040 comp rx=0 tx=0).stop 2023-10-06T11:00:13.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.717+0000 7ff6ba736700 1 -- 172.21.15.7:0/4233655668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6b40ac8d0 msgr2=0x7ff6b40cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:13.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.717+0000 7ff6ba736700 1 --2- 172.21.15.7:0/4233655668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6b40ac8d0 0x7ff6b40cc1b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80011e0 tx=0x7ff6a8007e10 comp rx=0 tx=0).stop 2023-10-06T11:00:13.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.717+0000 7ff6ba736700 1 -- 172.21.15.7:0/4233655668 shutdown_connections 2023-10-06T11:00:13.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.717+0000 7ff6ba736700 1 --2- 172.21.15.7:0/4233655668 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff6a0066f30 0x7ff6a00693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:13.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.717+0000 7ff6ba736700 1 --2- 172.21.15.7:0/4233655668 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6b40ccda0 0x7ff6b4159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:13.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.717+0000 7ff6ba736700 1 --2- 172.21.15.7:0/4233655668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b40aaa40 0x7ff6b4169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:13.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.717+0000 7ff6ba736700 1 --2- 172.21.15.7:0/4233655668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6b40ac8d0 0x7ff6b40cc1b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:13.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.717+0000 7ff6ba736700 1 -- 172.21.15.7:0/4233655668 >> 172.21.15.7:0/4233655668 conn(0x7ff6b4096160 msgr2=0x7ff6b4151130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:13.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.717+0000 7ff6ba736700 1 -- 172.21.15.7:0/4233655668 shutdown_connections 2023-10-06T11:00:13.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.717+0000 7ff6ba736700 1 -- 172.21.15.7:0/4233655668 wait complete. 2023-10-06T11:00:13.720 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2023-10-06T11:00:13.736 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:00:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.870+0000 7fbb0de5d700 1 Processor -- start 2023-10-06T11:00:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.870+0000 7fbb0de5d700 1 -- start start 2023-10-06T11:00:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.871+0000 7fbb0de5d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb081595f0 0x7fbb080b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.871+0000 7fbb0de5d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb080cf820 con 0x7fbb08159220 2023-10-06T11:00:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.871+0000 7fbb0de5d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb080cec10 con 0x7fbb080ce7a0 2023-10-06T11:00:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.871+0000 7fbb0de5d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb080ceef0 con 0x7fbb081595f0 2023-10-06T11:00:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.871+0000 7fbb077fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbb08159220 0x7fbb080aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35428/0 (socket says 172.21.15.7:35428) 2023-10-06T11:00:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.871+0000 7fbb077fe700 1 -- 172.21.15.7:0/909552344 learned_addr learned my addr 172.21.15.7:0/909552344 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.871+0000 7fbb07fff700 1 --2- 172.21.15.7:0/909552344 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb081595f0 0x7fbb080b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.871+0000 7fbb067fc700 1 -- 172.21.15.7:0/909552344 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167309585 0 0) 0x7fbb080cf820 con 0x7fbb08159220 2023-10-06T11:00:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.871+0000 7fbb067fc700 1 -- 172.21.15.7:0/909552344 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf0003570 con 0x7fbb08159220 2023-10-06T11:00:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.872+0000 7fbb067fc700 1 -- 172.21.15.7:0/909552344 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788389421 0 0) 0x7fbb080cec10 con 0x7fbb080ce7a0 2023-10-06T11:00:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.872+0000 7fbb067fc700 1 -- 172.21.15.7:0/909552344 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb080cf820 con 0x7fbb080ce7a0 2023-10-06T11:00:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.872+0000 7fbb067fc700 1 -- 172.21.15.7:0/909552344 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1903707734 0 0) 0x7fbaf0003570 con 0x7fbb08159220 2023-10-06T11:00:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.872+0000 7fbb07fff700 1 -- 172.21.15.7:0/909552344 >> v1:172.21.15.50:6789/0 conn(0x7fbb080ce7a0 legacy=0x7fbb080b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.872+0000 7fbb07fff700 1 -- 172.21.15.7:0/909552344 >> v1:172.21.15.7:6789/0 conn(0x7fbb08159220 legacy=0x7fbb080aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.872+0000 7fbb07fff700 1 -- 172.21.15.7:0/909552344 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb080cf1d0 con 0x7fbb081595f0 2023-10-06T11:00:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.872+0000 7fbb07fff700 1 --2- 172.21.15.7:0/909552344 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb081595f0 0x7fbb080b35d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009e90 tx=0x7fbb00009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5373bb405881b49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.872+0000 7fbb067fc700 1 -- 172.21.15.7:0/909552344 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0000e070 con 0x7fbb081595f0 2023-10-06T11:00:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.872+0000 7fbb067fc700 1 -- 172.21.15.7:0/909552344 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0000b870 con 0x7fbb081595f0 2023-10-06T11:00:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.872+0000 7fbb067fc700 1 -- 172.21.15.7:0/909552344 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8001470 con 0x7fbb081595f0 2023-10-06T11:00:13.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.873+0000 7fbb0de5d700 1 -- 172.21.15.7:0/909552344 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb081595f0 msgr2=0x7fbb080b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:13.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.873+0000 7fbb0de5d700 1 --2- 172.21.15.7:0/909552344 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb081595f0 0x7fbb080b35d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009e90 tx=0x7fbb00009780 comp rx=0 tx=0).stop 2023-10-06T11:00:13.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.873+0000 7fbb0de5d700 1 -- 172.21.15.7:0/909552344 shutdown_connections 2023-10-06T11:00:13.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.873+0000 7fbb0de5d700 1 --2- 172.21.15.7:0/909552344 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb081595f0 0x7fbb080b35d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.873+0000 7fbb0de5d700 1 -- 172.21.15.7:0/909552344 >> 172.21.15.7:0/909552344 conn(0x7fbb08069f60 msgr2=0x7fbb080670f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.873+0000 7fbb0de5d700 1 -- 172.21.15.7:0/909552344 shutdown_connections 2023-10-06T11:00:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.873+0000 7fbb0de5d700 1 -- 172.21.15.7:0/909552344 wait complete. 2023-10-06T11:00:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.874+0000 7fbb0de5d700 1 Processor -- start 2023-10-06T11:00:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.874+0000 7fbb0de5d700 1 -- start start 2023-10-06T11:00:13.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.875+0000 7fbb0de5d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb080ce7a0 0x7fbb08154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:13.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.875+0000 7fbb0de5d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb08159220 0x7fbb0815edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:13.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.875+0000 7fbb0de5d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0815f2f0 0x7fbb0815d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:13.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.875+0000 7fbb0de5d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0815f770 con 0x7fbb080ce7a0 2023-10-06T11:00:13.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.875+0000 7fbb0de5d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0815e990 con 0x7fbb0815f2f0 2023-10-06T11:00:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.875+0000 7fbb0de5d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb080c5590 con 0x7fbb08159220 2023-10-06T11:00:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.875+0000 7fbb077fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb080ce7a0 0x7fbb08154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.875+0000 7fbb077fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb080ce7a0 0x7fbb08154090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35196/0 (socket says 172.21.15.7:35196) 2023-10-06T11:00:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.875+0000 7fbb077fe700 1 -- 172.21.15.7:0/854783511 learned_addr learned my addr 172.21.15.7:0/854783511 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.875+0000 7fbb07fff700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0815f2f0 0x7fbb0815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.875+0000 7fbb06ffd700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb08159220 0x7fbb0815edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.876+0000 7fbb077fe700 1 -- 172.21.15.7:0/854783511 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb08159220 msgr2=0x7fbb0815edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.876+0000 7fbb077fe700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb08159220 0x7fbb0815edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.876+0000 7fbb077fe700 1 -- 172.21.15.7:0/854783511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0815f2f0 msgr2=0x7fbb0815d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.876+0000 7fbb077fe700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0815f2f0 0x7fbb0815d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.876+0000 7fbb077fe700 1 -- 172.21.15.7:0/854783511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb00009a20 con 0x7fbb080ce7a0 2023-10-06T11:00:13.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.876+0000 7fbb06ffd700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb08159220 0x7fbb0815edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:13.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.876+0000 7fbb077fe700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb080ce7a0 0x7fbb08154090 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800cbc0 tx=0x7fbaf8001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:13.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.876+0000 7fbaef7fe700 1 -- 172.21.15.7:0/854783511 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8007360 con 0x7fbb080ce7a0 2023-10-06T11:00:13.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.876+0000 7fbaef7fe700 1 -- 172.21.15.7:0/854783511 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf80074e0 con 0x7fbb080ce7a0 2023-10-06T11:00:13.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.876+0000 7fbb0de5d700 1 -- 172.21.15.7:0/854783511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0815e6b0 con 0x7fbb080ce7a0 2023-10-06T11:00:13.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.876+0000 7fbaef7fe700 1 -- 172.21.15.7:0/854783511 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8004830 con 0x7fbb080ce7a0 2023-10-06T11:00:13.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.876+0000 7fbb0de5d700 1 -- 172.21.15.7:0/854783511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb080c5220 con 0x7fbb080ce7a0 2023-10-06T11:00:13.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.877+0000 7fbb0de5d700 1 -- 172.21.15.7:0/854783511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb08070480 con 0x7fbb080ce7a0 2023-10-06T11:00:13.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.878+0000 7fbaef7fe700 1 -- 172.21.15.7:0/854783511 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbaf8004ba0 con 0x7fbb080ce7a0 2023-10-06T11:00:13.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.878+0000 7fbaef7fe700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbaf4066f30 0x7fbaf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:13.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.878+0000 7fbaef7fe700 1 -- 172.21.15.7:0/854783511 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fbaf80838e0 con 0x7fbb080ce7a0 2023-10-06T11:00:13.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.878+0000 7fbb06ffd700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbaf4066f30 0x7fbaf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:13.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.878+0000 7fbb06ffd700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbaf4066f30 0x7fbaf40693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbafc007fd0 tx=0x7fbafc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:13.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:13.882+0000 7fbaef7fe700 1 -- 172.21.15.7:0/854783511 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbaf8054710 con 0x7fbb080ce7a0 2023-10-06T11:00:14.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.166+0000 7fbb0de5d700 1 -- 172.21.15.7:0/854783511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbb080cf4b0 con 0x7fbb080ce7a0 2023-10-06T11:00:14.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.167+0000 7fbaef7fe700 1 -- 172.21.15.7:0/854783511 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fbaf8018020 con 0x7fbb080ce7a0 2023-10-06T11:00:14.168 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:14.169 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:00:14.169 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2023-10-06T11:00:14.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.169 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2023-10-06T11:00:14.169 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBF6B9lf5xzHxAAcz6DUCcDKY6kqw35Uk+wNA==", 2023-10-06T11:00:14.169 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.169 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:14.169 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-06T11:00:14.169 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-06T11:00:14.169 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.170 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2023-10-06T11:00:14.170 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBF6B9lr+TCLRAAS8X7U4CDijgiLkeY3N1k5A==", 2023-10-06T11:00:14.170 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.170 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:14.170 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-06T11:00:14.170 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-06T11:00:14.170 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.170 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.171 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2023-10-06T11:00:14.171 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBF6B9ldTW9JxAAi47qjerSGEuRhjY8dyhP1g==", 2023-10-06T11:00:14.171 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.171 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:14.171 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-06T11:00:14.171 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-06T11:00:14.171 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.171 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.171 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2023-10-06T11:00:14.172 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBF6B9lwoERNhAAi2s7pUC6Zw8QUPImXW/Bkw==", 2023-10-06T11:00:14.172 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.172 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:14.172 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-06T11:00:14.172 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-06T11:00:14.172 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.172 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.172 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2023-10-06T11:00:14.172 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBH6B9lgM4tHBAAK3+2wwnrUqtSS6DfeIljpA==", 2023-10-06T11:00:14.173 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.173 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:14.173 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:14.173 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.173 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.173 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2023-10-06T11:00:14.173 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBK6B9lK3gPGxAAs2vbC573ltq2FmhRYwRleg==", 2023-10-06T11:00:14.173 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.173 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:14.173 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:14.174 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.174 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.174 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2023-10-06T11:00:14.174 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBN6B9lAyLxGRAA7C972ijYflialIb63Kh74Q==", 2023-10-06T11:00:14.174 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.174 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:14.174 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:14.174 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.174 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.175 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2023-10-06T11:00:14.175 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBQ6B9lcKtyGBAAF05nCK/0waipy/gXdPtTig==", 2023-10-06T11:00:14.175 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.175 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:14.175 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:14.175 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.175 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.175 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2023-10-06T11:00:14.176 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBU6B9l8A1DIRAAiLVOvw89tvLJ/V4TAM8QUg==", 2023-10-06T11:00:14.176 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.176 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:14.176 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:14.176 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.176 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.176 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2023-10-06T11:00:14.176 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBX6B9lPjwFIBAANzBcrS6icTB7itpK6dQOJA==", 2023-10-06T11:00:14.176 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.176 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:14.177 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:14.177 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.177 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.177 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2023-10-06T11:00:14.177 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBa6B9lSwCtHhAAc9ckOLHeRYVEHIRVF2K0yw==", 2023-10-06T11:00:14.177 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.177 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:14.177 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:14.177 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.178 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.178 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2023-10-06T11:00:14.178 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBd6B9l3ueTHRAAsF+CSsK+R8ZqoAYsIGb2dQ==", 2023-10-06T11:00:14.178 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.178 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:14.178 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:14.178 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.178 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.179 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2023-10-06T11:00:14.179 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBF6B9lV+s+OxAA7FiireHQ6epyLCxHc9NRQA==", 2023-10-06T11:00:14.179 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.179 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:14.179 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-06T11:00:14.179 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-06T11:00:14.179 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-06T11:00:14.179 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.179 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2023-10-06T11:00:14.180 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBG6B9lJYM8BxAA0QUkFcKZNYlc9lNFaJlbKg==", 2023-10-06T11:00:14.180 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.180 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:14.180 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-06T11:00:14.180 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-06T11:00:14.180 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-06T11:00:14.180 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.180 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2023-10-06T11:00:14.180 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBG6B9ly+ZgAxAA9yXfZP3XEMbnUpSm/WDsgw==", 2023-10-06T11:00:14.181 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.181 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:14.181 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-06T11:00:14.181 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-06T11:00:14.181 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-06T11:00:14.181 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.181 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2023-10-06T11:00:14.181 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBG6B9l/ijxChAAeSzF0/kDS6iEj++8bIK70Q==", 2023-10-06T11:00:14.181 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.181 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:14.182 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-06T11:00:14.182 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-06T11:00:14.182 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-06T11:00:14.182 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.182 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2023-10-06T11:00:14.182 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBE6B9l/D1zLxAAcwgiWE7+MJYefQp+vfT2mA==", 2023-10-06T11:00:14.182 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.182 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-06T11:00:14.182 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-06T11:00:14.183 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-06T11:00:14.183 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.183 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.183 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-mds", 2023-10-06T11:00:14.183 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBj6B9lxDIrKhAAZRv2dvtnEifBTiSfIMqf4Q==", 2023-10-06T11:00:14.183 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.183 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T11:00:14.183 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.184 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T11:00:14.184 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBj6B9lzj8rKhAAZ6XHN+GKvOZK9l0hFDnJgQ==", 2023-10-06T11:00:14.184 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.184 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T11:00:14.184 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.184 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-osd", 2023-10-06T11:00:14.184 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBj6B9lNksrKhAANKFrCxT9XzSu81Tlkhoypg==", 2023-10-06T11:00:14.184 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.184 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T11:00:14.185 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.185 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T11:00:14.185 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBj6B9l+FMrKhAAG6ZQvF3NOp0buzSSE5dASw==", 2023-10-06T11:00:14.185 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.185 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T11:00:14.185 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.185 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T11:00:14.185 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBj6B9lF10rKhAAAvvrHw3J19NMBJjtMu3uYQ==", 2023-10-06T11:00:14.186 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.186 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T11:00:14.186 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.186 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T11:00:14.186 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBj6B9lH2YrKhAAdWUeFb9TGBDvhl6xRWqemQ==", 2023-10-06T11:00:14.186 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.186 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T11:00:14.186 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.187 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2023-10-06T11:00:14.187 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBF6B9lFqRxGxAAHsNDZAUE+we7WAUW6w0tYg==", 2023-10-06T11:00:14.187 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.187 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-06T11:00:14.187 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-06T11:00:14.187 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.187 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:14.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:14.187 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2023-10-06T11:00:14.188 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBF6B9lf8gqERAA3eufSjBI2rAsqsjudLpE7g==", 2023-10-06T11:00:14.188 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:14.188 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-06T11:00:14.188 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-06T11:00:14.188 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:14.188 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.188 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:14.188 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-06T11:00:14.188 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:00:14.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.169+0000 7fbb0de5d700 1 -- 172.21.15.7:0/854783511 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbaf4066f30 msgr2=0x7fbaf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:14.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.169+0000 7fbb0de5d700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbaf4066f30 0x7fbaf40693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbafc007fd0 tx=0x7fbafc009040 comp rx=0 tx=0).stop 2023-10-06T11:00:14.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.169+0000 7fbb0de5d700 1 -- 172.21.15.7:0/854783511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb080ce7a0 msgr2=0x7fbb08154090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:14.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.169+0000 7fbb0de5d700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb080ce7a0 0x7fbb08154090 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800cbc0 tx=0x7fbaf8001b50 comp rx=0 tx=0).stop 2023-10-06T11:00:14.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.169+0000 7fbb0de5d700 1 -- 172.21.15.7:0/854783511 shutdown_connections 2023-10-06T11:00:14.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.169+0000 7fbb0de5d700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbaf4066f30 0x7fbaf40693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.169+0000 7fbb0de5d700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb080ce7a0 0x7fbb08154090 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.169+0000 7fbb0de5d700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0815f2f0 0x7fbb0815d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.169+0000 7fbb0de5d700 1 --2- 172.21.15.7:0/854783511 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb08159220 0x7fbb0815edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.169+0000 7fbb0de5d700 1 -- 172.21.15.7:0/854783511 >> 172.21.15.7:0/854783511 conn(0x7fbb08069f60 msgr2=0x7fbb081583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:14.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.169+0000 7fbb0de5d700 1 -- 172.21.15.7:0/854783511 shutdown_connections 2023-10-06T11:00:14.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.169+0000 7fbb0de5d700 1 -- 172.21.15.7:0/854783511 wait complete. 2023-10-06T11:00:14.191 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T11:00:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.322+0000 7f0fd0d4a700 1 Processor -- start 2023-10-06T11:00:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.322+0000 7f0fd0d4a700 1 -- start start 2023-10-06T11:00:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.323+0000 7f0fd0d4a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0fcc159360 0x7f0fcc0afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.323+0000 7f0fd0d4a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0fcc0ac7f0 0x7f0fcc0a6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.323+0000 7f0fd0d4a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0fcc0a6ec0 0x7f0fcc0670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.323+0000 7f0fd0d4a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fcc0aeba0 con 0x7f0fcc0a6ec0 2023-10-06T11:00:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.323+0000 7f0fd0d4a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fcc0a7310 con 0x7f0fcc159360 2023-10-06T11:00:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.323+0000 7f0fd0d4a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc159730 con 0x7f0fcc0ac7f0 2023-10-06T11:00:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.323+0000 7f0fcad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0fcc0a6ec0 0x7f0fcc0670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.323+0000 7f0fcad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0fcc0a6ec0 0x7f0fcc0670f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35212/0 (socket says 172.21.15.7:35212) 2023-10-06T11:00:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.323+0000 7f0fcad9d700 1 -- 172.21.15.7:0/3672896446 learned_addr learned my addr 172.21.15.7:0/3672896446 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.323+0000 7f0fca59c700 1 --2- 172.21.15.7:0/3672896446 >> v2:172.21.15.50:3300/0 conn(0x7f0fcc159360 0x7f0fcc0afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:14.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.323+0000 7f0fc9d9b700 1 --2- 172.21.15.7:0/3672896446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0fcc0ac7f0 0x7f0fcc0a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:14.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.324+0000 7f0fcad9d700 1 -- 172.21.15.7:0/3672896446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0fcc0ac7f0 msgr2=0x7f0fcc0a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:14.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.324+0000 7f0fcad9d700 1 --2- 172.21.15.7:0/3672896446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0fcc0ac7f0 0x7f0fcc0a6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.324+0000 7f0fcad9d700 1 -- 172.21.15.7:0/3672896446 >> v2:172.21.15.50:3300/0 conn(0x7f0fcc159360 msgr2=0x7f0fcc0afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:14.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.324+0000 7f0fcad9d700 1 --2- 172.21.15.7:0/3672896446 >> v2:172.21.15.50:3300/0 conn(0x7f0fcc159360 0x7f0fcc0afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.324+0000 7f0fcad9d700 1 -- 172.21.15.7:0/3672896446 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc0ae270 con 0x7f0fcc0a6ec0 2023-10-06T11:00:14.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.324+0000 7f0fcad9d700 1 --2- 172.21.15.7:0/3672896446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fcc0a6ec0 0x7f0fcc0670f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc06e040 tx=0x7f0fc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddddf7a6b8118db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:14.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.324+0000 7f0fc959a700 1 -- 172.21.15.7:0/3672896446 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc400e070 con 0x7f0fcc0a6ec0 2023-10-06T11:00:14.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.324+0000 7f0fc959a700 1 -- 172.21.15.7:0/3672896446 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc400ba50 con 0x7f0fcc0a6ec0 2023-10-06T11:00:14.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.324+0000 7f0fc959a700 1 -- 172.21.15.7:0/3672896446 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40092e0 con 0x7f0fcc0a6ec0 2023-10-06T11:00:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.324+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/3672896446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fcc0a6ec0 msgr2=0x7f0fcc0670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.324+0000 7f0fd0d4a700 1 --2- 172.21.15.7:0/3672896446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fcc0a6ec0 0x7f0fcc0670f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc06e040 tx=0x7f0fc4009840 comp rx=0 tx=0).stop 2023-10-06T11:00:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.325+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/3672896446 shutdown_connections 2023-10-06T11:00:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.325+0000 7f0fd0d4a700 1 --2- 172.21.15.7:0/3672896446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fcc0a6ec0 0x7f0fcc0670f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.325+0000 7f0fd0d4a700 1 --2- 172.21.15.7:0/3672896446 >> v2:172.21.15.50:3300/0 conn(0x7f0fcc159360 0x7f0fcc0afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.325+0000 7f0fd0d4a700 1 --2- 172.21.15.7:0/3672896446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0fcc0ac7f0 0x7f0fcc0a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.325+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/3672896446 >> 172.21.15.7:0/3672896446 conn(0x7f0fcc095a70 msgr2=0x7f0fcc0af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.325+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/3672896446 shutdown_connections 2023-10-06T11:00:14.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.325+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/3672896446 wait complete. 2023-10-06T11:00:14.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.326+0000 7f0fd0d4a700 1 Processor -- start 2023-10-06T11:00:14.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.326+0000 7f0fd0d4a700 1 -- start start 2023-10-06T11:00:14.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fd0d4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fcc0a6ec0 0x7f0fcc16c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:14.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fd0d4a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fcc0ac7f0 0x7f0fcc1447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:14.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fd0d4a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0fcc159360 0x7f0fcc15df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:14.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fd0d4a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc16bd40 con 0x7f0fcc0ac7f0 2023-10-06T11:00:14.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fd0d4a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc16b130 con 0x7f0fcc0a6ec0 2023-10-06T11:00:14.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fd0d4a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc16b410 con 0x7f0fcc159360 2023-10-06T11:00:14.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fc9d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fcc0ac7f0 0x7f0fcc1447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:14.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fc9d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fcc0ac7f0 0x7f0fcc1447d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35226/0 (socket says 172.21.15.7:35226) 2023-10-06T11:00:14.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fc9d9b700 1 -- 172.21.15.7:0/2533139946 learned_addr learned my addr 172.21.15.7:0/2533139946 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:14.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fca59c700 1 --2- 172.21.15.7:0/2533139946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fcc0a6ec0 0x7f0fcc16c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:14.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fcad9d700 1 --2- 172.21.15.7:0/2533139946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0fcc159360 0x7f0fcc15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:14.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fc9d9b700 1 -- 172.21.15.7:0/2533139946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0fcc159360 msgr2=0x7f0fcc15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:14.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fc9d9b700 1 --2- 172.21.15.7:0/2533139946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0fcc159360 0x7f0fcc15df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fc9d9b700 1 -- 172.21.15.7:0/2533139946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fcc0a6ec0 msgr2=0x7f0fcc16c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:14.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fc9d9b700 1 --2- 172.21.15.7:0/2533139946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fcc0a6ec0 0x7f0fcc16c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fc9d9b700 1 -- 172.21.15.7:0/2533139946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc4009ae0 con 0x7f0fcc0ac7f0 2023-10-06T11:00:14.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fc9d9b700 1 --2- 172.21.15.7:0/2533139946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fcc0ac7f0 0x7f0fcc1447d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00d860 tx=0x7f0fbc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:14.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.327+0000 7f0fc27fc700 1 -- 172.21.15.7:0/2533139946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc0125f0 con 0x7f0fcc0ac7f0 2023-10-06T11:00:14.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.328+0000 7f0fc27fc700 1 -- 172.21.15.7:0/2533139946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc012750 con 0x7f0fcc0ac7f0 2023-10-06T11:00:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.328+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/2533139946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fcc16b6f0 con 0x7f0fcc0ac7f0 2023-10-06T11:00:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.328+0000 7f0fc27fc700 1 -- 172.21.15.7:0/2533139946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc012af0 con 0x7f0fcc0ac7f0 2023-10-06T11:00:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.328+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/2533139946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fcc144d10 con 0x7f0fcc0ac7f0 2023-10-06T11:00:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.329+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/2533139946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fcc16bef0 con 0x7f0fcc0ac7f0 2023-10-06T11:00:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.329+0000 7f0fc27fc700 1 -- 172.21.15.7:0/2533139946 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fbc013480 con 0x7f0fcc0ac7f0 2023-10-06T11:00:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.330+0000 7f0fc27fc700 1 --2- 172.21.15.7:0/2533139946 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0fac066f30 0x7f0fac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.330+0000 7f0fca59c700 1 --2- 172.21.15.7:0/2533139946 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0fac066f30 0x7f0fac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.330+0000 7f0fc27fc700 1 -- 172.21.15.7:0/2533139946 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f0fbc0847e0 con 0x7f0fcc0ac7f0 2023-10-06T11:00:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.330+0000 7f0fca59c700 1 --2- 172.21.15.7:0/2533139946 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0fac066f30 0x7f0fac0693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4006fd0 tx=0x7f0fb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.334+0000 7f0fc27fc700 1 -- 172.21.15.7:0/2533139946 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fcc16bef0 con 0x7f0fcc0ac7f0 2023-10-06T11:00:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.622+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/2533139946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f0fcc070480 con 0x7f0fcc0ac7f0 2023-10-06T11:00:14.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.626+0000 7f0fc27fc700 1 -- 172.21.15.7:0/2533139946 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0fbc055590 con 0x7f0fcc0ac7f0 2023-10-06T11:00:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.628+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/2533139946 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0fac066f30 msgr2=0x7f0fac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.628+0000 7f0fd0d4a700 1 --2- 172.21.15.7:0/2533139946 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0fac066f30 0x7f0fac0693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4006fd0 tx=0x7f0fb4008040 comp rx=0 tx=0).stop 2023-10-06T11:00:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.628+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/2533139946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fcc0ac7f0 msgr2=0x7f0fcc1447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.628+0000 7f0fd0d4a700 1 --2- 172.21.15.7:0/2533139946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fcc0ac7f0 0x7f0fcc1447d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00d860 tx=0x7f0fbc008040 comp rx=0 tx=0).stop 2023-10-06T11:00:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.628+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/2533139946 shutdown_connections 2023-10-06T11:00:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.628+0000 7f0fd0d4a700 1 --2- 172.21.15.7:0/2533139946 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0fac066f30 0x7f0fac0693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.628+0000 7f0fd0d4a700 1 --2- 172.21.15.7:0/2533139946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0fcc159360 0x7f0fcc15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.628+0000 7f0fd0d4a700 1 --2- 172.21.15.7:0/2533139946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fcc0a6ec0 0x7f0fcc16c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.628+0000 7f0fd0d4a700 1 --2- 172.21.15.7:0/2533139946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fcc0ac7f0 0x7f0fcc1447d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.628+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/2533139946 >> 172.21.15.7:0/2533139946 conn(0x7f0fcc095a70 msgr2=0x7f0fcc15a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.628+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/2533139946 shutdown_connections 2023-10-06T11:00:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.628+0000 7f0fd0d4a700 1 -- 172.21.15.7:0/2533139946 wait complete. 2023-10-06T11:00:14.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T11:00:14.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.774+0000 7f0849693700 1 Processor -- start 2023-10-06T11:00:14.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.774+0000 7f0849693700 1 -- start start 2023-10-06T11:00:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.775+0000 7f0849693700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08440cfb50 0x7f0844068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.775+0000 7f0849693700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0844069420 0x7f08440afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.775+0000 7f0849693700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08440cf6c0 con 0x7f08440af320 2023-10-06T11:00:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.775+0000 7f0849693700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0844159c00 con 0x7f0844069420 2023-10-06T11:00:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.775+0000 7f0849693700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08440698a0 con 0x7f08440cfb50 2023-10-06T11:00:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.775+0000 7f08437fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0844069420 0x7f08440afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.775+0000 7f08437fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0844069420 0x7f08440afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35240/0 (socket says 172.21.15.7:35240) 2023-10-06T11:00:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.775+0000 7f08437fe700 1 -- 172.21.15.7:0/1752715522 learned_addr learned my addr 172.21.15.7:0/1752715522 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.775+0000 7f08427fc700 1 --2- 172.21.15.7:0/1752715522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08440cfb50 0x7f0844068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.776+0000 7f08437fe700 1 -- 172.21.15.7:0/1752715522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08440cfb50 msgr2=0x7f0844068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.776+0000 7f08437fe700 1 --2- 172.21.15.7:0/1752715522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08440cfb50 0x7f0844068ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.776+0000 7f08437fe700 1 -- 172.21.15.7:0/1752715522 >> v1:172.21.15.50:6789/0 conn(0x7f08440af320 legacy=0x7f08440cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.776+0000 7f08437fe700 1 -- 172.21.15.7:0/1752715522 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08440cb750 con 0x7f0844069420 2023-10-06T11:00:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.776+0000 7f08437fe700 1 --2- 172.21.15.7:0/1752715522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0844069420 0x7f08440afc90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f083c009f50 tx=0x7f083c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0d99ec47b5f50c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.776+0000 7f0841ffb700 1 -- 172.21.15.7:0/1752715522 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c00e070 con 0x7f0844069420 2023-10-06T11:00:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.776+0000 7f0841ffb700 1 -- 172.21.15.7:0/1752715522 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c00ba50 con 0x7f0844069420 2023-10-06T11:00:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.776+0000 7f0841ffb700 1 -- 172.21.15.7:0/1752715522 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c0092e0 con 0x7f0844069420 2023-10-06T11:00:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.777+0000 7f0849693700 1 -- 172.21.15.7:0/1752715522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0844069420 msgr2=0x7f08440afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.777+0000 7f0849693700 1 --2- 172.21.15.7:0/1752715522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0844069420 0x7f08440afc90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f083c009f50 tx=0x7f083c009840 comp rx=0 tx=0).stop 2023-10-06T11:00:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.777+0000 7f0849693700 1 -- 172.21.15.7:0/1752715522 shutdown_connections 2023-10-06T11:00:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.777+0000 7f0849693700 1 --2- 172.21.15.7:0/1752715522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0844069420 0x7f08440afc90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.777+0000 7f0849693700 1 --2- 172.21.15.7:0/1752715522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08440cfb50 0x7f0844068ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.777+0000 7f0849693700 1 -- 172.21.15.7:0/1752715522 >> 172.21.15.7:0/1752715522 conn(0x7f0844067b80 msgr2=0x7f08440d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.777+0000 7f0849693700 1 -- 172.21.15.7:0/1752715522 shutdown_connections 2023-10-06T11:00:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.777+0000 7f0849693700 1 -- 172.21.15.7:0/1752715522 wait complete. 2023-10-06T11:00:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.779+0000 7f0849693700 1 Processor -- start 2023-10-06T11:00:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.779+0000 7f0849693700 1 -- start start 2023-10-06T11:00:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0849693700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0844069420 0x7f0844154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0849693700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08440af320 0x7f0844169960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0849693700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08440cfb50 0x7f084415c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0849693700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084415bdb0 con 0x7f0844069420 2023-10-06T11:00:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0849693700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08440b3c80 con 0x7f08440af320 2023-10-06T11:00:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0849693700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0844155660 con 0x7f08440cfb50 2023-10-06T11:00:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0842ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0844069420 0x7f0844154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0842ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0844069420 0x7f0844154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35250/0 (socket says 172.21.15.7:35250) 2023-10-06T11:00:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0842ffd700 1 -- 172.21.15.7:0/345729043 learned_addr learned my addr 172.21.15.7:0/345729043 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f08427fc700 1 --2- 172.21.15.7:0/345729043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08440af320 0x7f0844169960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f08437fe700 1 --2- 172.21.15.7:0/345729043 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08440cfb50 0x7f084415c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0842ffd700 1 -- 172.21.15.7:0/345729043 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08440cfb50 msgr2=0x7f084415c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0842ffd700 1 --2- 172.21.15.7:0/345729043 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08440cfb50 0x7f084415c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0842ffd700 1 -- 172.21.15.7:0/345729043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08440af320 msgr2=0x7f0844169960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0842ffd700 1 --2- 172.21.15.7:0/345729043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08440af320 0x7f0844169960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0842ffd700 1 -- 172.21.15.7:0/345729043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c009ae0 con 0x7f0844069420 2023-10-06T11:00:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f0842ffd700 1 --2- 172.21.15.7:0/345729043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0844069420 0x7f0844154bb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f082c00c790 tx=0x7f082c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.780+0000 7f083affd700 1 -- 172.21.15.7:0/345729043 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c011590 con 0x7f0844069420 2023-10-06T11:00:14.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.781+0000 7f083affd700 1 -- 172.21.15.7:0/345729043 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082c011710 con 0x7f0844069420 2023-10-06T11:00:14.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.781+0000 7f083affd700 1 -- 172.21.15.7:0/345729043 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c011ad0 con 0x7f0844069420 2023-10-06T11:00:14.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.781+0000 7f0849693700 1 -- 172.21.15.7:0/345729043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08441550f0 con 0x7f0844069420 2023-10-06T11:00:14.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.781+0000 7f0849693700 1 -- 172.21.15.7:0/345729043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084415b760 con 0x7f0844069420 2023-10-06T11:00:14.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.782+0000 7f0849693700 1 -- 172.21.15.7:0/345729043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084415c090 con 0x7f0844069420 2023-10-06T11:00:14.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.782+0000 7f083affd700 1 -- 172.21.15.7:0/345729043 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f082c01b3b0 con 0x7f0844069420 2023-10-06T11:00:14.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.782+0000 7f083affd700 1 --2- 172.21.15.7:0/345729043 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0824066f30 0x7f08240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:14.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.783+0000 7f083affd700 1 -- 172.21.15.7:0/345729043 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f082c083840 con 0x7f0844069420 2023-10-06T11:00:14.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.783+0000 7f08427fc700 1 --2- 172.21.15.7:0/345729043 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0824066f30 0x7f08240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:14.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.783+0000 7f08427fc700 1 --2- 172.21.15.7:0/345729043 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0824066f30 0x7f08240693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f084416ce40 tx=0x7f08340091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:14.787+0000 7f083affd700 1 -- 172.21.15.7:0/345729043 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f082c050b60 con 0x7f0844069420 2023-10-06T11:00:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.075+0000 7f0849693700 1 -- 172.21.15.7:0/345729043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f0844070480 con 0x7f0844069420 2023-10-06T11:00:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.079+0000 7f083affd700 1 -- 172.21.15.7:0/345729043 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f082c017070 con 0x7f0844069420 2023-10-06T11:00:15.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.082+0000 7f0849693700 1 -- 172.21.15.7:0/345729043 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0824066f30 msgr2=0x7f08240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:15.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.082+0000 7f0849693700 1 --2- 172.21.15.7:0/345729043 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0824066f30 0x7f08240693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f084416ce40 tx=0x7f08340091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.082+0000 7f0849693700 1 -- 172.21.15.7:0/345729043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0844069420 msgr2=0x7f0844154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:15.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.082+0000 7f0849693700 1 --2- 172.21.15.7:0/345729043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0844069420 0x7f0844154bb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f082c00c790 tx=0x7f082c007f40 comp rx=0 tx=0).stop 2023-10-06T11:00:15.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.082+0000 7f0849693700 1 -- 172.21.15.7:0/345729043 shutdown_connections 2023-10-06T11:00:15.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.082+0000 7f0849693700 1 --2- 172.21.15.7:0/345729043 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0824066f30 0x7f08240693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.082+0000 7f0849693700 1 --2- 172.21.15.7:0/345729043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0844069420 0x7f0844154bb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.082+0000 7f0849693700 1 --2- 172.21.15.7:0/345729043 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08440cfb50 0x7f084415c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.082+0000 7f0849693700 1 --2- 172.21.15.7:0/345729043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08440af320 0x7f0844169960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.082+0000 7f0849693700 1 -- 172.21.15.7:0/345729043 >> 172.21.15.7:0/345729043 conn(0x7f0844067b80 msgr2=0x7f0844156d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:15.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.082+0000 7f0849693700 1 -- 172.21.15.7:0/345729043 shutdown_connections 2023-10-06T11:00:15.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.082+0000 7f0849693700 1 -- 172.21.15.7:0/345729043 wait complete. 2023-10-06T11:00:15.097 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T11:00:15.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.228+0000 7f43d5958700 1 Processor -- start 2023-10-06T11:00:15.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.228+0000 7f43d5958700 1 -- start start 2023-10-06T11:00:15.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.229+0000 7f43d5958700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43d015c8e0 0x7f43d006d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.229+0000 7f43d5958700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43d006dd90 0x7f43d00cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.229+0000 7f43d5958700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d006e7f0 con 0x7f43d015c510 2023-10-06T11:00:15.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.229+0000 7f43d5958700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d00c8df0 con 0x7f43d015c8e0 2023-10-06T11:00:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.229+0000 7f43d5958700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d0069810 con 0x7f43d006dd90 2023-10-06T11:00:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.229+0000 7f43ceffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f43d015c510 0x7f43d0069100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35442/0 (socket says 172.21.15.7:35442) 2023-10-06T11:00:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.229+0000 7f43ceffd700 1 -- 172.21.15.7:0/463020465 learned_addr learned my addr 172.21.15.7:0/463020465 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.229+0000 7f43ce7fc700 1 --2- 172.21.15.7:0/463020465 >> v2:172.21.15.50:3300/0 conn(0x7f43d015c8e0 0x7f43d006d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.229+0000 7f43cf7fe700 1 --2- 172.21.15.7:0/463020465 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43d006dd90 0x7f43d00cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.229+0000 7f43cdffb700 1 -- 172.21.15.7:0/463020465 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034084852 0 0) 0x7f43d006e7f0 con 0x7f43d015c510 2023-10-06T11:00:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 -- 172.21.15.7:0/463020465 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b8003570 con 0x7f43d015c510 2023-10-06T11:00:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 -- 172.21.15.7:0/463020465 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 647576583 0 0) 0x7f43b8003570 con 0x7f43d015c510 2023-10-06T11:00:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 -- 172.21.15.7:0/463020465 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43d006dd90 msgr2=0x7f43d00cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 --2- 172.21.15.7:0/463020465 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43d006dd90 0x7f43d00cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 -- 172.21.15.7:0/463020465 >> v2:172.21.15.50:3300/0 conn(0x7f43d015c8e0 msgr2=0x7f43d006d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 --2- 172.21.15.7:0/463020465 >> v2:172.21.15.50:3300/0 conn(0x7f43d015c8e0 0x7f43d006d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 -- 172.21.15.7:0/463020465 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d006e230 con 0x7f43d015c510 2023-10-06T11:00:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 -- 172.21.15.7:0/463020465 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f43c0001470 con 0x7f43d015c510 2023-10-06T11:00:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 -- 172.21.15.7:0/463020465 >> v1:172.21.15.7:6789/0 conn(0x7f43d015c510 legacy=0x7f43d0069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 --2- 172.21.15.7:0/463020465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b8003a60 0x7f43b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 --2- 172.21.15.7:0/463020465 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43d006dd90 0x7f43b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 --2- 172.21.15.7:0/463020465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b8004d50 0x7f43b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 -- 172.21.15.7:0/463020465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00c8df0 con 0x7f43b8003a60 2023-10-06T11:00:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 -- 172.21.15.7:0/463020465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d0069810 con 0x7f43b8004d50 2023-10-06T11:00:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cdffb700 1 -- 172.21.15.7:0/463020465 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b800ba60 con 0x7f43d006dd90 2023-10-06T11:00:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43ceffd700 1 --2- 172.21.15.7:0/463020465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b8003a60 0x7f43b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43cf7fe700 1 --2- 172.21.15.7:0/463020465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b8004d50 0x7f43b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43ce7fc700 1 --2- 172.21.15.7:0/463020465 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43d006dd90 0x7f43b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43ceffd700 1 -- 172.21.15.7:0/463020465 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43d006dd90 msgr2=0x7f43b8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43ceffd700 1 --2- 172.21.15.7:0/463020465 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43d006dd90 0x7f43b8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43ceffd700 1 -- 172.21.15.7:0/463020465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b8004d50 msgr2=0x7f43b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43ceffd700 1 --2- 172.21.15.7:0/463020465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b8004d50 0x7f43b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.230+0000 7f43ceffd700 1 -- 172.21.15.7:0/463020465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b8003570 con 0x7f43b8003a60 2023-10-06T11:00:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.231+0000 7f43ceffd700 1 --2- 172.21.15.7:0/463020465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b8003a60 0x7f43b8003e70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f43c000c3c0 tx=0x7f43d00c8f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d31063106933e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.231+0000 7f43cdffb700 1 -- 172.21.15.7:0/463020465 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c000cc30 con 0x7f43b8003a60 2023-10-06T11:00:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.231+0000 7f43cdffb700 1 -- 172.21.15.7:0/463020465 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c000cdd0 con 0x7f43b8003a60 2023-10-06T11:00:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.231+0000 7f43cdffb700 1 -- 172.21.15.7:0/463020465 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0005b70 con 0x7f43b8003a60 2023-10-06T11:00:15.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.231+0000 7f43d5958700 1 -- 172.21.15.7:0/463020465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b8003a60 msgr2=0x7f43b8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:15.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.231+0000 7f43d5958700 1 --2- 172.21.15.7:0/463020465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b8003a60 0x7f43b8003e70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f43c000c3c0 tx=0x7f43d00c8f30 comp rx=0 tx=0).stop 2023-10-06T11:00:15.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.231+0000 7f43cf7fe700 1 -- 172.21.15.7:0/463020465 reap_dead start 2023-10-06T11:00:15.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.231+0000 7f43d5958700 1 -- 172.21.15.7:0/463020465 shutdown_connections 2023-10-06T11:00:15.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.231+0000 7f43d5958700 1 -- 172.21.15.7:0/463020465 >> 172.21.15.7:0/463020465 conn(0x7f43d006c2c0 msgr2=0x7f43d006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:15.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.231+0000 7f43d5958700 1 -- 172.21.15.7:0/463020465 shutdown_connections 2023-10-06T11:00:15.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.231+0000 7f43d5958700 1 -- 172.21.15.7:0/463020465 wait complete. 2023-10-06T11:00:15.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.233+0000 7f43d5958700 1 Processor -- start 2023-10-06T11:00:15.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.233+0000 7f43d5958700 1 -- start start 2023-10-06T11:00:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43d5958700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b8003a60 0x7f43d0154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43d5958700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43d00b2770 0x7f43d016a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43d5958700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43d00ca860 0x7f43d00cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43d5958700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00cb210 con 0x7f43d00ca860 2023-10-06T11:00:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43d5958700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d0155000 con 0x7f43b8003a60 2023-10-06T11:00:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43d5958700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00b2d30 con 0x7f43d00b2770 2023-10-06T11:00:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43cf7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43d00ca860 0x7f43d00cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43cf7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43d00ca860 0x7f43d00cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35270/0 (socket says 172.21.15.7:35270) 2023-10-06T11:00:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43cf7fe700 1 -- 172.21.15.7:0/274896079 learned_addr learned my addr 172.21.15.7:0/274896079 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43ceffd700 1 --2- 172.21.15.7:0/274896079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b8003a60 0x7f43d0154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43ce7fc700 1 --2- 172.21.15.7:0/274896079 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43d00b2770 0x7f43d016a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43cf7fe700 1 -- 172.21.15.7:0/274896079 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43d00b2770 msgr2=0x7f43d016a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:15.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43cf7fe700 1 --2- 172.21.15.7:0/274896079 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43d00b2770 0x7f43d016a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43cf7fe700 1 -- 172.21.15.7:0/274896079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b8003a60 msgr2=0x7f43d0154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:15.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43cf7fe700 1 --2- 172.21.15.7:0/274896079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b8003a60 0x7f43d0154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43cf7fe700 1 -- 172.21.15.7:0/274896079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d00b3010 con 0x7f43d00ca860 2023-10-06T11:00:15.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43cf7fe700 1 --2- 172.21.15.7:0/274896079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43d00ca860 0x7f43d00cacd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f43c80094d0 tx=0x7f43c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:15.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43b6ffd700 1 -- 172.21.15.7:0/274896079 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c800e040 con 0x7f43d00ca860 2023-10-06T11:00:15.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43b6ffd700 1 -- 172.21.15.7:0/274896079 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c800f040 con 0x7f43d00ca860 2023-10-06T11:00:15.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43d5958700 1 -- 172.21.15.7:0/274896079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d00b32f0 con 0x7f43d00ca860 2023-10-06T11:00:15.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.234+0000 7f43b6ffd700 1 -- 172.21.15.7:0/274896079 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c800fd70 con 0x7f43d00ca860 2023-10-06T11:00:15.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.235+0000 7f43d5958700 1 -- 172.21.15.7:0/274896079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d00b38b0 con 0x7f43d00ca860 2023-10-06T11:00:15.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.235+0000 7f43d5958700 1 -- 172.21.15.7:0/274896079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d00b3ad0 con 0x7f43d00ca860 2023-10-06T11:00:15.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.236+0000 7f43b6ffd700 1 -- 172.21.15.7:0/274896079 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43c8015640 con 0x7f43d00ca860 2023-10-06T11:00:15.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.237+0000 7f43b6ffd700 1 --2- 172.21.15.7:0/274896079 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f43bc066f30 0x7f43bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.237+0000 7f43b6ffd700 1 -- 172.21.15.7:0/274896079 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f43c8085770 con 0x7f43d00ca860 2023-10-06T11:00:15.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.237+0000 7f43ceffd700 1 --2- 172.21.15.7:0/274896079 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f43bc066f30 0x7f43bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.238+0000 7f43ceffd700 1 --2- 172.21.15.7:0/274896079 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f43bc066f30 0x7f43bc0693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f43c000c3c0 tx=0x7f43c0015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:15.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.241+0000 7f43b6ffd700 1 -- 172.21.15.7:0/274896079 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43c8052a70 con 0x7f43d00ca860 2023-10-06T11:00:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.529+0000 7f43d5958700 1 -- 172.21.15.7:0/274896079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f43d0070480 con 0x7f43d00ca860 2023-10-06T11:00:15.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.532+0000 7f43b6ffd700 1 -- 172.21.15.7:0/274896079 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f43c8056090 con 0x7f43d00ca860 2023-10-06T11:00:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.535+0000 7f43d5958700 1 -- 172.21.15.7:0/274896079 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f43bc066f30 msgr2=0x7f43bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.535+0000 7f43d5958700 1 --2- 172.21.15.7:0/274896079 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f43bc066f30 0x7f43bc0693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f43c000c3c0 tx=0x7f43c0015000 comp rx=0 tx=0).stop 2023-10-06T11:00:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.535+0000 7f43d5958700 1 -- 172.21.15.7:0/274896079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43d00ca860 msgr2=0x7f43d00cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.535+0000 7f43d5958700 1 --2- 172.21.15.7:0/274896079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43d00ca860 0x7f43d00cacd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f43c80094d0 tx=0x7f43c800b040 comp rx=0 tx=0).stop 2023-10-06T11:00:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.535+0000 7f43d5958700 1 -- 172.21.15.7:0/274896079 shutdown_connections 2023-10-06T11:00:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.535+0000 7f43d5958700 1 --2- 172.21.15.7:0/274896079 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f43bc066f30 0x7f43bc0693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.535+0000 7f43d5958700 1 --2- 172.21.15.7:0/274896079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43d00ca860 0x7f43d00cacd0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.535+0000 7f43d5958700 1 --2- 172.21.15.7:0/274896079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b8003a60 0x7f43d0154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.535+0000 7f43d5958700 1 --2- 172.21.15.7:0/274896079 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43d00b2770 0x7f43d016a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.535+0000 7f43d5958700 1 -- 172.21.15.7:0/274896079 >> 172.21.15.7:0/274896079 conn(0x7f43d006c2c0 msgr2=0x7f43d0156e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.535+0000 7f43d5958700 1 -- 172.21.15.7:0/274896079 shutdown_connections 2023-10-06T11:00:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.535+0000 7f43d5958700 1 -- 172.21.15.7:0/274896079 wait complete. 2023-10-06T11:00:15.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T11:00:15.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.681+0000 7fa58b60b700 1 Processor -- start 2023-10-06T11:00:15.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.681+0000 7fa58b60b700 1 -- start start 2023-10-06T11:00:15.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.682+0000 7fa58b60b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa5840aaa40 0x7fa5840cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.682+0000 7fa58b60b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5840ac8d0 0x7fa584155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.682+0000 7fa58b60b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa584069110 con 0x7fa5840ccda0 2023-10-06T11:00:15.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.682+0000 7fa58b60b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa584068b30 con 0x7fa5840aaa40 2023-10-06T11:00:15.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.682+0000 7fa58b60b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5840aafb0 con 0x7fa5840ac8d0 2023-10-06T11:00:15.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.683+0000 7fa588ba6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa5840aaa40 0x7fa5840cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.683+0000 7fa588ba6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa5840aaa40 0x7fa5840cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35274/0 (socket says 172.21.15.7:35274) 2023-10-06T11:00:15.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.683+0000 7fa588ba6700 1 -- 172.21.15.7:0/1140485085 learned_addr learned my addr 172.21.15.7:0/1140485085 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:15.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.683+0000 7fa589ba8700 1 --2- 172.21.15.7:0/1140485085 >> v2:172.21.15.50:3300/0 conn(0x7fa5840ac8d0 0x7fa584155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.683+0000 7fa588ba6700 1 -- 172.21.15.7:0/1140485085 >> v2:172.21.15.50:3300/0 conn(0x7fa5840ac8d0 msgr2=0x7fa584155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:15.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.683+0000 7fa588ba6700 1 --2- 172.21.15.7:0/1140485085 >> v2:172.21.15.50:3300/0 conn(0x7fa5840ac8d0 0x7fa584155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.683+0000 7fa588ba6700 1 -- 172.21.15.7:0/1140485085 >> v1:172.21.15.50:6789/0 conn(0x7fa5840ccda0 legacy=0x7fa5840aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:15.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.683+0000 7fa588ba6700 1 -- 172.21.15.7:0/1140485085 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa584068da0 con 0x7fa5840aaa40 2023-10-06T11:00:15.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.683+0000 7fa588ba6700 1 --2- 172.21.15.7:0/1140485085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5840aaa40 0x7fa5840cd170 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa57400bc50 tx=0x7fa57400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb03a8836e4d50e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:15.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.683+0000 7fa57bfff700 1 -- 172.21.15.7:0/1140485085 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57400dbb0 con 0x7fa5840aaa40 2023-10-06T11:00:15.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.683+0000 7fa57bfff700 1 -- 172.21.15.7:0/1140485085 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57400dd10 con 0x7fa5840aaa40 2023-10-06T11:00:15.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.683+0000 7fa57bfff700 1 -- 172.21.15.7:0/1140485085 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5740196b0 con 0x7fa5840aaa40 2023-10-06T11:00:15.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.684+0000 7fa58b60b700 1 -- 172.21.15.7:0/1140485085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5840aaa40 msgr2=0x7fa5840cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:15.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.684+0000 7fa58b60b700 1 --2- 172.21.15.7:0/1140485085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5840aaa40 0x7fa5840cd170 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa57400bc50 tx=0x7fa57400b4f0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.684+0000 7fa58b60b700 1 -- 172.21.15.7:0/1140485085 shutdown_connections 2023-10-06T11:00:15.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.684+0000 7fa58b60b700 1 --2- 172.21.15.7:0/1140485085 >> v2:172.21.15.50:3300/0 conn(0x7fa5840ac8d0 0x7fa584155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.684+0000 7fa58b60b700 1 --2- 172.21.15.7:0/1140485085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5840aaa40 0x7fa5840cd170 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.684+0000 7fa58b60b700 1 -- 172.21.15.7:0/1140485085 >> 172.21.15.7:0/1140485085 conn(0x7fa584096160 msgr2=0x7fa5840afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:15.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.684+0000 7fa58b60b700 1 -- 172.21.15.7:0/1140485085 shutdown_connections 2023-10-06T11:00:15.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.684+0000 7fa58b60b700 1 -- 172.21.15.7:0/1140485085 wait complete. 2023-10-06T11:00:15.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.685+0000 7fa58b60b700 1 Processor -- start 2023-10-06T11:00:15.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.685+0000 7fa58b60b700 1 -- start start 2023-10-06T11:00:15.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.686+0000 7fa58b60b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa5840aaa40 0x7fa584155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.686+0000 7fa58b60b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5840ac8d0 0x7fa584169260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.686+0000 7fa58b60b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5840ccda0 0x7fa584153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.686+0000 7fa58b60b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5841697a0 con 0x7fa5840ac8d0 2023-10-06T11:00:15.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.686+0000 7fa58b60b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa584155fe0 con 0x7fa5840ccda0 2023-10-06T11:00:15.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.686+0000 7fa58b60b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa584156360 con 0x7fa5840aaa40 2023-10-06T11:00:15.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.686+0000 7fa588ba6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5840ac8d0 0x7fa584169260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.686+0000 7fa588ba6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5840ac8d0 0x7fa584169260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35290/0 (socket says 172.21.15.7:35290) 2023-10-06T11:00:15.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.686+0000 7fa588ba6700 1 -- 172.21.15.7:0/713025229 learned_addr learned my addr 172.21.15.7:0/713025229 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:15.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa589ba8700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5840ccda0 0x7fa584153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa5893a7700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa5840aaa40 0x7fa584155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa588ba6700 1 -- 172.21.15.7:0/713025229 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa5840aaa40 msgr2=0x7fa584155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:15.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa588ba6700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa5840aaa40 0x7fa584155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa588ba6700 1 -- 172.21.15.7:0/713025229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5840ccda0 msgr2=0x7fa584153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:15.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa588ba6700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5840ccda0 0x7fa584153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa588ba6700 1 -- 172.21.15.7:0/713025229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57400b790 con 0x7fa5840ac8d0 2023-10-06T11:00:15.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa5893a7700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa5840aaa40 0x7fa584155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:15.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa589ba8700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5840ccda0 0x7fa584153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:15.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa588ba6700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5840ac8d0 0x7fa584169260 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa57400bc50 tx=0x7fa57401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:15.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa5797fa700 1 -- 172.21.15.7:0/713025229 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574010540 con 0x7fa5840ac8d0 2023-10-06T11:00:15.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa5797fa700 1 -- 172.21.15.7:0/713025229 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5740106e0 con 0x7fa5840ac8d0 2023-10-06T11:00:15.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa5797fa700 1 -- 172.21.15.7:0/713025229 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574010aa0 con 0x7fa5840ac8d0 2023-10-06T11:00:15.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa58b60b700 1 -- 172.21.15.7:0/713025229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa584156640 con 0x7fa5840ac8d0 2023-10-06T11:00:15.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.687+0000 7fa58b60b700 1 -- 172.21.15.7:0/713025229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa584156c00 con 0x7fa5840ac8d0 2023-10-06T11:00:15.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.688+0000 7fa58b60b700 1 -- 172.21.15.7:0/713025229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa584156df0 con 0x7fa5840ac8d0 2023-10-06T11:00:15.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.689+0000 7fa5797fa700 1 -- 172.21.15.7:0/713025229 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa574022030 con 0x7fa5840ac8d0 2023-10-06T11:00:15.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.689+0000 7fa5797fa700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa568066f30 0x7fa5680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:15.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.689+0000 7fa5797fa700 1 -- 172.21.15.7:0/713025229 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fa574014070 con 0x7fa5840ac8d0 2023-10-06T11:00:15.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.689+0000 7fa5893a7700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa568066f30 0x7fa5680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:15.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.690+0000 7fa5893a7700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa568066f30 0x7fa5680693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa5800017a0 tx=0x7fa580009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:15.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.694+0000 7fa5797fa700 1 -- 172.21.15.7:0/713025229 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa574055840 con 0x7fa5840ac8d0 2023-10-06T11:00:15.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.984+0000 7fa58b60b700 1 -- 172.21.15.7:0/713025229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa584070480 con 0x7fa5840ac8d0 2023-10-06T11:00:15.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.987+0000 7fa5797fa700 1 -- 172.21.15.7:0/713025229 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa574058e60 con 0x7fa5840ac8d0 2023-10-06T11:00:15.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.990+0000 7fa58b60b700 1 -- 172.21.15.7:0/713025229 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa568066f30 msgr2=0x7fa5680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:15.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.990+0000 7fa58b60b700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa568066f30 0x7fa5680693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa5800017a0 tx=0x7fa580009040 comp rx=0 tx=0).stop 2023-10-06T11:00:15.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.990+0000 7fa58b60b700 1 -- 172.21.15.7:0/713025229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5840ac8d0 msgr2=0x7fa584169260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:15.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.990+0000 7fa58b60b700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5840ac8d0 0x7fa584169260 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa57400bc50 tx=0x7fa57401b000 comp rx=0 tx=0).stop 2023-10-06T11:00:15.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.990+0000 7fa58b60b700 1 -- 172.21.15.7:0/713025229 shutdown_connections 2023-10-06T11:00:15.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.990+0000 7fa58b60b700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa568066f30 0x7fa5680693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.990+0000 7fa58b60b700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5840ccda0 0x7fa584153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.990+0000 7fa58b60b700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa5840aaa40 0x7fa584155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.990+0000 7fa58b60b700 1 --2- 172.21.15.7:0/713025229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5840ac8d0 0x7fa584169260 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:15.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.990+0000 7fa58b60b700 1 -- 172.21.15.7:0/713025229 >> 172.21.15.7:0/713025229 conn(0x7fa584096160 msgr2=0x7fa5840aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:15.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.990+0000 7fa58b60b700 1 -- 172.21.15.7:0/713025229 shutdown_connections 2023-10-06T11:00:15.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:15.990+0000 7fa58b60b700 1 -- 172.21.15.7:0/713025229 wait complete. 2023-10-06T11:00:16.005 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T11:00:16.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.137+0000 7f8aadd91700 1 Processor -- start 2023-10-06T11:00:16.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.137+0000 7f8aadd91700 1 -- start start 2023-10-06T11:00:16.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.138+0000 7f8aadd91700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8aa81590d0 0x7f8aa8069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:16.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.138+0000 7f8aadd91700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa80694d0 con 0x7f8aa806a0f0 2023-10-06T11:00:16.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.138+0000 7f8aadd91700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa815abc0 con 0x7f8aa815d520 2023-10-06T11:00:16.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.138+0000 7f8aadd91700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa8068990 con 0x7f8aa81590d0 2023-10-06T11:00:16.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.138+0000 7f8aa6ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8aa806a0f0 0x7f8aa815ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35448/0 (socket says 172.21.15.7:35448) 2023-10-06T11:00:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.138+0000 7f8aa6ffd700 1 -- 172.21.15.7:0/4009077602 learned_addr learned my addr 172.21.15.7:0/4009077602 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.138+0000 7f8aa77fe700 1 --2- 172.21.15.7:0/4009077602 >> v2:172.21.15.50:3300/0 conn(0x7f8aa81590d0 0x7f8aa8069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 -- 172.21.15.7:0/4009077602 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730649520 0 0) 0x7f8aa80694d0 con 0x7f8aa806a0f0 2023-10-06T11:00:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 -- 172.21.15.7:0/4009077602 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a90003570 con 0x7f8aa806a0f0 2023-10-06T11:00:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 -- 172.21.15.7:0/4009077602 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 144692068 0 0) 0x7f8a90003570 con 0x7f8aa806a0f0 2023-10-06T11:00:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 -- 172.21.15.7:0/4009077602 >> v2:172.21.15.50:3300/0 conn(0x7f8aa81590d0 msgr2=0x7f8aa8069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 --2- 172.21.15.7:0/4009077602 >> v2:172.21.15.50:3300/0 conn(0x7f8aa81590d0 0x7f8aa8069bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 -- 172.21.15.7:0/4009077602 >> v1:172.21.15.50:6789/0 conn(0x7f8aa815d520 legacy=0x7f8aa81594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 -- 172.21.15.7:0/4009077602 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa8068ba0 con 0x7f8aa806a0f0 2023-10-06T11:00:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 -- 172.21.15.7:0/4009077602 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f8a9c001470 con 0x7f8aa806a0f0 2023-10-06T11:00:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 -- 172.21.15.7:0/4009077602 >> v1:172.21.15.7:6789/0 conn(0x7f8aa806a0f0 legacy=0x7f8aa815ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 --2- 172.21.15.7:0/4009077602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8a90003a60 0x7f8a90003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 --2- 172.21.15.7:0/4009077602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a90004810 0x7f8a90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 --2- 172.21.15.7:0/4009077602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a900051c0 0x7f8a9000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 -- 172.21.15.7:0/4009077602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa8068990 con 0x7f8a900051c0 2023-10-06T11:00:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 -- 172.21.15.7:0/4009077602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9000c0d0 con 0x7f8a90004810 2023-10-06T11:00:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa67fc700 1 -- 172.21.15.7:0/4009077602 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9000c290 con 0x7f8a90003a60 2023-10-06T11:00:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa7fff700 1 --2- 172.21.15.7:0/4009077602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a900051c0 0x7f8a9000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa6ffd700 1 --2- 172.21.15.7:0/4009077602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a90004810 0x7f8a90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.139+0000 7f8aa77fe700 1 --2- 172.21.15.7:0/4009077602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8a90003a60 0x7f8a90003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.140+0000 7f8aa7fff700 1 -- 172.21.15.7:0/4009077602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8a90003a60 msgr2=0x7f8a90003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.140+0000 7f8aa7fff700 1 --2- 172.21.15.7:0/4009077602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8a90003a60 0x7f8a90003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.140+0000 7f8aa7fff700 1 -- 172.21.15.7:0/4009077602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a90004810 msgr2=0x7f8a90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.140+0000 7f8aa7fff700 1 --2- 172.21.15.7:0/4009077602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a90004810 0x7f8a90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.140+0000 7f8aa7fff700 1 -- 172.21.15.7:0/4009077602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a90003570 con 0x7f8a900051c0 2023-10-06T11:00:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.140+0000 7f8aa77fe700 1 --2- 172.21.15.7:0/4009077602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8a90003a60 0x7f8a90003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.140+0000 7f8aa6ffd700 1 --2- 172.21.15.7:0/4009077602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a90004810 0x7f8a90004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.140+0000 7f8aa7fff700 1 -- 172.21.15.7:0/4009077602 reap_dead start 2023-10-06T11:00:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.140+0000 7f8aa7fff700 1 --2- 172.21.15.7:0/4009077602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a900051c0 0x7f8a9000ba60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0001f90 tx=0x7f8aa0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb0f602390d8507 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.140+0000 7f8aa67fc700 1 -- 172.21.15.7:0/4009077602 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0001950 con 0x7f8a900051c0 2023-10-06T11:00:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.140+0000 7f8aa67fc700 1 -- 172.21.15.7:0/4009077602 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa000c8b0 con 0x7f8a900051c0 2023-10-06T11:00:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.140+0000 7f8aa67fc700 1 -- 172.21.15.7:0/4009077602 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa000cc50 con 0x7f8a900051c0 2023-10-06T11:00:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.140+0000 7f8aadd91700 1 -- 172.21.15.7:0/4009077602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a900051c0 msgr2=0x7f8a9000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.140+0000 7f8aadd91700 1 --2- 172.21.15.7:0/4009077602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a900051c0 0x7f8a9000ba60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0001f90 tx=0x7f8aa0001640 comp rx=0 tx=0).stop 2023-10-06T11:00:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.141+0000 7f8aadd91700 1 -- 172.21.15.7:0/4009077602 shutdown_connections 2023-10-06T11:00:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.141+0000 7f8aadd91700 1 --2- 172.21.15.7:0/4009077602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a900051c0 0x7f8a9000ba60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.141+0000 7f8aadd91700 1 -- 172.21.15.7:0/4009077602 >> 172.21.15.7:0/4009077602 conn(0x7f8aa8096160 msgr2=0x7f8aa80afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.141+0000 7f8aadd91700 1 -- 172.21.15.7:0/4009077602 shutdown_connections 2023-10-06T11:00:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.141+0000 7f8aadd91700 1 -- 172.21.15.7:0/4009077602 wait complete. 2023-10-06T11:00:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.142+0000 7f8aadd91700 1 Processor -- start 2023-10-06T11:00:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.142+0000 7f8aadd91700 1 -- start start 2023-10-06T11:00:16.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aadd91700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a900051c0 0x7f8aa816d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:16.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aadd91700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aa8097e80 0x7f8aa8155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aadd91700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8aa8151c20 0x7f8aa8159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aadd91700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa81562e0 con 0x7f8aa8097e80 2023-10-06T11:00:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aadd91700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa81575e0 con 0x7f8a900051c0 2023-10-06T11:00:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aadd91700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa8156510 con 0x7f8aa8151c20 2023-10-06T11:00:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aa6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aa8097e80 0x7f8aa8155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aa6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aa8097e80 0x7f8aa8155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35310/0 (socket says 172.21.15.7:35310) 2023-10-06T11:00:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aa6ffd700 1 -- 172.21.15.7:0/3549555418 learned_addr learned my addr 172.21.15.7:0/3549555418 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aa77fe700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a900051c0 0x7f8aa816d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aa7fff700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8aa8151c20 0x7f8aa8159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aa6ffd700 1 -- 172.21.15.7:0/3549555418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8aa8151c20 msgr2=0x7f8aa8159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aa6ffd700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8aa8151c20 0x7f8aa8159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aa6ffd700 1 -- 172.21.15.7:0/3549555418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a900051c0 msgr2=0x7f8aa816d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aa6ffd700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a900051c0 0x7f8aa816d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aa6ffd700 1 -- 172.21.15.7:0/3549555418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa81567f0 con 0x7f8aa8097e80 2023-10-06T11:00:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aa77fe700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a900051c0 0x7f8aa816d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aa7fff700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8aa8151c20 0x7f8aa8159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aa6ffd700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aa8097e80 0x7f8aa8155da0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c007b10 tx=0x7f8a9c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8a8f7fe700 1 -- 172.21.15.7:0/3549555418 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00f870 con 0x7f8aa8097e80 2023-10-06T11:00:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8a8f7fe700 1 -- 172.21.15.7:0/3549555418 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c00f9d0 con 0x7f8aa8097e80 2023-10-06T11:00:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8aadd91700 1 -- 172.21.15.7:0/3549555418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa8156ad0 con 0x7f8aa8097e80 2023-10-06T11:00:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.143+0000 7f8a8f7fe700 1 -- 172.21.15.7:0/3549555418 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00fd50 con 0x7f8aa8097e80 2023-10-06T11:00:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.144+0000 7f8aadd91700 1 -- 172.21.15.7:0/3549555418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa815a0a0 con 0x7f8aa8097e80 2023-10-06T11:00:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.145+0000 7f8aadd91700 1 -- 172.21.15.7:0/3549555418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa8156d10 con 0x7f8aa8097e80 2023-10-06T11:00:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.145+0000 7f8a8f7fe700 1 -- 172.21.15.7:0/3549555418 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a9c013600 con 0x7f8aa8097e80 2023-10-06T11:00:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.145+0000 7f8a8f7fe700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8a94066f30 0x7f8a940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.146+0000 7f8a8f7fe700 1 -- 172.21.15.7:0/3549555418 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f8a9c0847a0 con 0x7f8aa8097e80 2023-10-06T11:00:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.146+0000 7f8aa77fe700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8a94066f30 0x7f8a940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.146+0000 7f8aa77fe700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8a94066f30 0x7f8a940693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8a98006f00 tx=0x7f8a98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.150+0000 7f8a8f7fe700 1 -- 172.21.15.7:0/3549555418 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8aa8156d10 con 0x7f8aa8097e80 2023-10-06T11:00:16.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.442+0000 7f8aadd91700 1 -- 172.21.15.7:0/3549555418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f8aa81573b0 con 0x7f8aa8097e80 2023-10-06T11:00:16.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.446+0000 7f8a8f7fe700 1 -- 172.21.15.7:0/3549555418 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8aa81573b0 con 0x7f8aa8097e80 2023-10-06T11:00:16.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.448+0000 7f8aadd91700 1 -- 172.21.15.7:0/3549555418 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8a94066f30 msgr2=0x7f8a940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:16.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.448+0000 7f8aadd91700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8a94066f30 0x7f8a940693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8a98006f00 tx=0x7f8a98008040 comp rx=0 tx=0).stop 2023-10-06T11:00:16.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.448+0000 7f8aadd91700 1 -- 172.21.15.7:0/3549555418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aa8097e80 msgr2=0x7f8aa8155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:16.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.448+0000 7f8aadd91700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aa8097e80 0x7f8aa8155da0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c007b10 tx=0x7f8a9c001e50 comp rx=0 tx=0).stop 2023-10-06T11:00:16.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.448+0000 7f8aadd91700 1 -- 172.21.15.7:0/3549555418 shutdown_connections 2023-10-06T11:00:16.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.448+0000 7f8aadd91700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8a94066f30 0x7f8a940693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.448+0000 7f8aadd91700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8aa8151c20 0x7f8aa8159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.448+0000 7f8aadd91700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a900051c0 0x7f8aa816d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.449+0000 7f8aadd91700 1 --2- 172.21.15.7:0/3549555418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aa8097e80 0x7f8aa8155da0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.449+0000 7f8aadd91700 1 -- 172.21.15.7:0/3549555418 >> 172.21.15.7:0/3549555418 conn(0x7f8aa8096160 msgr2=0x7f8aa806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:16.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.449+0000 7f8aadd91700 1 -- 172.21.15.7:0/3549555418 shutdown_connections 2023-10-06T11:00:16.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.449+0000 7f8aadd91700 1 -- 172.21.15.7:0/3549555418 wait complete. 2023-10-06T11:00:16.464 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T11:00:16.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.595+0000 7f08bc6e7700 1 Processor -- start 2023-10-06T11:00:16.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.595+0000 7f08bc6e7700 1 -- start start 2023-10-06T11:00:16.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.596+0000 7f08bc6e7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08b4159240 0x7f08b415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:16.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.596+0000 7f08bc6e7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f08b40ccff0 0x7f08b415d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:16.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.596+0000 7f08bc6e7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b415b210 con 0x7f08b415ced0 2023-10-06T11:00:16.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.596+0000 7f08bc6e7700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b4068a90 con 0x7f08b40ccff0 2023-10-06T11:00:16.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.596+0000 7f08bc6e7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b40698b0 con 0x7f08b4159240 2023-10-06T11:00:16.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.597+0000 7f08bac84700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f08b40ccff0 0x7f08b415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:16.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.597+0000 7f08b9c82700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f08b415ced0 0x7f08b40cc8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35452/0 (socket says 172.21.15.7:35452) 2023-10-06T11:00:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.597+0000 7f08b9c82700 1 -- 172.21.15.7:0/1252177832 learned_addr learned my addr 172.21.15.7:0/1252177832 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.597+0000 7f08ba483700 1 --2- 172.21.15.7:0/1252177832 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08b4159240 0x7f08b415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.597+0000 7f08bac84700 1 -- 172.21.15.7:0/1252177832 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08b4159240 msgr2=0x7f08b415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.597+0000 7f08bac84700 1 --2- 172.21.15.7:0/1252177832 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08b4159240 0x7f08b415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.597+0000 7f08bac84700 1 -- 172.21.15.7:0/1252177832 >> v1:172.21.15.7:6789/0 conn(0x7f08b415ced0 legacy=0x7f08b40cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.597+0000 7f08bac84700 1 -- 172.21.15.7:0/1252177832 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b415d880 con 0x7f08b40ccff0 2023-10-06T11:00:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.597+0000 7f08bac84700 1 --2- 172.21.15.7:0/1252177832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08b40ccff0 0x7f08b415d340 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009e60 tx=0x7f08ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfd07e0462c9938 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.597+0000 7f08b9481700 1 -- 172.21.15.7:0/1252177832 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00e070 con 0x7f08b40ccff0 2023-10-06T11:00:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.597+0000 7f08b9481700 1 -- 172.21.15.7:0/1252177832 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac00bc30 con 0x7f08b40ccff0 2023-10-06T11:00:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.597+0000 7f08b9481700 1 -- 172.21.15.7:0/1252177832 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac012430 con 0x7f08b40ccff0 2023-10-06T11:00:16.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.598+0000 7f08bc6e7700 1 -- 172.21.15.7:0/1252177832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08b40ccff0 msgr2=0x7f08b415d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:16.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.598+0000 7f08bc6e7700 1 --2- 172.21.15.7:0/1252177832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08b40ccff0 0x7f08b415d340 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009e60 tx=0x7f08ac009780 comp rx=0 tx=0).stop 2023-10-06T11:00:16.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.598+0000 7f08bc6e7700 1 -- 172.21.15.7:0/1252177832 shutdown_connections 2023-10-06T11:00:16.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.598+0000 7f08bc6e7700 1 --2- 172.21.15.7:0/1252177832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08b40ccff0 0x7f08b415d340 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.598+0000 7f08bc6e7700 1 --2- 172.21.15.7:0/1252177832 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08b4159240 0x7f08b415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.598+0000 7f08bc6e7700 1 -- 172.21.15.7:0/1252177832 >> 172.21.15.7:0/1252177832 conn(0x7f08b4087920 msgr2=0x7f08b4097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:16.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.598+0000 7f08bc6e7700 1 -- 172.21.15.7:0/1252177832 shutdown_connections 2023-10-06T11:00:16.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.598+0000 7f08bc6e7700 1 -- 172.21.15.7:0/1252177832 wait complete. 2023-10-06T11:00:16.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.600+0000 7f08bc6e7700 1 Processor -- start 2023-10-06T11:00:16.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.600+0000 7f08bc6e7700 1 -- start start 2023-10-06T11:00:16.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bc6e7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b40ccff0 0x7f08b415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:16.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bc6e7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08b4159240 0x7f08b4153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:16.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bc6e7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08b415ced0 0x7f08b4153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bc6e7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b4154120 con 0x7f08b415ced0 2023-10-06T11:00:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bc6e7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b40c8f80 con 0x7f08b40ccff0 2023-10-06T11:00:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bc6e7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b40c9260 con 0x7f08b4159240 2023-10-06T11:00:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bac84700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08b415ced0 0x7f08b4153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bac84700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08b415ced0 0x7f08b4153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35328/0 (socket says 172.21.15.7:35328) 2023-10-06T11:00:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bac84700 1 -- 172.21.15.7:0/3517116434 learned_addr learned my addr 172.21.15.7:0/3517116434 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08b9c82700 1 --2- 172.21.15.7:0/3517116434 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08b4159240 0x7f08b4153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08ba483700 1 --2- 172.21.15.7:0/3517116434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b40ccff0 0x7f08b415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bac84700 1 -- 172.21.15.7:0/3517116434 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08b4159240 msgr2=0x7f08b4153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bac84700 1 --2- 172.21.15.7:0/3517116434 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08b4159240 0x7f08b4153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bac84700 1 -- 172.21.15.7:0/3517116434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b40ccff0 msgr2=0x7f08b415bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:16.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bac84700 1 --2- 172.21.15.7:0/3517116434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b40ccff0 0x7f08b415bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bac84700 1 -- 172.21.15.7:0/3517116434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac009a20 con 0x7f08b415ced0 2023-10-06T11:00:16.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.601+0000 7f08bac84700 1 --2- 172.21.15.7:0/3517116434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08b415ced0 0x7f08b4153aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f08ac013000 tx=0x7f08ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:16.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.602+0000 7f08aa7fc700 1 -- 172.21.15.7:0/3517116434 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac027470 con 0x7f08b415ced0 2023-10-06T11:00:16.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.602+0000 7f08aa7fc700 1 -- 172.21.15.7:0/3517116434 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac0275d0 con 0x7f08b415ced0 2023-10-06T11:00:16.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.602+0000 7f08aa7fc700 1 -- 172.21.15.7:0/3517116434 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac027990 con 0x7f08b415ced0 2023-10-06T11:00:16.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.602+0000 7f08bc6e7700 1 -- 172.21.15.7:0/3517116434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b40c9540 con 0x7f08b415ced0 2023-10-06T11:00:16.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.602+0000 7f08bc6e7700 1 -- 172.21.15.7:0/3517116434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b415c130 con 0x7f08b415ced0 2023-10-06T11:00:16.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.603+0000 7f08bc6e7700 1 -- 172.21.15.7:0/3517116434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b415c350 con 0x7f08b415ced0 2023-10-06T11:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.603+0000 7f08aa7fc700 1 -- 172.21.15.7:0/3517116434 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08ac024070 con 0x7f08b415ced0 2023-10-06T11:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.603+0000 7f08aa7fc700 1 --2- 172.21.15.7:0/3517116434 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0898066f30 0x7f08980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.604+0000 7f08ba483700 1 --2- 172.21.15.7:0/3517116434 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0898066f30 0x7f08980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.604+0000 7f08aa7fc700 1 -- 172.21.15.7:0/3517116434 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f08ac086f00 con 0x7f08b415ced0 2023-10-06T11:00:16.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.604+0000 7f08ba483700 1 --2- 172.21.15.7:0/3517116434 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0898066f30 0x7f08980693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f08b0006aa0 tx=0x7f08b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:16.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.608+0000 7f08aa7fc700 1 -- 172.21.15.7:0/3517116434 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08ac054220 con 0x7f08b415ced0 2023-10-06T11:00:16.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.893+0000 7f08bc6e7700 1 -- 172.21.15.7:0/3517116434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f08b4070480 con 0x7f08b415ced0 2023-10-06T11:00:16.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.897+0000 7f08aa7fc700 1 -- 172.21.15.7:0/3517116434 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f08ac057840 con 0x7f08b415ced0 2023-10-06T11:00:16.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.899+0000 7f08bc6e7700 1 -- 172.21.15.7:0/3517116434 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0898066f30 msgr2=0x7f08980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:16.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.899+0000 7f08bc6e7700 1 --2- 172.21.15.7:0/3517116434 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0898066f30 0x7f08980693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f08b0006aa0 tx=0x7f08b0008040 comp rx=0 tx=0).stop 2023-10-06T11:00:16.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.899+0000 7f08bc6e7700 1 -- 172.21.15.7:0/3517116434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08b415ced0 msgr2=0x7f08b4153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:16.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.899+0000 7f08bc6e7700 1 --2- 172.21.15.7:0/3517116434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08b415ced0 0x7f08b4153aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f08ac013000 tx=0x7f08ac019000 comp rx=0 tx=0).stop 2023-10-06T11:00:16.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.899+0000 7f08bc6e7700 1 -- 172.21.15.7:0/3517116434 shutdown_connections 2023-10-06T11:00:16.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.899+0000 7f08bc6e7700 1 --2- 172.21.15.7:0/3517116434 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0898066f30 0x7f08980693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.899+0000 7f08bc6e7700 1 --2- 172.21.15.7:0/3517116434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08b415ced0 0x7f08b4153aa0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.899+0000 7f08bc6e7700 1 --2- 172.21.15.7:0/3517116434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b40ccff0 0x7f08b415bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.899+0000 7f08bc6e7700 1 --2- 172.21.15.7:0/3517116434 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08b4159240 0x7f08b4153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:16.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.899+0000 7f08bc6e7700 1 -- 172.21.15.7:0/3517116434 >> 172.21.15.7:0/3517116434 conn(0x7f08b4087920 msgr2=0x7f08b4154e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:16.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.899+0000 7f08bc6e7700 1 -- 172.21.15.7:0/3517116434 shutdown_connections 2023-10-06T11:00:16.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:16.899+0000 7f08bc6e7700 1 -- 172.21.15.7:0/3517116434 wait complete. 2023-10-06T11:00:16.914 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:00:17.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.045+0000 7f15afa0a700 1 Processor -- start 2023-10-06T11:00:17.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.045+0000 7f15afa0a700 1 -- start start 2023-10-06T11:00:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.046+0000 7f15afa0a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f15a80aaa40 0x7f15a80cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.046+0000 7f15afa0a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15a80ac8d0 0x7f15a8155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.046+0000 7f15afa0a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a8069110 con 0x7f15a80ccda0 2023-10-06T11:00:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.046+0000 7f15afa0a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a8068b30 con 0x7f15a80ac8d0 2023-10-06T11:00:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.046+0000 7f15afa0a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80aafb0 con 0x7f15a80aaa40 2023-10-06T11:00:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.047+0000 7f15adfa7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15a80ac8d0 0x7f15a8155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.047+0000 7f15acfa5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f15a80aaa40 0x7f15a80cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.047+0000 7f15ad7a6700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f15a80ccda0 0x7f15a80aa330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:53802/0 (socket says 172.21.15.7:53802) 2023-10-06T11:00:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.047+0000 7f15adfa7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15a80ac8d0 0x7f15a8155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:49990/0 (socket says 172.21.15.7:49990) 2023-10-06T11:00:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.047+0000 7f15ad7a6700 1 -- 172.21.15.7:0/2023992349 learned_addr learned my addr 172.21.15.7:0/2023992349 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.047+0000 7f15acfa5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f15a80aaa40 0x7f15a80cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:57588/0 (socket says 172.21.15.7:57588) 2023-10-06T11:00:17.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.047+0000 7f15adfa7700 1 -- 172.21.15.7:0/2023992349 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f15a80aaa40 msgr2=0x7f15a80cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:17.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.047+0000 7f15adfa7700 1 --2- 172.21.15.7:0/2023992349 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f15a80aaa40 0x7f15a80cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.047+0000 7f15adfa7700 1 -- 172.21.15.7:0/2023992349 >> v1:172.21.15.50:6789/0 conn(0x7f15a80ccda0 legacy=0x7f15a80aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.047+0000 7f15adfa7700 1 -- 172.21.15.7:0/2023992349 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8068da0 con 0x7f15a80ac8d0 2023-10-06T11:00:17.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.047+0000 7f15acfa5700 1 --2- 172.21.15.7:0/2023992349 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f15a80aaa40 0x7f15a80cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:17.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.047+0000 7f159ffff700 1 -- 172.21.15.7:0/2023992349 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427822130 0 0) 0x7f15a8069110 con 0x7f15a80ccda0 2023-10-06T11:00:17.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.047+0000 7f15adfa7700 1 --2- 172.21.15.7:0/2023992349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a80ac8d0 0x7f15a8155af0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15a000d0d0 tx=0x7f15a000b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43e9e94a53ff99a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:17.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.047+0000 7f159ffff700 1 -- 172.21.15.7:0/2023992349 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0010070 con 0x7f15a80ac8d0 2023-10-06T11:00:17.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.048+0000 7f159ffff700 1 -- 172.21.15.7:0/2023992349 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a000ddd0 con 0x7f15a80ac8d0 2023-10-06T11:00:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.048+0000 7f159ffff700 1 -- 172.21.15.7:0/2023992349 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a000b320 con 0x7f15a80ac8d0 2023-10-06T11:00:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.048+0000 7f15afa0a700 1 -- 172.21.15.7:0/2023992349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a80ac8d0 msgr2=0x7f15a8155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.048+0000 7f15afa0a700 1 --2- 172.21.15.7:0/2023992349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a80ac8d0 0x7f15a8155af0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15a000d0d0 tx=0x7f15a000b990 comp rx=0 tx=0).stop 2023-10-06T11:00:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.048+0000 7f15afa0a700 1 -- 172.21.15.7:0/2023992349 shutdown_connections 2023-10-06T11:00:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.048+0000 7f15afa0a700 1 --2- 172.21.15.7:0/2023992349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a80ac8d0 0x7f15a8155af0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.048+0000 7f15afa0a700 1 --2- 172.21.15.7:0/2023992349 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f15a80aaa40 0x7f15a80cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.048+0000 7f15afa0a700 1 -- 172.21.15.7:0/2023992349 >> 172.21.15.7:0/2023992349 conn(0x7f15a8096160 msgr2=0x7f15a80afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.048+0000 7f15afa0a700 1 -- 172.21.15.7:0/2023992349 shutdown_connections 2023-10-06T11:00:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.048+0000 7f15afa0a700 1 -- 172.21.15.7:0/2023992349 wait complete. 2023-10-06T11:00:17.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.050+0000 7f15afa0a700 1 Processor -- start 2023-10-06T11:00:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.050+0000 7f15afa0a700 1 -- start start 2023-10-06T11:00:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.051+0000 7f15afa0a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f15a80aaa40 0x7f15a80ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.051+0000 7f15afa0a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15a80ac8d0 0x7f15a8097690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.051+0000 7f15afa0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a80ccda0 0x7f15a8097bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.051+0000 7f15afa0a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a8096e20 con 0x7f15a80ac8d0 2023-10-06T11:00:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.051+0000 7f15afa0a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a809a2a0 con 0x7f15a80ccda0 2023-10-06T11:00:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.051+0000 7f15afa0a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a8098270 con 0x7f15a80aaa40 2023-10-06T11:00:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.051+0000 7f15acfa5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15a80ac8d0 0x7f15a8097690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.051+0000 7f15acfa5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15a80ac8d0 0x7f15a8097690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35340/0 (socket says 172.21.15.7:35340) 2023-10-06T11:00:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.051+0000 7f15acfa5700 1 -- 172.21.15.7:0/1497203877 learned_addr learned my addr 172.21.15.7:0/1497203877 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:17.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.051+0000 7f15adfa7700 1 --2- 172.21.15.7:0/1497203877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a80ccda0 0x7f15a8097bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.051+0000 7f15ad7a6700 1 --2- 172.21.15.7:0/1497203877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f15a80aaa40 0x7f15a80ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.052+0000 7f15acfa5700 1 -- 172.21.15.7:0/1497203877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f15a80aaa40 msgr2=0x7f15a80ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.052+0000 7f15acfa5700 1 --2- 172.21.15.7:0/1497203877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f15a80aaa40 0x7f15a80ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.052+0000 7f15acfa5700 1 -- 172.21.15.7:0/1497203877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a80ccda0 msgr2=0x7f15a8097bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.052+0000 7f15acfa5700 1 --2- 172.21.15.7:0/1497203877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a80ccda0 0x7f15a8097bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.052+0000 7f15acfa5700 1 -- 172.21.15.7:0/1497203877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1598009420 con 0x7f15a80ac8d0 2023-10-06T11:00:17.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.052+0000 7f15acfa5700 1 --2- 172.21.15.7:0/1497203877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15a80ac8d0 0x7f15a8097690 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f159800ec80 tx=0x7f15980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:17.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.052+0000 7f159d7fa700 1 -- 172.21.15.7:0/1497203877 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159800c850 con 0x7f15a80ac8d0 2023-10-06T11:00:17.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.052+0000 7f159d7fa700 1 -- 172.21.15.7:0/1497203877 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159800c9b0 con 0x7f15a80ac8d0 2023-10-06T11:00:17.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.052+0000 7f15afa0a700 1 -- 172.21.15.7:0/1497203877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a000bc30 con 0x7f15a80ac8d0 2023-10-06T11:00:17.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.052+0000 7f159d7fa700 1 -- 172.21.15.7:0/1497203877 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159800cd30 con 0x7f15a80ac8d0 2023-10-06T11:00:17.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.052+0000 7f15afa0a700 1 -- 172.21.15.7:0/1497203877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a8099d00 con 0x7f15a80ac8d0 2023-10-06T11:00:17.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.053+0000 7f15afa0a700 1 -- 172.21.15.7:0/1497203877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a809a450 con 0x7f15a80ac8d0 2023-10-06T11:00:17.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.054+0000 7f159d7fa700 1 -- 172.21.15.7:0/1497203877 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1598013680 con 0x7f15a80ac8d0 2023-10-06T11:00:17.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.054+0000 7f159d7fa700 1 --2- 172.21.15.7:0/1497203877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f158c066f30 0x7f158c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.054+0000 7f159d7fa700 1 -- 172.21.15.7:0/1497203877 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f1598084780 con 0x7f15a80ac8d0 2023-10-06T11:00:17.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.054+0000 7f15ad7a6700 1 --2- 172.21.15.7:0/1497203877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f158c066f30 0x7f158c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.055+0000 7f15ad7a6700 1 --2- 172.21.15.7:0/1497203877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f158c066f30 0x7f158c0693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f15a4007fd0 tx=0x7f15a4007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:17.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.059+0000 7f159d7fa700 1 -- 172.21.15.7:0/1497203877 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15a809a450 con 0x7f15a80ac8d0 2023-10-06T11:00:17.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.262+0000 7f15afa0a700 1 -- 172.21.15.7:0/1497203877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15a809a450 con 0x7f15a80ac8d0 2023-10-06T11:00:17.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.263+0000 7f159d7fa700 1 -- 172.21.15.7:0/1497203877 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13855 (secure 0 0 0) 0x7f15a809a450 con 0x7f15a80ac8d0 2023-10-06T11:00:17.265 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:17.265 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":36,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:00:13.711589+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:00:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.266+0000 7f15afa0a700 1 -- 172.21.15.7:0/1497203877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f158c066f30 msgr2=0x7f158c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.266+0000 7f15afa0a700 1 --2- 172.21.15.7:0/1497203877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f158c066f30 0x7f158c0693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f15a4007fd0 tx=0x7f15a4007d30 comp rx=0 tx=0).stop 2023-10-06T11:00:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.266+0000 7f15afa0a700 1 -- 172.21.15.7:0/1497203877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15a80ac8d0 msgr2=0x7f15a8097690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.266+0000 7f15afa0a700 1 --2- 172.21.15.7:0/1497203877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15a80ac8d0 0x7f15a8097690 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f159800ec80 tx=0x7f15980091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.266+0000 7f15afa0a700 1 -- 172.21.15.7:0/1497203877 shutdown_connections 2023-10-06T11:00:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.266+0000 7f15afa0a700 1 --2- 172.21.15.7:0/1497203877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f158c066f30 0x7f158c0693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.266+0000 7f15afa0a700 1 --2- 172.21.15.7:0/1497203877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a80ccda0 0x7f15a8097bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.266+0000 7f15afa0a700 1 --2- 172.21.15.7:0/1497203877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f15a80aaa40 0x7f15a80ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.266+0000 7f15afa0a700 1 --2- 172.21.15.7:0/1497203877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15a80ac8d0 0x7f15a8097690 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.266+0000 7f15afa0a700 1 -- 172.21.15.7:0/1497203877 >> 172.21.15.7:0/1497203877 conn(0x7f15a8096160 msgr2=0x7f15a80cc210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:17.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.266+0000 7f15afa0a700 1 -- 172.21.15.7:0/1497203877 shutdown_connections 2023-10-06T11:00:17.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.266+0000 7f15afa0a700 1 -- 172.21.15.7:0/1497203877 wait complete. 2023-10-06T11:00:17.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T10:58:55.224661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T10:58:56.032929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:00:17.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.414+0000 7f14f58d2700 1 Processor -- start 2023-10-06T11:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.414+0000 7f14f58d2700 1 -- start start 2023-10-06T11:00:17.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.415+0000 7f14f58d2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f14f0159890 0x7f14f00cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.415+0000 7f14f58d2700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f00cf870 con 0x7f14f00af440 2023-10-06T11:00:17.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.415+0000 7f14f58d2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f00cecf0 con 0x7f14f01594c0 2023-10-06T11:00:17.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.415+0000 7f14f58d2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f00b1030 con 0x7f14f0159890 2023-10-06T11:00:17.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.415+0000 7f14ee7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f14f00af440 0x7f14f00caff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35458/0 (socket says 172.21.15.7:35458) 2023-10-06T11:00:17.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.415+0000 7f14ee7fc700 1 -- 172.21.15.7:0/3435849993 learned_addr learned my addr 172.21.15.7:0/3435849993 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:17.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.415+0000 7f14ef7fe700 1 --2- 172.21.15.7:0/3435849993 >> v2:172.21.15.50:3300/0 conn(0x7f14f0159890 0x7f14f00cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 -- 172.21.15.7:0/3435849993 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581639811 0 0) 0x7f14f00cf870 con 0x7f14f00af440 2023-10-06T11:00:17.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 -- 172.21.15.7:0/3435849993 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14dc003570 con 0x7f14f00af440 2023-10-06T11:00:17.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 -- 172.21.15.7:0/3435849993 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3946381168 0 0) 0x7f14dc003570 con 0x7f14f00af440 2023-10-06T11:00:17.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 -- 172.21.15.7:0/3435849993 >> v2:172.21.15.50:3300/0 conn(0x7f14f0159890 msgr2=0x7f14f00cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:17.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 --2- 172.21.15.7:0/3435849993 >> v2:172.21.15.50:3300/0 conn(0x7f14f0159890 0x7f14f00cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 -- 172.21.15.7:0/3435849993 >> v1:172.21.15.50:6789/0 conn(0x7f14f01594c0 legacy=0x7f14f00aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 -- 172.21.15.7:0/3435849993 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f00cef40 con 0x7f14f00af440 2023-10-06T11:00:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 -- 172.21.15.7:0/3435849993 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f14d8001470 con 0x7f14f00af440 2023-10-06T11:00:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 -- 172.21.15.7:0/3435849993 >> v1:172.21.15.7:6789/0 conn(0x7f14f00af440 legacy=0x7f14f00caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 --2- 172.21.15.7:0/3435849993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14dc003a60 0x7f14dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 --2- 172.21.15.7:0/3435849993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14dc004810 0x7f14dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 --2- 172.21.15.7:0/3435849993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14dc0051c0 0x7f14dc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 -- 172.21.15.7:0/3435849993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f00b1030 con 0x7f14dc004810 2023-10-06T11:00:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 -- 172.21.15.7:0/3435849993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc00c0d0 con 0x7f14dc0051c0 2023-10-06T11:00:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14edffb700 1 -- 172.21.15.7:0/3435849993 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc00c290 con 0x7f14dc003a60 2023-10-06T11:00:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14ef7fe700 1 --2- 172.21.15.7:0/3435849993 >> v2:172.21.15.50:3300/0 conn(0x7f14f0159890 0x7f14f00cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:17.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14ee7fc700 1 --2- 172.21.15.7:0/3435849993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14dc004810 0x7f14dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14eeffd700 1 --2- 172.21.15.7:0/3435849993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14dc003a60 0x7f14dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14ef7fe700 1 --2- 172.21.15.7:0/3435849993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14dc0051c0 0x7f14dc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14ee7fc700 1 -- 172.21.15.7:0/3435849993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14dc003a60 msgr2=0x7f14dc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:17.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14ee7fc700 1 --2- 172.21.15.7:0/3435849993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14dc003a60 0x7f14dc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14ee7fc700 1 -- 172.21.15.7:0/3435849993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14dc0051c0 msgr2=0x7f14dc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:17.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14ee7fc700 1 --2- 172.21.15.7:0/3435849993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14dc0051c0 0x7f14dc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14ee7fc700 1 -- 172.21.15.7:0/3435849993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc003570 con 0x7f14dc004810 2023-10-06T11:00:17.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14ef7fe700 1 --2- 172.21.15.7:0/3435849993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14dc0051c0 0x7f14dc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:17.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.416+0000 7f14ef7fe700 1 -- 172.21.15.7:0/3435849993 reap_dead start 2023-10-06T11:00:17.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.417+0000 7f14ee7fc700 1 --2- 172.21.15.7:0/3435849993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14dc004810 0x7f14dc004c80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f14d800c390 tx=0x7f14f0159cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddda1f1fbefdd34e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:17.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.417+0000 7f14edffb700 1 -- 172.21.15.7:0/3435849993 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d800cc60 con 0x7f14dc004810 2023-10-06T11:00:17.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.417+0000 7f14edffb700 1 -- 172.21.15.7:0/3435849993 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d800cdc0 con 0x7f14dc004810 2023-10-06T11:00:17.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.417+0000 7f14edffb700 1 -- 172.21.15.7:0/3435849993 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8005b70 con 0x7f14dc004810 2023-10-06T11:00:17.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.417+0000 7f14f58d2700 1 -- 172.21.15.7:0/3435849993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14dc004810 msgr2=0x7f14dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.417+0000 7f14f58d2700 1 --2- 172.21.15.7:0/3435849993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14dc004810 0x7f14dc004c80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f14d800c390 tx=0x7f14f0159cf0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.417+0000 7f14f58d2700 1 -- 172.21.15.7:0/3435849993 shutdown_connections 2023-10-06T11:00:17.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.417+0000 7f14f58d2700 1 --2- 172.21.15.7:0/3435849993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14dc004810 0x7f14dc004c80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.417+0000 7f14f58d2700 1 -- 172.21.15.7:0/3435849993 >> 172.21.15.7:0/3435849993 conn(0x7f14f0067bc0 msgr2=0x7f14f00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:17.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.417+0000 7f14f58d2700 1 -- 172.21.15.7:0/3435849993 shutdown_connections 2023-10-06T11:00:17.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.417+0000 7f14f58d2700 1 -- 172.21.15.7:0/3435849993 wait complete. 2023-10-06T11:00:17.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.419+0000 7f14f58d2700 1 Processor -- start 2023-10-06T11:00:17.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.419+0000 7f14f58d2700 1 -- start start 2023-10-06T11:00:17.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14f58d2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14dc004810 0x7f14f00c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14f58d2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14f00c78b0 0x7f14f00c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14f58d2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f00c8260 0x7f14f00b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14f58d2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f00c86c0 con 0x7f14f00c8260 2023-10-06T11:00:17.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14f58d2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f013f8e0 con 0x7f14dc004810 2023-10-06T11:00:17.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14f58d2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f0153080 con 0x7f14f00c78b0 2023-10-06T11:00:17.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14ef7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f00c8260 0x7f14f00b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14ef7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f00c8260 0x7f14f00b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35364/0 (socket says 172.21.15.7:35364) 2023-10-06T11:00:17.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14ef7fe700 1 -- 172.21.15.7:0/1996569409 learned_addr learned my addr 172.21.15.7:0/1996569409 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:17.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14ee7fc700 1 --2- 172.21.15.7:0/1996569409 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14f00c78b0 0x7f14f00c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14eeffd700 1 --2- 172.21.15.7:0/1996569409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14dc004810 0x7f14f00c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14ef7fe700 1 -- 172.21.15.7:0/1996569409 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14f00c78b0 msgr2=0x7f14f00c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14ef7fe700 1 --2- 172.21.15.7:0/1996569409 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14f00c78b0 0x7f14f00c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14ef7fe700 1 -- 172.21.15.7:0/1996569409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14dc004810 msgr2=0x7f14f00c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14ef7fe700 1 --2- 172.21.15.7:0/1996569409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14dc004810 0x7f14f00c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14ef7fe700 1 -- 172.21.15.7:0/1996569409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f0158200 con 0x7f14f00c8260 2023-10-06T11:00:17.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14ef7fe700 1 --2- 172.21.15.7:0/1996569409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f00c8260 0x7f14f00b4690 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f14f0159c60 tx=0x7f14e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:17.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14e6ffd700 1 -- 172.21.15.7:0/1996569409 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e800e070 con 0x7f14f00c8260 2023-10-06T11:00:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14e6ffd700 1 -- 172.21.15.7:0/1996569409 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e8011c50 con 0x7f14f00c8260 2023-10-06T11:00:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14f58d2700 1 -- 172.21.15.7:0/1996569409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f00c9da0 con 0x7f14f00c8260 2023-10-06T11:00:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.420+0000 7f14e6ffd700 1 -- 172.21.15.7:0/1996569409 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e8016470 con 0x7f14f00c8260 2023-10-06T11:00:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.421+0000 7f14f58d2700 1 -- 172.21.15.7:0/1996569409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f01578d0 con 0x7f14f00c8260 2023-10-06T11:00:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.421+0000 7f14f58d2700 1 -- 172.21.15.7:0/1996569409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f00cbc30 con 0x7f14f00c8260 2023-10-06T11:00:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.422+0000 7f14e6ffd700 1 -- 172.21.15.7:0/1996569409 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14e80167e0 con 0x7f14f00c8260 2023-10-06T11:00:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.422+0000 7f14e6ffd700 1 --2- 172.21.15.7:0/1996569409 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f14d0066f30 0x7f14d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.423+0000 7f14e6ffd700 1 -- 172.21.15.7:0/1996569409 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f14e8085090 con 0x7f14f00c8260 2023-10-06T11:00:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.423+0000 7f14eeffd700 1 --2- 172.21.15.7:0/1996569409 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f14d0066f30 0x7f14d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.423+0000 7f14eeffd700 1 --2- 172.21.15.7:0/1996569409 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f14d0066f30 0x7f14d00693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f14e0000c00 tx=0x7f14e0007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:17.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.427+0000 7f14e6ffd700 1 -- 172.21.15.7:0/1996569409 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14e8055e40 con 0x7f14f00c8260 2023-10-06T11:00:17.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.628+0000 7f14f58d2700 1 -- 172.21.15.7:0/1996569409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f14f00ca7d0 con 0x7f14f00c8260 2023-10-06T11:00:17.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.629+0000 7f14e6ffd700 1 -- 172.21.15.7:0/1996569409 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7f14e80559d0 con 0x7f14f00c8260 2023-10-06T11:00:17.631 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-10-06T11:00:17.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.631+0000 7f14f58d2700 1 -- 172.21.15.7:0/1996569409 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f14d0066f30 msgr2=0x7f14d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.631+0000 7f14f58d2700 1 --2- 172.21.15.7:0/1996569409 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f14d0066f30 0x7f14d00693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f14e0000c00 tx=0x7f14e0007d30 comp rx=0 tx=0).stop 2023-10-06T11:00:17.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.631+0000 7f14f58d2700 1 -- 172.21.15.7:0/1996569409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f00c8260 msgr2=0x7f14f00b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.631+0000 7f14f58d2700 1 --2- 172.21.15.7:0/1996569409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f00c8260 0x7f14f00b4690 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f14f0159c60 tx=0x7f14e800b040 comp rx=0 tx=0).stop 2023-10-06T11:00:17.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.631+0000 7f14f58d2700 1 -- 172.21.15.7:0/1996569409 shutdown_connections 2023-10-06T11:00:17.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.631+0000 7f14f58d2700 1 --2- 172.21.15.7:0/1996569409 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f14d0066f30 0x7f14d00693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.631+0000 7f14f58d2700 1 --2- 172.21.15.7:0/1996569409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f00c8260 0x7f14f00b4690 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.631+0000 7f14f58d2700 1 --2- 172.21.15.7:0/1996569409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14dc004810 0x7f14f00c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.631+0000 7f14f58d2700 1 --2- 172.21.15.7:0/1996569409 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14f00c78b0 0x7f14f00c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.631+0000 7f14f58d2700 1 -- 172.21.15.7:0/1996569409 >> 172.21.15.7:0/1996569409 conn(0x7f14f0067bc0 msgr2=0x7f14f0155b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:17.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.631+0000 7f14f58d2700 1 -- 172.21.15.7:0/1996569409 shutdown_connections 2023-10-06T11:00:17.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.631+0000 7f14f58d2700 1 -- 172.21.15.7:0/1996569409 wait complete. 2023-10-06T11:00:17.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:00:17.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.780+0000 7f60adec0700 1 Processor -- start 2023-10-06T11:00:17.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.780+0000 7f60adec0700 1 -- start start 2023-10-06T11:00:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.781+0000 7f60adec0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60a80a6d30 0x7f60a80ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.781+0000 7f60adec0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f60a80aeb50 0x7f60a80ac590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.781+0000 7f60adec0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a806b1e0 con 0x7f60a80a7100 2023-10-06T11:00:17.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.781+0000 7f60adec0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a806b4c0 con 0x7f60a80a6d30 2023-10-06T11:00:17.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.781+0000 7f60adec0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a806b7a0 con 0x7f60a80aeb50 2023-10-06T11:00:17.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.781+0000 7f60a77fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60a80a6d30 0x7f60a80ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.781+0000 7f60a7fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f60a80a7100 0x7f60a815ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35466/0 (socket says 172.21.15.7:35466) 2023-10-06T11:00:17.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.781+0000 7f60a7fff700 1 -- 172.21.15.7:0/197277342 learned_addr learned my addr 172.21.15.7:0/197277342 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:17.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.781+0000 7f60a6ffd700 1 --2- 172.21.15.7:0/197277342 >> v2:172.21.15.50:3300/0 conn(0x7f60a80aeb50 0x7f60a80ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.781+0000 7f60a77fe700 1 -- 172.21.15.7:0/197277342 >> v2:172.21.15.50:3300/0 conn(0x7f60a80aeb50 msgr2=0x7f60a80ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:17.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.781+0000 7f60a77fe700 1 --2- 172.21.15.7:0/197277342 >> v2:172.21.15.50:3300/0 conn(0x7f60a80aeb50 0x7f60a80ac590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.781+0000 7f60a77fe700 1 -- 172.21.15.7:0/197277342 >> v1:172.21.15.7:6789/0 conn(0x7f60a80a7100 legacy=0x7f60a815ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.781+0000 7f60a77fe700 1 -- 172.21.15.7:0/197277342 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a806ba80 con 0x7f60a80a6d30 2023-10-06T11:00:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.781+0000 7f60a67fc700 1 -- 172.21.15.7:0/197277342 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945184878 0 0) 0x7f60a806b1e0 con 0x7f60a80a7100 2023-10-06T11:00:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.782+0000 7f60a77fe700 1 --2- 172.21.15.7:0/197277342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60a80a6d30 0x7f60a80ae610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f60a806df60 tx=0x7f60980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115ccf6c82f8ce53 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.782+0000 7f60a67fc700 1 -- 172.21.15.7:0/197277342 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098011630 con 0x7f60a80a6d30 2023-10-06T11:00:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.782+0000 7f60a67fc700 1 -- 172.21.15.7:0/197277342 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6098011790 con 0x7f60a80a6d30 2023-10-06T11:00:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.782+0000 7f60a67fc700 1 -- 172.21.15.7:0/197277342 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098011b30 con 0x7f60a80a6d30 2023-10-06T11:00:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.782+0000 7f60adec0700 1 -- 172.21.15.7:0/197277342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60a80a6d30 msgr2=0x7f60a80ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.782+0000 7f60adec0700 1 --2- 172.21.15.7:0/197277342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60a80a6d30 0x7f60a80ae610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f60a806df60 tx=0x7f60980091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.782+0000 7f60adec0700 1 -- 172.21.15.7:0/197277342 shutdown_connections 2023-10-06T11:00:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.782+0000 7f60adec0700 1 --2- 172.21.15.7:0/197277342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60a80a6d30 0x7f60a80ae610 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.782+0000 7f60adec0700 1 --2- 172.21.15.7:0/197277342 >> v2:172.21.15.50:3300/0 conn(0x7f60a80aeb50 0x7f60a80ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.782+0000 7f60adec0700 1 -- 172.21.15.7:0/197277342 >> 172.21.15.7:0/197277342 conn(0x7f60a80cc560 msgr2=0x7f60a80cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.782+0000 7f60adec0700 1 -- 172.21.15.7:0/197277342 shutdown_connections 2023-10-06T11:00:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.782+0000 7f60adec0700 1 -- 172.21.15.7:0/197277342 wait complete. 2023-10-06T11:00:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.784+0000 7f60adec0700 1 Processor -- start 2023-10-06T11:00:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.784+0000 7f60adec0700 1 -- start start 2023-10-06T11:00:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.784+0000 7f60adec0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60a80a6d30 0x7f60a8148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.784+0000 7f60adec0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60a80a7100 0x7f60a8099380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.784+0000 7f60adec0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a80aeb50 0x7f60a815eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60adec0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a80998c0 con 0x7f60a80a6d30 2023-10-06T11:00:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60adec0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a815f2e0 con 0x7f60a80aeb50 2023-10-06T11:00:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60adec0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a815d910 con 0x7f60a80a7100 2023-10-06T11:00:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60a77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60a80a6d30 0x7f60a8148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60a77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60a80a6d30 0x7f60a8148b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35378/0 (socket says 172.21.15.7:35378) 2023-10-06T11:00:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60a77fe700 1 -- 172.21.15.7:0/2115733645 learned_addr learned my addr 172.21.15.7:0/2115733645 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60a6ffd700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60a80a7100 0x7f60a8099380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60a7fff700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a80aeb50 0x7f60a815eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60a77fe700 1 -- 172.21.15.7:0/2115733645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60a80a7100 msgr2=0x7f60a8099380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60a77fe700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60a80a7100 0x7f60a8099380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60a77fe700 1 -- 172.21.15.7:0/2115733645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a80aeb50 msgr2=0x7f60a815eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60a77fe700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a80aeb50 0x7f60a815eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60a77fe700 1 -- 172.21.15.7:0/2115733645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6098009420 con 0x7f60a80a6d30 2023-10-06T11:00:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60a7fff700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a80aeb50 0x7f60a815eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60a6ffd700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60a80a7100 0x7f60a8099380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60a77fe700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60a80a6d30 0x7f60a8148b40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f60a806fa20 tx=0x7f6098017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f608f7fe700 1 -- 172.21.15.7:0/2115733645 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098011b10 con 0x7f60a80a6d30 2023-10-06T11:00:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f608f7fe700 1 -- 172.21.15.7:0/2115733645 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60980233f0 con 0x7f60a80a6d30 2023-10-06T11:00:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60adec0700 1 -- 172.21.15.7:0/2115733645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a815dbf0 con 0x7f60a80a6d30 2023-10-06T11:00:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f608f7fe700 1 -- 172.21.15.7:0/2115733645 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980237b0 con 0x7f60a80a6d30 2023-10-06T11:00:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.785+0000 7f60adec0700 1 -- 172.21.15.7:0/2115733645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a815e1b0 con 0x7f60a80a6d30 2023-10-06T11:00:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.786+0000 7f60adec0700 1 -- 172.21.15.7:0/2115733645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a815f5a0 con 0x7f60a80a6d30 2023-10-06T11:00:17.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.787+0000 7f608f7fe700 1 -- 172.21.15.7:0/2115733645 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60980193b0 con 0x7f60a80a6d30 2023-10-06T11:00:17.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.787+0000 7f608f7fe700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6094066f30 0x7f60940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:17.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.787+0000 7f608f7fe700 1 -- 172.21.15.7:0/2115733645 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f6098085a00 con 0x7f60a80a6d30 2023-10-06T11:00:17.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.787+0000 7f60a6ffd700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6094066f30 0x7f60940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:17.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.788+0000 7f60a6ffd700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6094066f30 0x7f60940693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f609c006f00 tx=0x7f609c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.792+0000 7f608f7fe700 1 -- 172.21.15.7:0/2115733645 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6098052da0 con 0x7f60a80a6d30 2023-10-06T11:00:17.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.991+0000 7f60adec0700 1 -- 172.21.15.7:0/2115733645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60a815e3d0 con 0x7f60a80a6d30 2023-10-06T11:00:17.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.992+0000 7f608f7fe700 1 -- 172.21.15.7:0/2115733645 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f60980150a0 con 0x7f60a80a6d30 2023-10-06T11:00:17.994 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-06T11:00:17.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.994+0000 7f60adec0700 1 -- 172.21.15.7:0/2115733645 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6094066f30 msgr2=0x7f60940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.994+0000 7f60adec0700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6094066f30 0x7f60940693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f609c006f00 tx=0x7f609c008040 comp rx=0 tx=0).stop 2023-10-06T11:00:17.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.994+0000 7f60adec0700 1 -- 172.21.15.7:0/2115733645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60a80a6d30 msgr2=0x7f60a8148b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:17.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.994+0000 7f60adec0700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60a80a6d30 0x7f60a8148b40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f60a806fa20 tx=0x7f6098017000 comp rx=0 tx=0).stop 2023-10-06T11:00:17.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.994+0000 7f60adec0700 1 -- 172.21.15.7:0/2115733645 shutdown_connections 2023-10-06T11:00:17.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.994+0000 7f60adec0700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6094066f30 0x7f60940693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.994+0000 7f60adec0700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60a80a6d30 0x7f60a8148b40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.994+0000 7f60adec0700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a80aeb50 0x7f60a815eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.994+0000 7f60adec0700 1 --2- 172.21.15.7:0/2115733645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60a80a7100 0x7f60a8099380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:17.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.994+0000 7f60adec0700 1 -- 172.21.15.7:0/2115733645 >> 172.21.15.7:0/2115733645 conn(0x7f60a80cc560 msgr2=0x7f60a80b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:17.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.994+0000 7f60adec0700 1 -- 172.21.15.7:0/2115733645 shutdown_connections 2023-10-06T11:00:17.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:17.994+0000 7f60adec0700 1 -- 172.21.15.7:0/2115733645 wait complete. 2023-10-06T11:00:18.009 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:00:18.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.141+0000 7f09e28a0700 1 Processor -- start 2023-10-06T11:00:18.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.141+0000 7f09e28a0700 1 -- start start 2023-10-06T11:00:18.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.142+0000 7f09e28a0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f09dc159240 0x7f09dc15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:18.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.142+0000 7f09e28a0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f09dc0ccff0 0x7f09dc15d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:18.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.142+0000 7f09e28a0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09dc15b210 con 0x7f09dc15ced0 2023-10-06T11:00:18.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.142+0000 7f09e28a0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09dc068a90 con 0x7f09dc0ccff0 2023-10-06T11:00:18.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.142+0000 7f09e28a0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09dc0698b0 con 0x7f09dc159240 2023-10-06T11:00:18.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.142+0000 7f09e0e3d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f09dc0ccff0 0x7f09dc15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.142+0000 7f09db7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f09dc15ced0 0x7f09dc0cc8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35468/0 (socket says 172.21.15.7:35468) 2023-10-06T11:00:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.142+0000 7f09db7fe700 1 -- 172.21.15.7:0/2945069154 learned_addr learned my addr 172.21.15.7:0/2945069154 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.142+0000 7f09dbfff700 1 --2- 172.21.15.7:0/2945069154 >> v2:172.21.15.50:3300/0 conn(0x7f09dc159240 0x7f09dc15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.142+0000 7f09e0e3d700 1 -- 172.21.15.7:0/2945069154 >> v2:172.21.15.50:3300/0 conn(0x7f09dc159240 msgr2=0x7f09dc15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.142+0000 7f09e0e3d700 1 --2- 172.21.15.7:0/2945069154 >> v2:172.21.15.50:3300/0 conn(0x7f09dc159240 0x7f09dc15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.142+0000 7f09e0e3d700 1 -- 172.21.15.7:0/2945069154 >> v1:172.21.15.7:6789/0 conn(0x7f09dc15ced0 legacy=0x7f09dc0cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.142+0000 7f09e0e3d700 1 -- 172.21.15.7:0/2945069154 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc15d880 con 0x7f09dc0ccff0 2023-10-06T11:00:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.142+0000 7f09e0e3d700 1 --2- 172.21.15.7:0/2945069154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09dc0ccff0 0x7f09dc15d340 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f09dc06be10 tx=0x7f09d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55476fcdb4de199f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.143+0000 7f09daffd700 1 -- 172.21.15.7:0/2945069154 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400e070 con 0x7f09dc0ccff0 2023-10-06T11:00:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.143+0000 7f09daffd700 1 -- 172.21.15.7:0/2945069154 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400bc30 con 0x7f09dc0ccff0 2023-10-06T11:00:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.143+0000 7f09daffd700 1 -- 172.21.15.7:0/2945069154 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4012430 con 0x7f09dc0ccff0 2023-10-06T11:00:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.143+0000 7f09e28a0700 1 -- 172.21.15.7:0/2945069154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09dc0ccff0 msgr2=0x7f09dc15d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.143+0000 7f09e28a0700 1 --2- 172.21.15.7:0/2945069154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09dc0ccff0 0x7f09dc15d340 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f09dc06be10 tx=0x7f09d4009780 comp rx=0 tx=0).stop 2023-10-06T11:00:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.143+0000 7f09e28a0700 1 -- 172.21.15.7:0/2945069154 shutdown_connections 2023-10-06T11:00:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.143+0000 7f09e28a0700 1 --2- 172.21.15.7:0/2945069154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09dc0ccff0 0x7f09dc15d340 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.143+0000 7f09e28a0700 1 --2- 172.21.15.7:0/2945069154 >> v2:172.21.15.50:3300/0 conn(0x7f09dc159240 0x7f09dc15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.143+0000 7f09e28a0700 1 -- 172.21.15.7:0/2945069154 >> 172.21.15.7:0/2945069154 conn(0x7f09dc087920 msgr2=0x7f09dc097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.143+0000 7f09e28a0700 1 -- 172.21.15.7:0/2945069154 shutdown_connections 2023-10-06T11:00:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.143+0000 7f09e28a0700 1 -- 172.21.15.7:0/2945069154 wait complete. 2023-10-06T11:00:18.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.144+0000 7f09e28a0700 1 Processor -- start 2023-10-06T11:00:18.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.145+0000 7f09e28a0700 1 -- start start 2023-10-06T11:00:18.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.145+0000 7f09e28a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09dc0ccff0 0x7f09dc16a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:18.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.145+0000 7f09e28a0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09dc159240 0x7f09dc169f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:18.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.145+0000 7f09e28a0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09dc15ced0 0x7f09dc0c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:18.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.145+0000 7f09e28a0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc0c8e30 con 0x7f09dc0ccff0 2023-10-06T11:00:18.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.145+0000 7f09e28a0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc0c7bd0 con 0x7f09dc159240 2023-10-06T11:00:18.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.145+0000 7f09e28a0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc0c90d0 con 0x7f09dc15ced0 2023-10-06T11:00:18.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09dbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09dc0ccff0 0x7f09dc16a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:18.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09dbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09dc0ccff0 0x7f09dc16a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35392/0 (socket says 172.21.15.7:35392) 2023-10-06T11:00:18.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09dbfff700 1 -- 172.21.15.7:0/3363115396 learned_addr learned my addr 172.21.15.7:0/3363115396 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:18.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09db7fe700 1 --2- 172.21.15.7:0/3363115396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09dc159240 0x7f09dc169f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:18.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09e0e3d700 1 --2- 172.21.15.7:0/3363115396 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09dc15ced0 0x7f09dc0c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:18.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09dbfff700 1 -- 172.21.15.7:0/3363115396 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09dc15ced0 msgr2=0x7f09dc0c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:18.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09dbfff700 1 --2- 172.21.15.7:0/3363115396 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09dc15ced0 0x7f09dc0c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:18.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09dbfff700 1 -- 172.21.15.7:0/3363115396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09dc159240 msgr2=0x7f09dc169f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:18.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09dbfff700 1 --2- 172.21.15.7:0/3363115396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09dc159240 0x7f09dc169f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:18.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09dbfff700 1 -- 172.21.15.7:0/3363115396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d4009a20 con 0x7f09dc0ccff0 2023-10-06T11:00:18.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09dbfff700 1 --2- 172.21.15.7:0/3363115396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09dc0ccff0 0x7f09dc16a8a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00d810 tx=0x7f09cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:18.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09d3fff700 1 -- 172.21.15.7:0/3363115396 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0125f0 con 0x7f09dc0ccff0 2023-10-06T11:00:18.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09d3fff700 1 -- 172.21.15.7:0/3363115396 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc012750 con 0x7f09dc0ccff0 2023-10-06T11:00:18.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09e28a0700 1 -- 172.21.15.7:0/3363115396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09dc0c93b0 con 0x7f09dc0ccff0 2023-10-06T11:00:18.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09d3fff700 1 -- 172.21.15.7:0/3363115396 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc012b10 con 0x7f09dc0ccff0 2023-10-06T11:00:18.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.146+0000 7f09e28a0700 1 -- 172.21.15.7:0/3363115396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09dc16a4d0 con 0x7f09dc0ccff0 2023-10-06T11:00:18.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.147+0000 7f09e28a0700 1 -- 172.21.15.7:0/3363115396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09dc16a6c0 con 0x7f09dc0ccff0 2023-10-06T11:00:18.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.148+0000 7f09d3fff700 1 -- 172.21.15.7:0/3363115396 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09cc01e460 con 0x7f09dc0ccff0 2023-10-06T11:00:18.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.148+0000 7f09d3fff700 1 --2- 172.21.15.7:0/3363115396 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f09bc066f30 0x7f09bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:18.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.149+0000 7f09d3fff700 1 -- 172.21.15.7:0/3363115396 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f09cc0849a0 con 0x7f09dc0ccff0 2023-10-06T11:00:18.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.149+0000 7f09db7fe700 1 --2- 172.21.15.7:0/3363115396 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f09bc066f30 0x7f09bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:18.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.149+0000 7f09db7fe700 1 --2- 172.21.15.7:0/3363115396 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f09bc066f30 0x7f09bc0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f09dc158430 tx=0x7f09c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:18.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.153+0000 7f09d3fff700 1 -- 172.21.15.7:0/3363115396 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09cc051cc0 con 0x7f09dc0ccff0 2023-10-06T11:00:18.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.362+0000 7f09e28a0700 1 -- 172.21.15.7:0/3363115396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f09dc070480 con 0x7f09dc0ccff0 2023-10-06T11:00:18.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.362+0000 7f09d3fff700 1 -- 172.21.15.7:0/3363115396 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+126 (secure 0 0 0) 0x7f09cc0552e0 con 0x7f09dc0ccff0 2023-10-06T11:00:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:18.364 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-06T11:00:18.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:18.365 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-06T11:00:18.365 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": "rbd" 2023-10-06T11:00:18.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:18.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:18.365 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 2, 2023-10-06T11:00:18.365 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-06T11:00:18.365 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:18.365 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-06T11:00:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.365+0000 7f09e28a0700 1 -- 172.21.15.7:0/3363115396 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f09bc066f30 msgr2=0x7f09bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.365+0000 7f09e28a0700 1 --2- 172.21.15.7:0/3363115396 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f09bc066f30 0x7f09bc0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f09dc158430 tx=0x7f09c4009040 comp rx=0 tx=0).stop 2023-10-06T11:00:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.365+0000 7f09e28a0700 1 -- 172.21.15.7:0/3363115396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09dc0ccff0 msgr2=0x7f09dc16a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.365+0000 7f09e28a0700 1 --2- 172.21.15.7:0/3363115396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09dc0ccff0 0x7f09dc16a8a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00d810 tx=0x7f09cc008040 comp rx=0 tx=0).stop 2023-10-06T11:00:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.365+0000 7f09e28a0700 1 -- 172.21.15.7:0/3363115396 shutdown_connections 2023-10-06T11:00:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.365+0000 7f09e28a0700 1 --2- 172.21.15.7:0/3363115396 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f09bc066f30 0x7f09bc0693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.365+0000 7f09e28a0700 1 --2- 172.21.15.7:0/3363115396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09dc0ccff0 0x7f09dc16a8a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.365+0000 7f09e28a0700 1 --2- 172.21.15.7:0/3363115396 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09dc15ced0 0x7f09dc0c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.365+0000 7f09e28a0700 1 --2- 172.21.15.7:0/3363115396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09dc159240 0x7f09dc169f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.365+0000 7f09e28a0700 1 -- 172.21.15.7:0/3363115396 >> 172.21.15.7:0/3363115396 conn(0x7f09dc087920 msgr2=0x7f09dc154d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.365+0000 7f09e28a0700 1 -- 172.21.15.7:0/3363115396 shutdown_connections 2023-10-06T11:00:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.365+0000 7f09e28a0700 1 -- 172.21.15.7:0/3363115396 wait complete. 2023-10-06T11:00:18.380 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:00:18.380 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:00:18.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-06T11:00:18.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.515+0000 7ff68bc49700 1 Processor -- start 2023-10-06T11:00:18.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.515+0000 7ff68bc49700 1 -- start start 2023-10-06T11:00:18.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.516+0000 7ff68bc49700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6840cd480 0x7ff684069710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:18.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.516+0000 7ff68bc49700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff684069280 con 0x7ff6840ac900 2023-10-06T11:00:18.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.516+0000 7ff68bc49700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6840acd50 con 0x7ff684155f70 2023-10-06T11:00:18.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.516+0000 7ff68bc49700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6840aa680 con 0x7ff6840cd480 2023-10-06T11:00:18.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.516+0000 7ff6891e4700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff6840ac900 0x7ff6840ccd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35478/0 (socket says 172.21.15.7:35478) 2023-10-06T11:00:18.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.516+0000 7ff6891e4700 1 -- 172.21.15.7:0/3550245056 learned_addr learned my addr 172.21.15.7:0/3550245056 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:18.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.516+0000 7ff68a1e6700 1 --2- 172.21.15.7:0/3550245056 >> v2:172.21.15.50:3300/0 conn(0x7ff6840cd480 0x7ff684069710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.517+0000 7ff6889e3700 1 -- 172.21.15.7:0/3550245056 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221429555 0 0) 0x7ff684069280 con 0x7ff6840ac900 2023-10-06T11:00:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.517+0000 7ff6889e3700 1 -- 172.21.15.7:0/3550245056 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff670003570 con 0x7ff6840ac900 2023-10-06T11:00:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.517+0000 7ff6889e3700 1 -- 172.21.15.7:0/3550245056 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152767539 0 0) 0x7ff6840acd50 con 0x7ff684155f70 2023-10-06T11:00:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.517+0000 7ff6889e3700 1 -- 172.21.15.7:0/3550245056 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff684069280 con 0x7ff684155f70 2023-10-06T11:00:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.517+0000 7ff68a1e6700 1 -- 172.21.15.7:0/3550245056 >> v1:172.21.15.50:6789/0 conn(0x7ff684155f70 legacy=0x7ff6840a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.517+0000 7ff6889e3700 1 -- 172.21.15.7:0/3550245056 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3228721440 0 0) 0x7ff670003570 con 0x7ff6840ac900 2023-10-06T11:00:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.517+0000 7ff68a1e6700 1 -- 172.21.15.7:0/3550245056 >> v1:172.21.15.7:6789/0 conn(0x7ff6840ac900 legacy=0x7ff6840ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.517+0000 7ff68a1e6700 1 -- 172.21.15.7:0/3550245056 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6840aa3a0 con 0x7ff6840cd480 2023-10-06T11:00:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.517+0000 7ff68a1e6700 1 --2- 172.21.15.7:0/3550245056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6840cd480 0x7ff684069710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff67c009e60 tx=0x7ff67c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c24ec39378dc5af0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.517+0000 7ff6889e3700 1 -- 172.21.15.7:0/3550245056 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00e070 con 0x7ff6840cd480 2023-10-06T11:00:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.517+0000 7ff6889e3700 1 -- 172.21.15.7:0/3550245056 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67c00b7a0 con 0x7ff6840cd480 2023-10-06T11:00:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.517+0000 7ff6889e3700 1 -- 172.21.15.7:0/3550245056 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678001470 con 0x7ff6840cd480 2023-10-06T11:00:18.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.518+0000 7ff68bc49700 1 -- 172.21.15.7:0/3550245056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6840cd480 msgr2=0x7ff684069710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:18.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.518+0000 7ff68bc49700 1 --2- 172.21.15.7:0/3550245056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6840cd480 0x7ff684069710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff67c009e60 tx=0x7ff67c009780 comp rx=0 tx=0).stop 2023-10-06T11:00:18.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.518+0000 7ff68bc49700 1 -- 172.21.15.7:0/3550245056 shutdown_connections 2023-10-06T11:00:18.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.518+0000 7ff68bc49700 1 --2- 172.21.15.7:0/3550245056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6840cd480 0x7ff684069710 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:18.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.518+0000 7ff68bc49700 1 -- 172.21.15.7:0/3550245056 >> 172.21.15.7:0/3550245056 conn(0x7ff684096160 msgr2=0x7ff6840afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:18.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.518+0000 7ff68bc49700 1 -- 172.21.15.7:0/3550245056 shutdown_connections 2023-10-06T11:00:18.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.518+0000 7ff68bc49700 1 -- 172.21.15.7:0/3550245056 wait complete. 2023-10-06T11:00:18.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.519+0000 7ff68bc49700 1 Processor -- start 2023-10-06T11:00:18.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.519+0000 7ff68bc49700 1 -- start start 2023-10-06T11:00:18.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.520+0000 7ff68bc49700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6840ac900 0x7ff684157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:18.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.520+0000 7ff68bc49700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6840cd480 0x7ff684144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:18.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.520+0000 7ff68bc49700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff684155f70 0x7ff6841693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:18.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.520+0000 7ff68bc49700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff684169af0 con 0x7ff684155f70 2023-10-06T11:00:18.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.520+0000 7ff68bc49700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff684169dd0 con 0x7ff6840cd480 2023-10-06T11:00:18.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.520+0000 7ff68bc49700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68416a0b0 con 0x7ff6840ac900 2023-10-06T11:00:18.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.520+0000 7ff68a1e6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff684155f70 0x7ff6841693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.520+0000 7ff68a1e6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff684155f70 0x7ff6841693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35400/0 (socket says 172.21.15.7:35400) 2023-10-06T11:00:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.520+0000 7ff68a1e6700 1 -- 172.21.15.7:0/259773652 learned_addr learned my addr 172.21.15.7:0/259773652 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.521+0000 7ff6891e4700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6840cd480 0x7ff684144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.521+0000 7ff6899e5700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6840ac900 0x7ff684157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.521+0000 7ff68a1e6700 1 -- 172.21.15.7:0/259773652 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6840ac900 msgr2=0x7ff684157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.521+0000 7ff68a1e6700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6840ac900 0x7ff684157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.521+0000 7ff68a1e6700 1 -- 172.21.15.7:0/259773652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6840cd480 msgr2=0x7ff684144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.521+0000 7ff68a1e6700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6840cd480 0x7ff684144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.521+0000 7ff68a1e6700 1 -- 172.21.15.7:0/259773652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c009a20 con 0x7ff684155f70 2023-10-06T11:00:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.521+0000 7ff6899e5700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6840ac900 0x7ff684157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.521+0000 7ff68a1e6700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff684155f70 0x7ff6841693f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff67c003000 tx=0x7ff67c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:18.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.521+0000 7ff675ffb700 1 -- 172.21.15.7:0/259773652 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c021070 con 0x7ff684155f70 2023-10-06T11:00:18.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.521+0000 7ff675ffb700 1 -- 172.21.15.7:0/259773652 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67c01c2e0 con 0x7ff684155f70 2023-10-06T11:00:18.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.521+0000 7ff675ffb700 1 -- 172.21.15.7:0/259773652 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c01cdc0 con 0x7ff684155f70 2023-10-06T11:00:18.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.521+0000 7ff68bc49700 1 -- 172.21.15.7:0/259773652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff684158230 con 0x7ff684155f70 2023-10-06T11:00:18.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.521+0000 7ff68bc49700 1 -- 172.21.15.7:0/259773652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68414ccc0 con 0x7ff684155f70 2023-10-06T11:00:18.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.523+0000 7ff68bc49700 1 -- 172.21.15.7:0/259773652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff684158420 con 0x7ff684155f70 2023-10-06T11:00:18.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.523+0000 7ff675ffb700 1 -- 172.21.15.7:0/259773652 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff67c01a6f0 con 0x7ff684155f70 2023-10-06T11:00:18.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.523+0000 7ff675ffb700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff668066f30 0x7ff6680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:18.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.523+0000 7ff675ffb700 1 -- 172.21.15.7:0/259773652 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7ff67c087970 con 0x7ff684155f70 2023-10-06T11:00:18.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.523+0000 7ff6899e5700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff668066f30 0x7ff6680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:18.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.524+0000 7ff6899e5700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff668066f30 0x7ff6680693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff680007fd0 tx=0x7ff680009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:18.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.528+0000 7ff675ffb700 1 -- 172.21.15.7:0/259773652 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff67c054c90 con 0x7ff684155f70 2023-10-06T11:00:18.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:18.730+0000 7ff68bc49700 1 -- 172.21.15.7:0/259773652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff684070480 con 0x7ff684155f70 2023-10-06T11:00:19.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.734+0000 7ff675ffb700 1 -- 172.21.15.7:0/259773652 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff67c0582b0 con 0x7ff684155f70 2023-10-06T11:00:19.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.739+0000 7ff68bc49700 1 -- 172.21.15.7:0/259773652 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff668066f30 msgr2=0x7ff6680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:19.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.739+0000 7ff68bc49700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff668066f30 0x7ff6680693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff680007fd0 tx=0x7ff680009040 comp rx=0 tx=0).stop 2023-10-06T11:00:19.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.739+0000 7ff68bc49700 1 -- 172.21.15.7:0/259773652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff684155f70 msgr2=0x7ff6841693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:19.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.739+0000 7ff68bc49700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff684155f70 0x7ff6841693f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff67c003000 tx=0x7ff67c017000 comp rx=0 tx=0).stop 2023-10-06T11:00:19.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.740+0000 7ff68bc49700 1 -- 172.21.15.7:0/259773652 shutdown_connections 2023-10-06T11:00:19.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.740+0000 7ff68bc49700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff668066f30 0x7ff6680693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:19.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.740+0000 7ff68bc49700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff684155f70 0x7ff6841693f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:19.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.740+0000 7ff68bc49700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6840ac900 0x7ff684157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:19.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.740+0000 7ff68bc49700 1 --2- 172.21.15.7:0/259773652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6840cd480 0x7ff684144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:19.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.740+0000 7ff68bc49700 1 -- 172.21.15.7:0/259773652 >> 172.21.15.7:0/259773652 conn(0x7ff684096160 msgr2=0x7ff6840adbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.740+0000 7ff68bc49700 1 -- 172.21.15.7:0/259773652 shutdown_connections 2023-10-06T11:00:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.740+0000 7ff68bc49700 1 -- 172.21.15.7:0/259773652 wait complete. 2023-10-06T11:00:19.744 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-06T11:00:19.758 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:00:19.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.900+0000 7fbad6d79700 1 Processor -- start 2023-10-06T11:00:19.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.900+0000 7fbad6d79700 1 -- start start 2023-10-06T11:00:19.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.901+0000 7fbad6d79700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbad006c230 0x7fbad006c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:19.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.901+0000 7fbad6d79700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad015b050 con 0x7fbad00c9040 2023-10-06T11:00:19.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.901+0000 7fbad6d79700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad015b330 con 0x7fbad00ae430 2023-10-06T11:00:19.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.901+0000 7fbad6d79700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad00af590 con 0x7fbad006c230 2023-10-06T11:00:19.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.901+0000 7fbacffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbad006c230 0x7fbad006c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:19.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.901+0000 7fbad5316700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbad00c9040 0x7fbad00c9440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35482/0 (socket says 172.21.15.7:35482) 2023-10-06T11:00:19.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.901+0000 7fbad5316700 1 -- 172.21.15.7:0/633945307 learned_addr learned my addr 172.21.15.7:0/633945307 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:19.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.902+0000 7fbacffff700 1 -- 172.21.15.7:0/633945307 >> v1:172.21.15.50:6789/0 conn(0x7fbad00ae430 legacy=0x7fbad00b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:19.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.902+0000 7fbacffff700 1 -- 172.21.15.7:0/633945307 >> v1:172.21.15.7:6789/0 conn(0x7fbad00c9040 legacy=0x7fbad00c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:19.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.902+0000 7fbacf7fe700 1 -- 172.21.15.7:0/633945307 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678190008 0 0) 0x7fbad015b050 con 0x7fbad00c9040 2023-10-06T11:00:19.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.902+0000 7fbacffff700 1 -- 172.21.15.7:0/633945307 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad015b610 con 0x7fbad006c230 2023-10-06T11:00:19.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.902+0000 7fbacffff700 1 --2- 172.21.15.7:0/633945307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbad006c230 0x7fbad006c6b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbac40098e0 tx=0x7fbac40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2fe3c35b669a48 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:19.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.902+0000 7fbacf7fe700 1 -- 172.21.15.7:0/633945307 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4009e80 con 0x7fbad006c230 2023-10-06T11:00:19.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.902+0000 7fbacf7fe700 1 -- 172.21.15.7:0/633945307 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac400b860 con 0x7fbad006c230 2023-10-06T11:00:19.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.902+0000 7fbacf7fe700 1 -- 172.21.15.7:0/633945307 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac400bbe0 con 0x7fbad006c230 2023-10-06T11:00:19.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.903+0000 7fbad6d79700 1 -- 172.21.15.7:0/633945307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbad006c230 msgr2=0x7fbad006c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:19.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.903+0000 7fbad6d79700 1 --2- 172.21.15.7:0/633945307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbad006c230 0x7fbad006c6b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbac40098e0 tx=0x7fbac40091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:19.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.903+0000 7fbad6d79700 1 -- 172.21.15.7:0/633945307 shutdown_connections 2023-10-06T11:00:19.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.903+0000 7fbad6d79700 1 --2- 172.21.15.7:0/633945307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbad006c230 0x7fbad006c6b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:19.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.903+0000 7fbad6d79700 1 -- 172.21.15.7:0/633945307 >> 172.21.15.7:0/633945307 conn(0x7fbad00cded0 msgr2=0x7fbad00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:19.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.903+0000 7fbad6d79700 1 -- 172.21.15.7:0/633945307 shutdown_connections 2023-10-06T11:00:19.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.903+0000 7fbad6d79700 1 -- 172.21.15.7:0/633945307 wait complete. 2023-10-06T11:00:19.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.904+0000 7fbad6d79700 1 Processor -- start 2023-10-06T11:00:19.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.904+0000 7fbad6d79700 1 -- start start 2023-10-06T11:00:19.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad6d79700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbad006c230 0x7fbad0147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:19.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad6d79700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbad00ae430 0x7fbad01584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:19.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad6d79700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbad00c9040 0x7fbad0158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:19.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad6d79700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad01478d0 con 0x7fbad006c230 2023-10-06T11:00:19.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad6d79700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad0159cb0 con 0x7fbad00c9040 2023-10-06T11:00:19.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad6d79700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad0158100 con 0x7fbad00ae430 2023-10-06T11:00:19.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad4b15700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbad006c230 0x7fbad0147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:19.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad4b15700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbad006c230 0x7fbad0147390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35418/0 (socket says 172.21.15.7:35418) 2023-10-06T11:00:19.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad4b15700 1 -- 172.21.15.7:0/2944822308 learned_addr learned my addr 172.21.15.7:0/2944822308 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:19.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad5316700 1 --2- 172.21.15.7:0/2944822308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbad00c9040 0x7fbad0158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:19.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbacffff700 1 --2- 172.21.15.7:0/2944822308 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbad00ae430 0x7fbad01584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad4b15700 1 -- 172.21.15.7:0/2944822308 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbad00ae430 msgr2=0x7fbad01584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad4b15700 1 --2- 172.21.15.7:0/2944822308 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbad00ae430 0x7fbad01584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad4b15700 1 -- 172.21.15.7:0/2944822308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbad00c9040 msgr2=0x7fbad0158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad4b15700 1 --2- 172.21.15.7:0/2944822308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbad00c9040 0x7fbad0158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.905+0000 7fbad4b15700 1 -- 172.21.15.7:0/2944822308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac4009420 con 0x7fbad006c230 2023-10-06T11:00:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.906+0000 7fbad4b15700 1 --2- 172.21.15.7:0/2944822308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbad006c230 0x7fbad0147390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbac000c590 tx=0x7fbac000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.906+0000 7fbaccff9700 1 -- 172.21.15.7:0/2944822308 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0011590 con 0x7fbad006c230 2023-10-06T11:00:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.906+0000 7fbaccff9700 1 -- 172.21.15.7:0/2944822308 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac00116f0 con 0x7fbad006c230 2023-10-06T11:00:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.906+0000 7fbad6d79700 1 -- 172.21.15.7:0/2944822308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad01590a0 con 0x7fbad006c230 2023-10-06T11:00:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.906+0000 7fbaccff9700 1 -- 172.21.15.7:0/2944822308 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0011ab0 con 0x7fbad006c230 2023-10-06T11:00:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.906+0000 7fbad6d79700 1 -- 172.21.15.7:0/2944822308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad0159660 con 0x7fbad006c230 2023-10-06T11:00:19.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.907+0000 7fbad6d79700 1 -- 172.21.15.7:0/2944822308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad0070480 con 0x7fbad006c230 2023-10-06T11:00:19.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.907+0000 7fbaccff9700 1 -- 172.21.15.7:0/2944822308 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbac001b3b0 con 0x7fbad006c230 2023-10-06T11:00:19.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.908+0000 7fbaccff9700 1 --2- 172.21.15.7:0/2944822308 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbabc066f30 0x7fbabc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:19.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.908+0000 7fbaccff9700 1 -- 172.21.15.7:0/2944822308 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5896+0+0 (secure 0 0 0) 0x7fbac0083ba0 con 0x7fbad006c230 2023-10-06T11:00:19.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.908+0000 7fbacffff700 1 --2- 172.21.15.7:0/2944822308 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbabc066f30 0x7fbabc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:19.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.908+0000 7fbacffff700 1 --2- 172.21.15.7:0/2944822308 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbabc066f30 0x7fbabc0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbad015a330 tx=0x7fbac4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:19.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:19.913+0000 7fbaccff9700 1 -- 172.21.15.7:0/2944822308 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbac0050d50 con 0x7fbad006c230 2023-10-06T11:00:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.116+0000 7fbad6d79700 1 -- 172.21.15.7:0/2944822308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbad00c85e0 con 0x7fbad006c230 2023-10-06T11:00:20.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.742+0000 7fbaccff9700 1 -- 172.21.15.7:0/2944822308 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbac0017070 con 0x7fbad006c230 2023-10-06T11:00:20.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.750+0000 7fbad6d79700 1 -- 172.21.15.7:0/2944822308 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbabc066f30 msgr2=0x7fbabc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:20.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.750+0000 7fbad6d79700 1 --2- 172.21.15.7:0/2944822308 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbabc066f30 0x7fbabc0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbad015a330 tx=0x7fbac4017000 comp rx=0 tx=0).stop 2023-10-06T11:00:20.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.750+0000 7fbad6d79700 1 -- 172.21.15.7:0/2944822308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbad006c230 msgr2=0x7fbad0147390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:20.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.750+0000 7fbad6d79700 1 --2- 172.21.15.7:0/2944822308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbad006c230 0x7fbad0147390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbac000c590 tx=0x7fbac000c950 comp rx=0 tx=0).stop 2023-10-06T11:00:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.750+0000 7fbad6d79700 1 -- 172.21.15.7:0/2944822308 shutdown_connections 2023-10-06T11:00:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.750+0000 7fbad6d79700 1 --2- 172.21.15.7:0/2944822308 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbabc066f30 0x7fbabc0693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.750+0000 7fbad6d79700 1 --2- 172.21.15.7:0/2944822308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbad006c230 0x7fbad0147390 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.750+0000 7fbad6d79700 1 --2- 172.21.15.7:0/2944822308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbad00c9040 0x7fbad0158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.750+0000 7fbad6d79700 1 --2- 172.21.15.7:0/2944822308 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbad00ae430 0x7fbad01584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.750+0000 7fbad6d79700 1 -- 172.21.15.7:0/2944822308 >> 172.21.15.7:0/2944822308 conn(0x7fbad00cded0 msgr2=0x7fbad00afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.751+0000 7fbad6d79700 1 -- 172.21.15.7:0/2944822308 shutdown_connections 2023-10-06T11:00:20.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.751+0000 7fbad6d79700 1 -- 172.21.15.7:0/2944822308 wait complete. 2023-10-06T11:00:20.765 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-06T11:00:20.776 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:00:20.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.912+0000 7f796f47f700 1 Processor -- start 2023-10-06T11:00:20.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.912+0000 7f796f47f700 1 -- start start 2023-10-06T11:00:20.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.913+0000 7f796f47f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f796806dac0 0x7f796815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:20.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.913+0000 7f796f47f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f796806de90 0x7f796815b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:20.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.913+0000 7f796f47f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796815bb80 con 0x7f79680cc670 2023-10-06T11:00:20.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.913+0000 7f796f47f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79680c92c0 con 0x7f796806de90 2023-10-06T11:00:20.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.913+0000 7f796f47f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79680cc1e0 con 0x7f796806dac0 2023-10-06T11:00:20.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.913+0000 7f796ca1a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f796806de90 0x7f796815b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:20.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.913+0000 7f796d21b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f796806dac0 0x7f796815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:20.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.913+0000 7f796da1c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f79680cc670 0x7f79680ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:42418/0 (socket says 172.21.15.7:42418) 2023-10-06T11:00:20.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.913+0000 7f796da1c700 1 -- 172.21.15.7:0/64050710 learned_addr learned my addr 172.21.15.7:0/64050710 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:20.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.914+0000 7f795bfff700 1 -- 172.21.15.7:0/64050710 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735509033 0 0) 0x7f796815bb80 con 0x7f79680cc670 2023-10-06T11:00:20.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.914+0000 7f795bfff700 1 -- 172.21.15.7:0/64050710 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7954003570 con 0x7f79680cc670 2023-10-06T11:00:20.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.914+0000 7f796ca1a700 1 -- 172.21.15.7:0/64050710 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f796806dac0 msgr2=0x7f796815ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:20.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.914+0000 7f796ca1a700 1 --2- 172.21.15.7:0/64050710 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f796806dac0 0x7f796815ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:20.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.914+0000 7f796ca1a700 1 -- 172.21.15.7:0/64050710 >> v1:172.21.15.50:6789/0 conn(0x7f79680cc670 legacy=0x7f79680ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:20.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.914+0000 7f796ca1a700 1 -- 172.21.15.7:0/64050710 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796815b8a0 con 0x7f796806de90 2023-10-06T11:00:20.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.914+0000 7f796d21b700 1 --2- 172.21.15.7:0/64050710 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f796806dac0 0x7f796815ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:20.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.914+0000 7f796ca1a700 1 --2- 172.21.15.7:0/64050710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796806de90 0x7f796815b190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f795c009910 tx=0x7f795c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70eef53cec92d6b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.914+0000 7f795bfff700 1 -- 172.21.15.7:0/64050710 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c011630 con 0x7f796806de90 2023-10-06T11:00:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.914+0000 7f795bfff700 1 -- 172.21.15.7:0/64050710 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c011790 con 0x7f796806de90 2023-10-06T11:00:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.914+0000 7f795bfff700 1 -- 172.21.15.7:0/64050710 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c011b30 con 0x7f796806de90 2023-10-06T11:00:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.915+0000 7f796f47f700 1 -- 172.21.15.7:0/64050710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796806de90 msgr2=0x7f796815b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.915+0000 7f796f47f700 1 --2- 172.21.15.7:0/64050710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796806de90 0x7f796815b190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f795c009910 tx=0x7f795c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.915+0000 7f796f47f700 1 -- 172.21.15.7:0/64050710 shutdown_connections 2023-10-06T11:00:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.915+0000 7f796f47f700 1 --2- 172.21.15.7:0/64050710 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f796806dac0 0x7f796815ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.915+0000 7f796f47f700 1 --2- 172.21.15.7:0/64050710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796806de90 0x7f796815b190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.915+0000 7f796f47f700 1 -- 172.21.15.7:0/64050710 >> 172.21.15.7:0/64050710 conn(0x7f796806cd00 msgr2=0x7f79680cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.915+0000 7f796f47f700 1 -- 172.21.15.7:0/64050710 shutdown_connections 2023-10-06T11:00:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.915+0000 7f796f47f700 1 -- 172.21.15.7:0/64050710 wait complete. 2023-10-06T11:00:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.916+0000 7f796f47f700 1 Processor -- start 2023-10-06T11:00:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.916+0000 7f796f47f700 1 -- start start 2023-10-06T11:00:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.917+0000 7f796f47f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f796806dac0 0x7f79680afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.917+0000 7f796f47f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796806de90 0x7f7968152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.917+0000 7f796f47f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79680cc670 0x7f79680aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.917+0000 7f796f47f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7968153270 con 0x7f79680cc670 2023-10-06T11:00:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.917+0000 7f796f47f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680c4fd0 con 0x7f796806de90 2023-10-06T11:00:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.917+0000 7f796f47f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79680b3830 con 0x7f796806dac0 2023-10-06T11:00:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.917+0000 7f796da1c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79680cc670 0x7f79680aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.917+0000 7f796da1c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79680cc670 0x7f79680aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38826/0 (socket says 172.21.15.7:38826) 2023-10-06T11:00:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.917+0000 7f796da1c700 1 -- 172.21.15.7:0/3839477703 learned_addr learned my addr 172.21.15.7:0/3839477703 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.918+0000 7f796d21b700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f796806dac0 0x7f79680afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.918+0000 7f796ca1a700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796806de90 0x7f7968152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.918+0000 7f796da1c700 1 -- 172.21.15.7:0/3839477703 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f796806dac0 msgr2=0x7f79680afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.918+0000 7f796da1c700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f796806dac0 0x7f79680afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.918+0000 7f796da1c700 1 -- 172.21.15.7:0/3839477703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796806de90 msgr2=0x7f7968152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.918+0000 7f796da1c700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796806de90 0x7f7968152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.918+0000 7f796da1c700 1 -- 172.21.15.7:0/3839477703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7964009420 con 0x7f79680cc670 2023-10-06T11:00:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.918+0000 7f796ca1a700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796806de90 0x7f7968152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.918+0000 7f796da1c700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79680cc670 0x7f79680aecd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7960001460 tx=0x7f7960001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.918+0000 7f79597fa700 1 -- 172.21.15.7:0/3839477703 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796000a950 con 0x7f79680cc670 2023-10-06T11:00:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.918+0000 7f79597fa700 1 -- 172.21.15.7:0/3839477703 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796000aab0 con 0x7f79680cc670 2023-10-06T11:00:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.918+0000 7f796f47f700 1 -- 172.21.15.7:0/3839477703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c009420 con 0x7f79680cc670 2023-10-06T11:00:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.918+0000 7f79597fa700 1 -- 172.21.15.7:0/3839477703 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796000ae30 con 0x7f79680cc670 2023-10-06T11:00:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.918+0000 7f796f47f700 1 -- 172.21.15.7:0/3839477703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79680c5290 con 0x7f79680cc670 2023-10-06T11:00:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.919+0000 7f796f47f700 1 -- 172.21.15.7:0/3839477703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79680c5480 con 0x7f79680cc670 2023-10-06T11:00:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.920+0000 7f79597fa700 1 -- 172.21.15.7:0/3839477703 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7960007300 con 0x7f79680cc670 2023-10-06T11:00:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.920+0000 7f79597fa700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f794c066f30 0x7f794c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.920+0000 7f79597fa700 1 -- 172.21.15.7:0/3839477703 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f7960084cb0 con 0x7f79680cc670 2023-10-06T11:00:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.920+0000 7f796d21b700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f794c066f30 0x7f794c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.921+0000 7f796d21b700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f794c066f30 0x7f794c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f79640093f0 tx=0x7f7964008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:20.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:20.925+0000 7f79597fa700 1 -- 172.21.15.7:0/3839477703 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7960051c50 con 0x7f79680cc670 2023-10-06T11:00:21.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.177+0000 7f796f47f700 1 -- 172.21.15.7:0/3839477703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7968070480 con 0x7f79680cc670 2023-10-06T11:00:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.744+0000 7f79597fa700 1 -- 172.21.15.7:0/3839477703 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v15) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7960055270 con 0x7f79680cc670 2023-10-06T11:00:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.754+0000 7f796f47f700 1 -- 172.21.15.7:0/3839477703 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f794c066f30 msgr2=0x7f794c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.754+0000 7f796f47f700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f794c066f30 0x7f794c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f79640093f0 tx=0x7f7964008040 comp rx=0 tx=0).stop 2023-10-06T11:00:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.754+0000 7f796f47f700 1 -- 172.21.15.7:0/3839477703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79680cc670 msgr2=0x7f79680aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.754+0000 7f796f47f700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79680cc670 0x7f79680aecd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7960001460 tx=0x7f7960001a40 comp rx=0 tx=0).stop 2023-10-06T11:00:21.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.762+0000 7f796f47f700 1 -- 172.21.15.7:0/3839477703 shutdown_connections 2023-10-06T11:00:21.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.762+0000 7f796f47f700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f794c066f30 0x7f794c0693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:21.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.762+0000 7f796f47f700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79680cc670 0x7f79680aecd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:21.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.762+0000 7f796f47f700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f796806dac0 0x7f79680afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:21.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.762+0000 7f796f47f700 1 --2- 172.21.15.7:0/3839477703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796806de90 0x7f7968152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:21.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.762+0000 7f796f47f700 1 -- 172.21.15.7:0/3839477703 >> 172.21.15.7:0/3839477703 conn(0x7f796806cd00 msgr2=0x7f7968157c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:21.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.763+0000 7f796f47f700 1 -- 172.21.15.7:0/3839477703 shutdown_connections 2023-10-06T11:00:21.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.763+0000 7f796f47f700 1 -- 172.21.15.7:0/3839477703 wait complete. 2023-10-06T11:00:21.779 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 6 and data pool 7 2023-10-06T11:00:21.792 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:00:21.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.926+0000 7f2f84052700 1 Processor -- start 2023-10-06T11:00:21.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.926+0000 7f2f84052700 1 -- start start 2023-10-06T11:00:21.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.927+0000 7f2f84052700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f7c0cfb50 0x7f2f7c068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:21.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.927+0000 7f2f84052700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7c0cf6c0 con 0x7f2f7c0af320 2023-10-06T11:00:21.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.927+0000 7f2f84052700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7c0cb750 con 0x7f2f7c069420 2023-10-06T11:00:21.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.927+0000 7f2f84052700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c159c00 con 0x7f2f7c0cfb50 2023-10-06T11:00:21.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.927+0000 7f2f81dee700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2f7c0af320 0x7f2f7c0cb040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53054/0 (socket says 172.21.15.7:53054) 2023-10-06T11:00:21.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.927+0000 7f2f81dee700 1 -- 172.21.15.7:0/234997451 learned_addr learned my addr 172.21.15.7:0/234997451 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:21.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.927+0000 7f2f815ed700 1 --2- 172.21.15.7:0/234997451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f7c0cfb50 0x7f2f7c068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.927+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243668275 0 0) 0x7f2f7c0cf6c0 con 0x7f2f7c0af320 2023-10-06T11:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.927+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f68003570 con 0x7f2f7c0af320 2023-10-06T11:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.927+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834781858 0 0) 0x7f2f7c0cb750 con 0x7f2f7c069420 2023-10-06T11:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.927+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f7c0cf6c0 con 0x7f2f7c069420 2023-10-06T11:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.927+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 231988071 0 0) 0x7f2f68003570 con 0x7f2f7c0af320 2023-10-06T11:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f7c0cfb50 msgr2=0x7f2f7c068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f80dec700 1 --2- 172.21.15.7:0/234997451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f7c0cfb50 0x7f2f7c068ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 >> v1:172.21.15.50:6789/0 conn(0x7f2f7c069420 legacy=0x7f2f7c0afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c0ceab0 con 0x7f2f7c0af320 2023-10-06T11:00:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f2f78001470 con 0x7f2f7c0af320 2023-10-06T11:00:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f815ed700 1 --2- 172.21.15.7:0/234997451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f7c0cfb50 0x7f2f7c068ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 >> v1:172.21.15.7:6789/0 conn(0x7f2f7c0af320 legacy=0x7f2f7c0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f80dec700 1 --2- 172.21.15.7:0/234997451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f7c0cfb50 0x7f2f68003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f80dec700 1 --2- 172.21.15.7:0/234997451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f68004160 0x7f2f68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f80dec700 1 --2- 172.21.15.7:0/234997451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f68004d50 0x7f2f680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c159c00 con 0x7f2f68004160 2023-10-06T11:00:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6800bba0 con 0x7f2f68004d50 2023-10-06T11:00:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6800bd60 con 0x7f2f7c0cfb50 2023-10-06T11:00:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f815ed700 1 --2- 172.21.15.7:0/234997451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f68004160 0x7f2f68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f81dee700 1 --2- 172.21.15.7:0/234997451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f7c0cfb50 0x7f2f68003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f825ef700 1 --2- 172.21.15.7:0/234997451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f68004d50 0x7f2f680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f815ed700 1 -- 172.21.15.7:0/234997451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f7c0cfb50 msgr2=0x7f2f68003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:21.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f815ed700 1 --2- 172.21.15.7:0/234997451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f7c0cfb50 0x7f2f68003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:21.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f815ed700 1 -- 172.21.15.7:0/234997451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f68004d50 msgr2=0x7f2f680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:21.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f815ed700 1 --2- 172.21.15.7:0/234997451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f68004d50 0x7f2f680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:21.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f815ed700 1 -- 172.21.15.7:0/234997451 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c009420 con 0x7f2f68004160 2023-10-06T11:00:21.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f825ef700 1 --2- 172.21.15.7:0/234997451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f68004d50 0x7f2f680051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:21.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f815ed700 1 --2- 172.21.15.7:0/234997451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f68004160 0x7f2f68004810 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0cffa0 tx=0x7f2f6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd69719d35a13f82 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:21.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.928+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c009740 con 0x7f2f68004160 2023-10-06T11:00:21.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.929+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c00e920 con 0x7f2f68004160 2023-10-06T11:00:21.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.929+0000 7f2f80dec700 1 -- 172.21.15.7:0/234997451 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00ecc0 con 0x7f2f68004160 2023-10-06T11:00:21.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.929+0000 7f2f84052700 1 -- 172.21.15.7:0/234997451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f68004160 msgr2=0x7f2f68004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:21.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.929+0000 7f2f84052700 1 --2- 172.21.15.7:0/234997451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f68004160 0x7f2f68004810 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0cffa0 tx=0x7f2f6c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:21.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.929+0000 7f2f825ef700 1 -- 172.21.15.7:0/234997451 reap_dead start 2023-10-06T11:00:21.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.929+0000 7f2f84052700 1 -- 172.21.15.7:0/234997451 shutdown_connections 2023-10-06T11:00:21.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.929+0000 7f2f84052700 1 -- 172.21.15.7:0/234997451 >> 172.21.15.7:0/234997451 conn(0x7f2f7c067b80 msgr2=0x7f2f7c0d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:21.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.929+0000 7f2f84052700 1 -- 172.21.15.7:0/234997451 shutdown_connections 2023-10-06T11:00:21.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.929+0000 7f2f84052700 1 -- 172.21.15.7:0/234997451 wait complete. 2023-10-06T11:00:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.931+0000 7f2f84052700 1 Processor -- start 2023-10-06T11:00:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.931+0000 7f2f84052700 1 -- start start 2023-10-06T11:00:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f84052700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f68004160 0x7f2f7c141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f84052700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c0c53a0 0x7f2f7c0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f84052700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f7c0b5140 0x7f2f7c0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f84052700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0b5eb0 con 0x7f2f68004160 2023-10-06T11:00:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f84052700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0c5d50 con 0x7f2f7c0c53a0 2023-10-06T11:00:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f84052700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c15af80 con 0x7f2f7c0b5140 2023-10-06T11:00:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f81dee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f68004160 0x7f2f7c141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f81dee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f68004160 0x7f2f7c141460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38852/0 (socket says 172.21.15.7:38852) 2023-10-06T11:00:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f81dee700 1 -- 172.21.15.7:0/2505374449 learned_addr learned my addr 172.21.15.7:0/2505374449 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f815ed700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c0c53a0 0x7f2f7c0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f825ef700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f7c0b5140 0x7f2f7c0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f81dee700 1 -- 172.21.15.7:0/2505374449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f7c0b5140 msgr2=0x7f2f7c0b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f81dee700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f7c0b5140 0x7f2f7c0b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f81dee700 1 -- 172.21.15.7:0/2505374449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c0c53a0 msgr2=0x7f2f7c0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f81dee700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c0c53a0 0x7f2f7c0c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f81dee700 1 -- 172.21.15.7:0/2505374449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c15a650 con 0x7f2f68004160 2023-10-06T11:00:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.932+0000 7f2f815ed700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c0c53a0 0x7f2f7c0c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.933+0000 7f2f81dee700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f68004160 0x7f2f7c141460 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2f780073c0 tx=0x7f2f78001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.933+0000 7f2f71ffb700 1 -- 172.21.15.7:0/2505374449 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78018030 con 0x7f2f68004160 2023-10-06T11:00:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.933+0000 7f2f71ffb700 1 -- 172.21.15.7:0/2505374449 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7800f8d0 con 0x7f2f68004160 2023-10-06T11:00:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.933+0000 7f2f71ffb700 1 -- 172.21.15.7:0/2505374449 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800fc70 con 0x7f2f68004160 2023-10-06T11:00:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.933+0000 7f2f84052700 1 -- 172.21.15.7:0/2505374449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7c15a930 con 0x7f2f68004160 2023-10-06T11:00:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.933+0000 7f2f84052700 1 -- 172.21.15.7:0/2505374449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c1419a0 con 0x7f2f68004160 2023-10-06T11:00:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.934+0000 7f2f84052700 1 -- 172.21.15.7:0/2505374449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7c070480 con 0x7f2f68004160 2023-10-06T11:00:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.934+0000 7f2f71ffb700 1 -- 172.21.15.7:0/2505374449 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f7801b070 con 0x7f2f68004160 2023-10-06T11:00:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.935+0000 7f2f71ffb700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2f60066f30 0x7f2f600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:21.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.935+0000 7f2f71ffb700 1 -- 172.21.15.7:0/2505374449 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2f78019070 con 0x7f2f68004160 2023-10-06T11:00:21.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.935+0000 7f2f815ed700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2f60066f30 0x7f2f600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:21.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.935+0000 7f2f815ed700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2f60066f30 0x7f2f600693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0091e0 tx=0x7f2f6c019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:21.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:21.939+0000 7f2f71ffb700 1 -- 172.21.15.7:0/2505374449 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f780516f0 con 0x7f2f68004160 2023-10-06T11:00:22.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.144+0000 7f2f84052700 1 -- 172.21.15.7:0/2505374449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f7c06a000 con 0x7f2f68004160 2023-10-06T11:00:22.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.145+0000 7f2f71ffb700 1 -- 172.21.15.7:0/2505374449 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17084 (secure 0 0 0) 0x7f2f78054d10 con 0x7f2f68004160 2023-10-06T11:00:22.146 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:22.146 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":39,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:00:21.179476+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:00:18.763171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T11:00:20.149563+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:00:22.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.147+0000 7f2f84052700 1 -- 172.21.15.7:0/2505374449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2f60066f30 msgr2=0x7f2f600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:22.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.147+0000 7f2f84052700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2f60066f30 0x7f2f600693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0091e0 tx=0x7f2f6c019000 comp rx=0 tx=0).stop 2023-10-06T11:00:22.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.147+0000 7f2f84052700 1 -- 172.21.15.7:0/2505374449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f68004160 msgr2=0x7f2f7c141460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:22.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.147+0000 7f2f84052700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f68004160 0x7f2f7c141460 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2f780073c0 tx=0x7f2f78001e10 comp rx=0 tx=0).stop 2023-10-06T11:00:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.147+0000 7f2f84052700 1 -- 172.21.15.7:0/2505374449 shutdown_connections 2023-10-06T11:00:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.147+0000 7f2f84052700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2f60066f30 0x7f2f600693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.147+0000 7f2f84052700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f68004160 0x7f2f7c141460 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.147+0000 7f2f84052700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f7c0b5140 0x7f2f7c0b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.147+0000 7f2f84052700 1 --2- 172.21.15.7:0/2505374449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c0c53a0 0x7f2f7c0c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.147+0000 7f2f84052700 1 -- 172.21.15.7:0/2505374449 >> 172.21.15.7:0/2505374449 conn(0x7f2f7c067b80 msgr2=0x7f2f7c0c6390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.147+0000 7f2f84052700 1 -- 172.21.15.7:0/2505374449 shutdown_connections 2023-10-06T11:00:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.147+0000 7f2f84052700 1 -- 172.21.15.7:0/2505374449 wait complete. 2023-10-06T11:00:22.162 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:00:22.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.293+0000 7f6a7e6d5700 1 Processor -- start 2023-10-06T11:00:22.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.293+0000 7f6a7e6d5700 1 -- start start 2023-10-06T11:00:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.293+0000 7f6a7e6d5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a780a6c60 0x7f6a780a7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.293+0000 7f6a7e6d5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a780c8af0 0x7f6a780ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.293+0000 7f6a7e6d5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a780afb40 0x7f6a780ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.293+0000 7f6a7e6d5700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a780ad7f0 con 0x7f6a780c8af0 2023-10-06T11:00:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a7e6d5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a780caa70 con 0x7f6a780afb40 2023-10-06T11:00:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a7e6d5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a780ca460 con 0x7f6a780a6c60 2023-10-06T11:00:22.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a777fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a780c8af0 0x7f6a780ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:22.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a777fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a780c8af0 0x7f6a780ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38862/0 (socket says 172.21.15.7:38862) 2023-10-06T11:00:22.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a777fe700 1 -- 172.21.15.7:0/2755446935 learned_addr learned my addr 172.21.15.7:0/2755446935 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:22.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a7cc72700 1 --2- 172.21.15.7:0/2755446935 >> v2:172.21.15.50:3300/0 conn(0x7f6a780afb40 0x7f6a780ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:22.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a77fff700 1 --2- 172.21.15.7:0/2755446935 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a780a6c60 0x7f6a780a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:22.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a777fe700 1 -- 172.21.15.7:0/2755446935 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a780a6c60 msgr2=0x7f6a780a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:22.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a777fe700 1 --2- 172.21.15.7:0/2755446935 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a780a6c60 0x7f6a780a7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a777fe700 1 -- 172.21.15.7:0/2755446935 >> v2:172.21.15.50:3300/0 conn(0x7f6a780afb40 msgr2=0x7f6a780ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:22.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a777fe700 1 --2- 172.21.15.7:0/2755446935 >> v2:172.21.15.50:3300/0 conn(0x7f6a780afb40 0x7f6a780ae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a777fe700 1 -- 172.21.15.7:0/2755446935 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a780ad9f0 con 0x7f6a780c8af0 2023-10-06T11:00:22.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a77fff700 1 --2- 172.21.15.7:0/2755446935 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a780a6c60 0x7f6a780a7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:22.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a777fe700 1 --2- 172.21.15.7:0/2755446935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a780c8af0 0x7f6a780ae160 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6a78095f60 tx=0x7f6a6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478b2853e3ddf444 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:22.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a76ffd700 1 -- 172.21.15.7:0/2755446935 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00b860 con 0x7f6a780c8af0 2023-10-06T11:00:22.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a76ffd700 1 -- 172.21.15.7:0/2755446935 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c00b9c0 con 0x7f6a780c8af0 2023-10-06T11:00:22.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.294+0000 7f6a76ffd700 1 -- 172.21.15.7:0/2755446935 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00bd60 con 0x7f6a780c8af0 2023-10-06T11:00:22.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.295+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2755446935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a780c8af0 msgr2=0x7f6a780ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:22.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.295+0000 7f6a7e6d5700 1 --2- 172.21.15.7:0/2755446935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a780c8af0 0x7f6a780ae160 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6a78095f60 tx=0x7f6a6c009250 comp rx=0 tx=0).stop 2023-10-06T11:00:22.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.295+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2755446935 shutdown_connections 2023-10-06T11:00:22.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.295+0000 7f6a7e6d5700 1 --2- 172.21.15.7:0/2755446935 >> v2:172.21.15.50:3300/0 conn(0x7f6a780afb40 0x7f6a780ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.295+0000 7f6a7e6d5700 1 --2- 172.21.15.7:0/2755446935 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a780a6c60 0x7f6a780a7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.295+0000 7f6a7e6d5700 1 --2- 172.21.15.7:0/2755446935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a780c8af0 0x7f6a780ae160 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.295+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2755446935 >> 172.21.15.7:0/2755446935 conn(0x7f6a78095a70 msgr2=0x7f6a780af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:22.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.295+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2755446935 shutdown_connections 2023-10-06T11:00:22.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.295+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2755446935 wait complete. 2023-10-06T11:00:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.296+0000 7f6a7e6d5700 1 Processor -- start 2023-10-06T11:00:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.296+0000 7f6a7e6d5700 1 -- start start 2023-10-06T11:00:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.297+0000 7f6a7e6d5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a780a6c60 0x7f6a780a7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.297+0000 7f6a7e6d5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a780afb40 0x7f6a780aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.297+0000 7f6a7e6d5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a780c8af0 0x7f6a780ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.297+0000 7f6a7e6d5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a78152c70 con 0x7f6a780afb40 2023-10-06T11:00:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.297+0000 7f6a7e6d5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a780a7570 con 0x7f6a780a6c60 2023-10-06T11:00:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.297+0000 7f6a7e6d5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7816be70 con 0x7f6a780c8af0 2023-10-06T11:00:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.297+0000 7f6a777fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a780afb40 0x7f6a780aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.297+0000 7f6a777fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a780afb40 0x7f6a780aabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38874/0 (socket says 172.21.15.7:38874) 2023-10-06T11:00:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.297+0000 7f6a777fe700 1 -- 172.21.15.7:0/2616841101 learned_addr learned my addr 172.21.15.7:0/2616841101 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a77fff700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a780a6c60 0x7f6a780a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a7cc72700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a780c8af0 0x7f6a780ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a777fe700 1 -- 172.21.15.7:0/2616841101 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a780c8af0 msgr2=0x7f6a780ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a777fe700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a780c8af0 0x7f6a780ab0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a777fe700 1 -- 172.21.15.7:0/2616841101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a780a6c60 msgr2=0x7f6a780a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a777fe700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a780a6c60 0x7f6a780a7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a777fe700 1 -- 172.21.15.7:0/2616841101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c0094f0 con 0x7f6a780afb40 2023-10-06T11:00:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a77fff700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a780a6c60 0x7f6a780a7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a7cc72700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a780c8af0 0x7f6a780ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a777fe700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a780afb40 0x7f6a780aabb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c006fd0 tx=0x7f6a6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a5ffff700 1 -- 172.21.15.7:0/2616841101 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c01a450 con 0x7f6a780afb40 2023-10-06T11:00:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a5ffff700 1 -- 172.21.15.7:0/2616841101 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c01a5b0 con 0x7f6a780afb40 2023-10-06T11:00:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2616841101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a78152060 con 0x7f6a780afb40 2023-10-06T11:00:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a5ffff700 1 -- 172.21.15.7:0/2616841101 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c01a970 con 0x7f6a780afb40 2023-10-06T11:00:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.298+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2616841101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a78152620 con 0x7f6a780afb40 2023-10-06T11:00:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.299+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2616841101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a78070480 con 0x7f6a780afb40 2023-10-06T11:00:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.300+0000 7f6a5ffff700 1 -- 172.21.15.7:0/2616841101 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a6c01ad20 con 0x7f6a780afb40 2023-10-06T11:00:22.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.300+0000 7f6a5ffff700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a64066f30 0x7f6a640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:22.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.300+0000 7f6a5ffff700 1 -- 172.21.15.7:0/2616841101 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6a6c086540 con 0x7f6a780afb40 2023-10-06T11:00:22.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.300+0000 7f6a77fff700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a64066f30 0x7f6a640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:22.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.301+0000 7f6a77fff700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a64066f30 0x7f6a640693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6a68006fd0 tx=0x7f6a68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:22.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.305+0000 7f6a5ffff700 1 -- 172.21.15.7:0/2616841101 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a6c053510 con 0x7f6a780afb40 2023-10-06T11:00:22.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.506+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2616841101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a780ca700 con 0x7f6a780afb40 2023-10-06T11:00:22.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.506+0000 7f6a5ffff700 1 -- 172.21.15.7:0/2616841101 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17084 (secure 0 0 0) 0x7f6a6c056b30 con 0x7f6a780afb40 2023-10-06T11:00:22.508 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:22.508 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":39,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:00:21.179476+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:00:18.763171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T11:00:20.149563+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:00:22.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.509+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2616841101 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a64066f30 msgr2=0x7f6a640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:22.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.509+0000 7f6a7e6d5700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a64066f30 0x7f6a640693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6a68006fd0 tx=0x7f6a68008040 comp rx=0 tx=0).stop 2023-10-06T11:00:22.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.509+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2616841101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a780afb40 msgr2=0x7f6a780aabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:22.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.509+0000 7f6a7e6d5700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a780afb40 0x7f6a780aabb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c006fd0 tx=0x7f6a6c017000 comp rx=0 tx=0).stop 2023-10-06T11:00:22.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.509+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2616841101 shutdown_connections 2023-10-06T11:00:22.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.509+0000 7f6a7e6d5700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a64066f30 0x7f6a640693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.509+0000 7f6a7e6d5700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a780c8af0 0x7f6a780ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.509+0000 7f6a7e6d5700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a780a6c60 0x7f6a780a7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.509+0000 7f6a7e6d5700 1 --2- 172.21.15.7:0/2616841101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a780afb40 0x7f6a780aabb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.509+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2616841101 >> 172.21.15.7:0/2616841101 conn(0x7f6a78095a70 msgr2=0x7f6a7806c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:22.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.509+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2616841101 shutdown_connections 2023-10-06T11:00:22.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.509+0000 7f6a7e6d5700 1 -- 172.21.15.7:0/2616841101 wait complete. 2023-10-06T11:00:22.523 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:00:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.657+0000 7f61bc8f2700 1 Processor -- start 2023-10-06T11:00:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.657+0000 7f61bc8f2700 1 -- start start 2023-10-06T11:00:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.658+0000 7f61bc8f2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61b806dac0 0x7f61b815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.658+0000 7f61bc8f2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61b806de90 0x7f61b815b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.658+0000 7f61bc8f2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b815bb80 con 0x7f61b80cc670 2023-10-06T11:00:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.658+0000 7f61bc8f2700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b80c92c0 con 0x7f61b806dac0 2023-10-06T11:00:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.658+0000 7f61bc8f2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b80cc1e0 con 0x7f61b806de90 2023-10-06T11:00:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.658+0000 7f61b659c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61b806dac0 0x7f61b815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.658+0000 7f61b659c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61b806dac0 0x7f61b815ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38878/0 (socket says 172.21.15.7:38878) 2023-10-06T11:00:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.658+0000 7f61b659c700 1 -- 172.21.15.7:0/839908692 learned_addr learned my addr 172.21.15.7:0/839908692 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.658+0000 7f61b5d9b700 1 --2- 172.21.15.7:0/839908692 >> v2:172.21.15.50:3300/0 conn(0x7f61b806de90 0x7f61b815b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:22.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.659+0000 7f61b659c700 1 -- 172.21.15.7:0/839908692 >> v2:172.21.15.50:3300/0 conn(0x7f61b806de90 msgr2=0x7f61b815b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:22.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.659+0000 7f61b659c700 1 --2- 172.21.15.7:0/839908692 >> v2:172.21.15.50:3300/0 conn(0x7f61b806de90 0x7f61b815b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.659+0000 7f61b659c700 1 -- 172.21.15.7:0/839908692 >> v1:172.21.15.50:6789/0 conn(0x7f61b80cc670 legacy=0x7f61b80ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:22.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.659+0000 7f61b659c700 1 -- 172.21.15.7:0/839908692 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b815b8a0 con 0x7f61b806dac0 2023-10-06T11:00:22.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.659+0000 7f61b659c700 1 --2- 172.21.15.7:0/839908692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b806dac0 0x7f61b815ac50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f61b806fc90 tx=0x7f61a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7483c8741dad0d4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:22.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.659+0000 7f61b559a700 1 -- 172.21.15.7:0/839908692 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a8009e70 con 0x7f61b806dac0 2023-10-06T11:00:22.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.659+0000 7f61b559a700 1 -- 172.21.15.7:0/839908692 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a800b860 con 0x7f61b806dac0 2023-10-06T11:00:22.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.659+0000 7f61b559a700 1 -- 172.21.15.7:0/839908692 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a800bc00 con 0x7f61b806dac0 2023-10-06T11:00:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.660+0000 7f61bc8f2700 1 -- 172.21.15.7:0/839908692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b806dac0 msgr2=0x7f61b815ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.660+0000 7f61bc8f2700 1 --2- 172.21.15.7:0/839908692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b806dac0 0x7f61b815ac50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f61b806fc90 tx=0x7f61a8009250 comp rx=0 tx=0).stop 2023-10-06T11:00:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.660+0000 7f61bc8f2700 1 -- 172.21.15.7:0/839908692 shutdown_connections 2023-10-06T11:00:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.660+0000 7f61bc8f2700 1 --2- 172.21.15.7:0/839908692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b806dac0 0x7f61b815ac50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.660+0000 7f61bc8f2700 1 --2- 172.21.15.7:0/839908692 >> v2:172.21.15.50:3300/0 conn(0x7f61b806de90 0x7f61b815b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.660+0000 7f61bc8f2700 1 -- 172.21.15.7:0/839908692 >> 172.21.15.7:0/839908692 conn(0x7f61b806cd00 msgr2=0x7f61b80cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.660+0000 7f61bc8f2700 1 -- 172.21.15.7:0/839908692 shutdown_connections 2023-10-06T11:00:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.660+0000 7f61bc8f2700 1 -- 172.21.15.7:0/839908692 wait complete. 2023-10-06T11:00:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.661+0000 7f61bc8f2700 1 Processor -- start 2023-10-06T11:00:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.661+0000 7f61bc8f2700 1 -- start start 2023-10-06T11:00:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.662+0000 7f61bc8f2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b806dac0 0x7f61b814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.662+0000 7f61bc8f2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b806de90 0x7f61b81567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.662+0000 7f61bc8f2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b80cc670 0x7f61b8156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.662+0000 7f61bc8f2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b80c83b0 con 0x7f61b80cc670 2023-10-06T11:00:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.662+0000 7f61bc8f2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b81674a0 con 0x7f61b806dac0 2023-10-06T11:00:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.662+0000 7f61bc8f2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b80b0cc0 con 0x7f61b806de90 2023-10-06T11:00:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61b6d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b80cc670 0x7f61b8156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61b6d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b80cc670 0x7f61b8156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38884/0 (socket says 172.21.15.7:38884) 2023-10-06T11:00:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61b6d9d700 1 -- 172.21.15.7:0/21903773 learned_addr learned my addr 172.21.15.7:0/21903773 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61b659c700 1 --2- 172.21.15.7:0/21903773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b806dac0 0x7f61b814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61b5d9b700 1 --2- 172.21.15.7:0/21903773 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b806de90 0x7f61b81567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61b6d9d700 1 -- 172.21.15.7:0/21903773 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b806de90 msgr2=0x7f61b81567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61b6d9d700 1 --2- 172.21.15.7:0/21903773 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b806de90 0x7f61b81567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61b6d9d700 1 -- 172.21.15.7:0/21903773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b806dac0 msgr2=0x7f61b814d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61b6d9d700 1 --2- 172.21.15.7:0/21903773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b806dac0 0x7f61b814d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61b6d9d700 1 -- 172.21.15.7:0/21903773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a80094f0 con 0x7f61b80cc670 2023-10-06T11:00:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61b6d9d700 1 --2- 172.21.15.7:0/21903773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b80cc670 0x7f61b8156d30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f61b000c840 tx=0x7f61b0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61ae7fc700 1 -- 172.21.15.7:0/21903773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0012630 con 0x7f61b80cc670 2023-10-06T11:00:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61ae7fc700 1 -- 172.21.15.7:0/21903773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b00127b0 con 0x7f61b80cc670 2023-10-06T11:00:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61ae7fc700 1 -- 172.21.15.7:0/21903773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0012b70 con 0x7f61b80cc670 2023-10-06T11:00:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.663+0000 7f61bc8f2700 1 -- 172.21.15.7:0/21903773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b80afd50 con 0x7f61b80cc670 2023-10-06T11:00:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.664+0000 7f61bc8f2700 1 -- 172.21.15.7:0/21903773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b8167690 con 0x7f61b80cc670 2023-10-06T11:00:22.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.664+0000 7f61bc8f2700 1 -- 172.21.15.7:0/21903773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b8070480 con 0x7f61b80cc670 2023-10-06T11:00:22.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.665+0000 7f61ae7fc700 1 -- 172.21.15.7:0/21903773 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61b001a3a0 con 0x7f61b80cc670 2023-10-06T11:00:22.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.665+0000 7f61ae7fc700 1 --2- 172.21.15.7:0/21903773 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6198066f30 0x7f61980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:22.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.666+0000 7f61ae7fc700 1 -- 172.21.15.7:0/21903773 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f61b0084890 con 0x7f61b80cc670 2023-10-06T11:00:22.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.666+0000 7f61b659c700 1 --2- 172.21.15.7:0/21903773 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6198066f30 0x7f61980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:22.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.666+0000 7f61b659c700 1 --2- 172.21.15.7:0/21903773 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6198066f30 0x7f61980693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f61b806fc90 tx=0x7f61a8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:22.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.670+0000 7f61ae7fc700 1 -- 172.21.15.7:0/21903773 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61b0051860 con 0x7f61b80cc670 2023-10-06T11:00:22.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:22.929+0000 7f61bc8f2700 1 -- 172.21.15.7:0/21903773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f61b806f700 con 0x7f61b80cc670 2023-10-06T11:00:23.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.768+0000 7f61ae7fc700 1 -- 172.21.15.7:0/21903773 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f61b0054e80 con 0x7f61b80cc670 2023-10-06T11:00:23.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.771+0000 7f61bc8f2700 1 -- 172.21.15.7:0/21903773 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6198066f30 msgr2=0x7f61980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:23.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.771+0000 7f61bc8f2700 1 --2- 172.21.15.7:0/21903773 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6198066f30 0x7f61980693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f61b806fc90 tx=0x7f61a8017000 comp rx=0 tx=0).stop 2023-10-06T11:00:23.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.771+0000 7f61bc8f2700 1 -- 172.21.15.7:0/21903773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b80cc670 msgr2=0x7f61b8156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:23.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.771+0000 7f61bc8f2700 1 --2- 172.21.15.7:0/21903773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b80cc670 0x7f61b8156d30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f61b000c840 tx=0x7f61b0001670 comp rx=0 tx=0).stop 2023-10-06T11:00:23.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.771+0000 7f61bc8f2700 1 -- 172.21.15.7:0/21903773 shutdown_connections 2023-10-06T11:00:23.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.771+0000 7f61bc8f2700 1 --2- 172.21.15.7:0/21903773 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6198066f30 0x7f61980693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:23.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.771+0000 7f61bc8f2700 1 --2- 172.21.15.7:0/21903773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b80cc670 0x7f61b8156d30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:23.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.771+0000 7f61bc8f2700 1 --2- 172.21.15.7:0/21903773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b806dac0 0x7f61b814d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:23.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.771+0000 7f61bc8f2700 1 --2- 172.21.15.7:0/21903773 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b806de90 0x7f61b81567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:23.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.771+0000 7f61bc8f2700 1 -- 172.21.15.7:0/21903773 >> 172.21.15.7:0/21903773 conn(0x7f61b806cd00 msgr2=0x7f61b80c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:23.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.771+0000 7f61bc8f2700 1 -- 172.21.15.7:0/21903773 shutdown_connections 2023-10-06T11:00:23.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.771+0000 7f61bc8f2700 1 -- 172.21.15.7:0/21903773 wait complete. 2023-10-06T11:00:23.787 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:00:23.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.925+0000 7f6796795700 1 Processor -- start 2023-10-06T11:00:23.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.925+0000 7f6796795700 1 -- start start 2023-10-06T11:00:23.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f6796795700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67900caf10 0x7f6790159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:23.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f6796795700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f679015a300 0x7f679015a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:23.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f6796795700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6790069dd0 con 0x7f67900cab40 2023-10-06T11:00:23.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f6796795700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679006a070 con 0x7f67900caf10 2023-10-06T11:00:23.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f6796795700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679006a350 con 0x7f679015a300 2023-10-06T11:00:23.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f678ffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f67900cab40 0x7f67900694a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53056/0 (socket says 172.21.15.7:53056) 2023-10-06T11:00:23.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f678ffff700 1 -- 172.21.15.7:0/4293346190 learned_addr learned my addr 172.21.15.7:0/4293346190 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:23.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f6794d32700 1 --2- 172.21.15.7:0/4293346190 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f679015a300 0x7f679015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:23.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f678f7fe700 1 --2- 172.21.15.7:0/4293346190 >> v2:172.21.15.50:3300/0 conn(0x7f67900caf10 0x7f6790159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:23.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f678effd700 1 -- 172.21.15.7:0/4293346190 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803481733 0 0) 0x7f6790069dd0 con 0x7f67900cab40 2023-10-06T11:00:23.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f678effd700 1 -- 172.21.15.7:0/4293346190 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6778003570 con 0x7f67900cab40 2023-10-06T11:00:23.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f678effd700 1 -- 172.21.15.7:0/4293346190 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3915593005 0 0) 0x7f6778003570 con 0x7f67900cab40 2023-10-06T11:00:23.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f6794d32700 1 -- 172.21.15.7:0/4293346190 >> v2:172.21.15.50:3300/0 conn(0x7f67900caf10 msgr2=0x7f6790159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:23.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f6794d32700 1 --2- 172.21.15.7:0/4293346190 >> v2:172.21.15.50:3300/0 conn(0x7f67900caf10 0x7f6790159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:23.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f6794d32700 1 -- 172.21.15.7:0/4293346190 >> v1:172.21.15.7:6789/0 conn(0x7f67900cab40 legacy=0x7f67900694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:23.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f6794d32700 1 -- 172.21.15.7:0/4293346190 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67900c7360 con 0x7f679015a300 2023-10-06T11:00:23.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.926+0000 7f678f7fe700 1 --2- 172.21.15.7:0/4293346190 >> v2:172.21.15.50:3300/0 conn(0x7f67900caf10 0x7f6790159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:23.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.927+0000 7f6794d32700 1 --2- 172.21.15.7:0/4293346190 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f679015a300 0x7f679015a780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6788009e60 tx=0x7f6788009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b042988b87523cd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.927+0000 7f678effd700 1 -- 172.21.15.7:0/4293346190 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678800e070 con 0x7f679015a300 2023-10-06T11:00:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.927+0000 7f678effd700 1 -- 172.21.15.7:0/4293346190 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678800b7a0 con 0x7f679015a300 2023-10-06T11:00:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.927+0000 7f678effd700 1 -- 172.21.15.7:0/4293346190 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780001470 con 0x7f679015a300 2023-10-06T11:00:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.927+0000 7f6796795700 1 -- 172.21.15.7:0/4293346190 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f679015a300 msgr2=0x7f679015a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.927+0000 7f6796795700 1 --2- 172.21.15.7:0/4293346190 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f679015a300 0x7f679015a780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6788009e60 tx=0x7f6788009780 comp rx=0 tx=0).stop 2023-10-06T11:00:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.927+0000 7f6796795700 1 -- 172.21.15.7:0/4293346190 shutdown_connections 2023-10-06T11:00:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.927+0000 7f6796795700 1 --2- 172.21.15.7:0/4293346190 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f679015a300 0x7f679015a780 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.927+0000 7f6796795700 1 --2- 172.21.15.7:0/4293346190 >> v2:172.21.15.50:3300/0 conn(0x7f67900caf10 0x7f6790159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:23.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.927+0000 7f6796795700 1 -- 172.21.15.7:0/4293346190 >> 172.21.15.7:0/4293346190 conn(0x7f67900afc90 msgr2=0x7f67900b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:23.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.927+0000 7f6796795700 1 -- 172.21.15.7:0/4293346190 shutdown_connections 2023-10-06T11:00:23.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.928+0000 7f6796795700 1 -- 172.21.15.7:0/4293346190 wait complete. 2023-10-06T11:00:23.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.929+0000 7f6796795700 1 Processor -- start 2023-10-06T11:00:23.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.929+0000 7f6796795700 1 -- start start 2023-10-06T11:00:23.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6796795700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f67900cab40 0x7f67901577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:23.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6796795700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67900caf10 0x7f6790169cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:23.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6796795700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679015a300 0x7f6790151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:23.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6796795700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679016a230 con 0x7f679015a300 2023-10-06T11:00:23.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6796795700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6790157dd0 con 0x7f67900caf10 2023-10-06T11:00:23.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6796795700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67901580b0 con 0x7f67900cab40 2023-10-06T11:00:23.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6794d32700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679015a300 0x7f6790151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:23.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6794d32700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679015a300 0x7f6790151910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38888/0 (socket says 172.21.15.7:38888) 2023-10-06T11:00:23.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6794d32700 1 -- 172.21.15.7:0/2506858720 learned_addr learned my addr 172.21.15.7:0/2506858720 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:23.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f678ffff700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f67900cab40 0x7f67901577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f678f7fe700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67900caf10 0x7f6790169cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6794d32700 1 -- 172.21.15.7:0/2506858720 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f67900cab40 msgr2=0x7f67901577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6794d32700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f67900cab40 0x7f67901577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6794d32700 1 -- 172.21.15.7:0/2506858720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67900caf10 msgr2=0x7f6790169cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6794d32700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67900caf10 0x7f6790169cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6794d32700 1 -- 172.21.15.7:0/2506858720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784009420 con 0x7f679015a300 2023-10-06T11:00:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f678f7fe700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67900caf10 0x7f6790169cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.930+0000 7f6794d32700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679015a300 0x7f6790151910 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f679006a490 tx=0x7f6788018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.931+0000 7f6777fff700 1 -- 172.21.15.7:0/2506858720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788012d20 con 0x7f679015a300 2023-10-06T11:00:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.931+0000 7f6777fff700 1 -- 172.21.15.7:0/2506858720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678801d430 con 0x7f679015a300 2023-10-06T11:00:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.931+0000 7f6796795700 1 -- 172.21.15.7:0/2506858720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6788009a20 con 0x7f679015a300 2023-10-06T11:00:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.931+0000 7f6777fff700 1 -- 172.21.15.7:0/2506858720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678801d7f0 con 0x7f679015a300 2023-10-06T11:00:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.931+0000 7f6796795700 1 -- 172.21.15.7:0/2506858720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6790158670 con 0x7f679015a300 2023-10-06T11:00:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.932+0000 7f6796795700 1 -- 172.21.15.7:0/2506858720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6790070480 con 0x7f679015a300 2023-10-06T11:00:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.932+0000 7f6777fff700 1 -- 172.21.15.7:0/2506858720 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6788024070 con 0x7f679015a300 2023-10-06T11:00:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.932+0000 7f6777fff700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f677c066f30 0x7f677c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.933+0000 7f6777fff700 1 -- 172.21.15.7:0/2506858720 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6788086b10 con 0x7f679015a300 2023-10-06T11:00:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.933+0000 7f678ffff700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f677c066f30 0x7f677c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.933+0000 7f678ffff700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f677c066f30 0x7f677c0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6780001ed0 tx=0x7f6780001520 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:23.937+0000 7f6777fff700 1 -- 172.21.15.7:0/2506858720 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6788053ae0 con 0x7f679015a300 2023-10-06T11:00:24.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.184+0000 7f6796795700 1 -- 172.21.15.7:0/2506858720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f679015a830 con 0x7f679015a300 2023-10-06T11:00:24.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.774+0000 7f6777fff700 1 -- 172.21.15.7:0/2506858720 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6788057100 con 0x7f679015a300 2023-10-06T11:00:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.777+0000 7f6796795700 1 -- 172.21.15.7:0/2506858720 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f677c066f30 msgr2=0x7f677c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.777+0000 7f6796795700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f677c066f30 0x7f677c0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6780001ed0 tx=0x7f6780001520 comp rx=0 tx=0).stop 2023-10-06T11:00:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.777+0000 7f6796795700 1 -- 172.21.15.7:0/2506858720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679015a300 msgr2=0x7f6790151910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.777+0000 7f6796795700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679015a300 0x7f6790151910 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f679006a490 tx=0x7f6788018000 comp rx=0 tx=0).stop 2023-10-06T11:00:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.777+0000 7f6796795700 1 -- 172.21.15.7:0/2506858720 shutdown_connections 2023-10-06T11:00:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.777+0000 7f6796795700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f677c066f30 0x7f677c0693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.777+0000 7f6796795700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679015a300 0x7f6790151910 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.777+0000 7f6796795700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f67900cab40 0x7f67901577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.777+0000 7f6796795700 1 --2- 172.21.15.7:0/2506858720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67900caf10 0x7f6790169cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.777+0000 7f6796795700 1 -- 172.21.15.7:0/2506858720 >> 172.21.15.7:0/2506858720 conn(0x7f67900afc90 msgr2=0x7f679006c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.777+0000 7f6796795700 1 -- 172.21.15.7:0/2506858720 shutdown_connections 2023-10-06T11:00:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.777+0000 7f6796795700 1 -- 172.21.15.7:0/2506858720 wait complete. 2023-10-06T11:00:24.793 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:00:24.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.928+0000 7f2b9f2dd700 1 Processor -- start 2023-10-06T11:00:24.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.928+0000 7f2b9f2dd700 1 -- start start 2023-10-06T11:00:24.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.929+0000 7f2b9f2dd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b980c8d70 0x7f2b980ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:24.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.929+0000 7f2b9f2dd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2b980cac60 0x7f2b980cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:24.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.929+0000 7f2b9f2dd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b980cbd10 con 0x7f2b98158120 2023-10-06T11:00:24.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.929+0000 7f2b9f2dd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b980cb9e0 con 0x7f2b980c8d70 2023-10-06T11:00:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.929+0000 7f2b9f2dd700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b980c9300 con 0x7f2b980cac60 2023-10-06T11:00:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.930+0000 7f2b9c878700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b980c8d70 0x7f2b980ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.930+0000 7f2b9d87a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2b980cac60 0x7f2b980cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.930+0000 7f2b9c878700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b980c8d70 0x7f2b980ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:35626/0 (socket says 172.21.15.7:35626) 2023-10-06T11:00:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.930+0000 7f2b9d87a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2b980cac60 0x7f2b980cc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:55400/0 (socket says 172.21.15.7:55400) 2023-10-06T11:00:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.930+0000 7f2b9c878700 1 -- 172.21.15.7:0/4292984678 learned_addr learned my addr 172.21.15.7:0/4292984678 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.930+0000 7f2b9d079700 1 --1- 172.21.15.7:0/4292984678 >> v1:172.21.15.50:6789/0 conn(0x7f2b98158120 0x7f2b980c8660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:42460/0 (socket says 172.21.15.7:42460) 2023-10-06T11:00:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.930+0000 7f2b9c878700 1 -- 172.21.15.7:0/4292984678 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2b980cac60 msgr2=0x7f2b980cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.930+0000 7f2b9c878700 1 --2- 172.21.15.7:0/4292984678 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2b980cac60 0x7f2b980cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:24.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.930+0000 7f2b9c878700 1 -- 172.21.15.7:0/4292984678 >> v1:172.21.15.50:6789/0 conn(0x7f2b98158120 legacy=0x7f2b980c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:24.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.930+0000 7f2b9c878700 1 -- 172.21.15.7:0/4292984678 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b980c95e0 con 0x7f2b980c8d70 2023-10-06T11:00:24.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.930+0000 7f2b9d87a700 1 --2- 172.21.15.7:0/4292984678 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2b980cac60 0x7f2b980cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:24.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.930+0000 7f2b8bfff700 1 -- 172.21.15.7:0/4292984678 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155159400 0 0) 0x7f2b980cbd10 con 0x7f2b98158120 2023-10-06T11:00:24.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.930+0000 7f2b9c878700 1 --2- 172.21.15.7:0/4292984678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b980c8d70 0x7f2b980ca720 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0099b0 tx=0x7f2b8c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82235b77b608e813 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:24.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.930+0000 7f2b8bfff700 1 -- 172.21.15.7:0/4292984678 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c009ea0 con 0x7f2b980c8d70 2023-10-06T11:00:24.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.931+0000 7f2b8bfff700 1 -- 172.21.15.7:0/4292984678 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c00b860 con 0x7f2b980c8d70 2023-10-06T11:00:24.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.931+0000 7f2b8bfff700 1 -- 172.21.15.7:0/4292984678 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c00bc00 con 0x7f2b980c8d70 2023-10-06T11:00:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.931+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/4292984678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b980c8d70 msgr2=0x7f2b980ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.931+0000 7f2b9f2dd700 1 --2- 172.21.15.7:0/4292984678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b980c8d70 0x7f2b980ca720 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0099b0 tx=0x7f2b8c009250 comp rx=0 tx=0).stop 2023-10-06T11:00:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.931+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/4292984678 shutdown_connections 2023-10-06T11:00:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.931+0000 7f2b9f2dd700 1 --2- 172.21.15.7:0/4292984678 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2b980cac60 0x7f2b980cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.931+0000 7f2b9f2dd700 1 --2- 172.21.15.7:0/4292984678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b980c8d70 0x7f2b980ca720 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.931+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/4292984678 >> 172.21.15.7:0/4292984678 conn(0x7f2b98087920 msgr2=0x7f2b98097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.931+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/4292984678 shutdown_connections 2023-10-06T11:00:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.931+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/4292984678 wait complete. 2023-10-06T11:00:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.932+0000 7f2b9f2dd700 1 Processor -- start 2023-10-06T11:00:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.932+0000 7f2b9f2dd700 1 -- start start 2023-10-06T11:00:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.933+0000 7f2b9f2dd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2b980c8d70 0x7f2b980c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.933+0000 7f2b9f2dd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b980cac60 0x7f2b98168b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.933+0000 7f2b9f2dd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b98158120 0x7f2b980c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.933+0000 7f2b9f2dd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b980af0c0 con 0x7f2b980cac60 2023-10-06T11:00:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.933+0000 7f2b9f2dd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b980ae4b0 con 0x7f2b98158120 2023-10-06T11:00:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.933+0000 7f2b9f2dd700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b980ae790 con 0x7f2b980c8d70 2023-10-06T11:00:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b9c878700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b980cac60 0x7f2b98168b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b9c878700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b980cac60 0x7f2b98168b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38902/0 (socket says 172.21.15.7:38902) 2023-10-06T11:00:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b9c878700 1 -- 172.21.15.7:0/1522234814 learned_addr learned my addr 172.21.15.7:0/1522234814 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b9d87a700 1 --2- 172.21.15.7:0/1522234814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b98158120 0x7f2b980c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b9d079700 1 --2- 172.21.15.7:0/1522234814 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2b980c8d70 0x7f2b980c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b9c878700 1 -- 172.21.15.7:0/1522234814 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2b980c8d70 msgr2=0x7f2b980c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b9c878700 1 --2- 172.21.15.7:0/1522234814 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2b980c8d70 0x7f2b980c5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b9c878700 1 -- 172.21.15.7:0/1522234814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b98158120 msgr2=0x7f2b980c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b9c878700 1 --2- 172.21.15.7:0/1522234814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b98158120 0x7f2b980c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b9c878700 1 -- 172.21.15.7:0/1522234814 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b90009a20 con 0x7f2b980cac60 2023-10-06T11:00:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b9c878700 1 --2- 172.21.15.7:0/1522234814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b980cac60 0x7f2b98168b10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c006fd0 tx=0x7f2b8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b897fa700 1 -- 172.21.15.7:0/1522234814 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c00b9d0 con 0x7f2b980cac60 2023-10-06T11:00:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b897fa700 1 -- 172.21.15.7:0/1522234814 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c00bb50 con 0x7f2b980cac60 2023-10-06T11:00:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/1522234814 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c0094f0 con 0x7f2b980cac60 2023-10-06T11:00:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b897fa700 1 -- 172.21.15.7:0/1522234814 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c025670 con 0x7f2b980cac60 2023-10-06T11:00:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.934+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/1522234814 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b980aed50 con 0x7f2b980cac60 2023-10-06T11:00:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.936+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/1522234814 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b98070480 con 0x7f2b980cac60 2023-10-06T11:00:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.936+0000 7f2b897fa700 1 -- 172.21.15.7:0/1522234814 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b8c023070 con 0x7f2b980cac60 2023-10-06T11:00:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.936+0000 7f2b897fa700 1 --2- 172.21.15.7:0/1522234814 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2b7c066f30 0x7f2b7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.936+0000 7f2b897fa700 1 -- 172.21.15.7:0/1522234814 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2b8c085c90 con 0x7f2b980cac60 2023-10-06T11:00:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.936+0000 7f2b9d079700 1 --2- 172.21.15.7:0/1522234814 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2b7c066f30 0x7f2b7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.937+0000 7f2b9d079700 1 --2- 172.21.15.7:0/1522234814 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2b7c066f30 0x7f2b7c0693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2b94007fd0 tx=0x7f2b94007f40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:24.941+0000 7f2b897fa700 1 -- 172.21.15.7:0/1522234814 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b8c052d20 con 0x7f2b980cac60 2023-10-06T11:00:25.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.192+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/1522234814 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b980c98c0 con 0x7f2b980cac60 2023-10-06T11:00:25.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.192+0000 7f2b897fa700 1 -- 172.21.15.7:0/1522234814 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4585 (secure 0 0 0) 0x7f2b8c02a090 con 0x7f2b980cac60 2023-10-06T11:00:25.193 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:25.193 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/904048408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":904048408},{"type":"v1","addr":"172.21.15.50:6834","nonce":904048408}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5062,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/949655295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":949655295},{"type":"v1","addr":"172.21.15.50:6835","nonce":949655295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1576009113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1576009113},{"type":"v1","addr":"172.21.15.7:6835","nonce":1576009113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:00:21.179899+0000","modified":"2023-10-06T11:00:24.767544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5130":{"gid":5130,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1573170028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1573170028},{"type":"v1","addr":"172.21.15.7:6837","nonce":1573170028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:00:25.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.194+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/1522234814 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2b7c066f30 msgr2=0x7f2b7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.194+0000 7f2b9f2dd700 1 --2- 172.21.15.7:0/1522234814 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2b7c066f30 0x7f2b7c0693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2b94007fd0 tx=0x7f2b94007f40 comp rx=0 tx=0).stop 2023-10-06T11:00:25.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.194+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/1522234814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b980cac60 msgr2=0x7f2b98168b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.194+0000 7f2b9f2dd700 1 --2- 172.21.15.7:0/1522234814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b980cac60 0x7f2b98168b10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c006fd0 tx=0x7f2b8c017000 comp rx=0 tx=0).stop 2023-10-06T11:00:25.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.194+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/1522234814 shutdown_connections 2023-10-06T11:00:25.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.194+0000 7f2b9f2dd700 1 --2- 172.21.15.7:0/1522234814 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2b7c066f30 0x7f2b7c0693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.194+0000 7f2b9f2dd700 1 --2- 172.21.15.7:0/1522234814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b98158120 0x7f2b980c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.194+0000 7f2b9f2dd700 1 --2- 172.21.15.7:0/1522234814 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2b980c8d70 0x7f2b980c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.194+0000 7f2b9f2dd700 1 --2- 172.21.15.7:0/1522234814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b980cac60 0x7f2b98168b10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.194+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/1522234814 >> 172.21.15.7:0/1522234814 conn(0x7f2b98087920 msgr2=0x7f2b980ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:25.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.195+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/1522234814 shutdown_connections 2023-10-06T11:00:25.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.195+0000 7f2b9f2dd700 1 -- 172.21.15.7:0/1522234814 wait complete. 2023-10-06T11:00:25.197 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 19 2023-10-06T11:00:25.208 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:00:25.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.340+0000 7f9777a89700 1 Processor -- start 2023-10-06T11:00:25.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.340+0000 7f9777a89700 1 -- start start 2023-10-06T11:00:25.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.341+0000 7f9777a89700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97701619d0 0x7f977015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:25.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.341+0000 7f9777a89700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f977015edf0 0x7f9770067980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:25.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.341+0000 7f9777a89700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977006a1f0 con 0x7f977015d4d0 2023-10-06T11:00:25.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.341+0000 7f9777a89700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9770162130 con 0x7f97701619d0 2023-10-06T11:00:25.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.341+0000 7f9777a89700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97700695e0 con 0x7f977015edf0 2023-10-06T11:00:25.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.341+0000 7f9775024700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97701619d0 0x7f977015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:25.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.341+0000 7f9776026700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f977015edf0 0x7f9770067980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:25.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.341+0000 7f9775825700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f977015d4d0 0x7f97701612c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:42470/0 (socket says 172.21.15.7:42470) 2023-10-06T11:00:25.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.341+0000 7f9775825700 1 -- 172.21.15.7:0/663452812 learned_addr learned my addr 172.21.15.7:0/663452812 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:25.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.341+0000 7f9775024700 1 --2- 172.21.15.7:0/663452812 >> v2:172.21.15.50:3300/0 conn(0x7f97701619d0 0x7f977015e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:35644/0 (socket says 172.21.15.7:35644) 2023-10-06T11:00:25.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.341+0000 7f9776026700 1 -- 172.21.15.7:0/663452812 >> v2:172.21.15.50:3300/0 conn(0x7f97701619d0 msgr2=0x7f977015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:25.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.341+0000 7f9776026700 1 --2- 172.21.15.7:0/663452812 >> v2:172.21.15.50:3300/0 conn(0x7f97701619d0 0x7f977015e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.341+0000 7f9776026700 1 -- 172.21.15.7:0/663452812 >> v1:172.21.15.50:6789/0 conn(0x7f977015d4d0 legacy=0x7f97701612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.342+0000 7f9774823700 1 -- 172.21.15.7:0/663452812 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011862443 0 0) 0x7f977006a1f0 con 0x7f977015d4d0 2023-10-06T11:00:25.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.342+0000 7f9776026700 1 -- 172.21.15.7:0/663452812 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97700698c0 con 0x7f977015edf0 2023-10-06T11:00:25.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.342+0000 7f9775024700 1 --2- 172.21.15.7:0/663452812 >> v2:172.21.15.50:3300/0 conn(0x7f97701619d0 0x7f977015e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:25.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.342+0000 7f9776026700 1 --2- 172.21.15.7:0/663452812 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f977015edf0 0x7f9770067980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9768009e60 tx=0x7f9768009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aab85b9ab02d4677 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:25.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.342+0000 7f9774823700 1 -- 172.21.15.7:0/663452812 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976800e070 con 0x7f977015edf0 2023-10-06T11:00:25.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.342+0000 7f9774823700 1 -- 172.21.15.7:0/663452812 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976800bb60 con 0x7f977015edf0 2023-10-06T11:00:25.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.342+0000 7f9774823700 1 -- 172.21.15.7:0/663452812 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768012430 con 0x7f977015edf0 2023-10-06T11:00:25.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.342+0000 7f9777a89700 1 -- 172.21.15.7:0/663452812 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f977015edf0 msgr2=0x7f9770067980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.342+0000 7f9777a89700 1 --2- 172.21.15.7:0/663452812 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f977015edf0 0x7f9770067980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9768009e60 tx=0x7f9768009780 comp rx=0 tx=0).stop 2023-10-06T11:00:25.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.343+0000 7f9777a89700 1 -- 172.21.15.7:0/663452812 shutdown_connections 2023-10-06T11:00:25.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.343+0000 7f9777a89700 1 --2- 172.21.15.7:0/663452812 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f977015edf0 0x7f9770067980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.343+0000 7f9777a89700 1 --2- 172.21.15.7:0/663452812 >> v2:172.21.15.50:3300/0 conn(0x7f97701619d0 0x7f977015e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.343+0000 7f9777a89700 1 -- 172.21.15.7:0/663452812 >> 172.21.15.7:0/663452812 conn(0x7f9770096160 msgr2=0x7f97700afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:25.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.343+0000 7f9777a89700 1 -- 172.21.15.7:0/663452812 shutdown_connections 2023-10-06T11:00:25.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.343+0000 7f9777a89700 1 -- 172.21.15.7:0/663452812 wait complete. 2023-10-06T11:00:25.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.344+0000 7f9777a89700 1 Processor -- start 2023-10-06T11:00:25.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.344+0000 7f9777a89700 1 -- start start 2023-10-06T11:00:25.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9777a89700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f977015d4d0 0x7f9770154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:25.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9777a89700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f977015edf0 0x7f977006b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:25.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9777a89700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97701619d0 0x7f977006bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:25.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9777a89700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9770159610 con 0x7f977015d4d0 2023-10-06T11:00:25.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9777a89700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97700ae390 con 0x7f97701619d0 2023-10-06T11:00:25.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9777a89700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97700ae670 con 0x7f977015edf0 2023-10-06T11:00:25.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9775825700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f977015d4d0 0x7f9770154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9775825700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f977015d4d0 0x7f9770154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38904/0 (socket says 172.21.15.7:38904) 2023-10-06T11:00:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9775825700 1 -- 172.21.15.7:0/464731756 learned_addr learned my addr 172.21.15.7:0/464731756 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9776026700 1 --2- 172.21.15.7:0/464731756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97701619d0 0x7f977006bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9775024700 1 --2- 172.21.15.7:0/464731756 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f977015edf0 0x7f977006b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9775825700 1 -- 172.21.15.7:0/464731756 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f977015edf0 msgr2=0x7f977006b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9775825700 1 --2- 172.21.15.7:0/464731756 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f977015edf0 0x7f977006b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9775825700 1 -- 172.21.15.7:0/464731756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97701619d0 msgr2=0x7f977006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9775825700 1 --2- 172.21.15.7:0/464731756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97701619d0 0x7f977006bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9775825700 1 -- 172.21.15.7:0/464731756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c009420 con 0x7f977015d4d0 2023-10-06T11:00:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.345+0000 7f9775825700 1 --2- 172.21.15.7:0/464731756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f977015d4d0 0x7f9770154220 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f976400c7e0 tx=0x7f9764007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.346+0000 7f9761ffb700 1 -- 172.21.15.7:0/464731756 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764005b30 con 0x7f977015d4d0 2023-10-06T11:00:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.346+0000 7f9761ffb700 1 -- 172.21.15.7:0/464731756 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764005c90 con 0x7f977015d4d0 2023-10-06T11:00:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.346+0000 7f9777a89700 1 -- 172.21.15.7:0/464731756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9768009a20 con 0x7f977015d4d0 2023-10-06T11:00:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.346+0000 7f9761ffb700 1 -- 172.21.15.7:0/464731756 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764007300 con 0x7f977015d4d0 2023-10-06T11:00:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.346+0000 7f9777a89700 1 -- 172.21.15.7:0/464731756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9770154760 con 0x7f977015d4d0 2023-10-06T11:00:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.347+0000 7f9777a89700 1 -- 172.21.15.7:0/464731756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97701597e0 con 0x7f977015d4d0 2023-10-06T11:00:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.347+0000 7f9761ffb700 1 -- 172.21.15.7:0/464731756 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f976401b3b0 con 0x7f977015d4d0 2023-10-06T11:00:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.348+0000 7f9761ffb700 1 --2- 172.21.15.7:0/464731756 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9754066f30 0x7f97540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.348+0000 7f9761ffb700 1 -- 172.21.15.7:0/464731756 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9764083cf0 con 0x7f977015d4d0 2023-10-06T11:00:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.348+0000 7f9775024700 1 --2- 172.21.15.7:0/464731756 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9754066f30 0x7f97540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.348+0000 7f9775024700 1 --2- 172.21.15.7:0/464731756 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9754066f30 0x7f97540693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f97700af3d0 tx=0x7f976c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.352+0000 7f9761ffb700 1 -- 172.21.15.7:0/464731756 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97701597e0 con 0x7f977015d4d0 2023-10-06T11:00:25.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.554+0000 7f9777a89700 1 -- 172.21.15.7:0/464731756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9770069380 con 0x7f977015d4d0 2023-10-06T11:00:25.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.555+0000 7f9761ffb700 1 -- 172.21.15.7:0/464731756 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f9764017020 con 0x7f977015d4d0 2023-10-06T11:00:25.556 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:25.557 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":40,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:00:22.740341+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:00:18.763171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T11:00:20.149563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:00:25.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.558+0000 7f9777a89700 1 -- 172.21.15.7:0/464731756 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9754066f30 msgr2=0x7f97540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.558+0000 7f9777a89700 1 --2- 172.21.15.7:0/464731756 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9754066f30 0x7f97540693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f97700af3d0 tx=0x7f976c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.558+0000 7f9777a89700 1 -- 172.21.15.7:0/464731756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f977015d4d0 msgr2=0x7f9770154220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.558+0000 7f9777a89700 1 --2- 172.21.15.7:0/464731756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f977015d4d0 0x7f9770154220 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f976400c7e0 tx=0x7f9764007df0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.558+0000 7f9777a89700 1 -- 172.21.15.7:0/464731756 shutdown_connections 2023-10-06T11:00:25.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.558+0000 7f9777a89700 1 --2- 172.21.15.7:0/464731756 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9754066f30 0x7f97540693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.558+0000 7f9777a89700 1 --2- 172.21.15.7:0/464731756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f977015d4d0 0x7f9770154220 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.558+0000 7f9777a89700 1 --2- 172.21.15.7:0/464731756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97701619d0 0x7f977006bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.558+0000 7f9777a89700 1 --2- 172.21.15.7:0/464731756 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f977015edf0 0x7f977006b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.558+0000 7f9777a89700 1 -- 172.21.15.7:0/464731756 >> 172.21.15.7:0/464731756 conn(0x7f9770096160 msgr2=0x7f977015d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:25.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.558+0000 7f9777a89700 1 -- 172.21.15.7:0/464731756 shutdown_connections 2023-10-06T11:00:25.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.558+0000 7f9777a89700 1 -- 172.21.15.7:0/464731756 wait complete. 2023-10-06T11:00:25.573 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:00:25.573 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:00:25.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.705+0000 7f0ec30da700 1 Processor -- start 2023-10-06T11:00:25.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.705+0000 7f0ec30da700 1 -- start start 2023-10-06T11:00:25.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ec30da700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ebc15ce10 0x7f0ebc15d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:25.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ec30da700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc15d7c0 con 0x7f0ebc1594a0 2023-10-06T11:00:25.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ec30da700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc0694d0 con 0x7f0ebc1590d0 2023-10-06T11:00:25.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ec30da700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc068990 con 0x7f0ebc15ce10 2023-10-06T11:00:25.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ec1677700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0ebc1594a0 0x7f0ebc159920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53066/0 (socket says 172.21.15.7:53066) 2023-10-06T11:00:25.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ec1677700 1 -- 172.21.15.7:0/1414307805 learned_addr learned my addr 172.21.15.7:0/1414307805 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:25.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ebbfff700 1 --2- 172.21.15.7:0/1414307805 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ebc15ce10 0x7f0ebc15d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:25.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ebb7fe700 1 -- 172.21.15.7:0/1414307805 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100641425 0 0) 0x7f0ebc15d7c0 con 0x7f0ebc1594a0 2023-10-06T11:00:25.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ebb7fe700 1 -- 172.21.15.7:0/1414307805 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea8003570 con 0x7f0ebc1594a0 2023-10-06T11:00:25.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ebb7fe700 1 -- 172.21.15.7:0/1414307805 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691603488 0 0) 0x7f0ebc0694d0 con 0x7f0ebc1590d0 2023-10-06T11:00:25.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ebb7fe700 1 -- 172.21.15.7:0/1414307805 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ebc15d7c0 con 0x7f0ebc1590d0 2023-10-06T11:00:25.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ebbfff700 1 -- 172.21.15.7:0/1414307805 >> v1:172.21.15.50:6789/0 conn(0x7f0ebc1590d0 legacy=0x7f0ebc069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ebbfff700 1 -- 172.21.15.7:0/1414307805 >> v1:172.21.15.7:6789/0 conn(0x7f0ebc1594a0 legacy=0x7f0ebc159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ebbfff700 1 -- 172.21.15.7:0/1414307805 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc068ba0 con 0x7f0ebc15ce10 2023-10-06T11:00:25.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.706+0000 7f0ebbfff700 1 --2- 172.21.15.7:0/1414307805 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ebc15ce10 0x7f0ebc15d280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009910 tx=0x7f0ea40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da67b918b5b6bcbf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:25.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.707+0000 7f0ebb7fe700 1 -- 172.21.15.7:0/1414307805 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4011630 con 0x7f0ebc15ce10 2023-10-06T11:00:25.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.707+0000 7f0ebb7fe700 1 -- 172.21.15.7:0/1414307805 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea4011790 con 0x7f0ebc15ce10 2023-10-06T11:00:25.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.707+0000 7f0ebb7fe700 1 -- 172.21.15.7:0/1414307805 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4011b30 con 0x7f0ebc15ce10 2023-10-06T11:00:25.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.707+0000 7f0ec30da700 1 -- 172.21.15.7:0/1414307805 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ebc15ce10 msgr2=0x7f0ebc15d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.707+0000 7f0ec30da700 1 --2- 172.21.15.7:0/1414307805 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ebc15ce10 0x7f0ebc15d280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009910 tx=0x7f0ea40091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.707+0000 7f0ec30da700 1 -- 172.21.15.7:0/1414307805 shutdown_connections 2023-10-06T11:00:25.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.707+0000 7f0ec30da700 1 --2- 172.21.15.7:0/1414307805 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ebc15ce10 0x7f0ebc15d280 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.707+0000 7f0ec30da700 1 -- 172.21.15.7:0/1414307805 >> 172.21.15.7:0/1414307805 conn(0x7f0ebc096160 msgr2=0x7f0ebc0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:25.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.707+0000 7f0ec30da700 1 -- 172.21.15.7:0/1414307805 shutdown_connections 2023-10-06T11:00:25.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.707+0000 7f0ec30da700 1 -- 172.21.15.7:0/1414307805 wait complete. 2023-10-06T11:00:25.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.709+0000 7f0ec30da700 1 Processor -- start 2023-10-06T11:00:25.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.709+0000 7f0ec30da700 1 -- start start 2023-10-06T11:00:25.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ec30da700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ebc1590d0 0x7f0ebc150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:25.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ec30da700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ebc1594a0 0x7f0ebc14ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:25.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ec30da700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ebc15ce10 0x7f0ebc1699f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:25.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ec30da700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc14cf80 con 0x7f0ebc1594a0 2023-10-06T11:00:25.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ec30da700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0ace30 con 0x7f0ebc15ce10 2023-10-06T11:00:25.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ec30da700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc169f30 con 0x7f0ebc1590d0 2023-10-06T11:00:25.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ebbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ebc1594a0 0x7f0ebc14ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:25.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ebbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ebc1594a0 0x7f0ebc14ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38916/0 (socket says 172.21.15.7:38916) 2023-10-06T11:00:25.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ebbfff700 1 -- 172.21.15.7:0/314269829 learned_addr learned my addr 172.21.15.7:0/314269829 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:25.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ec1677700 1 --2- 172.21.15.7:0/314269829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ebc15ce10 0x7f0ebc1699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:25.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ec0e76700 1 --2- 172.21.15.7:0/314269829 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ebc1590d0 0x7f0ebc150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:25.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ebbfff700 1 -- 172.21.15.7:0/314269829 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ebc1590d0 msgr2=0x7f0ebc150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ebbfff700 1 --2- 172.21.15.7:0/314269829 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ebc1590d0 0x7f0ebc150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ebbfff700 1 -- 172.21.15.7:0/314269829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ebc15ce10 msgr2=0x7f0ebc1699f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ebbfff700 1 --2- 172.21.15.7:0/314269829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ebc15ce10 0x7f0ebc1699f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ebbfff700 1 -- 172.21.15.7:0/314269829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea4009420 con 0x7f0ebc1594a0 2023-10-06T11:00:25.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.710+0000 7f0ebbfff700 1 --2- 172.21.15.7:0/314269829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ebc1594a0 0x7f0ebc14ca40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009f00 tx=0x7f0ea4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:25.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.711+0000 7f0eb8ff9700 1 -- 172.21.15.7:0/314269829 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea401f070 con 0x7f0ebc1594a0 2023-10-06T11:00:25.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.711+0000 7f0eb8ff9700 1 -- 172.21.15.7:0/314269829 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea4002f70 con 0x7f0ebc1594a0 2023-10-06T11:00:25.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.711+0000 7f0ec30da700 1 -- 172.21.15.7:0/314269829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ebc16a200 con 0x7f0ebc1594a0 2023-10-06T11:00:25.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.711+0000 7f0eb8ff9700 1 -- 172.21.15.7:0/314269829 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4011900 con 0x7f0ebc1594a0 2023-10-06T11:00:25.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.711+0000 7f0ec30da700 1 -- 172.21.15.7:0/314269829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ebc16a7c0 con 0x7f0ebc1594a0 2023-10-06T11:00:25.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.712+0000 7f0ec30da700 1 -- 172.21.15.7:0/314269829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ebc070480 con 0x7f0ebc1594a0 2023-10-06T11:00:25.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.712+0000 7f0eb8ff9700 1 -- 172.21.15.7:0/314269829 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ea4023070 con 0x7f0ebc1594a0 2023-10-06T11:00:25.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.713+0000 7f0eb8ff9700 1 --2- 172.21.15.7:0/314269829 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0e9c066f30 0x7f0e9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:25.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.713+0000 7f0eb8ff9700 1 -- 172.21.15.7:0/314269829 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0ea4085a10 con 0x7f0ebc1594a0 2023-10-06T11:00:25.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.713+0000 7f0ec0e76700 1 --2- 172.21.15.7:0/314269829 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0e9c066f30 0x7f0e9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:25.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.713+0000 7f0ec0e76700 1 --2- 172.21.15.7:0/314269829 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0e9c066f30 0x7f0e9c0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0eac007fd0 tx=0x7f0eac007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:25.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.717+0000 7f0eb8ff9700 1 -- 172.21.15.7:0/314269829 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ea40529e0 con 0x7f0ebc1594a0 2023-10-06T11:00:25.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.917+0000 7f0ec30da700 1 -- 172.21.15.7:0/314269829 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ebc0acf70 con 0x7f0e9c066f30 2023-10-06T11:00:25.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.926+0000 7f0eb8ff9700 1 -- 172.21.15.7:0/314269829 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300960 (secure 0 0 0) 0x7f0ebc0acf70 con 0x7f0e9c066f30 2023-10-06T11:00:25.930 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:25.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.929+0000 7f0ec30da700 1 -- 172.21.15.7:0/314269829 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0e9c066f30 msgr2=0x7f0e9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.929+0000 7f0ec30da700 1 --2- 172.21.15.7:0/314269829 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0e9c066f30 0x7f0e9c0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0eac007fd0 tx=0x7f0eac007d50 comp rx=0 tx=0).stop 2023-10-06T11:00:25.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.929+0000 7f0ec30da700 1 -- 172.21.15.7:0/314269829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ebc1594a0 msgr2=0x7f0ebc14ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:25.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.929+0000 7f0ec30da700 1 --2- 172.21.15.7:0/314269829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ebc1594a0 0x7f0ebc14ca40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009f00 tx=0x7f0ea4017000 comp rx=0 tx=0).stop 2023-10-06T11:00:25.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.930+0000 7f0ec30da700 1 -- 172.21.15.7:0/314269829 shutdown_connections 2023-10-06T11:00:25.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.930+0000 7f0ec30da700 1 --2- 172.21.15.7:0/314269829 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0e9c066f30 0x7f0e9c0693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.930+0000 7f0ec30da700 1 --2- 172.21.15.7:0/314269829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ebc15ce10 0x7f0ebc1699f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.930+0000 7f0ec30da700 1 --2- 172.21.15.7:0/314269829 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ebc1590d0 0x7f0ebc150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.930+0000 7f0ec30da700 1 --2- 172.21.15.7:0/314269829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ebc1594a0 0x7f0ebc14ca40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:25.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.930+0000 7f0ec30da700 1 -- 172.21.15.7:0/314269829 >> 172.21.15.7:0/314269829 conn(0x7f0ebc096160 msgr2=0x7f0ebc154c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:25.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.930+0000 7f0ec30da700 1 -- 172.21.15.7:0/314269829 shutdown_connections 2023-10-06T11:00:25.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:25.930+0000 7f0ec30da700 1 -- 172.21.15.7:0/314269829 wait complete. 2023-10-06T11:00:25.934 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-06T11:00:25.944 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-10-06T11:00:23.990423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382704,"kb_used_data":4400,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592016,"statfs":{"total":773094113280,"available":770654224384,"internally_reserved":0,"allocated":4505600,"data_stored":2631188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.256603"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.740415+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:00.089642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.737919+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:28.662034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.735855+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:02.317643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.741694+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:42.781533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.741464+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:49.108423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.737614+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:43.145482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.736946+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:52:19.522262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.743777+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:17.499197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.736025+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:38.173300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.742849+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:08.479402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.742605+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:25.215468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.739381+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:24.700100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.740381+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:14.349993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.741542+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:03.577436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.741365+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:05.918529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.743255+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:03.577436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.739466+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:25.634230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.736112+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:22.755742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.736927+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:42.781533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.740036+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:12.940530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.739458+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:34.642462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.736895+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:17.499197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.742716+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:34:00.216415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.741566+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:26.988226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.736110+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:57.950700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T11:00:14.530317+0000","last_change":"2023-10-06T10:58:56.328381+0000","last_active":"2023-10-06T11:00:14.530317+0000","last_peered":"2023-10-06T11:00:14.530317+0000","last_clean":"2023-10-06T11:00:14.530317+0000","last_became_active":"2023-10-06T10:58:56.328054+0000","last_became_peered":"2023-10-06T10:58:56.328054+0000","last_unstale":"2023-10-06T11:00:14.530317+0000","last_undegraded":"2023-10-06T11:00:14.530317+0000","last_fullsized":"2023-10-06T11:00:14.530317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.741597+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:17.499197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T11:00:14.616546+0000","last_change":"2023-10-06T10:58:56.326189+0000","last_active":"2023-10-06T11:00:14.616546+0000","last_peered":"2023-10-06T11:00:14.616546+0000","last_clean":"2023-10-06T11:00:14.616546+0000","last_became_active":"2023-10-06T10:58:56.325852+0000","last_became_peered":"2023-10-06T10:58:56.325852+0000","last_unstale":"2023-10-06T11:00:14.616546+0000","last_undegraded":"2023-10-06T11:00:14.616546+0000","last_fullsized":"2023-10-06T11:00:14.616546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:28.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.735863+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:59:13.159772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T11:00:13.714959+0000","last_change":"2023-10-06T10:58:56.325363+0000","last_active":"2023-10-06T11:00:13.714959+0000","last_peered":"2023-10-06T11:00:13.714959+0000","last_clean":"2023-10-06T11:00:13.714959+0000","last_became_active":"2023-10-06T10:58:56.325095+0000","last_became_peered":"2023-10-06T10:58:56.325095+0000","last_unstale":"2023-10-06T11:00:13.714959+0000","last_undegraded":"2023-10-06T11:00:13.714959+0000","last_fullsized":"2023-10-06T11:00:13.714959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T11:00:13.715355+0000","last_change":"2023-10-06T10:58:57.328525+0000","last_active":"2023-10-06T11:00:13.715355+0000","last_peered":"2023-10-06T11:00:13.715355+0000","last_clean":"2023-10-06T11:00:13.715355+0000","last_became_active":"2023-10-06T10:58:57.327509+0000","last_became_peered":"2023-10-06T10:58:57.327509+0000","last_unstale":"2023-10-06T11:00:13.715355+0000","last_undegraded":"2023-10-06T11:00:13.715355+0000","last_fullsized":"2023-10-06T11:00:13.715355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_clean_scrub_stamp":"2023-10-06T10:58:56.314996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:45.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.741551+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:16:19.741786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T11:00:13.715355+0000","last_change":"2023-10-06T10:58:56.331567+0000","last_active":"2023-10-06T11:00:13.715355+0000","last_peered":"2023-10-06T11:00:13.715355+0000","last_clean":"2023-10-06T11:00:13.715355+0000","last_became_active":"2023-10-06T10:58:56.331244+0000","last_became_peered":"2023-10-06T10:58:56.331244+0000","last_unstale":"2023-10-06T11:00:13.715355+0000","last_undegraded":"2023-10-06T11:00:13.715355+0000","last_fullsized":"2023-10-06T11:00:13.715355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.736740+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:26.988226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T11:00:13.715330+0000","last_change":"2023-10-06T10:58:56.332184+0000","last_active":"2023-10-06T11:00:13.715330+0000","last_peered":"2023-10-06T11:00:13.715330+0000","last_clean":"2023-10-06T11:00:13.715330+0000","last_became_active":"2023-10-06T10:58:56.331830+0000","last_became_peered":"2023-10-06T10:58:56.331830+0000","last_unstale":"2023-10-06T11:00:13.715330+0000","last_undegraded":"2023-10-06T11:00:13.715330+0000","last_fullsized":"2023-10-06T11:00:13.715330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:54:02.320834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.740048+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:15.889566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T11:00:14.616677+0000","last_change":"2023-10-06T10:58:56.331654+0000","last_active":"2023-10-06T11:00:14.616677+0000","last_peered":"2023-10-06T11:00:14.616677+0000","last_clean":"2023-10-06T11:00:14.616677+0000","last_became_active":"2023-10-06T10:58:56.331345+0000","last_became_peered":"2023-10-06T10:58:56.331345+0000","last_unstale":"2023-10-06T11:00:14.616677+0000","last_undegraded":"2023-10-06T11:00:14.616677+0000","last_fullsized":"2023-10-06T11:00:14.616677+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.735871+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:34:00.216415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T11:00:14.617006+0000","last_change":"2023-10-06T10:58:56.331650+0000","last_active":"2023-10-06T11:00:14.617006+0000","last_peered":"2023-10-06T11:00:14.617006+0000","last_clean":"2023-10-06T11:00:14.617006+0000","last_became_active":"2023-10-06T10:58:56.331344+0000","last_became_peered":"2023-10-06T10:58:56.331344+0000","last_unstale":"2023-10-06T11:00:14.617006+0000","last_undegraded":"2023-10-06T11:00:14.617006+0000","last_fullsized":"2023-10-06T11:00:14.617006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:45.584545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:00:20.733780+0000","last_change":"2023-10-06T11:00:20.733780+0000","last_active":"2023-10-06T11:00:20.733780+0000","last_peered":"2023-10-06T11:00:20.733780+0000","last_clean":"2023-10-06T11:00:20.733780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:20.733780+0000","last_undegraded":"2023-10-06T11:00:20.733780+0000","last_fullsized":"2023-10-06T11:00:20.733780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:00:19.727918+0000","last_change":"2023-10-06T11:00:19.742697+0000","last_active":"2023-10-06T11:00:19.727918+0000","last_peered":"2023-10-06T11:00:19.727918+0000","last_clean":"2023-10-06T11:00:19.727918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:00:19.727918+0000","last_undegraded":"2023-10-06T11:00:19.727918+0000","last_fullsized":"2023-10-06T11:00:19.727918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:59:13.159772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T11:00:14.616992+0000","last_change":"2023-10-06T10:58:56.326315+0000","last_active":"2023-10-06T11:00:14.616992+0000","last_peered":"2023-10-06T11:00:14.616992+0000","last_clean":"2023-10-06T11:00:14.616992+0000","last_became_active":"2023-10-06T10:58:56.325897+0000","last_became_peered":"2023-10-06T10:58:56.325897+0000","last_unstale":"2023-10-06T11:00:14.616992+0000","last_undegraded":"2023-10-06T11:00:14.616992+0000","last_fullsized":"2023-10-06T11:00:14.616992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1007616,"data_stored":770544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 10:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Oct 6 10:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.433}]},{"osd":2,"last update":"Fri Oct 6 10:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Oct 6 10:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Oct 6 10:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 10:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Oct 6 10:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.5}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":409600,"data_stored":179198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45300000000000001}]},{"osd":3,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.503}]},{"osd":4,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.34699999999999998}]},{"osd":5,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.371}]},{"osd":7,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1007616,"data_stored":770544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.40000000000000002}]},{"osd":3,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.443},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.374}]},{"osd":4,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.61899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":421888,"data_stored":185676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.442}]},{"osd":2,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.371}]},{"osd":3,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.0870000000000002,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.9540000000000002,"5min":2.9540000000000002,"15min":2.9540000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":186654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.442}]},{"osd":1,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.39000000000000001}]},{"osd":3,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.374}]},{"osd":4,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.75900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":409600,"data_stored":179198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":4.617,"5min":4.617,"15min":4.617},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":4.3230000000000004,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.434}]},{"osd":2,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":6.4400000000000004,"5min":6.4400000000000004,"15min":6.4400000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":6.4930000000000003,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":4.3760000000000003,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.624}]},{"osd":5,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.755}]},{"osd":6,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.4470000000000001,"5min":4.4470000000000001,"15min":4.4470000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.60599999999999998}]},{"osd":7,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.4130000000000003,"5min":4.4130000000000003,"15min":4.4130000000000003},"last":0.76900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":180176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64800000000000002}]},{"osd":1,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":5.476,"5min":5.476,"15min":5.476},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63500000000000001}]},{"osd":7,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.747}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":409600,"data_stored":179198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61699999999999999}]},{"osd":1,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.626}]},{"osd":2,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.38800000000000001}]},{"osd":6,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:00:26.022 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:00:26.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.157+0000 7f9638550700 1 Processor -- start 2023-10-06T11:00:26.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.157+0000 7f9638550700 1 -- start start 2023-10-06T11:00:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.158+0000 7f9638550700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96301590d0 0x7f9630069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.158+0000 7f9638550700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f963006a0f0 0x7f963015ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.158+0000 7f9638550700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f963015d350 0x7f9630067980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.158+0000 7f9638550700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f963015d7d0 con 0x7f963015d350 2023-10-06T11:00:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.158+0000 7f9638550700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96300694d0 con 0x7f96301590d0 2023-10-06T11:00:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.158+0000 7f9638550700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9630068ba0 con 0x7f963006a0f0 2023-10-06T11:00:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.158+0000 7f9636aed700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f963015d350 0x7f9630067980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.158+0000 7f9636aed700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f963015d350 0x7f9630067980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38924/0 (socket says 172.21.15.7:38924) 2023-10-06T11:00:26.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.158+0000 7f9636aed700 1 -- 172.21.15.7:0/2300816927 learned_addr learned my addr 172.21.15.7:0/2300816927 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:26.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.158+0000 7f9635aeb700 1 --2- 172.21.15.7:0/2300816927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f963006a0f0 0x7f963015ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:26.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.158+0000 7f96362ec700 1 --2- 172.21.15.7:0/2300816927 >> v2:172.21.15.50:3300/0 conn(0x7f96301590d0 0x7f9630069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:26.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.159+0000 7f9636aed700 1 -- 172.21.15.7:0/2300816927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f963006a0f0 msgr2=0x7f963015ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:26.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.159+0000 7f9636aed700 1 --2- 172.21.15.7:0/2300816927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f963006a0f0 0x7f963015ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.159+0000 7f9636aed700 1 -- 172.21.15.7:0/2300816927 >> v2:172.21.15.50:3300/0 conn(0x7f96301590d0 msgr2=0x7f9630069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:26.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.159+0000 7f9636aed700 1 --2- 172.21.15.7:0/2300816927 >> v2:172.21.15.50:3300/0 conn(0x7f96301590d0 0x7f9630069bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.159+0000 7f9636aed700 1 -- 172.21.15.7:0/2300816927 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9630068e80 con 0x7f963015d350 2023-10-06T11:00:26.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.159+0000 7f96362ec700 1 --2- 172.21.15.7:0/2300816927 >> v2:172.21.15.50:3300/0 conn(0x7f96301590d0 0x7f9630069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:26.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.159+0000 7f9635aeb700 1 --2- 172.21.15.7:0/2300816927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f963006a0f0 0x7f963015ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:26.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.159+0000 7f9636aed700 1 --2- 172.21.15.7:0/2300816927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f963015d350 0x7f9630067980 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f963006ec40 tx=0x7f9628009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15123e4aed26b9f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:26.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.159+0000 7f96352ea700 1 -- 172.21.15.7:0/2300816927 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962800e070 con 0x7f963015d350 2023-10-06T11:00:26.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.159+0000 7f96352ea700 1 -- 172.21.15.7:0/2300816927 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962800ba50 con 0x7f963015d350 2023-10-06T11:00:26.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.159+0000 7f96352ea700 1 -- 172.21.15.7:0/2300816927 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280092e0 con 0x7f963015d350 2023-10-06T11:00:26.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.160+0000 7f9638550700 1 -- 172.21.15.7:0/2300816927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f963015d350 msgr2=0x7f9630067980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:26.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.160+0000 7f9638550700 1 --2- 172.21.15.7:0/2300816927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f963015d350 0x7f9630067980 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f963006ec40 tx=0x7f9628009840 comp rx=0 tx=0).stop 2023-10-06T11:00:26.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.160+0000 7f9638550700 1 -- 172.21.15.7:0/2300816927 shutdown_connections 2023-10-06T11:00:26.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.160+0000 7f9638550700 1 --2- 172.21.15.7:0/2300816927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f963015d350 0x7f9630067980 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.160+0000 7f9638550700 1 --2- 172.21.15.7:0/2300816927 >> v2:172.21.15.50:3300/0 conn(0x7f96301590d0 0x7f9630069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.160+0000 7f9638550700 1 --2- 172.21.15.7:0/2300816927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f963006a0f0 0x7f963015ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.160+0000 7f9638550700 1 -- 172.21.15.7:0/2300816927 >> 172.21.15.7:0/2300816927 conn(0x7f9630096160 msgr2=0x7f96300afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:26.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.160+0000 7f9638550700 1 -- 172.21.15.7:0/2300816927 shutdown_connections 2023-10-06T11:00:26.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.160+0000 7f9638550700 1 -- 172.21.15.7:0/2300816927 wait complete. 2023-10-06T11:00:26.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.161+0000 7f9638550700 1 Processor -- start 2023-10-06T11:00:26.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.161+0000 7f9638550700 1 -- start start 2023-10-06T11:00:26.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9638550700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f963006a0f0 0x7f9630159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:26.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9638550700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96301590d0 0x7f9630147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:26.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9638550700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f963015d350 0x7f9630096ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:26.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9638550700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9630098930 con 0x7f96301590d0 2023-10-06T11:00:26.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9638550700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9630098c10 con 0x7f963006a0f0 2023-10-06T11:00:26.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9638550700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9630098ef0 con 0x7f963015d350 2023-10-06T11:00:26.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9635aeb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96301590d0 0x7f9630147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:26.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9635aeb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96301590d0 0x7f9630147950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38938/0 (socket says 172.21.15.7:38938) 2023-10-06T11:00:26.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9635aeb700 1 -- 172.21.15.7:0/3992487215 learned_addr learned my addr 172.21.15.7:0/3992487215 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:26.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f96362ec700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f963006a0f0 0x7f9630159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:26.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9636aed700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f963015d350 0x7f9630096ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:26.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9635aeb700 1 -- 172.21.15.7:0/3992487215 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f963015d350 msgr2=0x7f9630096ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:26.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9635aeb700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f963015d350 0x7f9630096ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9635aeb700 1 -- 172.21.15.7:0/3992487215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f963006a0f0 msgr2=0x7f9630159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:26.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9635aeb700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f963006a0f0 0x7f9630159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9635aeb700 1 -- 172.21.15.7:0/3992487215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9628009ae0 con 0x7f96301590d0 2023-10-06T11:00:26.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f96362ec700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f963006a0f0 0x7f9630159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:26.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.162+0000 7f9635aeb700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96301590d0 0x7f9630147950 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f962400e8d0 tx=0x7f9624008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:26.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.163+0000 7f96227fc700 1 -- 172.21.15.7:0/3992487215 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624013410 con 0x7f96301590d0 2023-10-06T11:00:26.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.163+0000 7f96227fc700 1 -- 172.21.15.7:0/3992487215 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9624013570 con 0x7f96301590d0 2023-10-06T11:00:26.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.163+0000 7f9638550700 1 -- 172.21.15.7:0/3992487215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96300991d0 con 0x7f96301590d0 2023-10-06T11:00:26.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.163+0000 7f96227fc700 1 -- 172.21.15.7:0/3992487215 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624013910 con 0x7f96301590d0 2023-10-06T11:00:26.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.163+0000 7f9638550700 1 -- 172.21.15.7:0/3992487215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9630159dd0 con 0x7f96301590d0 2023-10-06T11:00:26.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.164+0000 7f9638550700 1 -- 172.21.15.7:0/3992487215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9630099670 con 0x7f96301590d0 2023-10-06T11:00:26.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.164+0000 7f96227fc700 1 -- 172.21.15.7:0/3992487215 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9624013d00 con 0x7f96301590d0 2023-10-06T11:00:26.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.164+0000 7f96227fc700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9614066f30 0x7f96140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:26.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.165+0000 7f96227fc700 1 -- 172.21.15.7:0/3992487215 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9624084540 con 0x7f96301590d0 2023-10-06T11:00:26.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.165+0000 7f96362ec700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9614066f30 0x7f96140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:26.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.165+0000 7f96362ec700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9614066f30 0x7f96140693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f962c006fd0 tx=0x7f962c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:26.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.169+0000 7f96227fc700 1 -- 172.21.15.7:0/3992487215 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9624051510 con 0x7f96301590d0 2023-10-06T11:00:26.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.367+0000 7f9638550700 1 -- 172.21.15.7:0/3992487215 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9630070480 con 0x7f9614066f30 2023-10-06T11:00:26.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.376+0000 7f96227fc700 1 -- 172.21.15.7:0/3992487215 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311921 (secure 0 0 0) 0x7f9630070480 con 0x7f9614066f30 2023-10-06T11:00:26.380 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:26.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.380+0000 7f9638550700 1 -- 172.21.15.7:0/3992487215 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9614066f30 msgr2=0x7f96140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:26.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.380+0000 7f9638550700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9614066f30 0x7f96140693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f962c006fd0 tx=0x7f962c008040 comp rx=0 tx=0).stop 2023-10-06T11:00:26.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.380+0000 7f9638550700 1 -- 172.21.15.7:0/3992487215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96301590d0 msgr2=0x7f9630147950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:26.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.380+0000 7f9638550700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96301590d0 0x7f9630147950 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f962400e8d0 tx=0x7f9624008040 comp rx=0 tx=0).stop 2023-10-06T11:00:26.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.380+0000 7f9638550700 1 -- 172.21.15.7:0/3992487215 shutdown_connections 2023-10-06T11:00:26.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.380+0000 7f9638550700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9614066f30 0x7f96140693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.380+0000 7f9638550700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f963015d350 0x7f9630096ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.380+0000 7f9638550700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f963006a0f0 0x7f9630159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.380+0000 7f9638550700 1 --2- 172.21.15.7:0/3992487215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96301590d0 0x7f9630147950 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.380+0000 7f9638550700 1 -- 172.21.15.7:0/3992487215 >> 172.21.15.7:0/3992487215 conn(0x7f9630096160 msgr2=0x7f96300b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:26.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.380+0000 7f9638550700 1 -- 172.21.15.7:0/3992487215 shutdown_connections 2023-10-06T11:00:26.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.380+0000 7f9638550700 1 -- 172.21.15.7:0/3992487215 wait complete. 2023-10-06T11:00:26.383 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-06T11:00:26.394 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-10-06T11:00:25.990823+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":192,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383128,"kb_used_data":4824,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591592,"statfs":{"total":773094113280,"available":770653790208,"internally_reserved":0,"allocated":4939776,"data_stored":2845268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001071"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.766632+0000","last_change":"2023-10-06T11:00:21.761291+0000","last_active":"2023-10-06T11:00:21.766632+0000","last_peered":"2023-10-06T11:00:21.766632+0000","last_clean":"2023-10-06T11:00:21.766632+0000","last_became_active":"2023-10-06T11:00:21.761003+0000","last_became_peered":"2023-10-06T11:00:21.761003+0000","last_unstale":"2023-10-06T11:00:21.766632+0000","last_undegraded":"2023-10-06T11:00:21.766632+0000","last_fullsized":"2023-10-06T11:00:21.766632+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:29.667895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.773530+0000","last_change":"2023-10-06T11:00:21.771371+0000","last_active":"2023-10-06T11:00:21.773530+0000","last_peered":"2023-10-06T11:00:21.773530+0000","last_clean":"2023-10-06T11:00:21.773530+0000","last_became_active":"2023-10-06T11:00:21.771052+0000","last_became_peered":"2023-10-06T11:00:21.771052+0000","last_unstale":"2023-10-06T11:00:21.773530+0000","last_undegraded":"2023-10-06T11:00:21.773530+0000","last_fullsized":"2023-10-06T11:00:21.773530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:39.179161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.763146+0000","last_change":"2023-10-06T11:00:21.759710+0000","last_active":"2023-10-06T11:00:21.763146+0000","last_peered":"2023-10-06T11:00:21.763146+0000","last_clean":"2023-10-06T11:00:21.763146+0000","last_became_active":"2023-10-06T11:00:21.759329+0000","last_became_peered":"2023-10-06T11:00:21.759329+0000","last_unstale":"2023-10-06T11:00:21.763146+0000","last_undegraded":"2023-10-06T11:00:21.763146+0000","last_fullsized":"2023-10-06T11:00:21.763146+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:39.602031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.777184+0000","last_change":"2023-10-06T11:00:21.775683+0000","last_active":"2023-10-06T11:00:21.777184+0000","last_peered":"2023-10-06T11:00:21.777184+0000","last_clean":"2023-10-06T11:00:21.777184+0000","last_became_active":"2023-10-06T11:00:21.775417+0000","last_became_peered":"2023-10-06T11:00:21.775417+0000","last_unstale":"2023-10-06T11:00:21.777184+0000","last_undegraded":"2023-10-06T11:00:21.777184+0000","last_fullsized":"2023-10-06T11:00:21.777184+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:08.063734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.775206+0000","last_change":"2023-10-06T11:00:21.774397+0000","last_active":"2023-10-06T11:00:21.775206+0000","last_peered":"2023-10-06T11:00:21.775206+0000","last_clean":"2023-10-06T11:00:21.775206+0000","last_became_active":"2023-10-06T11:00:21.774075+0000","last_became_peered":"2023-10-06T11:00:21.774075+0000","last_unstale":"2023-10-06T11:00:21.775206+0000","last_undegraded":"2023-10-06T11:00:21.775206+0000","last_fullsized":"2023-10-06T11:00:21.775206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:14:19.394654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.774667+0000","last_change":"2023-10-06T11:00:21.762187+0000","last_active":"2023-10-06T11:00:21.774667+0000","last_peered":"2023-10-06T11:00:21.774667+0000","last_clean":"2023-10-06T11:00:21.774667+0000","last_became_active":"2023-10-06T11:00:21.760724+0000","last_became_peered":"2023-10-06T11:00:21.760724+0000","last_unstale":"2023-10-06T11:00:21.774667+0000","last_undegraded":"2023-10-06T11:00:21.774667+0000","last_fullsized":"2023-10-06T11:00:21.774667+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:54:11.701670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.768951+0000","last_change":"2023-10-06T11:00:21.767540+0000","last_active":"2023-10-06T11:00:21.768951+0000","last_peered":"2023-10-06T11:00:21.768951+0000","last_clean":"2023-10-06T11:00:21.768951+0000","last_became_active":"2023-10-06T11:00:21.766910+0000","last_became_peered":"2023-10-06T11:00:21.766910+0000","last_unstale":"2023-10-06T11:00:21.768951+0000","last_undegraded":"2023-10-06T11:00:21.768951+0000","last_fullsized":"2023-10-06T11:00:21.768951+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:23.761604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.778291+0000","last_change":"2023-10-06T11:00:21.774465+0000","last_active":"2023-10-06T11:00:21.778291+0000","last_peered":"2023-10-06T11:00:21.778291+0000","last_clean":"2023-10-06T11:00:21.778291+0000","last_became_active":"2023-10-06T11:00:21.773889+0000","last_became_peered":"2023-10-06T11:00:21.773889+0000","last_unstale":"2023-10-06T11:00:21.778291+0000","last_undegraded":"2023-10-06T11:00:21.778291+0000","last_fullsized":"2023-10-06T11:00:21.778291+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:08.269411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.774402+0000","last_change":"2023-10-06T11:00:21.767347+0000","last_active":"2023-10-06T11:00:21.774402+0000","last_peered":"2023-10-06T11:00:21.774402+0000","last_clean":"2023-10-06T11:00:21.774402+0000","last_became_active":"2023-10-06T11:00:21.767130+0000","last_became_peered":"2023-10-06T11:00:21.767130+0000","last_unstale":"2023-10-06T11:00:21.774402+0000","last_undegraded":"2023-10-06T11:00:21.774402+0000","last_fullsized":"2023-10-06T11:00:21.774402+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:23.881228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.777968+0000","last_change":"2023-10-06T11:00:21.774901+0000","last_active":"2023-10-06T11:00:21.777968+0000","last_peered":"2023-10-06T11:00:21.777968+0000","last_clean":"2023-10-06T11:00:21.777968+0000","last_became_active":"2023-10-06T11:00:21.774611+0000","last_became_peered":"2023-10-06T11:00:21.774611+0000","last_unstale":"2023-10-06T11:00:21.777968+0000","last_undegraded":"2023-10-06T11:00:21.777968+0000","last_fullsized":"2023-10-06T11:00:21.777968+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:07.730725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.776778+0000","last_change":"2023-10-06T11:00:21.770554+0000","last_active":"2023-10-06T11:00:21.776778+0000","last_peered":"2023-10-06T11:00:21.776778+0000","last_clean":"2023-10-06T11:00:21.776778+0000","last_became_active":"2023-10-06T11:00:21.770264+0000","last_became_peered":"2023-10-06T11:00:21.770264+0000","last_unstale":"2023-10-06T11:00:21.776778+0000","last_undegraded":"2023-10-06T11:00:21.776778+0000","last_fullsized":"2023-10-06T11:00:21.776778+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:29.453369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.765241+0000","last_change":"2023-10-06T11:00:21.763571+0000","last_active":"2023-10-06T11:00:21.765241+0000","last_peered":"2023-10-06T11:00:21.765241+0000","last_clean":"2023-10-06T11:00:21.765241+0000","last_became_active":"2023-10-06T11:00:21.763276+0000","last_became_peered":"2023-10-06T11:00:21.763276+0000","last_unstale":"2023-10-06T11:00:21.765241+0000","last_undegraded":"2023-10-06T11:00:21.765241+0000","last_fullsized":"2023-10-06T11:00:21.765241+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:23.761604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.762822+0000","last_change":"2023-10-06T11:00:21.758910+0000","last_active":"2023-10-06T11:00:21.762822+0000","last_peered":"2023-10-06T11:00:21.762822+0000","last_clean":"2023-10-06T11:00:21.762822+0000","last_became_active":"2023-10-06T11:00:21.758559+0000","last_became_peered":"2023-10-06T11:00:21.758559+0000","last_unstale":"2023-10-06T11:00:21.762822+0000","last_undegraded":"2023-10-06T11:00:21.762822+0000","last_fullsized":"2023-10-06T11:00:21.762822+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:31.159104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.777326+0000","last_change":"2023-10-06T11:00:21.770312+0000","last_active":"2023-10-06T11:00:21.777326+0000","last_peered":"2023-10-06T11:00:21.777326+0000","last_clean":"2023-10-06T11:00:21.777326+0000","last_became_active":"2023-10-06T11:00:21.767022+0000","last_became_peered":"2023-10-06T11:00:21.767022+0000","last_unstale":"2023-10-06T11:00:21.777326+0000","last_undegraded":"2023-10-06T11:00:21.777326+0000","last_fullsized":"2023-10-06T11:00:21.777326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:29.667895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.773291+0000","last_change":"2023-10-06T11:00:21.756882+0000","last_active":"2023-10-06T11:00:21.773291+0000","last_peered":"2023-10-06T11:00:21.773291+0000","last_clean":"2023-10-06T11:00:21.773291+0000","last_became_active":"2023-10-06T11:00:21.756587+0000","last_became_peered":"2023-10-06T11:00:21.756587+0000","last_unstale":"2023-10-06T11:00:21.773291+0000","last_undegraded":"2023-10-06T11:00:21.773291+0000","last_fullsized":"2023-10-06T11:00:21.773291+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:20.920786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.775018+0000","last_change":"2023-10-06T11:00:21.773873+0000","last_active":"2023-10-06T11:00:21.775018+0000","last_peered":"2023-10-06T11:00:21.775018+0000","last_clean":"2023-10-06T11:00:21.775018+0000","last_became_active":"2023-10-06T11:00:21.773096+0000","last_became_peered":"2023-10-06T11:00:21.773096+0000","last_unstale":"2023-10-06T11:00:21.775018+0000","last_undegraded":"2023-10-06T11:00:21.775018+0000","last_fullsized":"2023-10-06T11:00:21.775018+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:06.924390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.763248+0000","last_change":"2023-10-06T11:00:21.757479+0000","last_active":"2023-10-06T11:00:21.763248+0000","last_peered":"2023-10-06T11:00:21.763248+0000","last_clean":"2023-10-06T11:00:21.763248+0000","last_became_active":"2023-10-06T11:00:21.757189+0000","last_became_peered":"2023-10-06T11:00:21.757189+0000","last_unstale":"2023-10-06T11:00:21.763248+0000","last_undegraded":"2023-10-06T11:00:21.763248+0000","last_fullsized":"2023-10-06T11:00:21.763248+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:27:53.411400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.772408+0000","last_change":"2023-10-06T11:00:21.771178+0000","last_active":"2023-10-06T11:00:21.772408+0000","last_peered":"2023-10-06T11:00:21.772408+0000","last_clean":"2023-10-06T11:00:21.772408+0000","last_became_active":"2023-10-06T11:00:21.770831+0000","last_became_peered":"2023-10-06T11:00:21.770831+0000","last_unstale":"2023-10-06T11:00:21.772408+0000","last_undegraded":"2023-10-06T11:00:21.772408+0000","last_fullsized":"2023-10-06T11:00:21.772408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:57.444178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.775007+0000","last_change":"2023-10-06T11:00:21.773830+0000","last_active":"2023-10-06T11:00:21.775007+0000","last_peered":"2023-10-06T11:00:21.775007+0000","last_clean":"2023-10-06T11:00:21.775007+0000","last_became_active":"2023-10-06T11:00:21.773454+0000","last_became_peered":"2023-10-06T11:00:21.773454+0000","last_unstale":"2023-10-06T11:00:21.775007+0000","last_undegraded":"2023-10-06T11:00:21.775007+0000","last_fullsized":"2023-10-06T11:00:21.775007+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:35.648323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.778794+0000","last_change":"2023-10-06T11:00:21.777548+0000","last_active":"2023-10-06T11:00:21.778794+0000","last_peered":"2023-10-06T11:00:21.778794+0000","last_clean":"2023-10-06T11:00:21.778794+0000","last_became_active":"2023-10-06T11:00:21.777251+0000","last_became_peered":"2023-10-06T11:00:21.777251+0000","last_unstale":"2023-10-06T11:00:21.778794+0000","last_undegraded":"2023-10-06T11:00:21.778794+0000","last_fullsized":"2023-10-06T11:00:21.778794+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:26.221329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.775148+0000","last_change":"2023-10-06T11:00:21.757530+0000","last_active":"2023-10-06T11:00:21.775148+0000","last_peered":"2023-10-06T11:00:21.775148+0000","last_clean":"2023-10-06T11:00:21.775148+0000","last_became_active":"2023-10-06T11:00:21.757171+0000","last_became_peered":"2023-10-06T11:00:21.757171+0000","last_unstale":"2023-10-06T11:00:21.775148+0000","last_undegraded":"2023-10-06T11:00:21.775148+0000","last_fullsized":"2023-10-06T11:00:21.775148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:53:09.955733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.777347+0000","last_change":"2023-10-06T11:00:21.774310+0000","last_active":"2023-10-06T11:00:21.777347+0000","last_peered":"2023-10-06T11:00:21.777347+0000","last_clean":"2023-10-06T11:00:21.777347+0000","last_became_active":"2023-10-06T11:00:21.773866+0000","last_became_peered":"2023-10-06T11:00:21.773866+0000","last_unstale":"2023-10-06T11:00:21.777347+0000","last_undegraded":"2023-10-06T11:00:21.777347+0000","last_fullsized":"2023-10-06T11:00:21.777347+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:27:01.009123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.761666+0000","last_change":"2023-10-06T11:00:21.757097+0000","last_active":"2023-10-06T11:00:21.761666+0000","last_peered":"2023-10-06T11:00:21.761666+0000","last_clean":"2023-10-06T11:00:21.761666+0000","last_became_active":"2023-10-06T11:00:21.756310+0000","last_became_peered":"2023-10-06T11:00:21.756310+0000","last_unstale":"2023-10-06T11:00:21.761666+0000","last_undegraded":"2023-10-06T11:00:21.761666+0000","last_fullsized":"2023-10-06T11:00:21.761666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:39.278041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.761600+0000","last_change":"2023-10-06T11:00:21.756234+0000","last_active":"2023-10-06T11:00:21.761600+0000","last_peered":"2023-10-06T11:00:21.761600+0000","last_clean":"2023-10-06T11:00:21.761600+0000","last_became_active":"2023-10-06T11:00:21.755888+0000","last_became_peered":"2023-10-06T11:00:21.755888+0000","last_unstale":"2023-10-06T11:00:21.761600+0000","last_undegraded":"2023-10-06T11:00:21.761600+0000","last_fullsized":"2023-10-06T11:00:21.761600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:18.505058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.768127+0000","last_change":"2023-10-06T11:00:21.761539+0000","last_active":"2023-10-06T11:00:21.768127+0000","last_peered":"2023-10-06T11:00:21.768127+0000","last_clean":"2023-10-06T11:00:21.768127+0000","last_became_active":"2023-10-06T11:00:21.761028+0000","last_became_peered":"2023-10-06T11:00:21.761028+0000","last_unstale":"2023-10-06T11:00:21.768127+0000","last_undegraded":"2023-10-06T11:00:21.768127+0000","last_fullsized":"2023-10-06T11:00:21.768127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:17.608300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.762979+0000","last_change":"2023-10-06T11:00:21.761163+0000","last_active":"2023-10-06T11:00:21.762979+0000","last_peered":"2023-10-06T11:00:21.762979+0000","last_clean":"2023-10-06T11:00:21.762979+0000","last_became_active":"2023-10-06T11:00:21.760898+0000","last_became_peered":"2023-10-06T11:00:21.760898+0000","last_unstale":"2023-10-06T11:00:21.762979+0000","last_undegraded":"2023-10-06T11:00:21.762979+0000","last_fullsized":"2023-10-06T11:00:21.762979+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:39.278041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.763128+0000","last_change":"2023-10-06T11:00:21.756750+0000","last_active":"2023-10-06T11:00:21.763128+0000","last_peered":"2023-10-06T11:00:21.763128+0000","last_clean":"2023-10-06T11:00:21.763128+0000","last_became_active":"2023-10-06T11:00:21.756474+0000","last_became_peered":"2023-10-06T11:00:21.756474+0000","last_unstale":"2023-10-06T11:00:21.763128+0000","last_undegraded":"2023-10-06T11:00:21.763128+0000","last_fullsized":"2023-10-06T11:00:21.763128+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:54:11.701670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.765268+0000","last_change":"2023-10-06T11:00:21.763674+0000","last_active":"2023-10-06T11:00:21.765268+0000","last_peered":"2023-10-06T11:00:21.765268+0000","last_clean":"2023-10-06T11:00:21.765268+0000","last_became_active":"2023-10-06T11:00:21.763350+0000","last_became_peered":"2023-10-06T11:00:21.763350+0000","last_unstale":"2023-10-06T11:00:21.765268+0000","last_undegraded":"2023-10-06T11:00:21.765268+0000","last_fullsized":"2023-10-06T11:00:21.765268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:40:20.551995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.764929+0000","last_change":"2023-10-06T11:00:21.761111+0000","last_active":"2023-10-06T11:00:21.764929+0000","last_peered":"2023-10-06T11:00:21.764929+0000","last_clean":"2023-10-06T11:00:21.764929+0000","last_became_active":"2023-10-06T11:00:21.760753+0000","last_became_peered":"2023-10-06T11:00:21.760753+0000","last_unstale":"2023-10-06T11:00:21.764929+0000","last_undegraded":"2023-10-06T11:00:21.764929+0000","last_fullsized":"2023-10-06T11:00:21.764929+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:43.787394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.764752+0000","last_change":"2023-10-06T11:00:21.761225+0000","last_active":"2023-10-06T11:00:21.764752+0000","last_peered":"2023-10-06T11:00:21.764752+0000","last_clean":"2023-10-06T11:00:21.764752+0000","last_became_active":"2023-10-06T11:00:21.760846+0000","last_became_peered":"2023-10-06T11:00:21.760846+0000","last_unstale":"2023-10-06T11:00:21.764752+0000","last_undegraded":"2023-10-06T11:00:21.764752+0000","last_fullsized":"2023-10-06T11:00:21.764752+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:20.920786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.773657+0000","last_change":"2023-10-06T11:00:21.759651+0000","last_active":"2023-10-06T11:00:21.773657+0000","last_peered":"2023-10-06T11:00:21.773657+0000","last_clean":"2023-10-06T11:00:21.773657+0000","last_became_active":"2023-10-06T11:00:21.759360+0000","last_became_peered":"2023-10-06T11:00:21.759360+0000","last_unstale":"2023-10-06T11:00:21.773657+0000","last_undegraded":"2023-10-06T11:00:21.773657+0000","last_fullsized":"2023-10-06T11:00:21.773657+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:38.496876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.769988+0000","last_change":"2023-10-06T11:00:21.763363+0000","last_active":"2023-10-06T11:00:21.769988+0000","last_peered":"2023-10-06T11:00:21.769988+0000","last_clean":"2023-10-06T11:00:21.769988+0000","last_became_active":"2023-10-06T11:00:21.763056+0000","last_became_peered":"2023-10-06T11:00:21.763056+0000","last_unstale":"2023-10-06T11:00:21.769988+0000","last_undegraded":"2023-10-06T11:00:21.769988+0000","last_fullsized":"2023-10-06T11:00:21.769988+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:43.787394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.765488+0000","last_change":"2023-10-06T11:00:21.763699+0000","last_active":"2023-10-06T11:00:21.765488+0000","last_peered":"2023-10-06T11:00:21.765488+0000","last_clean":"2023-10-06T11:00:21.765488+0000","last_became_active":"2023-10-06T11:00:21.763426+0000","last_became_peered":"2023-10-06T11:00:21.763426+0000","last_unstale":"2023-10-06T11:00:21.765488+0000","last_undegraded":"2023-10-06T11:00:21.765488+0000","last_fullsized":"2023-10-06T11:00:21.765488+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:26.221329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'4","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.777168+0000","last_change":"2023-10-06T11:00:20.758142+0000","last_active":"2023-10-06T11:00:21.777168+0000","last_peered":"2023-10-06T11:00:21.777168+0000","last_clean":"2023-10-06T11:00:21.777168+0000","last_became_active":"2023-10-06T11:00:20.757851+0000","last_became_peered":"2023-10-06T11:00:20.757851+0000","last_unstale":"2023-10-06T11:00:21.777168+0000","last_undegraded":"2023-10-06T11:00:21.777168+0000","last_fullsized":"2023-10-06T11:00:21.777168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:40:19.546134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.752480+0000","last_change":"2023-10-06T11:00:21.750399+0000","last_active":"2023-10-06T11:00:21.752480+0000","last_peered":"2023-10-06T11:00:21.752480+0000","last_clean":"2023-10-06T11:00:21.752480+0000","last_became_active":"2023-10-06T11:00:21.750098+0000","last_became_peered":"2023-10-06T11:00:21.750098+0000","last_unstale":"2023-10-06T11:00:21.752480+0000","last_undegraded":"2023-10-06T11:00:21.752480+0000","last_fullsized":"2023-10-06T11:00:21.752480+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:16:20.747647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.767825+0000","last_change":"2023-10-06T11:00:20.757103+0000","last_active":"2023-10-06T11:00:21.767825+0000","last_peered":"2023-10-06T11:00:21.767825+0000","last_clean":"2023-10-06T11:00:21.767825+0000","last_became_active":"2023-10-06T11:00:20.756797+0000","last_became_peered":"2023-10-06T11:00:20.756797+0000","last_unstale":"2023-10-06T11:00:21.767825+0000","last_undegraded":"2023-10-06T11:00:21.767825+0000","last_fullsized":"2023-10-06T11:00:21.767825+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:53:29.443513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.764243+0000","last_change":"2023-10-06T11:00:21.762455+0000","last_active":"2023-10-06T11:00:21.764243+0000","last_peered":"2023-10-06T11:00:21.764243+0000","last_clean":"2023-10-06T11:00:21.764243+0000","last_became_active":"2023-10-06T11:00:21.762127+0000","last_became_peered":"2023-10-06T11:00:21.762127+0000","last_unstale":"2023-10-06T11:00:21.764243+0000","last_undegraded":"2023-10-06T11:00:21.764243+0000","last_fullsized":"2023-10-06T11:00:21.764243+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:58.956561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.771782+0000","last_change":"2023-10-06T11:00:20.754055+0000","last_active":"2023-10-06T11:00:21.771782+0000","last_peered":"2023-10-06T11:00:21.771782+0000","last_clean":"2023-10-06T11:00:21.771782+0000","last_became_active":"2023-10-06T11:00:20.753640+0000","last_became_peered":"2023-10-06T11:00:20.753640+0000","last_unstale":"2023-10-06T11:00:21.771782+0000","last_undegraded":"2023-10-06T11:00:21.771782+0000","last_fullsized":"2023-10-06T11:00:21.771782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:08.479402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.764340+0000","last_change":"2023-10-06T11:00:21.759423+0000","last_active":"2023-10-06T11:00:21.764340+0000","last_peered":"2023-10-06T11:00:21.764340+0000","last_clean":"2023-10-06T11:00:21.764340+0000","last_became_active":"2023-10-06T11:00:21.757844+0000","last_became_peered":"2023-10-06T11:00:21.757844+0000","last_unstale":"2023-10-06T11:00:21.764340+0000","last_undegraded":"2023-10-06T11:00:21.764340+0000","last_fullsized":"2023-10-06T11:00:21.764340+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:31.159104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.766604+0000","last_change":"2023-10-06T11:00:20.757284+0000","last_active":"2023-10-06T11:00:21.766604+0000","last_peered":"2023-10-06T11:00:21.766604+0000","last_clean":"2023-10-06T11:00:21.766604+0000","last_became_active":"2023-10-06T11:00:20.756993+0000","last_became_peered":"2023-10-06T11:00:20.756993+0000","last_unstale":"2023-10-06T11:00:21.766604+0000","last_undegraded":"2023-10-06T11:00:21.766604+0000","last_fullsized":"2023-10-06T11:00:21.766604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:30.153243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.752029+0000","last_change":"2023-10-06T11:00:21.749466+0000","last_active":"2023-10-06T11:00:21.752029+0000","last_peered":"2023-10-06T11:00:21.752029+0000","last_clean":"2023-10-06T11:00:21.752029+0000","last_became_active":"2023-10-06T11:00:21.749182+0000","last_became_peered":"2023-10-06T11:00:21.749182+0000","last_unstale":"2023-10-06T11:00:21.752029+0000","last_undegraded":"2023-10-06T11:00:21.752029+0000","last_fullsized":"2023-10-06T11:00:21.752029+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:18.489058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.775261+0000","last_change":"2023-10-06T11:00:20.761505+0000","last_active":"2023-10-06T11:00:21.775261+0000","last_peered":"2023-10-06T11:00:21.775261+0000","last_clean":"2023-10-06T11:00:21.775261+0000","last_became_active":"2023-10-06T11:00:20.761239+0000","last_became_peered":"2023-10-06T11:00:20.761239+0000","last_unstale":"2023-10-06T11:00:21.775261+0000","last_undegraded":"2023-10-06T11:00:21.775261+0000","last_fullsized":"2023-10-06T11:00:21.775261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:22.755742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.778614+0000","last_change":"2023-10-06T11:00:21.777387+0000","last_active":"2023-10-06T11:00:21.778614+0000","last_peered":"2023-10-06T11:00:21.778614+0000","last_clean":"2023-10-06T11:00:21.778614+0000","last_became_active":"2023-10-06T11:00:21.777108+0000","last_became_peered":"2023-10-06T11:00:21.777108+0000","last_unstale":"2023-10-06T11:00:21.778614+0000","last_undegraded":"2023-10-06T11:00:21.778614+0000","last_fullsized":"2023-10-06T11:00:21.778614+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:05.502004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.764661+0000","last_change":"2023-10-06T11:00:20.755979+0000","last_active":"2023-10-06T11:00:21.764661+0000","last_peered":"2023-10-06T11:00:21.764661+0000","last_clean":"2023-10-06T11:00:21.764661+0000","last_became_active":"2023-10-06T11:00:20.755509+0000","last_became_peered":"2023-10-06T11:00:20.755509+0000","last_unstale":"2023-10-06T11:00:21.764661+0000","last_undegraded":"2023-10-06T11:00:21.764661+0000","last_fullsized":"2023-10-06T11:00:21.764661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:11.251758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.778307+0000","last_change":"2023-10-06T11:00:21.775352+0000","last_active":"2023-10-06T11:00:21.778307+0000","last_peered":"2023-10-06T11:00:21.778307+0000","last_clean":"2023-10-06T11:00:21.778307+0000","last_became_active":"2023-10-06T11:00:21.774963+0000","last_became_peered":"2023-10-06T11:00:21.774963+0000","last_unstale":"2023-10-06T11:00:21.778307+0000","last_undegraded":"2023-10-06T11:00:21.778307+0000","last_fullsized":"2023-10-06T11:00:21.778307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:53:09.955733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.748829+0000","last_change":"2023-10-06T11:00:20.749373+0000","last_active":"2023-10-06T11:00:21.748829+0000","last_peered":"2023-10-06T11:00:21.748829+0000","last_clean":"2023-10-06T11:00:21.748829+0000","last_became_active":"2023-10-06T11:00:20.749058+0000","last_became_peered":"2023-10-06T11:00:20.749058+0000","last_unstale":"2023-10-06T11:00:21.748829+0000","last_undegraded":"2023-10-06T11:00:21.748829+0000","last_fullsized":"2023-10-06T11:00:21.748829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:25.215468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.761644+0000","last_change":"2023-10-06T11:00:21.757045+0000","last_active":"2023-10-06T11:00:21.761644+0000","last_peered":"2023-10-06T11:00:21.761644+0000","last_clean":"2023-10-06T11:00:21.761644+0000","last_became_active":"2023-10-06T11:00:21.755923+0000","last_became_peered":"2023-10-06T11:00:21.755923+0000","last_unstale":"2023-10-06T11:00:21.761644+0000","last_undegraded":"2023-10-06T11:00:21.761644+0000","last_fullsized":"2023-10-06T11:00:21.761644+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:31.159104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.748459+0000","last_change":"2023-10-06T11:00:20.760623+0000","last_active":"2023-10-06T11:00:21.748459+0000","last_peered":"2023-10-06T11:00:21.748459+0000","last_clean":"2023-10-06T11:00:21.748459+0000","last_became_active":"2023-10-06T11:00:20.760318+0000","last_became_peered":"2023-10-06T11:00:20.760318+0000","last_unstale":"2023-10-06T11:00:21.748459+0000","last_undegraded":"2023-10-06T11:00:21.748459+0000","last_fullsized":"2023-10-06T11:00:21.748459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:52:19.522262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.772393+0000","last_change":"2023-10-06T11:00:21.771182+0000","last_active":"2023-10-06T11:00:21.772393+0000","last_peered":"2023-10-06T11:00:21.772393+0000","last_clean":"2023-10-06T11:00:21.772393+0000","last_became_active":"2023-10-06T11:00:21.770801+0000","last_became_peered":"2023-10-06T11:00:21.770801+0000","last_unstale":"2023-10-06T11:00:21.772393+0000","last_undegraded":"2023-10-06T11:00:21.772393+0000","last_fullsized":"2023-10-06T11:00:21.772393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:06.323724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.745389+0000","last_change":"2023-10-06T11:00:20.758990+0000","last_active":"2023-10-06T11:00:21.745389+0000","last_peered":"2023-10-06T11:00:21.745389+0000","last_clean":"2023-10-06T11:00:21.745389+0000","last_became_active":"2023-10-06T11:00:20.758718+0000","last_became_peered":"2023-10-06T11:00:20.758718+0000","last_unstale":"2023-10-06T11:00:21.745389+0000","last_undegraded":"2023-10-06T11:00:21.745389+0000","last_fullsized":"2023-10-06T11:00:21.745389+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:08.936005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.768862+0000","last_change":"2023-10-06T11:00:21.765429+0000","last_active":"2023-10-06T11:00:21.768862+0000","last_peered":"2023-10-06T11:00:21.768862+0000","last_clean":"2023-10-06T11:00:21.768862+0000","last_became_active":"2023-10-06T11:00:21.765073+0000","last_became_peered":"2023-10-06T11:00:21.765073+0000","last_unstale":"2023-10-06T11:00:21.768862+0000","last_undegraded":"2023-10-06T11:00:21.768862+0000","last_fullsized":"2023-10-06T11:00:21.768862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:39.179161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.752909+0000","last_change":"2023-10-06T11:00:20.756650+0000","last_active":"2023-10-06T11:00:21.752909+0000","last_peered":"2023-10-06T11:00:21.752909+0000","last_clean":"2023-10-06T11:00:21.752909+0000","last_became_active":"2023-10-06T11:00:20.756397+0000","last_became_peered":"2023-10-06T11:00:20.756397+0000","last_unstale":"2023-10-06T11:00:21.752909+0000","last_undegraded":"2023-10-06T11:00:21.752909+0000","last_fullsized":"2023-10-06T11:00:21.752909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:26.988226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.776962+0000","last_change":"2023-10-06T11:00:21.769956+0000","last_active":"2023-10-06T11:00:21.776962+0000","last_peered":"2023-10-06T11:00:21.776962+0000","last_clean":"2023-10-06T11:00:21.776962+0000","last_became_active":"2023-10-06T11:00:21.769701+0000","last_became_peered":"2023-10-06T11:00:21.769701+0000","last_unstale":"2023-10-06T11:00:21.776962+0000","last_undegraded":"2023-10-06T11:00:21.776962+0000","last_fullsized":"2023-10-06T11:00:21.776962+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:08.063734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'3","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.766495+0000","last_change":"2023-10-06T11:00:20.759743+0000","last_active":"2023-10-06T11:00:21.766495+0000","last_peered":"2023-10-06T11:00:21.766495+0000","last_clean":"2023-10-06T11:00:21.766495+0000","last_became_active":"2023-10-06T11:00:20.759423+0000","last_became_peered":"2023-10-06T11:00:20.759423+0000","last_unstale":"2023-10-06T11:00:21.766495+0000","last_undegraded":"2023-10-06T11:00:21.766495+0000","last_fullsized":"2023-10-06T11:00:21.766495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:12.940530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.769031+0000","last_change":"2023-10-06T11:00:21.767665+0000","last_active":"2023-10-06T11:00:21.769031+0000","last_peered":"2023-10-06T11:00:21.769031+0000","last_clean":"2023-10-06T11:00:21.769031+0000","last_became_active":"2023-10-06T11:00:21.767375+0000","last_became_peered":"2023-10-06T11:00:21.767375+0000","last_unstale":"2023-10-06T11:00:21.769031+0000","last_undegraded":"2023-10-06T11:00:21.769031+0000","last_fullsized":"2023-10-06T11:00:21.769031+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:58.956561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'6","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.777901+0000","last_change":"2023-10-06T11:00:20.757554+0000","last_active":"2023-10-06T11:00:21.777901+0000","last_peered":"2023-10-06T11:00:21.777901+0000","last_clean":"2023-10-06T11:00:21.777901+0000","last_became_active":"2023-10-06T11:00:20.757236+0000","last_became_peered":"2023-10-06T11:00:20.757236+0000","last_unstale":"2023-10-06T11:00:21.777901+0000","last_undegraded":"2023-10-06T11:00:21.777901+0000","last_fullsized":"2023-10-06T11:00:21.777901+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:20:51.220731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.773396+0000","last_change":"2023-10-06T11:00:21.772300+0000","last_active":"2023-10-06T11:00:21.773396+0000","last_peered":"2023-10-06T11:00:21.773396+0000","last_clean":"2023-10-06T11:00:21.773396+0000","last_became_active":"2023-10-06T11:00:21.771970+0000","last_became_peered":"2023-10-06T11:00:21.771970+0000","last_unstale":"2023-10-06T11:00:21.773396+0000","last_undegraded":"2023-10-06T11:00:21.773396+0000","last_fullsized":"2023-10-06T11:00:21.773396+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:13.946391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.775196+0000","last_change":"2023-10-06T11:00:20.763640+0000","last_active":"2023-10-06T11:00:21.775196+0000","last_peered":"2023-10-06T11:00:21.775196+0000","last_clean":"2023-10-06T11:00:21.775196+0000","last_became_active":"2023-10-06T11:00:20.763332+0000","last_became_peered":"2023-10-06T11:00:20.763332+0000","last_unstale":"2023-10-06T11:00:21.775196+0000","last_undegraded":"2023-10-06T11:00:21.775196+0000","last_fullsized":"2023-10-06T11:00:21.775196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:57.950700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.777663+0000","last_change":"2023-10-06T11:00:21.772659+0000","last_active":"2023-10-06T11:00:21.777663+0000","last_peered":"2023-10-06T11:00:21.777663+0000","last_clean":"2023-10-06T11:00:21.777663+0000","last_became_active":"2023-10-06T11:00:21.772350+0000","last_became_peered":"2023-10-06T11:00:21.772350+0000","last_unstale":"2023-10-06T11:00:21.777663+0000","last_undegraded":"2023-10-06T11:00:21.777663+0000","last_fullsized":"2023-10-06T11:00:21.777663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:44.151343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.755611+0000","last_change":"2023-10-06T11:00:20.760601+0000","last_active":"2023-10-06T11:00:21.755611+0000","last_peered":"2023-10-06T11:00:21.755611+0000","last_clean":"2023-10-06T11:00:21.755611+0000","last_became_active":"2023-10-06T11:00:20.760305+0000","last_became_peered":"2023-10-06T11:00:20.760305+0000","last_unstale":"2023-10-06T11:00:21.755611+0000","last_undegraded":"2023-10-06T11:00:21.755611+0000","last_fullsized":"2023-10-06T11:00:21.755611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:52:19.522262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.776983+0000","last_change":"2023-10-06T11:00:21.766867+0000","last_active":"2023-10-06T11:00:21.776983+0000","last_peered":"2023-10-06T11:00:21.776983+0000","last_clean":"2023-10-06T11:00:21.776983+0000","last_became_active":"2023-10-06T11:00:21.766615+0000","last_became_peered":"2023-10-06T11:00:21.766615+0000","last_unstale":"2023-10-06T11:00:21.776983+0000","last_undegraded":"2023-10-06T11:00:21.776983+0000","last_fullsized":"2023-10-06T11:00:21.776983+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:18.489058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.749361+0000","last_change":"2023-10-06T11:00:20.764430+0000","last_active":"2023-10-06T11:00:21.749361+0000","last_peered":"2023-10-06T11:00:21.749361+0000","last_clean":"2023-10-06T11:00:21.749361+0000","last_became_active":"2023-10-06T11:00:20.763811+0000","last_became_peered":"2023-10-06T11:00:20.763811+0000","last_unstale":"2023-10-06T11:00:21.749361+0000","last_undegraded":"2023-10-06T11:00:21.749361+0000","last_fullsized":"2023-10-06T11:00:21.749361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:43.145482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.768970+0000","last_change":"2023-10-06T11:00:21.767742+0000","last_active":"2023-10-06T11:00:21.768970+0000","last_peered":"2023-10-06T11:00:21.768970+0000","last_clean":"2023-10-06T11:00:21.768970+0000","last_became_active":"2023-10-06T11:00:21.767242+0000","last_became_peered":"2023-10-06T11:00:21.767242+0000","last_unstale":"2023-10-06T11:00:21.768970+0000","last_undegraded":"2023-10-06T11:00:21.768970+0000","last_fullsized":"2023-10-06T11:00:21.768970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:44.151343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'8","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.778262+0000","last_change":"2023-10-06T11:00:20.758673+0000","last_active":"2023-10-06T11:00:21.778262+0000","last_peered":"2023-10-06T11:00:21.778262+0000","last_clean":"2023-10-06T11:00:21.778262+0000","last_became_active":"2023-10-06T11:00:20.756880+0000","last_became_peered":"2023-10-06T11:00:20.756880+0000","last_unstale":"2023-10-06T11:00:21.778262+0000","last_undegraded":"2023-10-06T11:00:21.778262+0000","last_fullsized":"2023-10-06T11:00:21.778262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:42.781533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.762961+0000","last_change":"2023-10-06T11:00:21.758957+0000","last_active":"2023-10-06T11:00:21.762961+0000","last_peered":"2023-10-06T11:00:21.762961+0000","last_clean":"2023-10-06T11:00:21.762961+0000","last_became_active":"2023-10-06T11:00:21.758714+0000","last_became_peered":"2023-10-06T11:00:21.758714+0000","last_unstale":"2023-10-06T11:00:21.762961+0000","last_undegraded":"2023-10-06T11:00:21.762961+0000","last_fullsized":"2023-10-06T11:00:21.762961+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:52:20.528123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.777777+0000","last_change":"2023-10-06T11:00:20.763786+0000","last_active":"2023-10-06T11:00:21.777777+0000","last_peered":"2023-10-06T11:00:21.777777+0000","last_clean":"2023-10-06T11:00:21.777777+0000","last_became_active":"2023-10-06T11:00:20.763479+0000","last_became_peered":"2023-10-06T11:00:20.763479+0000","last_unstale":"2023-10-06T11:00:21.777777+0000","last_undegraded":"2023-10-06T11:00:21.777777+0000","last_fullsized":"2023-10-06T11:00:21.777777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:05.029965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.776652+0000","last_change":"2023-10-06T11:00:21.770195+0000","last_active":"2023-10-06T11:00:21.776652+0000","last_peered":"2023-10-06T11:00:21.776652+0000","last_clean":"2023-10-06T11:00:21.776652+0000","last_became_active":"2023-10-06T11:00:21.769909+0000","last_became_peered":"2023-10-06T11:00:21.769909+0000","last_unstale":"2023-10-06T11:00:21.776652+0000","last_undegraded":"2023-10-06T11:00:21.776652+0000","last_fullsized":"2023-10-06T11:00:21.776652+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:09.941866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.765877+0000","last_change":"2023-10-06T11:00:20.755368+0000","last_active":"2023-10-06T11:00:21.765877+0000","last_peered":"2023-10-06T11:00:21.765877+0000","last_clean":"2023-10-06T11:00:21.765877+0000","last_became_active":"2023-10-06T11:00:20.754997+0000","last_became_peered":"2023-10-06T11:00:20.754997+0000","last_unstale":"2023-10-06T11:00:21.765877+0000","last_undegraded":"2023-10-06T11:00:21.765877+0000","last_fullsized":"2023-10-06T11:00:21.765877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:28.447508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.767910+0000","last_change":"2023-10-06T11:00:21.762639+0000","last_active":"2023-10-06T11:00:21.767910+0000","last_peered":"2023-10-06T11:00:21.767910+0000","last_clean":"2023-10-06T11:00:21.767910+0000","last_became_active":"2023-10-06T11:00:21.762325+0000","last_became_peered":"2023-10-06T11:00:21.762325+0000","last_unstale":"2023-10-06T11:00:21.767910+0000","last_undegraded":"2023-10-06T11:00:21.767910+0000","last_fullsized":"2023-10-06T11:00:21.767910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:03.323504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.768949+0000","last_change":"2023-10-06T11:00:20.751745+0000","last_active":"2023-10-06T11:00:21.768949+0000","last_peered":"2023-10-06T11:00:21.768949+0000","last_clean":"2023-10-06T11:00:21.768949+0000","last_became_active":"2023-10-06T11:00:20.751427+0000","last_became_peered":"2023-10-06T11:00:20.751427+0000","last_unstale":"2023-10-06T11:00:21.768949+0000","last_undegraded":"2023-10-06T11:00:21.768949+0000","last_fullsized":"2023-10-06T11:00:21.768949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:16.602439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.764967+0000","last_change":"2023-10-06T11:00:21.761054+0000","last_active":"2023-10-06T11:00:21.764967+0000","last_peered":"2023-10-06T11:00:21.764967+0000","last_clean":"2023-10-06T11:00:21.764967+0000","last_became_active":"2023-10-06T11:00:21.760721+0000","last_became_peered":"2023-10-06T11:00:21.760721+0000","last_unstale":"2023-10-06T11:00:21.764967+0000","last_undegraded":"2023-10-06T11:00:21.764967+0000","last_fullsized":"2023-10-06T11:00:21.764967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:26.221329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.752219+0000","last_change":"2023-10-06T11:00:20.759987+0000","last_active":"2023-10-06T11:00:21.752219+0000","last_peered":"2023-10-06T11:00:21.752219+0000","last_clean":"2023-10-06T11:00:21.752219+0000","last_became_active":"2023-10-06T11:00:20.759728+0000","last_became_peered":"2023-10-06T11:00:20.759728+0000","last_unstale":"2023-10-06T11:00:21.752219+0000","last_undegraded":"2023-10-06T11:00:21.752219+0000","last_fullsized":"2023-10-06T11:00:21.752219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:12.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.777886+0000","last_change":"2023-10-06T11:00:21.772790+0000","last_active":"2023-10-06T11:00:21.777886+0000","last_peered":"2023-10-06T11:00:21.777886+0000","last_clean":"2023-10-06T11:00:21.777886+0000","last_became_active":"2023-10-06T11:00:21.772516+0000","last_became_peered":"2023-10-06T11:00:21.772516+0000","last_unstale":"2023-10-06T11:00:21.777886+0000","last_undegraded":"2023-10-06T11:00:21.777886+0000","last_fullsized":"2023-10-06T11:00:21.777886+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:27:53.411400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.775090+0000","last_change":"2023-10-06T11:00:20.754091+0000","last_active":"2023-10-06T11:00:21.775090+0000","last_peered":"2023-10-06T11:00:21.775090+0000","last_clean":"2023-10-06T11:00:21.775090+0000","last_became_active":"2023-10-06T11:00:20.753543+0000","last_became_peered":"2023-10-06T11:00:20.753543+0000","last_unstale":"2023-10-06T11:00:21.775090+0000","last_undegraded":"2023-10-06T11:00:21.775090+0000","last_fullsized":"2023-10-06T11:00:21.775090+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:38.173300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.763873+0000","last_change":"2023-10-06T11:00:21.759070+0000","last_active":"2023-10-06T11:00:21.763873+0000","last_peered":"2023-10-06T11:00:21.763873+0000","last_clean":"2023-10-06T11:00:21.763873+0000","last_became_active":"2023-10-06T11:00:21.758776+0000","last_became_peered":"2023-10-06T11:00:21.758776+0000","last_unstale":"2023-10-06T11:00:21.763873+0000","last_undegraded":"2023-10-06T11:00:21.763873+0000","last_fullsized":"2023-10-06T11:00:21.763873+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:17.608300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.748767+0000","last_change":"2023-10-06T11:00:20.755205+0000","last_active":"2023-10-06T11:00:21.748767+0000","last_peered":"2023-10-06T11:00:21.748767+0000","last_clean":"2023-10-06T11:00:21.748767+0000","last_became_active":"2023-10-06T11:00:20.754921+0000","last_became_peered":"2023-10-06T11:00:20.754921+0000","last_unstale":"2023-10-06T11:00:21.748767+0000","last_undegraded":"2023-10-06T11:00:21.748767+0000","last_fullsized":"2023-10-06T11:00:21.748767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:30.153243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.762882+0000","last_change":"2023-10-06T11:00:21.759535+0000","last_active":"2023-10-06T11:00:21.762882+0000","last_peered":"2023-10-06T11:00:21.762882+0000","last_clean":"2023-10-06T11:00:21.762882+0000","last_became_active":"2023-10-06T11:00:21.759317+0000","last_became_peered":"2023-10-06T11:00:21.759317+0000","last_unstale":"2023-10-06T11:00:21.762882+0000","last_undegraded":"2023-10-06T11:00:21.762882+0000","last_fullsized":"2023-10-06T11:00:21.762882+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:17.608300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.747895+0000","last_change":"2023-10-06T11:00:20.759350+0000","last_active":"2023-10-06T11:00:21.747895+0000","last_peered":"2023-10-06T11:00:21.747895+0000","last_clean":"2023-10-06T11:00:21.747895+0000","last_became_active":"2023-10-06T11:00:20.757154+0000","last_became_peered":"2023-10-06T11:00:20.757154+0000","last_unstale":"2023-10-06T11:00:21.747895+0000","last_undegraded":"2023-10-06T11:00:21.747895+0000","last_fullsized":"2023-10-06T11:00:21.747895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:16:19.741786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.773041+0000","last_change":"2023-10-06T11:00:21.764666+0000","last_active":"2023-10-06T11:00:21.773041+0000","last_peered":"2023-10-06T11:00:21.773041+0000","last_clean":"2023-10-06T11:00:21.773041+0000","last_became_active":"2023-10-06T11:00:21.764394+0000","last_became_peered":"2023-10-06T11:00:21.764394+0000","last_unstale":"2023-10-06T11:00:21.773041+0000","last_undegraded":"2023-10-06T11:00:21.773041+0000","last_fullsized":"2023-10-06T11:00:21.773041+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:58.956561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.755044+0000","last_change":"2023-10-06T11:00:20.760026+0000","last_active":"2023-10-06T11:00:21.755044+0000","last_peered":"2023-10-06T11:00:21.755044+0000","last_clean":"2023-10-06T11:00:21.755044+0000","last_became_active":"2023-10-06T11:00:20.759693+0000","last_became_peered":"2023-10-06T11:00:20.759693+0000","last_unstale":"2023-10-06T11:00:21.755044+0000","last_undegraded":"2023-10-06T11:00:21.755044+0000","last_fullsized":"2023-10-06T11:00:21.755044+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:16.602439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.777473+0000","last_change":"2023-10-06T11:00:21.768044+0000","last_active":"2023-10-06T11:00:21.777473+0000","last_peered":"2023-10-06T11:00:21.777473+0000","last_clean":"2023-10-06T11:00:21.777473+0000","last_became_active":"2023-10-06T11:00:21.762323+0000","last_became_peered":"2023-10-06T11:00:21.762323+0000","last_unstale":"2023-10-06T11:00:21.777473+0000","last_undegraded":"2023-10-06T11:00:21.777473+0000","last_fullsized":"2023-10-06T11:00:21.777473+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:02.376504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.746517+0000","last_change":"2023-10-06T11:00:20.763560+0000","last_active":"2023-10-06T11:00:21.746517+0000","last_peered":"2023-10-06T11:00:21.746517+0000","last_clean":"2023-10-06T11:00:21.746517+0000","last_became_active":"2023-10-06T11:00:20.763285+0000","last_became_peered":"2023-10-06T11:00:20.763285+0000","last_unstale":"2023-10-06T11:00:21.746517+0000","last_undegraded":"2023-10-06T11:00:21.746517+0000","last_fullsized":"2023-10-06T11:00:21.746517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:22.875367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.745235+0000","last_change":"2023-10-06T10:58:56.328381+0000","last_active":"2023-10-06T11:00:21.745235+0000","last_peered":"2023-10-06T11:00:21.745235+0000","last_clean":"2023-10-06T11:00:21.745235+0000","last_became_active":"2023-10-06T10:58:56.328054+0000","last_became_peered":"2023-10-06T10:58:56.328054+0000","last_unstale":"2023-10-06T11:00:21.745235+0000","last_undegraded":"2023-10-06T11:00:21.745235+0000","last_fullsized":"2023-10-06T11:00:21.745235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.777866+0000","last_change":"2023-10-06T11:00:21.771827+0000","last_active":"2023-10-06T11:00:21.777866+0000","last_peered":"2023-10-06T11:00:21.777866+0000","last_clean":"2023-10-06T11:00:21.777866+0000","last_became_active":"2023-10-06T11:00:21.771550+0000","last_became_peered":"2023-10-06T11:00:21.771550+0000","last_unstale":"2023-10-06T11:00:21.777866+0000","last_undegraded":"2023-10-06T11:00:21.777866+0000","last_fullsized":"2023-10-06T11:00:21.777866+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:33.009327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.754052+0000","last_change":"2023-10-06T11:00:20.755706+0000","last_active":"2023-10-06T11:00:21.754052+0000","last_peered":"2023-10-06T11:00:21.754052+0000","last_clean":"2023-10-06T11:00:21.754052+0000","last_became_active":"2023-10-06T11:00:20.755401+0000","last_became_peered":"2023-10-06T11:00:20.755401+0000","last_unstale":"2023-10-06T11:00:21.754052+0000","last_undegraded":"2023-10-06T11:00:21.754052+0000","last_fullsized":"2023-10-06T11:00:21.754052+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:34.642462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.752964+0000","last_change":"2023-10-06T10:58:56.326189+0000","last_active":"2023-10-06T11:00:21.752964+0000","last_peered":"2023-10-06T11:00:21.752964+0000","last_clean":"2023-10-06T11:00:21.752964+0000","last_became_active":"2023-10-06T10:58:56.325852+0000","last_became_peered":"2023-10-06T10:58:56.325852+0000","last_unstale":"2023-10-06T11:00:21.752964+0000","last_undegraded":"2023-10-06T11:00:21.752964+0000","last_fullsized":"2023-10-06T11:00:21.752964+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:28.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.769013+0000","last_change":"2023-10-06T11:00:21.767253+0000","last_active":"2023-10-06T11:00:21.769013+0000","last_peered":"2023-10-06T11:00:21.769013+0000","last_clean":"2023-10-06T11:00:21.769013+0000","last_became_active":"2023-10-06T11:00:21.766929+0000","last_became_peered":"2023-10-06T11:00:21.766929+0000","last_unstale":"2023-10-06T11:00:21.769013+0000","last_undegraded":"2023-10-06T11:00:21.769013+0000","last_fullsized":"2023-10-06T11:00:21.769013+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:53:30.449374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.743824+0000","last_change":"2023-10-06T11:00:20.754993+0000","last_active":"2023-10-06T11:00:21.743824+0000","last_peered":"2023-10-06T11:00:21.743824+0000","last_clean":"2023-10-06T11:00:21.743824+0000","last_became_active":"2023-10-06T11:00:20.754627+0000","last_became_peered":"2023-10-06T11:00:20.754627+0000","last_unstale":"2023-10-06T11:00:21.743824+0000","last_undegraded":"2023-10-06T11:00:21.743824+0000","last_fullsized":"2023-10-06T11:00:21.743824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:03.577436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.743934+0000","last_change":"2023-10-06T10:58:56.325363+0000","last_active":"2023-10-06T11:00:21.743934+0000","last_peered":"2023-10-06T11:00:21.743934+0000","last_clean":"2023-10-06T11:00:21.743934+0000","last_became_active":"2023-10-06T10:58:56.325095+0000","last_became_peered":"2023-10-06T10:58:56.325095+0000","last_unstale":"2023-10-06T11:00:21.743934+0000","last_undegraded":"2023-10-06T11:00:21.743934+0000","last_fullsized":"2023-10-06T11:00:21.743934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":179,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.755239+0000","last_change":"2023-10-06T10:58:57.328525+0000","last_active":"2023-10-06T11:00:21.755239+0000","last_peered":"2023-10-06T11:00:21.755239+0000","last_clean":"2023-10-06T11:00:21.755239+0000","last_became_active":"2023-10-06T10:58:57.327509+0000","last_became_peered":"2023-10-06T10:58:57.327509+0000","last_unstale":"2023-10-06T11:00:21.755239+0000","last_undegraded":"2023-10-06T11:00:21.755239+0000","last_fullsized":"2023-10-06T11:00:21.755239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_clean_scrub_stamp":"2023-10-06T10:58:56.314996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:45.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.778585+0000","last_change":"2023-10-06T11:00:21.776443+0000","last_active":"2023-10-06T11:00:21.778585+0000","last_peered":"2023-10-06T11:00:21.778585+0000","last_clean":"2023-10-06T11:00:21.778585+0000","last_became_active":"2023-10-06T11:00:21.776166+0000","last_became_peered":"2023-10-06T11:00:21.776166+0000","last_unstale":"2023-10-06T11:00:21.778585+0000","last_undegraded":"2023-10-06T11:00:21.778585+0000","last_fullsized":"2023-10-06T11:00:21.778585+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:33.009327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.753800+0000","last_change":"2023-10-06T11:00:20.761301+0000","last_active":"2023-10-06T11:00:21.753800+0000","last_peered":"2023-10-06T11:00:21.753800+0000","last_clean":"2023-10-06T11:00:21.753800+0000","last_became_active":"2023-10-06T11:00:20.760972+0000","last_became_peered":"2023-10-06T11:00:20.760972+0000","last_unstale":"2023-10-06T11:00:21.753800+0000","last_undegraded":"2023-10-06T11:00:21.753800+0000","last_fullsized":"2023-10-06T11:00:21.753800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:38.272180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.755681+0000","last_change":"2023-10-06T10:58:56.331567+0000","last_active":"2023-10-06T11:00:21.755681+0000","last_peered":"2023-10-06T11:00:21.755681+0000","last_clean":"2023-10-06T11:00:21.755681+0000","last_became_active":"2023-10-06T10:58:56.331244+0000","last_became_peered":"2023-10-06T10:58:56.331244+0000","last_unstale":"2023-10-06T11:00:21.755681+0000","last_undegraded":"2023-10-06T11:00:21.755681+0000","last_fullsized":"2023-10-06T11:00:21.755681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.777928+0000","last_change":"2023-10-06T11:00:21.770722+0000","last_active":"2023-10-06T11:00:21.777928+0000","last_peered":"2023-10-06T11:00:21.777928+0000","last_clean":"2023-10-06T11:00:21.777928+0000","last_became_active":"2023-10-06T11:00:21.770371+0000","last_became_peered":"2023-10-06T11:00:21.770371+0000","last_unstale":"2023-10-06T11:00:21.777928+0000","last_undegraded":"2023-10-06T11:00:21.777928+0000","last_fullsized":"2023-10-06T11:00:21.777928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:53:30.449374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.777462+0000","last_change":"2023-10-06T11:00:20.762946+0000","last_active":"2023-10-06T11:00:21.777462+0000","last_peered":"2023-10-06T11:00:21.777462+0000","last_clean":"2023-10-06T11:00:21.777462+0000","last_became_active":"2023-10-06T11:00:20.762656+0000","last_became_peered":"2023-10-06T11:00:20.762656+0000","last_unstale":"2023-10-06T11:00:21.777462+0000","last_undegraded":"2023-10-06T11:00:21.777462+0000","last_fullsized":"2023-10-06T11:00:21.777462+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:38.272180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.755142+0000","last_change":"2023-10-06T10:58:56.332184+0000","last_active":"2023-10-06T11:00:21.755142+0000","last_peered":"2023-10-06T11:00:21.755142+0000","last_clean":"2023-10-06T11:00:21.755142+0000","last_became_active":"2023-10-06T10:58:56.331830+0000","last_became_peered":"2023-10-06T10:58:56.331830+0000","last_unstale":"2023-10-06T11:00:21.755142+0000","last_undegraded":"2023-10-06T11:00:21.755142+0000","last_fullsized":"2023-10-06T11:00:21.755142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:54:02.320834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.774971+0000","last_change":"2023-10-06T11:00:21.773598+0000","last_active":"2023-10-06T11:00:21.774971+0000","last_peered":"2023-10-06T11:00:21.774971+0000","last_clean":"2023-10-06T11:00:21.774971+0000","last_became_active":"2023-10-06T11:00:21.773178+0000","last_became_peered":"2023-10-06T11:00:21.773178+0000","last_unstale":"2023-10-06T11:00:21.774971+0000","last_undegraded":"2023-10-06T11:00:21.774971+0000","last_fullsized":"2023-10-06T11:00:21.774971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:16.895428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.749187+0000","last_change":"2023-10-06T11:00:20.757021+0000","last_active":"2023-10-06T11:00:21.749187+0000","last_peered":"2023-10-06T11:00:21.749187+0000","last_clean":"2023-10-06T11:00:21.749187+0000","last_became_active":"2023-10-06T11:00:20.756751+0000","last_became_peered":"2023-10-06T11:00:20.756751+0000","last_unstale":"2023-10-06T11:00:21.749187+0000","last_undegraded":"2023-10-06T11:00:21.749187+0000","last_fullsized":"2023-10-06T11:00:21.749187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:14:18.388793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.748897+0000","last_change":"2023-10-06T10:58:56.331654+0000","last_active":"2023-10-06T11:00:21.748897+0000","last_peered":"2023-10-06T11:00:21.748897+0000","last_clean":"2023-10-06T11:00:21.748897+0000","last_became_active":"2023-10-06T10:58:56.331345+0000","last_became_peered":"2023-10-06T10:58:56.331345+0000","last_unstale":"2023-10-06T11:00:21.748897+0000","last_undegraded":"2023-10-06T11:00:21.748897+0000","last_fullsized":"2023-10-06T11:00:21.748897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.768903+0000","last_change":"2023-10-06T11:00:21.764271+0000","last_active":"2023-10-06T11:00:21.768903+0000","last_peered":"2023-10-06T11:00:21.768903+0000","last_clean":"2023-10-06T11:00:21.768903+0000","last_became_active":"2023-10-06T11:00:21.763952+0000","last_became_peered":"2023-10-06T11:00:21.763952+0000","last_unstale":"2023-10-06T11:00:21.768903+0000","last_undegraded":"2023-10-06T11:00:21.768903+0000","last_fullsized":"2023-10-06T11:00:21.768903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:01.095504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.743719+0000","last_change":"2023-10-06T11:00:20.760048+0000","last_active":"2023-10-06T11:00:21.743719+0000","last_peered":"2023-10-06T11:00:21.743719+0000","last_clean":"2023-10-06T11:00:21.743719+0000","last_became_active":"2023-10-06T11:00:20.759774+0000","last_became_peered":"2023-10-06T11:00:20.759774+0000","last_unstale":"2023-10-06T11:00:21.743719+0000","last_undegraded":"2023-10-06T11:00:21.743719+0000","last_fullsized":"2023-10-06T11:00:21.743719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:16:19.741786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.743605+0000","last_change":"2023-10-06T10:58:56.331650+0000","last_active":"2023-10-06T11:00:21.743605+0000","last_peered":"2023-10-06T11:00:21.743605+0000","last_clean":"2023-10-06T11:00:21.743605+0000","last_became_active":"2023-10-06T10:58:56.331344+0000","last_became_peered":"2023-10-06T10:58:56.331344+0000","last_unstale":"2023-10-06T11:00:21.743605+0000","last_undegraded":"2023-10-06T11:00:21.743605+0000","last_fullsized":"2023-10-06T11:00:21.743605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:45.584545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.763223+0000","last_change":"2023-10-06T11:00:21.757355+0000","last_active":"2023-10-06T11:00:21.763223+0000","last_peered":"2023-10-06T11:00:21.763223+0000","last_clean":"2023-10-06T11:00:21.763223+0000","last_became_active":"2023-10-06T11:00:21.756946+0000","last_became_peered":"2023-10-06T11:00:21.756946+0000","last_unstale":"2023-10-06T11:00:21.763223+0000","last_undegraded":"2023-10-06T11:00:21.763223+0000","last_fullsized":"2023-10-06T11:00:21.763223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:20.733780+0000","last_clean_scrub_stamp":"2023-10-06T11:00:20.733780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:04:17.082434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.748597+0000","last_change":"2023-10-06T11:00:20.764915+0000","last_active":"2023-10-06T11:00:21.748597+0000","last_peered":"2023-10-06T11:00:21.748597+0000","last_clean":"2023-10-06T11:00:21.748597+0000","last_became_active":"2023-10-06T11:00:20.764645+0000","last_became_peered":"2023-10-06T11:00:20.764645+0000","last_unstale":"2023-10-06T11:00:21.748597+0000","last_undegraded":"2023-10-06T11:00:21.748597+0000","last_fullsized":"2023-10-06T11:00:21.748597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:00:19.727918+0000","last_clean_scrub_stamp":"2023-10-06T11:00:19.727918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:16.602439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T11:00:21.744468+0000","last_change":"2023-10-06T10:58:56.326315+0000","last_active":"2023-10-06T11:00:21.744468+0000","last_peered":"2023-10-06T11:00:21.744468+0000","last_clean":"2023-10-06T11:00:21.744468+0000","last_became_active":"2023-10-06T10:58:56.325897+0000","last_became_peered":"2023-10-06T10:58:56.325897+0000","last_unstale":"2023-10-06T11:00:21.744468+0000","last_undegraded":"2023-10-06T11:00:21.744468+0000","last_fullsized":"2023-10-06T11:00:21.744468+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298324,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073516,"statfs":{"total":96636764160,"available":96331280384,"internally_reserved":0,"allocated":1060864,"data_stored":798437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 10:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.78900000000000003}]},{"osd":1,"last update":"Fri Oct 6 10:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.754}]},{"osd":2,"last update":"Fri Oct 6 10:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.76600000000000001}]},{"osd":3,"last update":"Fri Oct 6 10:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.81100000000000005}]},{"osd":4,"last update":"Fri Oct 6 10:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.623},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Oct 6 10:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Fri Oct 6 10:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.70599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297744,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074096,"statfs":{"total":96636764160,"available":96331874304,"internally_reserved":0,"allocated":466944,"data_stored":207645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.81999999999999995}]},{"osd":1,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.67100000000000004}]},{"osd":2,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.74399999999999999}]},{"osd":3,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.79300000000000004}]},{"osd":4,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.51700000000000002}]},{"osd":7,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298324,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073516,"statfs":{"total":96636764160,"available":96331280384,"internally_reserved":0,"allocated":1060864,"data_stored":798417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.255},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.40500000000000003}]},{"osd":3,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.752},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.621}]},{"osd":6,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.65800000000000003}]},{"osd":7,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.78800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":462848,"data_stored":207035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.46800000000000003}]},{"osd":2,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.432},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.0870000000000002,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.9540000000000002,"5min":2.9540000000000002,"15min":2.9540000000000002},"last":0.75},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.69999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":479232,"data_stored":209537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.28399999999999997}]},{"osd":1,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.38900000000000001}]},{"osd":3,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.317},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.46100000000000002}]},{"osd":4,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.873},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.93500000000000005}]},{"osd":7,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.85599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297748,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074092,"statfs":{"total":96636764160,"available":96331870208,"internally_reserved":0,"allocated":471040,"data_stored":207611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":4.617,"5min":4.617,"15min":4.617},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":4.3230000000000004,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":6.4400000000000004,"5min":6.4400000000000004,"15min":6.4400000000000004},"last":0.5},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":6.4930000000000003,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":4.3760000000000003,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.41699999999999998}]},{"osd":5,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.4470000000000001,"5min":4.4470000000000001,"15min":4.4470000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.76100000000000001}]},{"osd":7,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.4130000000000003,"5min":4.4130000000000003,"15min":4.4130000000000003},"last":0.57199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":475136,"data_stored":209515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.86799999999999999}]},{"osd":1,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":5.476,"5min":5.476,"15min":5.476},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.91000000000000003}]},{"osd":5,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Oct 6 10:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.82599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":462848,"data_stored":207071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 10:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:00:26.401 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:00:26.401 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:00:26.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.575+0000 7fbf6d8fb700 1 Processor -- start 2023-10-06T11:00:26.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.575+0000 7fbf6d8fb700 1 -- start start 2023-10-06T11:00:26.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.576+0000 7fbf6d8fb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbf680abc60 0x7fbf680b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:26.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.576+0000 7fbf6d8fb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf6806cf80 0x7fbf68159d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:26.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.576+0000 7fbf6d8fb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf680b0650 con 0x7fbf680ac030 2023-10-06T11:00:26.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.576+0000 7fbf6d8fb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6815aae0 con 0x7fbf680abc60 2023-10-06T11:00:26.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.576+0000 7fbf6d8fb700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680afd20 con 0x7fbf6806cf80 2023-10-06T11:00:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.577+0000 7fbf66ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbf680abc60 0x7fbf680b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.577+0000 7fbf677fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf6806cf80 0x7fbf68159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.577+0000 7fbf66ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbf680abc60 0x7fbf680b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:35690/0 (socket says 172.21.15.7:35690) 2023-10-06T11:00:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.577+0000 7fbf66ffd700 1 -- 172.21.15.7:0/1354473405 learned_addr learned my addr 172.21.15.7:0/1354473405 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.577+0000 7fbf667fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbf680ac030 0x7fbf6806c870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:42478/0 (socket says 172.21.15.7:42478) 2023-10-06T11:00:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.577+0000 7fbf66ffd700 1 -- 172.21.15.7:0/1354473405 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf6806cf80 msgr2=0x7fbf68159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.577+0000 7fbf66ffd700 1 --2- 172.21.15.7:0/1354473405 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf6806cf80 0x7fbf68159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.577+0000 7fbf66ffd700 1 -- 172.21.15.7:0/1354473405 >> v1:172.21.15.50:6789/0 conn(0x7fbf680ac030 legacy=0x7fbf6806c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.577+0000 7fbf66ffd700 1 -- 172.21.15.7:0/1354473405 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf680b0000 con 0x7fbf680abc60 2023-10-06T11:00:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.577+0000 7fbf677fe700 1 --2- 172.21.15.7:0/1354473405 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf6806cf80 0x7fbf68159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.577+0000 7fbf66ffd700 1 --2- 172.21.15.7:0/1354473405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf680abc60 0x7fbf680b0ae0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009990 tx=0x7fbf58009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6760b585ded97b5f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.578+0000 7fbf65ffb700 1 -- 172.21.15.7:0/1354473405 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58009e80 con 0x7fbf680abc60 2023-10-06T11:00:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.578+0000 7fbf65ffb700 1 -- 172.21.15.7:0/1354473405 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf58005c10 con 0x7fbf680abc60 2023-10-06T11:00:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.578+0000 7fbf65ffb700 1 -- 172.21.15.7:0/1354473405 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5800b650 con 0x7fbf680abc60 2023-10-06T11:00:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.578+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/1354473405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf680abc60 msgr2=0x7fbf680b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.578+0000 7fbf6d8fb700 1 --2- 172.21.15.7:0/1354473405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf680abc60 0x7fbf680b0ae0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009990 tx=0x7fbf58009220 comp rx=0 tx=0).stop 2023-10-06T11:00:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.578+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/1354473405 shutdown_connections 2023-10-06T11:00:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.578+0000 7fbf6d8fb700 1 --2- 172.21.15.7:0/1354473405 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf6806cf80 0x7fbf68159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.578+0000 7fbf6d8fb700 1 --2- 172.21.15.7:0/1354473405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf680abc60 0x7fbf680b0ae0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.578+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/1354473405 >> 172.21.15.7:0/1354473405 conn(0x7fbf680cce30 msgr2=0x7fbf680cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.578+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/1354473405 shutdown_connections 2023-10-06T11:00:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.578+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/1354473405 wait complete. 2023-10-06T11:00:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.580+0000 7fbf6d8fb700 1 Processor -- start 2023-10-06T11:00:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.580+0000 7fbf6d8fb700 1 -- start start 2023-10-06T11:00:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.581+0000 7fbf6d8fb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf6806cf80 0x7fbf681554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.581+0000 7fbf6d8fb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf680abc60 0x7fbf68158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.581+0000 7fbf6d8fb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680ac030 0x7fbf680ad940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.581+0000 7fbf6d8fb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf68154440 con 0x7fbf680abc60 2023-10-06T11:00:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.581+0000 7fbf6d8fb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf68154720 con 0x7fbf6806cf80 2023-10-06T11:00:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.581+0000 7fbf6d8fb700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf68154a00 con 0x7fbf680ac030 2023-10-06T11:00:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.581+0000 7fbf667fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf680abc60 0x7fbf68158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.581+0000 7fbf667fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf680abc60 0x7fbf68158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38940/0 (socket says 172.21.15.7:38940) 2023-10-06T11:00:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.581+0000 7fbf667fc700 1 -- 172.21.15.7:0/2840718782 learned_addr learned my addr 172.21.15.7:0/2840718782 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.582+0000 7fbf677fe700 1 --2- 172.21.15.7:0/2840718782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680ac030 0x7fbf680ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.582+0000 7fbf66ffd700 1 --2- 172.21.15.7:0/2840718782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf6806cf80 0x7fbf681554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.582+0000 7fbf667fc700 1 -- 172.21.15.7:0/2840718782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680ac030 msgr2=0x7fbf680ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.582+0000 7fbf667fc700 1 --2- 172.21.15.7:0/2840718782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680ac030 0x7fbf680ad940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.582+0000 7fbf667fc700 1 -- 172.21.15.7:0/2840718782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf6806cf80 msgr2=0x7fbf681554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.582+0000 7fbf667fc700 1 --2- 172.21.15.7:0/2840718782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf6806cf80 0x7fbf681554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.582+0000 7fbf667fc700 1 -- 172.21.15.7:0/2840718782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf60009a20 con 0x7fbf680abc60 2023-10-06T11:00:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.582+0000 7fbf667fc700 1 --2- 172.21.15.7:0/2840718782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf680abc60 0x7fbf68158560 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbf50001eb0 tx=0x7fbf50007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.582+0000 7fbf5effd700 1 -- 172.21.15.7:0/2840718782 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50005a70 con 0x7fbf680abc60 2023-10-06T11:00:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.582+0000 7fbf5effd700 1 -- 172.21.15.7:0/2840718782 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf50005bd0 con 0x7fbf680abc60 2023-10-06T11:00:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.582+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/2840718782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf58009480 con 0x7fbf680abc60 2023-10-06T11:00:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.582+0000 7fbf5effd700 1 -- 172.21.15.7:0/2840718782 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf500070d0 con 0x7fbf680abc60 2023-10-06T11:00:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.582+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/2840718782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf68154fc0 con 0x7fbf680abc60 2023-10-06T11:00:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.583+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/2840718782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf68070480 con 0x7fbf680abc60 2023-10-06T11:00:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.585+0000 7fbf5effd700 1 -- 172.21.15.7:0/2840718782 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf50007480 con 0x7fbf680abc60 2023-10-06T11:00:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.585+0000 7fbf5effd700 1 --2- 172.21.15.7:0/2840718782 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbf48066f30 0x7fbf480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.585+0000 7fbf5effd700 1 -- 172.21.15.7:0/2840718782 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbf50084050 con 0x7fbf680abc60 2023-10-06T11:00:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.585+0000 7fbf66ffd700 1 --2- 172.21.15.7:0/2840718782 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbf48066f30 0x7fbf480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.586+0000 7fbf66ffd700 1 --2- 172.21.15.7:0/2840718782 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbf48066f30 0x7fbf480693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbf58007fd0 tx=0x7fbf58016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.589+0000 7fbf5effd700 1 -- 172.21.15.7:0/2840718782 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf500510a0 con 0x7fbf680abc60 2023-10-06T11:00:26.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.875+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/2840718782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbf680b02e0 con 0x7fbf680abc60 2023-10-06T11:00:26.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.878+0000 7fbf5effd700 1 -- 172.21.15.7:0/2840718782 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbf500170e0 con 0x7fbf680abc60 2023-10-06T11:00:26.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.881+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/2840718782 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbf48066f30 msgr2=0x7fbf480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:26.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.881+0000 7fbf6d8fb700 1 --2- 172.21.15.7:0/2840718782 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbf48066f30 0x7fbf480693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbf58007fd0 tx=0x7fbf58016000 comp rx=0 tx=0).stop 2023-10-06T11:00:26.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.881+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/2840718782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf680abc60 msgr2=0x7fbf68158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:26.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.881+0000 7fbf6d8fb700 1 --2- 172.21.15.7:0/2840718782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf680abc60 0x7fbf68158560 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbf50001eb0 tx=0x7fbf50007f40 comp rx=0 tx=0).stop 2023-10-06T11:00:26.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.881+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/2840718782 shutdown_connections 2023-10-06T11:00:26.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.881+0000 7fbf6d8fb700 1 --2- 172.21.15.7:0/2840718782 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbf48066f30 0x7fbf480693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.881+0000 7fbf6d8fb700 1 --2- 172.21.15.7:0/2840718782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680ac030 0x7fbf680ad940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.881+0000 7fbf6d8fb700 1 --2- 172.21.15.7:0/2840718782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf6806cf80 0x7fbf681554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.881+0000 7fbf6d8fb700 1 --2- 172.21.15.7:0/2840718782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf680abc60 0x7fbf68158560 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:26.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.881+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/2840718782 >> 172.21.15.7:0/2840718782 conn(0x7fbf680cce30 msgr2=0x7fbf68068260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:26.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.881+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/2840718782 shutdown_connections 2023-10-06T11:00:26.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:26.881+0000 7fbf6d8fb700 1 -- 172.21.15.7:0/2840718782 wait complete. 2023-10-06T11:00:26.883 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-06T11:00:26.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:00:27.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.026+0000 7f2ac2eb7700 1 Processor -- start 2023-10-06T11:00:27.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.026+0000 7f2ac2eb7700 1 -- start start 2023-10-06T11:00:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.027+0000 7f2ac2eb7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2abc159360 0x7f2abc0afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.027+0000 7f2ac2eb7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2abc0ac7f0 0x7f2abc0a6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.027+0000 7f2ac2eb7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2abc0aeba0 con 0x7f2abc0a6ec0 2023-10-06T11:00:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.027+0000 7f2ac2eb7700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2abc0a7310 con 0x7f2abc159360 2023-10-06T11:00:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.027+0000 7f2ac2eb7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc159730 con 0x7f2abc0ac7f0 2023-10-06T11:00:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.027+0000 7f2ac0c53700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2abc159360 0x7f2abc0afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.027+0000 7f2ac0c53700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2abc159360 0x7f2abc0afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38950/0 (socket says 172.21.15.7:38950) 2023-10-06T11:00:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.027+0000 7f2ac0c53700 1 -- 172.21.15.7:0/540659762 learned_addr learned my addr 172.21.15.7:0/540659762 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.028+0000 7f2abbfff700 1 --2- 172.21.15.7:0/540659762 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2abc0ac7f0 0x7f2abc0a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.028+0000 7f2ac0c53700 1 -- 172.21.15.7:0/540659762 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2abc0ac7f0 msgr2=0x7f2abc0a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.028+0000 7f2ac0c53700 1 --2- 172.21.15.7:0/540659762 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2abc0ac7f0 0x7f2abc0a6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.028+0000 7f2ac0c53700 1 -- 172.21.15.7:0/540659762 >> v1:172.21.15.50:6789/0 conn(0x7f2abc0a6ec0 legacy=0x7f2abc0670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.028+0000 7f2ac0c53700 1 -- 172.21.15.7:0/540659762 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc0ae270 con 0x7f2abc159360 2023-10-06T11:00:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.028+0000 7f2abbfff700 1 --2- 172.21.15.7:0/540659762 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2abc0ac7f0 0x7f2abc0a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.028+0000 7f2ac0c53700 1 --2- 172.21.15.7:0/540659762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc159360 0x7f2abc0afb40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0099b0 tx=0x7f2aac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5922f914a9d0297 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.028+0000 7f2abb7fe700 1 -- 172.21.15.7:0/540659762 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00b820 con 0x7f2abc159360 2023-10-06T11:00:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.028+0000 7f2abb7fe700 1 -- 172.21.15.7:0/540659762 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac00b980 con 0x7f2abc159360 2023-10-06T11:00:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.028+0000 7f2abb7fe700 1 -- 172.21.15.7:0/540659762 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00bd20 con 0x7f2abc159360 2023-10-06T11:00:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.029+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/540659762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc159360 msgr2=0x7f2abc0afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.029+0000 7f2ac2eb7700 1 --2- 172.21.15.7:0/540659762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc159360 0x7f2abc0afb40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0099b0 tx=0x7f2aac009250 comp rx=0 tx=0).stop 2023-10-06T11:00:27.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.029+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/540659762 shutdown_connections 2023-10-06T11:00:27.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.029+0000 7f2ac2eb7700 1 --2- 172.21.15.7:0/540659762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc159360 0x7f2abc0afb40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.029+0000 7f2ac2eb7700 1 --2- 172.21.15.7:0/540659762 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2abc0ac7f0 0x7f2abc0a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.029+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/540659762 >> 172.21.15.7:0/540659762 conn(0x7f2abc095a70 msgr2=0x7f2abc0af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:27.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.029+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/540659762 shutdown_connections 2023-10-06T11:00:27.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.029+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/540659762 wait complete. 2023-10-06T11:00:27.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.030+0000 7f2ac2eb7700 1 Processor -- start 2023-10-06T11:00:27.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.031+0000 7f2ac2eb7700 1 -- start start 2023-10-06T11:00:27.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac2eb7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2abc0a6ec0 0x7f2abc153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac2eb7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2abc0ac7f0 0x7f2abc0cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac2eb7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc159360 0x7f2abc0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac2eb7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc098110 con 0x7f2abc159360 2023-10-06T11:00:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac2eb7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0cb6d0 con 0x7f2abc0a6ec0 2023-10-06T11:00:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac2eb7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0cb9b0 con 0x7f2abc0ac7f0 2023-10-06T11:00:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac1454700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc159360 0x7f2abc0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac1454700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc159360 0x7f2abc0cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38966/0 (socket says 172.21.15.7:38966) 2023-10-06T11:00:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac1454700 1 -- 172.21.15.7:0/4001732877 learned_addr learned my addr 172.21.15.7:0/4001732877 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac0c53700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2abc0a6ec0 0x7f2abc153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2abbfff700 1 --2- 172.21.15.7:0/4001732877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2abc0ac7f0 0x7f2abc0cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac1454700 1 -- 172.21.15.7:0/4001732877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2abc0ac7f0 msgr2=0x7f2abc0cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac1454700 1 --2- 172.21.15.7:0/4001732877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2abc0ac7f0 0x7f2abc0cab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac1454700 1 -- 172.21.15.7:0/4001732877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2abc0a6ec0 msgr2=0x7f2abc153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac1454700 1 --2- 172.21.15.7:0/4001732877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2abc0a6ec0 0x7f2abc153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac1454700 1 -- 172.21.15.7:0/4001732877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac0094f0 con 0x7f2abc159360 2023-10-06T11:00:27.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.032+0000 7f2ac1454700 1 --2- 172.21.15.7:0/4001732877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc159360 0x7f2abc0cb070 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400c930 tx=0x7f2ab40026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:27.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.033+0000 7f2ab8ff9700 1 -- 172.21.15.7:0/4001732877 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4012630 con 0x7f2abc159360 2023-10-06T11:00:27.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.033+0000 7f2ab8ff9700 1 -- 172.21.15.7:0/4001732877 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab40127d0 con 0x7f2abc159360 2023-10-06T11:00:27.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.033+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/4001732877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2abc0cbc90 con 0x7f2abc159360 2023-10-06T11:00:27.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.033+0000 7f2ab8ff9700 1 -- 172.21.15.7:0/4001732877 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4012b90 con 0x7f2abc159360 2023-10-06T11:00:27.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.033+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/4001732877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2abc154050 con 0x7f2abc159360 2023-10-06T11:00:27.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.034+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/4001732877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2abc098280 con 0x7f2abc159360 2023-10-06T11:00:27.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.034+0000 7f2ab8ff9700 1 -- 172.21.15.7:0/4001732877 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ab401b400 con 0x7f2abc159360 2023-10-06T11:00:27.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.034+0000 7f2ab8ff9700 1 --2- 172.21.15.7:0/4001732877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2aa8066f30 0x7f2aa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.035+0000 7f2ab8ff9700 1 -- 172.21.15.7:0/4001732877 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2ab4084a40 con 0x7f2abc159360 2023-10-06T11:00:27.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.035+0000 7f2ac0c53700 1 --2- 172.21.15.7:0/4001732877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2aa8066f30 0x7f2aa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.035+0000 7f2ac0c53700 1 --2- 172.21.15.7:0/4001732877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2aa8066f30 0x7f2aa80693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0099b0 tx=0x7f2aac016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:27.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.039+0000 7f2ab8ff9700 1 -- 172.21.15.7:0/4001732877 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2abc098280 con 0x7f2abc159360 2023-10-06T11:00:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.286+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/4001732877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2abc098280 con 0x7f2abc159360 2023-10-06T11:00:27.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.287+0000 7f2ab8ff9700 1 -- 172.21.15.7:0/4001732877 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4585 (secure 0 0 0) 0x7f2abc098280 con 0x7f2abc159360 2023-10-06T11:00:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:27.288 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/904048408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":904048408},{"type":"v1","addr":"172.21.15.50:6834","nonce":904048408}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5062,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/949655295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":949655295},{"type":"v1","addr":"172.21.15.50:6835","nonce":949655295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1576009113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1576009113},{"type":"v1","addr":"172.21.15.7:6835","nonce":1576009113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:00:21.179899+0000","modified":"2023-10-06T11:00:24.767544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5130":{"gid":5130,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1573170028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1573170028},{"type":"v1","addr":"172.21.15.7:6837","nonce":1573170028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:00:27.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.289+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/4001732877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2aa8066f30 msgr2=0x7f2aa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.289+0000 7f2ac2eb7700 1 --2- 172.21.15.7:0/4001732877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2aa8066f30 0x7f2aa80693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0099b0 tx=0x7f2aac016000 comp rx=0 tx=0).stop 2023-10-06T11:00:27.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.289+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/4001732877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc159360 msgr2=0x7f2abc0cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.289+0000 7f2ac2eb7700 1 --2- 172.21.15.7:0/4001732877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc159360 0x7f2abc0cb070 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400c930 tx=0x7f2ab40026e0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.289+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/4001732877 shutdown_connections 2023-10-06T11:00:27.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.289+0000 7f2ac2eb7700 1 --2- 172.21.15.7:0/4001732877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2aa8066f30 0x7f2aa80693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.289+0000 7f2ac2eb7700 1 --2- 172.21.15.7:0/4001732877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc159360 0x7f2abc0cb070 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.289+0000 7f2ac2eb7700 1 --2- 172.21.15.7:0/4001732877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2abc0a6ec0 0x7f2abc153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.289+0000 7f2ac2eb7700 1 --2- 172.21.15.7:0/4001732877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2abc0ac7f0 0x7f2abc0cab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.289+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/4001732877 >> 172.21.15.7:0/4001732877 conn(0x7f2abc095a70 msgr2=0x7f2abc15ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:27.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.289+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/4001732877 shutdown_connections 2023-10-06T11:00:27.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.289+0000 7f2ac2eb7700 1 -- 172.21.15.7:0/4001732877 wait complete. 2023-10-06T11:00:27.291 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 19 2023-10-06T11:00:27.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:00:21.179899+0000', 'modified': '2023-10-06T11:00:24.767544+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5130}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5130': {'gid': 5130, 'name': 'a', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6837/1573170028', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6836', 'nonce': 1573170028}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 1573170028}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:00:27.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:00:27.705 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T11:00:27.722 INFO:tasks.ceph.mds.a.smithi007.stderr:2023-10-06T11:00:27.722+0000 7f009b0d0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:00:27.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.847+0000 7f614b65b700 1 Processor -- start 2023-10-06T11:00:27.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.847+0000 7f614b65b700 1 -- start start 2023-10-06T11:00:27.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.848+0000 7f614b65b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6144159220 0x7f61440aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.848+0000 7f614b65b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61440cf820 con 0x7f61441595f0 2023-10-06T11:00:27.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.848+0000 7f614b65b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61440cec10 con 0x7f61440ce7a0 2023-10-06T11:00:27.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.848+0000 7f614b65b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61440ceef0 con 0x7f6144159220 2023-10-06T11:00:27.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.848+0000 7f6149bf8700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f61441595f0 0x7f61440cc740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53074/0 (socket says 172.21.15.7:53074) 2023-10-06T11:00:27.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.848+0000 7f6149bf8700 1 -- 172.21.15.7:0/4183598888 learned_addr learned my addr 172.21.15.7:0/4183598888 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:27.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.848+0000 7f61493f7700 1 --2- 172.21.15.7:0/4183598888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6144159220 0x7f61440aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.848+0000 7f613bfff700 1 -- 172.21.15.7:0/4183598888 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97486989 0 0) 0x7f61440cf820 con 0x7f61441595f0 2023-10-06T11:00:27.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.848+0000 7f613bfff700 1 -- 172.21.15.7:0/4183598888 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6130003570 con 0x7f61441595f0 2023-10-06T11:00:27.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.849+0000 7f613bfff700 1 -- 172.21.15.7:0/4183598888 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153973696 0 0) 0x7f61440cec10 con 0x7f61440ce7a0 2023-10-06T11:00:27.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.849+0000 7f613bfff700 1 -- 172.21.15.7:0/4183598888 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61440cf820 con 0x7f61440ce7a0 2023-10-06T11:00:27.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.849+0000 7f61493f7700 1 -- 172.21.15.7:0/4183598888 >> v1:172.21.15.50:6789/0 conn(0x7f61440ce7a0 legacy=0x7f61440cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.849+0000 7f613bfff700 1 -- 172.21.15.7:0/4183598888 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3610368880 0 0) 0x7f6130003570 con 0x7f61441595f0 2023-10-06T11:00:27.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.849+0000 7f61493f7700 1 -- 172.21.15.7:0/4183598888 >> v1:172.21.15.7:6789/0 conn(0x7f61441595f0 legacy=0x7f61440cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.849+0000 7f61493f7700 1 -- 172.21.15.7:0/4183598888 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61440cf1d0 con 0x7f6144159220 2023-10-06T11:00:27.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.849+0000 7f61493f7700 1 --2- 172.21.15.7:0/4183598888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6144159220 0x7f61440aedb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6134009910 tx=0x7f61340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c98440816d404921 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:27.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.849+0000 7f613bfff700 1 -- 172.21.15.7:0/4183598888 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c0017f0 con 0x7f6144159220 2023-10-06T11:00:27.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.849+0000 7f613bfff700 1 -- 172.21.15.7:0/4183598888 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6134011420 con 0x7f6144159220 2023-10-06T11:00:27.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.849+0000 7f613bfff700 1 -- 172.21.15.7:0/4183598888 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61340117c0 con 0x7f6144159220 2023-10-06T11:00:27.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.850+0000 7f614b65b700 1 -- 172.21.15.7:0/4183598888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6144159220 msgr2=0x7f61440aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.850+0000 7f614b65b700 1 --2- 172.21.15.7:0/4183598888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6144159220 0x7f61440aedb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6134009910 tx=0x7f61340091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.850+0000 7f614b65b700 1 -- 172.21.15.7:0/4183598888 shutdown_connections 2023-10-06T11:00:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.850+0000 7f614b65b700 1 --2- 172.21.15.7:0/4183598888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6144159220 0x7f61440aedb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.850+0000 7f614b65b700 1 -- 172.21.15.7:0/4183598888 >> 172.21.15.7:0/4183598888 conn(0x7f6144069f60 msgr2=0x7f61440670f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.850+0000 7f614b65b700 1 -- 172.21.15.7:0/4183598888 shutdown_connections 2023-10-06T11:00:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.850+0000 7f614b65b700 1 -- 172.21.15.7:0/4183598888 wait complete. 2023-10-06T11:00:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.851+0000 7f614b65b700 1 Processor -- start 2023-10-06T11:00:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.851+0000 7f614b65b700 1 -- start start 2023-10-06T11:00:27.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.852+0000 7f614b65b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61440ce7a0 0x7f614414f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.852+0000 7f614b65b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6144159220 0x7f614416a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.852+0000 7f614b65b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6144168d30 0x7f61441516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.852+0000 7f614b65b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6144150b80 con 0x7f61440ce7a0 2023-10-06T11:00:27.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.852+0000 7f614b65b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614416a560 con 0x7f6144168d30 2023-10-06T11:00:27.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.852+0000 7f614b65b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614414edf0 con 0x7f6144159220 2023-10-06T11:00:27.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.852+0000 7f61493f7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61440ce7a0 0x7f614414f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.852+0000 7f61493f7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61440ce7a0 0x7f614414f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38968/0 (socket says 172.21.15.7:38968) 2023-10-06T11:00:27.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.852+0000 7f61493f7700 1 -- 172.21.15.7:0/2460950782 learned_addr learned my addr 172.21.15.7:0/2460950782 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:27.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.852+0000 7f6148bf6700 1 --2- 172.21.15.7:0/2460950782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6144159220 0x7f614416a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.853+0000 7f6149bf8700 1 --2- 172.21.15.7:0/2460950782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6144168d30 0x7f61441516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.853+0000 7f61493f7700 1 -- 172.21.15.7:0/2460950782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6144159220 msgr2=0x7f614416a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.853+0000 7f61493f7700 1 --2- 172.21.15.7:0/2460950782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6144159220 0x7f614416a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.853+0000 7f61493f7700 1 -- 172.21.15.7:0/2460950782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6144168d30 msgr2=0x7f61441516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.853+0000 7f61493f7700 1 --2- 172.21.15.7:0/2460950782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6144168d30 0x7f61441516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.853+0000 7f61493f7700 1 -- 172.21.15.7:0/2460950782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6134009420 con 0x7f61440ce7a0 2023-10-06T11:00:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.853+0000 7f61493f7700 1 --2- 172.21.15.7:0/2460950782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61440ce7a0 0x7f614414f500 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f61340091e0 tx=0x7f6134016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.853+0000 7f61397fa700 1 -- 172.21.15.7:0/2460950782 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613401cc90 con 0x7f61440ce7a0 2023-10-06T11:00:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.853+0000 7f61397fa700 1 -- 172.21.15.7:0/2460950782 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613401cdf0 con 0x7f61440ce7a0 2023-10-06T11:00:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.853+0000 7f614b65b700 1 -- 172.21.15.7:0/2460950782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614414fae0 con 0x7f61440ce7a0 2023-10-06T11:00:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.853+0000 7f61397fa700 1 -- 172.21.15.7:0/2460950782 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613401a6a0 con 0x7f61440ce7a0 2023-10-06T11:00:27.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.853+0000 7f614b65b700 1 -- 172.21.15.7:0/2460950782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6144150120 con 0x7f61440ce7a0 2023-10-06T11:00:27.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.855+0000 7f61397fa700 1 -- 172.21.15.7:0/2460950782 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f613401aad0 con 0x7f61440ce7a0 2023-10-06T11:00:27.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.855+0000 7f61397fa700 1 --2- 172.21.15.7:0/2460950782 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6128066f30 0x7f61280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.855+0000 7f61397fa700 1 -- 172.21.15.7:0/2460950782 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6134086730 con 0x7f61440ce7a0 2023-10-06T11:00:27.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.855+0000 7f6148bf6700 1 --2- 172.21.15.7:0/2460950782 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6128066f30 0x7f61280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.856+0000 7f6148bf6700 1 --2- 172.21.15.7:0/2460950782 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6128066f30 0x7f61280693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f61440cd3d0 tx=0x7f6140009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:27.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.857+0000 7f615496fb80 1 Processor -- start 2023-10-06T11:00:27.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.857+0000 7f615496fb80 1 -- start start 2023-10-06T11:00:27.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.858+0000 7f615496fb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4daa450 0x564be4daa820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.858+0000 7f615496fb80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4d8ff40 0x564be4db2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.858+0000 7f615496fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4db34d0 0x564be4db3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.858+0000 7f615496fb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be4c7d310 con 0x564be4daa450 2023-10-06T11:00:27.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.858+0000 7f615496fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be4cba130 con 0x564be4db34d0 2023-10-06T11:00:27.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.858+0000 7f615496fb80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x564be4cb7af0 con 0x564be4d8ff40 2023-10-06T11:00:27.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.858+0000 7f61493f7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4daa450 0x564be4daa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.858+0000 7f61493f7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4daa450 0x564be4daa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38972/0 (socket says 172.21.15.7:38972) 2023-10-06T11:00:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.858+0000 7f61493f7700 1 -- 172.21.15.7:0/10246309 learned_addr learned my addr 172.21.15.7:0/10246309 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.859+0000 7f6148bf6700 1 --2- 172.21.15.7:0/10246309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4d8ff40 0x564be4db2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.859+0000 7f6149bf8700 1 --2- 172.21.15.7:0/10246309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4db34d0 0x564be4db3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.859+0000 7f61493f7700 1 -- 172.21.15.7:0/10246309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4d8ff40 msgr2=0x564be4db2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.859+0000 7f61493f7700 1 --2- 172.21.15.7:0/10246309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4d8ff40 0x564be4db2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.859+0000 7f61493f7700 1 -- 172.21.15.7:0/10246309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4db34d0 msgr2=0x564be4db3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.859+0000 7f61493f7700 1 --2- 172.21.15.7:0/10246309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4db34d0 0x564be4db3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.859+0000 7f61493f7700 1 -- 172.21.15.7:0/10246309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564be4ab9790 con 0x564be4daa450 2023-10-06T11:00:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.859+0000 7f61493f7700 1 --2- 172.21.15.7:0/10246309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4daa450 0x564be4daa820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f61340538a0 tx=0x7f61340848f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d04cb87978a2f34 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.859+0000 7f612e7fc700 1 -- 172.21.15.7:0/10246309 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134057aa0 con 0x564be4daa450 2023-10-06T11:00:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.859+0000 7f612e7fc700 1 -- 172.21.15.7:0/10246309 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61340573a0 con 0x564be4daa450 2023-10-06T11:00:27.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.859+0000 7f612e7fc700 1 -- 172.21.15.7:0/10246309 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613405a5f0 con 0x564be4daa450 2023-10-06T11:00:27.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.860+0000 7f615496fb80 1 -- 172.21.15.7:0/10246309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4daa450 msgr2=0x564be4daa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.860+0000 7f615496fb80 1 --2- 172.21.15.7:0/10246309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4daa450 0x564be4daa820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f61340538a0 tx=0x7f61340848f0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.860+0000 7f615496fb80 1 -- 172.21.15.7:0/10246309 shutdown_connections 2023-10-06T11:00:27.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.860+0000 7f615496fb80 1 --2- 172.21.15.7:0/10246309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4daa450 0x564be4daa820 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.860+0000 7f615496fb80 1 --2- 172.21.15.7:0/10246309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4db34d0 0x564be4db3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.860+0000 7f615496fb80 1 --2- 172.21.15.7:0/10246309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4d8ff40 0x564be4db2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.860+0000 7f615496fb80 1 -- 172.21.15.7:0/10246309 >> 172.21.15.7:0/10246309 conn(0x564be4dad880 msgr2=0x564be4dadc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.860+0000 7f615496fb80 1 -- 172.21.15.7:0/10246309 shutdown_connections 2023-10-06T11:00:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.860+0000 7f615496fb80 1 -- 172.21.15.7:0/10246309 wait complete. 2023-10-06T11:00:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.860+0000 7f615496fb80 1 -- start start 2023-10-06T11:00:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.861+0000 7f615496fb80 1 Processor -- start 2023-10-06T11:00:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f615496fb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4d8ff40 0x564be4d845e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f615496fb80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4daa450 0x564be4d855f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f615496fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4db34d0 0x564be4d63590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f615496fb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be4cb38e0 con 0x564be4d8ff40 2023-10-06T11:00:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f615496fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be4c5f980 con 0x564be4db34d0 2023-10-06T11:00:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f615496fb80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x564be4c5f620 con 0x564be4daa450 2023-10-06T11:00:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f615496fb80 10 client.0 _ll_register_callbacks cb 0x564be4ac2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:00:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f61493f7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4d8ff40 0x564be4d845e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f61493f7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4d8ff40 0x564be4d845e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38980/0 (socket says 172.21.15.7:38980) 2023-10-06T11:00:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f61493f7700 1 -- 172.21.15.7:0/2270323263 learned_addr learned my addr 172.21.15.7:0/2270323263 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f6148bf6700 1 --2- 172.21.15.7:0/2270323263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4daa450 0x564be4d855f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f6149bf8700 1 --2- 172.21.15.7:0/2270323263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4db34d0 0x564be4d63590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f61493f7700 1 -- 172.21.15.7:0/2270323263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4daa450 msgr2=0x564be4d855f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f61493f7700 1 --2- 172.21.15.7:0/2270323263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4daa450 0x564be4d855f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f61493f7700 1 -- 172.21.15.7:0/2270323263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4db34d0 msgr2=0x564be4d63590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f61493f7700 1 --2- 172.21.15.7:0/2270323263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4db34d0 0x564be4d63590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f61493f7700 1 -- 172.21.15.7:0/2270323263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6144150120 con 0x564be4d8ff40 2023-10-06T11:00:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f61493f7700 1 --2- 172.21.15.7:0/2270323263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4d8ff40 0x564be4d845e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6134013040 tx=0x7f613406d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa3fe0e706b3a93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f61237fe700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-06T11:00:27.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f61237fe700 1 -- 172.21.15.7:0/2270323263 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613405e340 con 0x564be4d8ff40 2023-10-06T11:00:27.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f61237fe700 1 -- 172.21.15.7:0/2270323263 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f613405a5f0 con 0x564be4d8ff40 2023-10-06T11:00:27.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.862+0000 7f615496fb80 1 -- 172.21.15.7:0/2270323263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564be4d57d60 con 0x564be4d8ff40 2023-10-06T11:00:27.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.863+0000 7f61237fe700 1 -- 172.21.15.7:0/2270323263 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6134055740 con 0x564be4d8ff40 2023-10-06T11:00:27.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.863+0000 7f615496fb80 10 client.5286 fetch_fsmap learned FSMap version 19 2023-10-06T11:00:27.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.863+0000 7f615496fb80 1 -- 172.21.15.7:0/2270323263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x564be4ba60a0 con 0x564be4d8ff40 2023-10-06T11:00:27.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.863+0000 7f61237fe700 1 -- 172.21.15.7:0/2270323263 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564be4d57d60 con 0x564be4d8ff40 2023-10-06T11:00:27.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.863+0000 7f61237fe700 1 -- 172.21.15.7:0/2270323263 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 19) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6134053ab0 con 0x564be4d8ff40 2023-10-06T11:00:27.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.863+0000 7f615496fb80 10 client.5286 fetch_fsmap finished waiting for FSMap version 19 2023-10-06T11:00:27.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.863+0000 7f615496fb80 10 client.5286 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T11:00:27.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.863+0000 7f615496fb80 20 client.5286 populate_metadata read hostname 'smithi007' 2023-10-06T11:00:27.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.863+0000 7f615496fb80 1 --2- 172.21.15.7:0/2270323263 >> [v2:172.21.15.7:6836/1573170028,v1:172.21.15.7:6837/1573170028] conn(0x564be4d89800 0x564be4d89bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.863+0000 7f615496fb80 4 client.5286 mds_command: new command op to 5130 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:00:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.863+0000 7f615496fb80 1 -- 172.21.15.7:0/2270323263 --> [v2:172.21.15.7:6836/1573170028,v1:172.21.15.7:6837/1573170028] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564be4d34b30 con 0x564be4d89800 2023-10-06T11:00:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.863+0000 7f6148bf6700 1 --2- 172.21.15.7:0/2270323263 >> [v2:172.21.15.7:6836/1573170028,v1:172.21.15.7:6837/1573170028] conn(0x564be4d89800 0x564be4d89bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.863+0000 7f6148bf6700 1 --2- 172.21.15.7:0/2270323263 >> [v2:172.21.15.7:6836/1573170028,v1:172.21.15.7:6837/1573170028] conn(0x564be4d89800 0x564be4d89bd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ea66c8c25a7b79e server_cookie=541cfdf9265931da in_seq=0 out_seq=0 2023-10-06T11:00:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.863+0000 7f61237fe700 10 client.5286 ms_handle_connect on v2:172.21.15.7:6836/1573170028 2023-10-06T11:00:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.864+0000 7f61237fe700 1 -- 172.21.15.7:0/2270323263 <== mds.0 v2:172.21.15.7:6836/1573170028 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564be4d34b30 con 0x564be4d89800 2023-10-06T11:00:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.864+0000 7f61237fe700 10 client.5286 handle_command_reply: tid=0 2023-10-06T11:00:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.864+0000 7f615496fb80 1 client.5286 shutdown 2023-10-06T11:00:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.864+0000 7f615496fb80 1 -- 172.21.15.7:0/2270323263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4d8ff40 msgr2=0x564be4d845e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.864+0000 7f615496fb80 1 --2- 172.21.15.7:0/2270323263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4d8ff40 0x564be4d845e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6134013040 tx=0x7f613406d000 comp rx=0 tx=0).stop 2023-10-06T11:00:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.864+0000 7f615496fb80 1 -- 172.21.15.7:0/2270323263 shutdown_connections 2023-10-06T11:00:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.864+0000 7f615496fb80 1 --2- 172.21.15.7:0/2270323263 >> [v2:172.21.15.7:6836/1573170028,v1:172.21.15.7:6837/1573170028] conn(0x564be4d89800 0x564be4d89bd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.864+0000 7f615496fb80 1 --2- 172.21.15.7:0/2270323263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4d8ff40 0x564be4d845e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.864+0000 7f615496fb80 1 --2- 172.21.15.7:0/2270323263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4db34d0 0x564be4d63590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.864+0000 7f61237fe700 0 client.5286 ms_handle_reset on v2:172.21.15.7:6836/1573170028 2023-10-06T11:00:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.864+0000 7f615496fb80 1 --2- 172.21.15.7:0/2270323263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4daa450 0x564be4d855f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.864+0000 7f615496fb80 1 -- 172.21.15.7:0/2270323263 >> 172.21.15.7:0/2270323263 conn(0x564be4dad880 msgr2=0x564be4d5fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.864+0000 7f615496fb80 1 -- 172.21.15.7:0/2270323263 shutdown_connections 2023-10-06T11:00:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.864+0000 7f615496fb80 1 -- 172.21.15.7:0/2270323263 wait complete. 2023-10-06T11:00:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.865+0000 7f615496fb80 20 client.5286 trim_cache size 0 max 16384 2023-10-06T11:00:27.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.882+0000 7f615496fb80 1 Processor -- start 2023-10-06T11:00:27.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.882+0000 7f615496fb80 1 -- start start 2023-10-06T11:00:27.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.883+0000 7f615496fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4d8ff40 0x564be4d89bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.883+0000 7f615496fb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4daa450 0x564be4d8a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.883+0000 7f615496fb80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4db34d0 0x564be4d84c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.883+0000 7f615496fb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be4b4b1e0 con 0x564be4daa450 2023-10-06T11:00:27.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.883+0000 7f615496fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be4d8a990 con 0x564be4d8ff40 2023-10-06T11:00:27.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.883+0000 7f615496fb80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x564be4dab280 con 0x564be4db34d0 2023-10-06T11:00:27.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.883+0000 7f6148bf6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4daa450 0x564be4d8a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f6148bf6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4daa450 0x564be4d8a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38992/0 (socket says 172.21.15.7:38992) 2023-10-06T11:00:27.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f6148bf6700 1 -- 172.21.15.7:0/2774364903 learned_addr learned my addr 172.21.15.7:0/2774364903 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:27.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f61493f7700 1 --2- 172.21.15.7:0/2774364903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4d8ff40 0x564be4d89bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f6149bf8700 1 --2- 172.21.15.7:0/2774364903 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4db34d0 0x564be4d84c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f6148bf6700 1 -- 172.21.15.7:0/2774364903 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4db34d0 msgr2=0x564be4d84c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:27.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f6148bf6700 1 --2- 172.21.15.7:0/2774364903 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4db34d0 0x564be4d84c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f6148bf6700 1 -- 172.21.15.7:0/2774364903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4d8ff40 msgr2=0x564be4d89bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:27.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f6148bf6700 1 --2- 172.21.15.7:0/2774364903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4d8ff40 0x564be4d89bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f6148bf6700 1 -- 172.21.15.7:0/2774364903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564be4c823c0 con 0x564be4daa450 2023-10-06T11:00:27.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f6149bf8700 1 --2- 172.21.15.7:0/2774364903 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4db34d0 0x564be4d84c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:27.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f61493f7700 1 --2- 172.21.15.7:0/2774364903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4d8ff40 0x564be4d89bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:27.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f6148bf6700 1 --2- 172.21.15.7:0/2774364903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4daa450 0x564be4d8a110 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x564be4d8c9b0 tx=0x7f6140013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22af5a1fc1ced27b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:27.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f612effd700 1 -- 172.21.15.7:0/2774364903 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140027070 con 0x564be4daa450 2023-10-06T11:00:27.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f612effd700 1 -- 172.21.15.7:0/2774364903 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6140013600 con 0x564be4daa450 2023-10-06T11:00:27.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.884+0000 7f612effd700 1 -- 172.21.15.7:0/2774364903 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140013980 con 0x564be4daa450 2023-10-06T11:00:27.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.885+0000 7f615496fb80 1 -- 172.21.15.7:0/2774364903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4daa450 msgr2=0x564be4d8a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.885+0000 7f615496fb80 1 --2- 172.21.15.7:0/2774364903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4daa450 0x564be4d8a110 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x564be4d8c9b0 tx=0x7f6140013000 comp rx=0 tx=0).stop 2023-10-06T11:00:27.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.885+0000 7f615496fb80 1 -- 172.21.15.7:0/2774364903 shutdown_connections 2023-10-06T11:00:27.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.885+0000 7f615496fb80 1 --2- 172.21.15.7:0/2774364903 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4db34d0 0x564be4d84c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.885+0000 7f615496fb80 1 --2- 172.21.15.7:0/2774364903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4d8ff40 0x564be4d89bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.885+0000 7f615496fb80 1 --2- 172.21.15.7:0/2774364903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4daa450 0x564be4d8a110 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.885+0000 7f615496fb80 1 -- 172.21.15.7:0/2774364903 >> 172.21.15.7:0/2774364903 conn(0x564be4dad880 msgr2=0x564be4d8ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:27.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.885+0000 7f615496fb80 1 -- 172.21.15.7:0/2774364903 shutdown_connections 2023-10-06T11:00:27.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.885+0000 7f615496fb80 1 -- 172.21.15.7:0/2774364903 wait complete. 2023-10-06T11:00:27.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.885+0000 7f615496fb80 1 -- start start 2023-10-06T11:00:27.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.886+0000 7f615496fb80 1 Processor -- start 2023-10-06T11:00:27.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.887+0000 7f615496fb80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4d8ff40 0x564be4d89bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.887+0000 7f615496fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4daa450 0x564be4d8a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.887+0000 7f615496fb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4db34d0 0x564be4d64670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.887+0000 7f615496fb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be4e0fcd0 con 0x564be4db34d0 2023-10-06T11:00:27.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.887+0000 7f615496fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be4d882c0 con 0x564be4daa450 2023-10-06T11:00:27.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.887+0000 7f615496fb80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x564be4d933e0 con 0x564be4d8ff40 2023-10-06T11:00:27.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.887+0000 7f615496fb80 10 client.0 _ll_register_callbacks cb 0x564be4ac2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:00:27.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.887+0000 7f6149bf8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4db34d0 0x564be4d64670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.887+0000 7f6149bf8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4db34d0 0x564be4d64670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39004/0 (socket says 172.21.15.7:39004) 2023-10-06T11:00:27.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.887+0000 7f6149bf8700 1 -- 172.21.15.7:0/2327501360 learned_addr learned my addr 172.21.15.7:0/2327501360 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:27.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f6148bf6700 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4daa450 0x564be4d8a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f61493f7700 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4d8ff40 0x564be4d89bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f6149bf8700 1 -- 172.21.15.7:0/2327501360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4d8ff40 msgr2=0x564be4d89bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:27.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f6149bf8700 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4d8ff40 0x564be4d89bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f6149bf8700 1 -- 172.21.15.7:0/2327501360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4daa450 msgr2=0x564be4d8a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:27.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f6149bf8700 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4daa450 0x564be4d8a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f6149bf8700 1 -- 172.21.15.7:0/2327501360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614000f040 con 0x564be4db34d0 2023-10-06T11:00:27.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f6148bf6700 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4daa450 0x564be4d8a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:27.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f61493f7700 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4d8ff40 0x564be4d89bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:27.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f6149bf8700 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4db34d0 0x564be4d64670 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f613c001920 tx=0x7f613c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212b742ed3040643 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:27.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f61237fe700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-06T11:00:27.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f61237fe700 1 -- 172.21.15.7:0/2327501360 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c0072e0 con 0x564be4db34d0 2023-10-06T11:00:27.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f61237fe700 1 -- 172.21.15.7:0/2327501360 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f613c007440 con 0x564be4db34d0 2023-10-06T11:00:27.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f615496fb80 1 -- 172.21.15.7:0/2327501360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61340573a0 con 0x564be4db34d0 2023-10-06T11:00:27.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f61237fe700 1 -- 172.21.15.7:0/2327501360 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f613c007810 con 0x564be4db34d0 2023-10-06T11:00:27.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f615496fb80 10 client.5292 fetch_fsmap learned FSMap version 19 2023-10-06T11:00:27.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f615496fb80 1 -- 172.21.15.7:0/2327501360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x564be4b1a1d0 con 0x564be4db34d0 2023-10-06T11:00:27.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.888+0000 7f61237fe700 1 -- 172.21.15.7:0/2327501360 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61340573a0 con 0x564be4db34d0 2023-10-06T11:00:27.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f61237fe700 1 -- 172.21.15.7:0/2327501360 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 19) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f613c01f3f0 con 0x564be4db34d0 2023-10-06T11:00:27.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f615496fb80 10 client.5292 fetch_fsmap finished waiting for FSMap version 19 2023-10-06T11:00:27.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f615496fb80 10 client.5292 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T11:00:27.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f615496fb80 20 client.5292 populate_metadata read hostname 'smithi007' 2023-10-06T11:00:27.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f615496fb80 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.7:6836/1573170028,v1:172.21.15.7:6837/1573170028] conn(0x564be4d65020 0x564be4e0e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:27.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f615496fb80 4 client.5292 mds_command: new command op to 5130 tid=0[{"prefix": "status"}] 2023-10-06T11:00:27.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f615496fb80 1 -- 172.21.15.7:0/2327501360 --> [v2:172.21.15.7:6836/1573170028,v1:172.21.15.7:6837/1573170028] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564be4c568d0 con 0x564be4d65020 2023-10-06T11:00:27.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f61493f7700 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.7:6836/1573170028,v1:172.21.15.7:6837/1573170028] conn(0x564be4d65020 0x564be4e0e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:27.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f61493f7700 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.7:6836/1573170028,v1:172.21.15.7:6837/1573170028] conn(0x564be4d65020 0x564be4e0e7d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d26847c6aee2bb31 server_cookie=35335f472a9b9964 in_seq=0 out_seq=0 2023-10-06T11:00:27.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f61237fe700 10 client.5292 ms_handle_connect on v2:172.21.15.7:6836/1573170028 2023-10-06T11:00:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f61237fe700 1 -- 172.21.15.7:0/2327501360 <== mds.0 v2:172.21.15.7:6836/1573170028 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x564be4c568d0 con 0x564be4d65020 2023-10-06T11:00:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f61237fe700 10 client.5292 handle_command_reply: tid=0 2023-10-06T11:00:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f615496fb80 1 client.5292 shutdown 2023-10-06T11:00:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f615496fb80 1 -- 172.21.15.7:0/2327501360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4db34d0 msgr2=0x564be4d64670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f615496fb80 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4db34d0 0x564be4d64670 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f613c001920 tx=0x7f613c009040 comp rx=0 tx=0).stop 2023-10-06T11:00:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f615496fb80 1 -- 172.21.15.7:0/2327501360 shutdown_connections 2023-10-06T11:00:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.889+0000 7f615496fb80 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.7:6836/1573170028,v1:172.21.15.7:6837/1573170028] conn(0x564be4d65020 0x564be4e0e7d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f615496fb80 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564be4db34d0 0x564be4d64670 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f615496fb80 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x564be4d8ff40 0x564be4d89bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f61237fe700 0 client.5292 ms_handle_reset on v2:172.21.15.7:6836/1573170028 2023-10-06T11:00:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f615496fb80 1 --2- 172.21.15.7:0/2327501360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564be4daa450 0x564be4d8a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f615496fb80 1 -- 172.21.15.7:0/2327501360 >> 172.21.15.7:0/2327501360 conn(0x564be4dad880 msgr2=0x564be4d59df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f615496fb80 1 -- 172.21.15.7:0/2327501360 shutdown_connections 2023-10-06T11:00:27.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f615496fb80 1 -- 172.21.15.7:0/2327501360 wait complete. 2023-10-06T11:00:27.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f615496fb80 20 client.5292 trim_cache size 0 max 16384 2023-10-06T11:00:27.898 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:00:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "ff7fc17b-4d49-4596-ba3b-1d865cad8f21", 2023-10-06T11:00:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-06T11:00:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5130, 2023-10-06T11:00:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-06T11:00:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-06T11:00:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-06T11:00:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 6.1489411260000004, 2023-10-06T11:00:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 19, 2023-10-06T11:00:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 40, 2023-10-06T11:00:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 40, 2023-10-06T11:00:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 16.06835233 2023-10-06T11:00:27.899 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:00:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f614b65b700 1 -- 172.21.15.7:0/2460950782 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6128066f30 msgr2=0x7f61280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f614b65b700 1 --2- 172.21.15.7:0/2460950782 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6128066f30 0x7f61280693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f61440cd3d0 tx=0x7f6140009040 comp rx=0 tx=0).stop 2023-10-06T11:00:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f614b65b700 1 -- 172.21.15.7:0/2460950782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61440ce7a0 msgr2=0x7f614414f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f614b65b700 1 --2- 172.21.15.7:0/2460950782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61440ce7a0 0x7f614414f500 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f61340091e0 tx=0x7f6134016000 comp rx=0 tx=0).stop 2023-10-06T11:00:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f614b65b700 1 -- 172.21.15.7:0/2460950782 shutdown_connections 2023-10-06T11:00:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f614b65b700 1 --2- 172.21.15.7:0/2460950782 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6128066f30 0x7f61280693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f614b65b700 1 --2- 172.21.15.7:0/2460950782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61440ce7a0 0x7f614414f500 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f614b65b700 1 --2- 172.21.15.7:0/2460950782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6144168d30 0x7f61441516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f614b65b700 1 --2- 172.21.15.7:0/2460950782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6144159220 0x7f614416a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f614b65b700 1 -- 172.21.15.7:0/2460950782 >> 172.21.15.7:0/2460950782 conn(0x7f6144069f60 msgr2=0x7f6144153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:27.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f614b65b700 1 -- 172.21.15.7:0/2460950782 shutdown_connections 2023-10-06T11:00:27.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:27.890+0000 7f614b65b700 1 -- 172.21.15.7:0/2460950782 wait complete. 2023-10-06T11:00:27.904 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:00:28.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.078+0000 7f9242662700 1 Processor -- start 2023-10-06T11:00:28.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.078+0000 7f9242662700 1 -- start start 2023-10-06T11:00:28.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.079+0000 7f9242662700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f923c0af320 0x7f923c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:28.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.079+0000 7f9242662700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f923c0cb580 0x7f923c068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:28.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.079+0000 7f9242662700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923c0b0ca0 con 0x7f923c0cfb50 2023-10-06T11:00:28.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.079+0000 7f9242662700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923c159c00 con 0x7f923c0af320 2023-10-06T11:00:28.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.079+0000 7f9242662700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0cf6c0 con 0x7f923c0cb580 2023-10-06T11:00:28.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.080+0000 7f923b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f923c0cb580 0x7f923c068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:28.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.080+0000 7f923bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f923c0af320 0x7f923c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:28.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.080+0000 7f9240bff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f923c0cfb50 0x7f923c15d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:42512/0 (socket says 172.21.15.7:42512) 2023-10-06T11:00:28.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.080+0000 7f923b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f923c0cb580 0x7f923c068ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:55534/0 (socket says 172.21.15.7:55534) 2023-10-06T11:00:28.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.080+0000 7f9240bff700 1 -- 172.21.15.7:0/364300566 learned_addr learned my addr 172.21.15.7:0/364300566 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:28.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.080+0000 7f923b7fe700 1 -- 172.21.15.7:0/364300566 >> v2:172.21.15.50:3300/0 conn(0x7f923c0af320 msgr2=0x7f923c0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:28.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.080+0000 7f923b7fe700 1 --2- 172.21.15.7:0/364300566 >> v2:172.21.15.50:3300/0 conn(0x7f923c0af320 0x7f923c0cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:28.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.080+0000 7f923affd700 1 -- 172.21.15.7:0/364300566 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635286777 0 0) 0x7f9234001490 con 0x7f923c0cfb50 2023-10-06T11:00:28.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.080+0000 7f923b7fe700 1 -- 172.21.15.7:0/364300566 >> v1:172.21.15.50:6789/0 conn(0x7f923c0cfb50 legacy=0x7f923c15d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:28.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.080+0000 7f923b7fe700 1 -- 172.21.15.7:0/364300566 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c0ceab0 con 0x7f923c0cb580 2023-10-06T11:00:28.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.080+0000 7f923b7fe700 1 --2- 172.21.15.7:0/364300566 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f923c0cb580 0x7f923c068ee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f92240098e0 tx=0x7f92240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e47ae0766c65009b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:28.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.081+0000 7f923affd700 1 -- 172.21.15.7:0/364300566 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922400b6d0 con 0x7f923c0cb580 2023-10-06T11:00:28.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.081+0000 7f923affd700 1 -- 172.21.15.7:0/364300566 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922400b830 con 0x7f923c0cb580 2023-10-06T11:00:28.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.081+0000 7f923affd700 1 -- 172.21.15.7:0/364300566 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922400bbd0 con 0x7f923c0cb580 2023-10-06T11:00:28.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.081+0000 7f9242662700 1 -- 172.21.15.7:0/364300566 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f923c0cb580 msgr2=0x7f923c068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:28.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.081+0000 7f9242662700 1 --2- 172.21.15.7:0/364300566 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f923c0cb580 0x7f923c068ee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f92240098e0 tx=0x7f92240091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:28.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.081+0000 7f9242662700 1 -- 172.21.15.7:0/364300566 shutdown_connections 2023-10-06T11:00:28.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.081+0000 7f9242662700 1 --2- 172.21.15.7:0/364300566 >> v2:172.21.15.50:3300/0 conn(0x7f923c0af320 0x7f923c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:28.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.081+0000 7f9242662700 1 --2- 172.21.15.7:0/364300566 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f923c0cb580 0x7f923c068ee0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:28.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.081+0000 7f9242662700 1 -- 172.21.15.7:0/364300566 >> 172.21.15.7:0/364300566 conn(0x7f923c067b80 msgr2=0x7f923c0d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:28.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.081+0000 7f9242662700 1 -- 172.21.15.7:0/364300566 shutdown_connections 2023-10-06T11:00:28.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.081+0000 7f9242662700 1 -- 172.21.15.7:0/364300566 wait complete. 2023-10-06T11:00:28.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.082+0000 7f9242662700 1 Processor -- start 2023-10-06T11:00:28.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.083+0000 7f9242662700 1 -- start start 2023-10-06T11:00:28.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.083+0000 7f9242662700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c0af320 0x7f923c1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:28.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.083+0000 7f9242662700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f923c0cb580 0x7f923c0c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:28.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.083+0000 7f9242662700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923c0cfb50 0x7f923c0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:28.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.083+0000 7f9242662700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c15bc90 con 0x7f923c0af320 2023-10-06T11:00:28.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.083+0000 7f9242662700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c15bf70 con 0x7f923c0cfb50 2023-10-06T11:00:28.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.083+0000 7f9242662700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c15c250 con 0x7f923c0cb580 2023-10-06T11:00:28.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.084+0000 7f923bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c0af320 0x7f923c1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:28.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.084+0000 7f923bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c0af320 0x7f923c1559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39016/0 (socket says 172.21.15.7:39016) 2023-10-06T11:00:28.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.084+0000 7f923bfff700 1 -- 172.21.15.7:0/4230088501 learned_addr learned my addr 172.21.15.7:0/4230088501 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:28.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.084+0000 7f923b7fe700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f923c0cb580 0x7f923c0c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:28.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.084+0000 7f9240bff700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923c0cfb50 0x7f923c0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:28.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.084+0000 7f923bfff700 1 -- 172.21.15.7:0/4230088501 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f923c0cb580 msgr2=0x7f923c0c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:28.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.084+0000 7f923bfff700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f923c0cb580 0x7f923c0c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:28.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.084+0000 7f923bfff700 1 -- 172.21.15.7:0/4230088501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923c0cfb50 msgr2=0x7f923c0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:28.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.084+0000 7f923bfff700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923c0cfb50 0x7f923c0c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:28.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.084+0000 7f923bfff700 1 -- 172.21.15.7:0/4230088501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9224009420 con 0x7f923c0af320 2023-10-06T11:00:28.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.084+0000 7f9240bff700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923c0cfb50 0x7f923c0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:28.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.084+0000 7f923bfff700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c0af320 0x7f923c1559a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f922c00ec80 tx=0x7f922c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:28.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.084+0000 7f9233fff700 1 -- 172.21.15.7:0/4230088501 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c00c850 con 0x7f923c0af320 2023-10-06T11:00:28.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.085+0000 7f9233fff700 1 -- 172.21.15.7:0/4230088501 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922c00c9b0 con 0x7f923c0af320 2023-10-06T11:00:28.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.085+0000 7f9242662700 1 -- 172.21.15.7:0/4230088501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c15c530 con 0x7f923c0af320 2023-10-06T11:00:28.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.085+0000 7f9233fff700 1 -- 172.21.15.7:0/4230088501 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c00cd50 con 0x7f923c0af320 2023-10-06T11:00:28.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.085+0000 7f9242662700 1 -- 172.21.15.7:0/4230088501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923c0c9080 con 0x7f923c0af320 2023-10-06T11:00:28.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.086+0000 7f9242662700 1 -- 172.21.15.7:0/4230088501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923c0b43d0 con 0x7f923c0af320 2023-10-06T11:00:28.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.086+0000 7f9233fff700 1 -- 172.21.15.7:0/4230088501 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f922c013680 con 0x7f923c0af320 2023-10-06T11:00:28.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.086+0000 7f9233fff700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f921c066f30 0x7f921c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:28.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.087+0000 7f9233fff700 1 -- 172.21.15.7:0/4230088501 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f922c084b60 con 0x7f923c0af320 2023-10-06T11:00:28.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.087+0000 7f923b7fe700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f921c066f30 0x7f921c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:28.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.087+0000 7f923b7fe700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f921c066f30 0x7f921c0693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f92240091e0 tx=0x7f9224017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:28.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.091+0000 7f9233fff700 1 -- 172.21.15.7:0/4230088501 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f922c051b30 con 0x7f923c0af320 2023-10-06T11:00:28.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.341+0000 7f9242662700 1 -- 172.21.15.7:0/4230088501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f923c070480 con 0x7f923c0af320 2023-10-06T11:00:28.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.341+0000 7f9233fff700 1 -- 172.21.15.7:0/4230088501 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7f922c017070 con 0x7f923c0af320 2023-10-06T11:00:28.342 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:00:28.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.343+0000 7f9242662700 1 -- 172.21.15.7:0/4230088501 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f921c066f30 msgr2=0x7f921c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:28.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.343+0000 7f9242662700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f921c066f30 0x7f921c0693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f92240091e0 tx=0x7f9224017000 comp rx=0 tx=0).stop 2023-10-06T11:00:28.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.343+0000 7f9242662700 1 -- 172.21.15.7:0/4230088501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c0af320 msgr2=0x7f923c1559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:28.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.343+0000 7f9242662700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c0af320 0x7f923c1559a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f922c00ec80 tx=0x7f922c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:28.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.343+0000 7f9242662700 1 -- 172.21.15.7:0/4230088501 shutdown_connections 2023-10-06T11:00:28.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.343+0000 7f9242662700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f921c066f30 0x7f921c0693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:28.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.343+0000 7f9242662700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c0af320 0x7f923c1559a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:28.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.343+0000 7f9242662700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923c0cfb50 0x7f923c0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:28.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.343+0000 7f9242662700 1 --2- 172.21.15.7:0/4230088501 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f923c0cb580 0x7f923c0c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:28.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.343+0000 7f9242662700 1 -- 172.21.15.7:0/4230088501 >> 172.21.15.7:0/4230088501 conn(0x7f923c067b80 msgr2=0x7f923c1565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:28.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.344+0000 7f9242662700 1 -- 172.21.15.7:0/4230088501 shutdown_connections 2023-10-06T11:00:28.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:28.344+0000 7f9242662700 1 -- 172.21.15.7:0/4230088501 wait complete. 2023-10-06T11:00:28.358 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:00:28.358 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:00:28.358 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-06T11:00:28.358 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:00:28.358 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:28.358 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:00:28.358 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:00:28.358 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:00:28.358 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:00:28.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:28.359 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-06T11:00:28.379 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:00:28.379 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:00:28.379 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:00:28.379 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:28.380 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-06T11:00:28.380 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:28.380 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:00:28.380 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:28.380 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-06T11:00:28.380 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:00:28.380 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:28.380 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-06T11:00:28.380 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:00:28.380 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:28.381 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-06T11:00:28.381 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:00:28.381 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42337sec preferred_lft 42337sec 2023-10-06T11:00:28.381 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-06T11:00:28.381 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:28.381 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:00:28.381 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:28.381 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-06T11:00:28.381 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:00:28.381 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 4e:b6:a2:96:c6:8a brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:28.382 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:00:28.382 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:28.382 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::10ea:76ff:fedd:887a/64 scope link 2023-10-06T11:00:28.382 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:28.382 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:00:28.382 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether b6:89:e7:77:c6:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:00:28.382 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::b489:e7ff:fe77:c63a/64 scope link 2023-10-06T11:00:28.382 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:28.382 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:00:28.382 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 4e:b6:a2:96:c6:8a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:00:28.382 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::4cb6:a2ff:fe96:c68a/64 scope link 2023-10-06T11:00:28.383 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:28.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:28.383 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:00:28.451 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-06T11:00:28.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:28.452 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-06T11:00:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-06T11:00:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:00:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:00:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:00:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:00:28.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:28.518 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T11:00:28.518 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T11:00:28.518 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:00:28.518 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:00:28.518 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:00:28.518 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T11:00:28.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:28.641 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-06T11:00:28.663 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:00:28.663 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:00:28.663 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:00:28.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:28.663 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-06T11:00:28.739 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:00:28.739 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:00:28.739 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:28.803 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:00:28.803 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:00:28.803 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:28.866 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T11:00:28.943 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:00:28.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:00:29.017 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:00:29.018 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:00:29.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:29.019 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T11:00:29.083 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:00:29.083 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:00:29.125 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T11:00:29.160 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:00:29.160 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:00:29.226 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2023-10-06T11:00:29.225+0000 7ff7db4a3540 -1 init, newargv = 0x560ac6d91a90 newargc=15 2023-10-06T11:00:29.226 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[135780]: starting ceph client 2023-10-06T11:00:29.231 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[135780]: starting fuse 2023-10-06T11:00:29.233 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:00:29.235 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:00:29.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:29.235 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T11:00:29.297 INFO:teuthology.orchestra.run.smithi007.stdout:47 2023-10-06T11:00:29.297 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T11:00:29.297 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:00:29.297 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2023-10-06T11:00:29.297 DEBUG:teuthology.orchestra.run.smithi007:> import re 2023-10-06T11:00:29.297 DEBUG:teuthology.orchestra.run.smithi007:> import os 2023-10-06T11:00:29.297 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2023-10-06T11:00:29.297 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:00:29.298 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2023-10-06T11:00:29.298 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:00:29.298 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2023-10-06T11:00:29.298 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:00:29.298 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:00:29.298 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2023-10-06T11:00:29.298 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2023-10-06T11:00:29.298 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2023-10-06T11:00:29.298 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2023-10-06T11:00:29.298 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:00:29.298 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2023-10-06T11:00:29.299 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:00:29.299 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:00:29.299 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:00:29.299 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2023-10-06T11:00:29.299 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2023-10-06T11:00:29.299 DEBUG:teuthology.orchestra.run.smithi007:> return f 2023-10-06T11:00:29.299 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:00:29.299 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:00:29.299 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.0")) 2023-10-06T11:00:29.299 DEBUG:teuthology.orchestra.run.smithi007:> ' 2023-10-06T11:00:29.437 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.135780.asok 2023-10-06T11:00:29.618 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.135780.asok 2023-10-06T11:00:29.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:29.618 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.135780.asok status 2023-10-06T11:00:29.796 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:00:29.796 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2023-10-06T11:00:29.796 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:00:29.796 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:00:29.796 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2023-10-06T11:00:29.796 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2023-10-06T11:00:29.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:00:29.797 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "135780", 2023-10-06T11:00:29.797 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2023-10-06T11:00:29.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:29.797 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2023-10-06T11:00:29.797 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2023-10-06T11:00:29.797 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5301, 2023-10-06T11:00:29.797 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2023-10-06T11:00:29.797 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2023-10-06T11:00:29.797 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2023-10-06T11:00:29.797 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 5301 2023-10-06T11:00:29.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:29.798 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T11:00:29.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T11:00:29.798 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:00:29.798 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3215164149 2023-10-06T11:00:29.798 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:29.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:29.798 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T11:00:29.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T11:00:29.798 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:00:29.798 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3215164149 2023-10-06T11:00:29.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:29.798 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.5301 192.168.0.1:0/3215164149", 2023-10-06T11:00:29.799 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.1:0/3215164149", 2023-10-06T11:00:29.799 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2023-10-06T11:00:29.799 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 19, 2023-10-06T11:00:29.799 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 40, 2023-10-06T11:00:29.799 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:00:29.799 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2023-10-06T11:00:29.799 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2023-10-06T11:00:29.799 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:00:29.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:29.807 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2023-10-06T11:00:29.807 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:29.827 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2023-10-06T11:00:29.828 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:29.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:29.828 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:29.901 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2023-10-06T11:00:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.084+0000 7fc70d089700 1 Processor -- start 2023-10-06T11:00:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.084+0000 7fc70d089700 1 -- start start 2023-10-06T11:00:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.085+0000 7fc70d089700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc708159160 0x7fc7080b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.085+0000 7fc70d089700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc708069bb0 0x7fc70815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.085+0000 7fc70d089700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7080692c0 con 0x7fc70815d360 2023-10-06T11:00:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.085+0000 7fc70d089700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70815d7e0 con 0x7fc708069bb0 2023-10-06T11:00:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.085+0000 7fc70d089700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70806a3e0 con 0x7fc708159160 2023-10-06T11:00:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.085+0000 7fc70659c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc708069bb0 0x7fc70815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.085+0000 7fc70659c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc708069bb0 0x7fc70815ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59628/0 (socket says 172.21.15.7:59628) 2023-10-06T11:00:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.085+0000 7fc70659c700 1 -- 172.21.15.7:0/2159285541 learned_addr learned my addr 172.21.15.7:0/2159285541 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.085+0000 7fc706d9d700 1 --2- 172.21.15.7:0/2159285541 >> v2:172.21.15.50:3300/0 conn(0x7fc708159160 0x7fc7080b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.086+0000 7fc70659c700 1 -- 172.21.15.7:0/2159285541 >> v2:172.21.15.50:3300/0 conn(0x7fc708159160 msgr2=0x7fc7080b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.086+0000 7fc70659c700 1 --2- 172.21.15.7:0/2159285541 >> v2:172.21.15.50:3300/0 conn(0x7fc708159160 0x7fc7080b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.086+0000 7fc70659c700 1 -- 172.21.15.7:0/2159285541 >> v1:172.21.15.50:6789/0 conn(0x7fc70815d360 legacy=0x7fc708067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.086+0000 7fc70659c700 1 -- 172.21.15.7:0/2159285541 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc708068c70 con 0x7fc708069bb0 2023-10-06T11:00:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.086+0000 7fc70659c700 1 --2- 172.21.15.7:0/2159285541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc708069bb0 0x7fc70815ce20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc708087260 tx=0x7fc6fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d016078b6de245 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.086+0000 7fc705d9b700 1 -- 172.21.15.7:0/2159285541 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc00b860 con 0x7fc708069bb0 2023-10-06T11:00:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.086+0000 7fc705d9b700 1 -- 172.21.15.7:0/2159285541 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc00b9c0 con 0x7fc708069bb0 2023-10-06T11:00:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.086+0000 7fc705d9b700 1 -- 172.21.15.7:0/2159285541 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc00bd60 con 0x7fc708069bb0 2023-10-06T11:00:30.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.087+0000 7fc70d089700 1 -- 172.21.15.7:0/2159285541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc708069bb0 msgr2=0x7fc70815ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:30.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.087+0000 7fc70d089700 1 --2- 172.21.15.7:0/2159285541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc708069bb0 0x7fc70815ce20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc708087260 tx=0x7fc6fc009250 comp rx=0 tx=0).stop 2023-10-06T11:00:30.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.087+0000 7fc70d089700 1 -- 172.21.15.7:0/2159285541 shutdown_connections 2023-10-06T11:00:30.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.087+0000 7fc70d089700 1 --2- 172.21.15.7:0/2159285541 >> v2:172.21.15.50:3300/0 conn(0x7fc708159160 0x7fc7080b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:30.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.087+0000 7fc70d089700 1 --2- 172.21.15.7:0/2159285541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc708069bb0 0x7fc70815ce20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:30.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.087+0000 7fc70d089700 1 -- 172.21.15.7:0/2159285541 >> 172.21.15.7:0/2159285541 conn(0x7fc708096160 msgr2=0x7fc7080afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:30.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.087+0000 7fc70d089700 1 -- 172.21.15.7:0/2159285541 shutdown_connections 2023-10-06T11:00:30.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.087+0000 7fc70d089700 1 -- 172.21.15.7:0/2159285541 wait complete. 2023-10-06T11:00:30.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.089+0000 7fc70d089700 1 Processor -- start 2023-10-06T11:00:30.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.089+0000 7fc70d089700 1 -- start start 2023-10-06T11:00:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70d089700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc708069bb0 0x7fc7081519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70d089700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc708159160 0x7fc708157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70d089700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc70815d360 0x7fc708158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70d089700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080aca80 con 0x7fc708159160 2023-10-06T11:00:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70d089700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080acd60 con 0x7fc708069bb0 2023-10-06T11:00:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70d089700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080ad040 con 0x7fc70815d360 2023-10-06T11:00:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc708159160 0x7fc708157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc708159160 0x7fc708157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59634/0 (socket says 172.21.15.7:59634) 2023-10-06T11:00:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70659c700 1 -- 172.21.15.7:0/3498560909 learned_addr learned my addr 172.21.15.7:0/3498560909 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc706d9d700 1 --2- 172.21.15.7:0/3498560909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc708069bb0 0x7fc7081519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70759e700 1 --2- 172.21.15.7:0/3498560909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc70815d360 0x7fc708158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70659c700 1 -- 172.21.15.7:0/3498560909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc70815d360 msgr2=0x7fc708158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70659c700 1 --2- 172.21.15.7:0/3498560909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc70815d360 0x7fc708158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70659c700 1 -- 172.21.15.7:0/3498560909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc708069bb0 msgr2=0x7fc7081519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70659c700 1 --2- 172.21.15.7:0/3498560909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc708069bb0 0x7fc7081519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70659c700 1 -- 172.21.15.7:0/3498560909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc0094f0 con 0x7fc708159160 2023-10-06T11:00:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc70659c700 1 --2- 172.21.15.7:0/3498560909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc708159160 0x7fc708157f30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc7080b2e50 tx=0x7fc6fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.090+0000 7fc6eeffd700 1 -- 172.21.15.7:0/3498560909 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc011e40 con 0x7fc708159160 2023-10-06T11:00:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.091+0000 7fc6eeffd700 1 -- 172.21.15.7:0/3498560909 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc01a420 con 0x7fc708159160 2023-10-06T11:00:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.091+0000 7fc70d089700 1 -- 172.21.15.7:0/3498560909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7080ad320 con 0x7fc708159160 2023-10-06T11:00:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.091+0000 7fc6eeffd700 1 -- 172.21.15.7:0/3498560909 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc01a7a0 con 0x7fc708159160 2023-10-06T11:00:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.091+0000 7fc70d089700 1 -- 172.21.15.7:0/3498560909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7080adb20 con 0x7fc708159160 2023-10-06T11:00:30.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.092+0000 7fc70d089700 1 -- 172.21.15.7:0/3498560909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc708070480 con 0x7fc708159160 2023-10-06T11:00:30.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.092+0000 7fc6eeffd700 1 -- 172.21.15.7:0/3498560909 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6fc01ab90 con 0x7fc708159160 2023-10-06T11:00:30.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.093+0000 7fc6eeffd700 1 --2- 172.21.15.7:0/3498560909 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc6f4066f30 0x7fc6f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:30.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.093+0000 7fc6eeffd700 1 -- 172.21.15.7:0/3498560909 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc6fc086250 con 0x7fc708159160 2023-10-06T11:00:30.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.093+0000 7fc706d9d700 1 --2- 172.21.15.7:0/3498560909 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc6f4066f30 0x7fc6f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:30.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.093+0000 7fc706d9d700 1 --2- 172.21.15.7:0/3498560909 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc6f4066f30 0x7fc6f40693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8006fd0 tx=0x7fc6f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:30.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.098+0000 7fc6eeffd700 1 -- 172.21.15.7:0/3498560909 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6fc053220 con 0x7fc708159160 2023-10-06T11:00:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:30.299+0000 7fc70d089700 1 -- 172.21.15.7:0/3498560909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) v1 -- 0x7fc708068f50 con 0x7fc708159160 2023-10-06T11:00:31.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.050+0000 7fc6eeffd700 1 -- 172.21.15.7:0/3498560909 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v41) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc6fc056840 con 0x7fc708159160 2023-10-06T11:00:31.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.056+0000 7fc70d089700 1 -- 172.21.15.7:0/3498560909 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc6f4066f30 msgr2=0x7fc6f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:31.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.056+0000 7fc70d089700 1 --2- 172.21.15.7:0/3498560909 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc6f4066f30 0x7fc6f40693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8006fd0 tx=0x7fc6f8008040 comp rx=0 tx=0).stop 2023-10-06T11:00:31.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.056+0000 7fc70d089700 1 -- 172.21.15.7:0/3498560909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc708159160 msgr2=0x7fc708157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:31.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.056+0000 7fc70d089700 1 --2- 172.21.15.7:0/3498560909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc708159160 0x7fc708157f30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc7080b2e50 tx=0x7fc6fc017000 comp rx=0 tx=0).stop 2023-10-06T11:00:31.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.061+0000 7fc70d089700 1 -- 172.21.15.7:0/3498560909 shutdown_connections 2023-10-06T11:00:31.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.061+0000 7fc70d089700 1 --2- 172.21.15.7:0/3498560909 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc6f4066f30 0x7fc6f40693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:31.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.061+0000 7fc70d089700 1 --2- 172.21.15.7:0/3498560909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc70815d360 0x7fc708158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:31.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.061+0000 7fc70d089700 1 --2- 172.21.15.7:0/3498560909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc708069bb0 0x7fc7081519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:31.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.061+0000 7fc70d089700 1 --2- 172.21.15.7:0/3498560909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc708159160 0x7fc708157f30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:31.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.061+0000 7fc70d089700 1 -- 172.21.15.7:0/3498560909 >> 172.21.15.7:0/3498560909 conn(0x7fc708096160 msgr2=0x7fc708152890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:31.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.061+0000 7fc70d089700 1 -- 172.21.15.7:0/3498560909 shutdown_connections 2023-10-06T11:00:31.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.061+0000 7fc70d089700 1 -- 172.21.15.7:0/3498560909 wait complete. 2023-10-06T11:00:31.063 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'data_new' created 2023-10-06T11:00:31.076 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2023-10-06T11:00:31.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.213+0000 7fcf19542700 1 Processor -- start 2023-10-06T11:00:31.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.213+0000 7fcf19542700 1 -- start start 2023-10-06T11:00:31.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.214+0000 7fcf19542700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcf141594c0 0x7fcf140aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:31.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.214+0000 7fcf19542700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf14159890 0x7fcf140af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:31.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.214+0000 7fcf19542700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcf140caff0 0x7fcf140cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:31.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.214+0000 7fcf19542700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf140cf870 con 0x7fcf141594c0 2023-10-06T11:00:31.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.214+0000 7fcf19542700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf140cef40 con 0x7fcf140caff0 2023-10-06T11:00:31.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.214+0000 7fcf19542700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf140cf220 con 0x7fcf14159890 2023-10-06T11:00:31.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.214+0000 7fcf12ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcf141594c0 0x7fcf140aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:31.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.214+0000 7fcf12ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcf141594c0 0x7fcf140aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59636/0 (socket says 172.21.15.7:59636) 2023-10-06T11:00:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.214+0000 7fcf12ffd700 1 -- 172.21.15.7:0/4204494525 learned_addr learned my addr 172.21.15.7:0/4204494525 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.215+0000 7fcf137fe700 1 --2- 172.21.15.7:0/4204494525 >> v2:172.21.15.50:3300/0 conn(0x7fcf140caff0 0x7fcf140cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.215+0000 7fcf0bfff700 1 --2- 172.21.15.7:0/4204494525 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf14159890 0x7fcf140af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.215+0000 7fcf12ffd700 1 -- 172.21.15.7:0/4204494525 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf14159890 msgr2=0x7fcf140af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.215+0000 7fcf12ffd700 1 --2- 172.21.15.7:0/4204494525 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf14159890 0x7fcf140af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.215+0000 7fcf12ffd700 1 -- 172.21.15.7:0/4204494525 >> v2:172.21.15.50:3300/0 conn(0x7fcf140caff0 msgr2=0x7fcf140cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.215+0000 7fcf12ffd700 1 --2- 172.21.15.7:0/4204494525 >> v2:172.21.15.50:3300/0 conn(0x7fcf140caff0 0x7fcf140cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.215+0000 7fcf12ffd700 1 -- 172.21.15.7:0/4204494525 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf140cf500 con 0x7fcf141594c0 2023-10-06T11:00:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.215+0000 7fcf12ffd700 1 --2- 172.21.15.7:0/4204494525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf141594c0 0x7fcf140aed30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcf140ca9f0 tx=0x7fcf04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caae0cb1a6d1e032 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.215+0000 7fcf127fc700 1 -- 172.21.15.7:0/4204494525 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04009e70 con 0x7fcf141594c0 2023-10-06T11:00:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.215+0000 7fcf127fc700 1 -- 172.21.15.7:0/4204494525 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0400b860 con 0x7fcf141594c0 2023-10-06T11:00:31.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.215+0000 7fcf127fc700 1 -- 172.21.15.7:0/4204494525 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0400bc00 con 0x7fcf141594c0 2023-10-06T11:00:31.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.216+0000 7fcf19542700 1 -- 172.21.15.7:0/4204494525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf141594c0 msgr2=0x7fcf140aed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:31.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.216+0000 7fcf19542700 1 --2- 172.21.15.7:0/4204494525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf141594c0 0x7fcf140aed30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcf140ca9f0 tx=0x7fcf04009250 comp rx=0 tx=0).stop 2023-10-06T11:00:31.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.216+0000 7fcf19542700 1 -- 172.21.15.7:0/4204494525 shutdown_connections 2023-10-06T11:00:31.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.216+0000 7fcf19542700 1 --2- 172.21.15.7:0/4204494525 >> v2:172.21.15.50:3300/0 conn(0x7fcf140caff0 0x7fcf140cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:31.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.216+0000 7fcf19542700 1 --2- 172.21.15.7:0/4204494525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf141594c0 0x7fcf140aed30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:31.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.216+0000 7fcf19542700 1 --2- 172.21.15.7:0/4204494525 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf14159890 0x7fcf140af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:31.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.216+0000 7fcf19542700 1 -- 172.21.15.7:0/4204494525 >> 172.21.15.7:0/4204494525 conn(0x7fcf14067bc0 msgr2=0x7fcf140d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:31.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.216+0000 7fcf19542700 1 -- 172.21.15.7:0/4204494525 shutdown_connections 2023-10-06T11:00:31.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.216+0000 7fcf19542700 1 -- 172.21.15.7:0/4204494525 wait complete. 2023-10-06T11:00:31.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.217+0000 7fcf19542700 1 Processor -- start 2023-10-06T11:00:31.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.217+0000 7fcf19542700 1 -- start start 2023-10-06T11:00:31.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf19542700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf140caff0 0x7fcf140b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:31.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf19542700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf141594c0 0x7fcf1415a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:31.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf19542700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf14159890 0x7fcf14154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:31.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf19542700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf140affe0 con 0x7fcf141594c0 2023-10-06T11:00:31.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf19542700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1415bbf0 con 0x7fcf14159890 2023-10-06T11:00:31.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf19542700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1415ad20 con 0x7fcf140caff0 2023-10-06T11:00:31.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf0bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf141594c0 0x7fcf1415a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:31.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf0bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf141594c0 0x7fcf1415a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59642/0 (socket says 172.21.15.7:59642) 2023-10-06T11:00:31.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf0bfff700 1 -- 172.21.15.7:0/589623549 learned_addr learned my addr 172.21.15.7:0/589623549 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:31.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf137fe700 1 --2- 172.21.15.7:0/589623549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf14159890 0x7fcf14154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:31.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf12ffd700 1 --2- 172.21.15.7:0/589623549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf140caff0 0x7fcf140b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:31.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf0bfff700 1 -- 172.21.15.7:0/589623549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf140caff0 msgr2=0x7fcf140b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:31.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf0bfff700 1 --2- 172.21.15.7:0/589623549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf140caff0 0x7fcf140b26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:31.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf0bfff700 1 -- 172.21.15.7:0/589623549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf14159890 msgr2=0x7fcf14154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:31.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf0bfff700 1 --2- 172.21.15.7:0/589623549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf14159890 0x7fcf14154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:31.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf0bfff700 1 -- 172.21.15.7:0/589623549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf040094f0 con 0x7fcf141594c0 2023-10-06T11:00:31.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.218+0000 7fcf0bfff700 1 --2- 172.21.15.7:0/589623549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf141594c0 0x7fcf1415a7e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00d860 tx=0x7fcefc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.219+0000 7fcf0affd700 1 -- 172.21.15.7:0/589623549 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc0125f0 con 0x7fcf141594c0 2023-10-06T11:00:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.219+0000 7fcf0affd700 1 -- 172.21.15.7:0/589623549 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc012750 con 0x7fcf141594c0 2023-10-06T11:00:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.219+0000 7fcf19542700 1 -- 172.21.15.7:0/589623549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf141550a0 con 0x7fcf141594c0 2023-10-06T11:00:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.219+0000 7fcf0affd700 1 -- 172.21.15.7:0/589623549 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc012b10 con 0x7fcf141594c0 2023-10-06T11:00:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.219+0000 7fcf19542700 1 -- 172.21.15.7:0/589623549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1415b2c0 con 0x7fcf141594c0 2023-10-06T11:00:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.220+0000 7fcf19542700 1 -- 172.21.15.7:0/589623549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf140c71a0 con 0x7fcf141594c0 2023-10-06T11:00:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.220+0000 7fcf0affd700 1 -- 172.21.15.7:0/589623549 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcefc01e460 con 0x7fcf141594c0 2023-10-06T11:00:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.221+0000 7fcf0affd700 1 --2- 172.21.15.7:0/589623549 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fcef4066f30 0x7fcef40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.221+0000 7fcf0affd700 1 -- 172.21.15.7:0/589623549 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6741+0+0 (secure 0 0 0) 0x7fcefc084e70 con 0x7fcf141594c0 2023-10-06T11:00:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.221+0000 7fcf12ffd700 1 --2- 172.21.15.7:0/589623549 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fcef4066f30 0x7fcef40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.221+0000 7fcf12ffd700 1 --2- 172.21.15.7:0/589623549 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fcef4066f30 0x7fcef40693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf140ca9f0 tx=0x7fcf04017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:31.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.226+0000 7fcf0affd700 1 -- 172.21.15.7:0/589623549 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcefc055760 con 0x7fcf141594c0 2023-10-06T11:00:31.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:31.474+0000 7fcf19542700 1 -- 172.21.15.7:0/589623549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) v1 -- 0x7fcf14070480 con 0x7fcf141594c0 2023-10-06T11:00:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.065+0000 7fcf0affd700 1 -- 172.21.15.7:0/589623549 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 8 to fsmap v20) v1 ==== 131+0+0 (secure 0 0 0) 0x7fcefc0552f0 con 0x7fcf141594c0 2023-10-06T11:00:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.069+0000 7fcf19542700 1 -- 172.21.15.7:0/589623549 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fcef4066f30 msgr2=0x7fcef40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.069+0000 7fcf19542700 1 --2- 172.21.15.7:0/589623549 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fcef4066f30 0x7fcef40693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf140ca9f0 tx=0x7fcf04017000 comp rx=0 tx=0).stop 2023-10-06T11:00:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.069+0000 7fcf19542700 1 -- 172.21.15.7:0/589623549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf141594c0 msgr2=0x7fcf1415a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.069+0000 7fcf19542700 1 --2- 172.21.15.7:0/589623549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf141594c0 0x7fcf1415a7e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00d860 tx=0x7fcefc008040 comp rx=0 tx=0).stop 2023-10-06T11:00:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.069+0000 7fcf19542700 1 -- 172.21.15.7:0/589623549 shutdown_connections 2023-10-06T11:00:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.069+0000 7fcf19542700 1 --2- 172.21.15.7:0/589623549 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fcef4066f30 0x7fcef40693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.069+0000 7fcf19542700 1 --2- 172.21.15.7:0/589623549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf14159890 0x7fcf14154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.069+0000 7fcf19542700 1 --2- 172.21.15.7:0/589623549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf140caff0 0x7fcf140b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.069+0000 7fcf19542700 1 --2- 172.21.15.7:0/589623549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf141594c0 0x7fcf1415a7e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.069+0000 7fcf19542700 1 -- 172.21.15.7:0/589623549 >> 172.21.15.7:0/589623549 conn(0x7fcf14067bc0 msgr2=0x7fcf140c4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.069+0000 7fcf19542700 1 -- 172.21.15.7:0/589623549 shutdown_connections 2023-10-06T11:00:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.069+0000 7fcf19542700 1 -- 172.21.15.7:0/589623549 wait complete. 2023-10-06T11:00:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:added data pool 8 to fsmap 2023-10-06T11:00:32.085 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:00:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.220+0000 7f2597cb6700 1 Processor -- start 2023-10-06T11:00:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.221+0000 7f2597cb6700 1 -- start start 2023-10-06T11:00:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2597cb6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f25900ccda0 0x7f25900cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2597cb6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25900aaa40 0x7f2590155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2597cb6700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2590069110 con 0x7f25900ac8d0 2023-10-06T11:00:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2597cb6700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2590068b30 con 0x7f25900ccda0 2023-10-06T11:00:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2597cb6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25900aafb0 con 0x7f25900aaa40 2023-10-06T11:00:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2595a52700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f25900ccda0 0x7f25900cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2595a52700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f25900ccda0 0x7f25900cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59652/0 (socket says 172.21.15.7:59652) 2023-10-06T11:00:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2595a52700 1 -- 172.21.15.7:0/3586480640 learned_addr learned my addr 172.21.15.7:0/3586480640 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2595251700 1 --1- 172.21.15.7:0/3586480640 >> v1:172.21.15.7:6789/0 conn(0x7f25900ac8d0 0x7f25900aa330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39036/0 (socket says 172.21.15.7:39036) 2023-10-06T11:00:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2595a52700 1 -- 172.21.15.7:0/3586480640 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25900aaa40 msgr2=0x7f2590155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2596253700 1 --2- 172.21.15.7:0/3586480640 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25900aaa40 0x7f2590155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2595a52700 1 --2- 172.21.15.7:0/3586480640 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25900aaa40 0x7f2590155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2594a50700 1 -- 172.21.15.7:0/3586480640 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607786340 0 0) 0x7f2590069110 con 0x7f25900ac8d0 2023-10-06T11:00:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2595a52700 1 -- 172.21.15.7:0/3586480640 >> v1:172.21.15.7:6789/0 conn(0x7f25900ac8d0 legacy=0x7f25900aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2595a52700 1 -- 172.21.15.7:0/3586480640 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2590068da0 con 0x7f25900ccda0 2023-10-06T11:00:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.222+0000 7f2596253700 1 --2- 172.21.15.7:0/3586480640 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25900aaa40 0x7f2590155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:32.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.223+0000 7f2595a52700 1 --2- 172.21.15.7:0/3586480640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25900ccda0 0x7f25900cd170 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f258c0099b0 tx=0x7f258c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46619cd44b792012 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:32.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.223+0000 7f2594a50700 1 -- 172.21.15.7:0/3586480640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c00b860 con 0x7f25900ccda0 2023-10-06T11:00:32.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.223+0000 7f2594a50700 1 -- 172.21.15.7:0/3586480640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c00b9c0 con 0x7f25900ccda0 2023-10-06T11:00:32.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.223+0000 7f2594a50700 1 -- 172.21.15.7:0/3586480640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c00bd60 con 0x7f25900ccda0 2023-10-06T11:00:32.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.223+0000 7f2597cb6700 1 -- 172.21.15.7:0/3586480640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25900ccda0 msgr2=0x7f25900cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.223+0000 7f2597cb6700 1 --2- 172.21.15.7:0/3586480640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25900ccda0 0x7f25900cd170 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f258c0099b0 tx=0x7f258c009250 comp rx=0 tx=0).stop 2023-10-06T11:00:32.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.223+0000 7f2597cb6700 1 -- 172.21.15.7:0/3586480640 shutdown_connections 2023-10-06T11:00:32.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.223+0000 7f2597cb6700 1 --2- 172.21.15.7:0/3586480640 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25900aaa40 0x7f2590155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.223+0000 7f2597cb6700 1 --2- 172.21.15.7:0/3586480640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25900ccda0 0x7f25900cd170 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.223+0000 7f2597cb6700 1 -- 172.21.15.7:0/3586480640 >> 172.21.15.7:0/3586480640 conn(0x7f2590096160 msgr2=0x7f25900afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:32.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.223+0000 7f2597cb6700 1 -- 172.21.15.7:0/3586480640 shutdown_connections 2023-10-06T11:00:32.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.223+0000 7f2597cb6700 1 -- 172.21.15.7:0/3586480640 wait complete. 2023-10-06T11:00:32.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.225+0000 7f2597cb6700 1 Processor -- start 2023-10-06T11:00:32.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.225+0000 7f2597cb6700 1 -- start start 2023-10-06T11:00:32.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.226+0000 7f2597cb6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25900aaa40 0x7f25900985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:32.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.226+0000 7f2597cb6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25900ac8d0 0x7f2590097d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:32.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.226+0000 7f2597cb6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25900ccda0 0x7f2590158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:32.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.226+0000 7f2597cb6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2590167550 con 0x7f25900ac8d0 2023-10-06T11:00:32.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.226+0000 7f2597cb6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2590166680 con 0x7f25900ccda0 2023-10-06T11:00:32.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.226+0000 7f2597cb6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2590166940 con 0x7f25900aaa40 2023-10-06T11:00:32.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.226+0000 7f2595251700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25900ac8d0 0x7f2590097d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:32.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.226+0000 7f2595251700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25900ac8d0 0x7f2590097d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59654/0 (socket says 172.21.15.7:59654) 2023-10-06T11:00:32.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.226+0000 7f2595251700 1 -- 172.21.15.7:0/2623774982 learned_addr learned my addr 172.21.15.7:0/2623774982 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:32.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2596253700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25900ccda0 0x7f2590158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:32.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2595a52700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25900aaa40 0x7f25900985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:32.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2595251700 1 -- 172.21.15.7:0/2623774982 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25900aaa40 msgr2=0x7f25900985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2595251700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25900aaa40 0x7f25900985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2595251700 1 -- 172.21.15.7:0/2623774982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25900ccda0 msgr2=0x7f2590158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2595251700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25900ccda0 0x7f2590158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2595251700 1 -- 172.21.15.7:0/2623774982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c0094f0 con 0x7f25900ac8d0 2023-10-06T11:00:32.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2595a52700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25900aaa40 0x7f25900985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:32.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2596253700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25900ccda0 0x7f2590158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:32.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2595251700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25900ac8d0 0x7f2590097d80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f25800011e0 tx=0x7f2580007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:32.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2585ffb700 1 -- 172.21.15.7:0/2623774982 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580007300 con 0x7f25900ac8d0 2023-10-06T11:00:32.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2585ffb700 1 -- 172.21.15.7:0/2623774982 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2580007460 con 0x7f25900ac8d0 2023-10-06T11:00:32.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2597cb6700 1 -- 172.21.15.7:0/2623774982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2590166c20 con 0x7f25900ac8d0 2023-10-06T11:00:32.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2585ffb700 1 -- 172.21.15.7:0/2623774982 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580004830 con 0x7f25900ac8d0 2023-10-06T11:00:32.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.227+0000 7f2597cb6700 1 -- 172.21.15.7:0/2623774982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25901671e0 con 0x7f25900ac8d0 2023-10-06T11:00:32.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.228+0000 7f2597cb6700 1 -- 172.21.15.7:0/2623774982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2590098380 con 0x7f25900ac8d0 2023-10-06T11:00:32.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.229+0000 7f2585ffb700 1 -- 172.21.15.7:0/2623774982 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2580004be0 con 0x7f25900ac8d0 2023-10-06T11:00:32.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.229+0000 7f2585ffb700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2574066f30 0x7f25740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:32.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.229+0000 7f2585ffb700 1 -- 172.21.15.7:0/2623774982 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f2580083ea0 con 0x7f25900ac8d0 2023-10-06T11:00:32.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.229+0000 7f2595a52700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2574066f30 0x7f25740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:32.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.230+0000 7f2595a52700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2574066f30 0x7f25740693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f258c0099b0 tx=0x7f258c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:32.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.234+0000 7f2585ffb700 1 -- 172.21.15.7:0/2623774982 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2580050d60 con 0x7f25900ac8d0 2023-10-06T11:00:32.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.480+0000 7f2597cb6700 1 -- 172.21.15.7:0/2623774982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2590070480 con 0x7f25900ac8d0 2023-10-06T11:00:32.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.481+0000 7f2585ffb700 1 -- 172.21.15.7:0/2623774982 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4587 (secure 0 0 0) 0x7f2580018020 con 0x7f25900ac8d0 2023-10-06T11:00:32.482 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:32.482 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/904048408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":904048408},{"type":"v1","addr":"172.21.15.50:6834","nonce":904048408}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5062,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/949655295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":949655295},{"type":"v1","addr":"172.21.15.50:6835","nonce":949655295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1576009113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1576009113},{"type":"v1","addr":"172.21.15.7:6835","nonce":1576009113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:00:21.179899+0000","modified":"2023-10-06T11:00:32.049499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5130":{"gid":5130,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1573170028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1573170028},{"type":"v1","addr":"172.21.15.7:6837","nonce":1573170028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:00:32.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.483+0000 7f2597cb6700 1 -- 172.21.15.7:0/2623774982 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2574066f30 msgr2=0x7f25740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.483+0000 7f2597cb6700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2574066f30 0x7f25740693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f258c0099b0 tx=0x7f258c017000 comp rx=0 tx=0).stop 2023-10-06T11:00:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.483+0000 7f2597cb6700 1 -- 172.21.15.7:0/2623774982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25900ac8d0 msgr2=0x7f2590097d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.483+0000 7f2597cb6700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25900ac8d0 0x7f2590097d80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f25800011e0 tx=0x7f2580007e10 comp rx=0 tx=0).stop 2023-10-06T11:00:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.483+0000 7f2597cb6700 1 -- 172.21.15.7:0/2623774982 shutdown_connections 2023-10-06T11:00:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.483+0000 7f2597cb6700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2574066f30 0x7f25740693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.483+0000 7f2597cb6700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25900ccda0 0x7f2590158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.483+0000 7f2597cb6700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25900aaa40 0x7f25900985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.483+0000 7f2597cb6700 1 --2- 172.21.15.7:0/2623774982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25900ac8d0 0x7f2590097d80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.483+0000 7f2597cb6700 1 -- 172.21.15.7:0/2623774982 >> 172.21.15.7:0/2623774982 conn(0x7f2590096160 msgr2=0x7f259006ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.484+0000 7f2597cb6700 1 -- 172.21.15.7:0/2623774982 shutdown_connections 2023-10-06T11:00:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.484+0000 7f2597cb6700 1 -- 172.21.15.7:0/2623774982 wait complete. 2023-10-06T11:00:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 20 2023-10-06T11:00:32.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:00:32.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.629+0000 7f223a51f700 1 Processor -- start 2023-10-06T11:00:32.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.629+0000 7f223a51f700 1 -- start start 2023-10-06T11:00:32.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.630+0000 7f223a51f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2234158120 0x7f22340c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:32.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.630+0000 7f223a51f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22340cbd10 con 0x7f22340c8ba0 2023-10-06T11:00:32.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.630+0000 7f223a51f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22340cb9e0 con 0x7f22340cae30 2023-10-06T11:00:32.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.630+0000 7f223a51f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22340c9300 con 0x7f2234158120 2023-10-06T11:00:32.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.630+0000 7f22337fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f22340c8ba0 0x7f22340ca720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39038/0 (socket says 172.21.15.7:39038) 2023-10-06T11:00:32.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.630+0000 7f22337fe700 1 -- 172.21.15.7:0/1998379604 learned_addr learned my addr 172.21.15.7:0/1998379604 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:32.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.630+0000 7f2233fff700 1 --2- 172.21.15.7:0/1998379604 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2234158120 0x7f22340c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:32.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.631+0000 7f2232ffd700 1 -- 172.21.15.7:0/1998379604 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500263677 0 0) 0x7f22340cbd10 con 0x7f22340c8ba0 2023-10-06T11:00:32.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.631+0000 7f2232ffd700 1 -- 172.21.15.7:0/1998379604 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2220003570 con 0x7f22340c8ba0 2023-10-06T11:00:32.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.631+0000 7f2232ffd700 1 -- 172.21.15.7:0/1998379604 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322354920 0 0) 0x7f22340cb9e0 con 0x7f22340cae30 2023-10-06T11:00:32.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.631+0000 7f2232ffd700 1 -- 172.21.15.7:0/1998379604 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22340cbd10 con 0x7f22340cae30 2023-10-06T11:00:32.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.631+0000 7f2233fff700 1 -- 172.21.15.7:0/1998379604 >> v1:172.21.15.50:6789/0 conn(0x7f22340cae30 legacy=0x7f22340cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.631+0000 7f2233fff700 1 -- 172.21.15.7:0/1998379604 >> v1:172.21.15.7:6789/0 conn(0x7f22340c8ba0 legacy=0x7f22340ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.631+0000 7f2233fff700 1 -- 172.21.15.7:0/1998379604 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22340c95e0 con 0x7f2234158120 2023-10-06T11:00:32.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.631+0000 7f2233fff700 1 --2- 172.21.15.7:0/1998379604 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2234158120 0x7f22340c8660 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2224009900 tx=0x7f2224009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaca16a14801a9ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:32.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.631+0000 7f2232ffd700 1 -- 172.21.15.7:0/1998379604 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224005c10 con 0x7f2234158120 2023-10-06T11:00:32.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.631+0000 7f2232ffd700 1 -- 172.21.15.7:0/1998379604 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2224005d70 con 0x7f2234158120 2023-10-06T11:00:32.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.631+0000 7f2232ffd700 1 -- 172.21.15.7:0/1998379604 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224006260 con 0x7f2234158120 2023-10-06T11:00:32.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.632+0000 7f223a51f700 1 -- 172.21.15.7:0/1998379604 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2234158120 msgr2=0x7f22340c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.632+0000 7f223a51f700 1 --2- 172.21.15.7:0/1998379604 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2234158120 0x7f22340c8660 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2224009900 tx=0x7f2224009120 comp rx=0 tx=0).stop 2023-10-06T11:00:32.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.632+0000 7f223a51f700 1 -- 172.21.15.7:0/1998379604 shutdown_connections 2023-10-06T11:00:32.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.632+0000 7f223a51f700 1 --2- 172.21.15.7:0/1998379604 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2234158120 0x7f22340c8660 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.632+0000 7f223a51f700 1 -- 172.21.15.7:0/1998379604 >> 172.21.15.7:0/1998379604 conn(0x7f2234087920 msgr2=0x7f2234097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:32.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.632+0000 7f223a51f700 1 -- 172.21.15.7:0/1998379604 shutdown_connections 2023-10-06T11:00:32.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.632+0000 7f223a51f700 1 -- 172.21.15.7:0/1998379604 wait complete. 2023-10-06T11:00:32.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.633+0000 7f223a51f700 1 Processor -- start 2023-10-06T11:00:32.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.633+0000 7f223a51f700 1 -- start start 2023-10-06T11:00:32.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.634+0000 7f223a51f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22340c8ba0 0x7f2234150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:32.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.634+0000 7f223a51f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22340cae30 0x7f223406a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:32.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.634+0000 7f223a51f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2234158120 0x7f22341560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:32.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.634+0000 7f223a51f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22340c3b20 con 0x7f22340c8ba0 2023-10-06T11:00:32.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.634+0000 7f223a51f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22340c4ec0 con 0x7f22340cae30 2023-10-06T11:00:32.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.634+0000 7f223a51f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22340aef30 con 0x7f2234158120 2023-10-06T11:00:32.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.634+0000 7f2233fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22340c8ba0 0x7f2234150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:32.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.634+0000 7f2233fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22340c8ba0 0x7f2234150460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59664/0 (socket says 172.21.15.7:59664) 2023-10-06T11:00:32.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.634+0000 7f2233fff700 1 -- 172.21.15.7:0/4278538392 learned_addr learned my addr 172.21.15.7:0/4278538392 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:32.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.634+0000 7f22337fe700 1 --2- 172.21.15.7:0/4278538392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22340cae30 0x7f223406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:32.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.634+0000 7f2238abc700 1 --2- 172.21.15.7:0/4278538392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2234158120 0x7f22341560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:32.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.635+0000 7f2233fff700 1 -- 172.21.15.7:0/4278538392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2234158120 msgr2=0x7f22341560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.635+0000 7f2233fff700 1 --2- 172.21.15.7:0/4278538392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2234158120 0x7f22341560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.635+0000 7f2233fff700 1 -- 172.21.15.7:0/4278538392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22340cae30 msgr2=0x7f223406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.635+0000 7f2233fff700 1 --2- 172.21.15.7:0/4278538392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22340cae30 0x7f223406a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.635+0000 7f2233fff700 1 -- 172.21.15.7:0/4278538392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22240093c0 con 0x7f22340c8ba0 2023-10-06T11:00:32.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.635+0000 7f2233fff700 1 --2- 172.21.15.7:0/4278538392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22340c8ba0 0x7f2234150460 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2224009390 tx=0x7f2224016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:32.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.635+0000 7f222bfff700 1 -- 172.21.15.7:0/4278538392 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222401d8f0 con 0x7f22340c8ba0 2023-10-06T11:00:32.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.635+0000 7f222bfff700 1 -- 172.21.15.7:0/4278538392 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222401da70 con 0x7f22340c8ba0 2023-10-06T11:00:32.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.635+0000 7f223a51f700 1 -- 172.21.15.7:0/4278538392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22340694a0 con 0x7f22340c8ba0 2023-10-06T11:00:32.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.635+0000 7f222bfff700 1 -- 172.21.15.7:0/4278538392 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222401de30 con 0x7f22340c8ba0 2023-10-06T11:00:32.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.635+0000 7f223a51f700 1 -- 172.21.15.7:0/4278538392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2234069a60 con 0x7f22340c8ba0 2023-10-06T11:00:32.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.636+0000 7f223a51f700 1 -- 172.21.15.7:0/4278538392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22340aed00 con 0x7f22340c8ba0 2023-10-06T11:00:32.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.636+0000 7f222bfff700 1 -- 172.21.15.7:0/4278538392 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f222401b690 con 0x7f22340c8ba0 2023-10-06T11:00:32.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.637+0000 7f222bfff700 1 --2- 172.21.15.7:0/4278538392 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2214066f30 0x7f22140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:32.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.637+0000 7f222bfff700 1 -- 172.21.15.7:0/4278538392 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f2224086a30 con 0x7f22340c8ba0 2023-10-06T11:00:32.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.637+0000 7f22337fe700 1 --2- 172.21.15.7:0/4278538392 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2214066f30 0x7f22140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:32.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.637+0000 7f22337fe700 1 --2- 172.21.15.7:0/4278538392 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2214066f30 0x7f22140693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f221c0058d0 tx=0x7f221c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:32.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.642+0000 7f222bfff700 1 -- 172.21.15.7:0/4278538392 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22340aed00 con 0x7f22340c8ba0 2023-10-06T11:00:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.846+0000 7f223a51f700 1 -- 172.21.15.7:0/4278538392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22340aed00 con 0x7f22340c8ba0 2023-10-06T11:00:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.847+0000 7f222bfff700 1 -- 172.21.15.7:0/4278538392 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18643 (secure 0 0 0) 0x7f22340aed00 con 0x7f22340c8ba0 2023-10-06T11:00:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:32.848 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":42,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:00:31.474860+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:00:18.763171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T11:00:20.149563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":8,"pool_name":"data_new","create_time":"2023-10-06T11:00:30.330717+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:00:32.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.849+0000 7f223a51f700 1 -- 172.21.15.7:0/4278538392 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2214066f30 msgr2=0x7f22140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.849+0000 7f223a51f700 1 --2- 172.21.15.7:0/4278538392 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2214066f30 0x7f22140693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f221c0058d0 tx=0x7f221c009040 comp rx=0 tx=0).stop 2023-10-06T11:00:32.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.849+0000 7f223a51f700 1 -- 172.21.15.7:0/4278538392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22340c8ba0 msgr2=0x7f2234150460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:32.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.849+0000 7f223a51f700 1 --2- 172.21.15.7:0/4278538392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22340c8ba0 0x7f2234150460 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2224009390 tx=0x7f2224016000 comp rx=0 tx=0).stop 2023-10-06T11:00:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.849+0000 7f223a51f700 1 -- 172.21.15.7:0/4278538392 shutdown_connections 2023-10-06T11:00:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.849+0000 7f223a51f700 1 --2- 172.21.15.7:0/4278538392 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2214066f30 0x7f22140693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.849+0000 7f223a51f700 1 --2- 172.21.15.7:0/4278538392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22340c8ba0 0x7f2234150460 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.849+0000 7f223a51f700 1 --2- 172.21.15.7:0/4278538392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2234158120 0x7f22341560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.849+0000 7f223a51f700 1 --2- 172.21.15.7:0/4278538392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22340cae30 0x7f223406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.849+0000 7f223a51f700 1 -- 172.21.15.7:0/4278538392 >> 172.21.15.7:0/4278538392 conn(0x7f2234087920 msgr2=0x7f22340b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.849+0000 7f223a51f700 1 -- 172.21.15.7:0/4278538392 shutdown_connections 2023-10-06T11:00:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:32.849+0000 7f223a51f700 1 -- 172.21.15.7:0/4278538392 wait complete. 2023-10-06T11:00:32.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:32.864 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2023-10-06T11:00:32.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:32.889 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2023-10-06T11:00:32.954 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2023-10-06T11:00:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.145+0000 7faebd56c700 1 Processor -- start 2023-10-06T11:00:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.145+0000 7faebd56c700 1 -- start start 2023-10-06T11:00:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.146+0000 7faebd56c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faeb81594c0 0x7faeb80aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.146+0000 7faebd56c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb80cb700 0x7faeb80af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.146+0000 7faebd56c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb80cf870 con 0x7faeb8159890 2023-10-06T11:00:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.146+0000 7faebd56c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80cecf0 con 0x7faeb81594c0 2023-10-06T11:00:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.146+0000 7faebd56c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80b1030 con 0x7faeb80cb700 2023-10-06T11:00:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.146+0000 7faeb77fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb80cb700 0x7faeb80af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.146+0000 7faeb6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faeb81594c0 0x7faeb80aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.146+0000 7faeb77fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb80cb700 0x7faeb80af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:58528/0 (socket says 172.21.15.7:58528) 2023-10-06T11:00:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.146+0000 7faeb6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faeb81594c0 0x7faeb80aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:37294/0 (socket says 172.21.15.7:37294) 2023-10-06T11:00:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.146+0000 7faeb77fe700 1 -- 172.21.15.7:0/3282291362 learned_addr learned my addr 172.21.15.7:0/3282291362 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:33.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.146+0000 7faeb6ffd700 1 -- 172.21.15.7:0/3282291362 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb80cb700 msgr2=0x7faeb80af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:33.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.146+0000 7faeb6ffd700 1 --2- 172.21.15.7:0/3282291362 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb80cb700 0x7faeb80af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:33.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.146+0000 7faeb6ffd700 1 -- 172.21.15.7:0/3282291362 >> v1:172.21.15.50:6789/0 conn(0x7faeb8159890 legacy=0x7faeb80caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:33.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.146+0000 7faeb5ffb700 1 -- 172.21.15.7:0/3282291362 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070464341 0 0) 0x7faeb80cf870 con 0x7faeb8159890 2023-10-06T11:00:33.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.147+0000 7faeb6ffd700 1 -- 172.21.15.7:0/3282291362 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80cef40 con 0x7faeb81594c0 2023-10-06T11:00:33.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.147+0000 7faeb6ffd700 1 --2- 172.21.15.7:0/3282291362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb81594c0 0x7faeb80aed30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faea80098e0 tx=0x7faea80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8c6ad0bd3fe9851 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:33.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.147+0000 7faeb5ffb700 1 -- 172.21.15.7:0/3282291362 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800b640 con 0x7faeb81594c0 2023-10-06T11:00:33.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.147+0000 7faeb5ffb700 1 -- 172.21.15.7:0/3282291362 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea800b7a0 con 0x7faeb81594c0 2023-10-06T11:00:33.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.147+0000 7faeb5ffb700 1 -- 172.21.15.7:0/3282291362 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800bb40 con 0x7faeb81594c0 2023-10-06T11:00:33.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.148+0000 7faebd56c700 1 -- 172.21.15.7:0/3282291362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb81594c0 msgr2=0x7faeb80aed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:33.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.148+0000 7faebd56c700 1 --2- 172.21.15.7:0/3282291362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb81594c0 0x7faeb80aed30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faea80098e0 tx=0x7faea80091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:33.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.148+0000 7faebd56c700 1 -- 172.21.15.7:0/3282291362 shutdown_connections 2023-10-06T11:00:33.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.148+0000 7faebd56c700 1 --2- 172.21.15.7:0/3282291362 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb80cb700 0x7faeb80af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:33.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.148+0000 7faebd56c700 1 --2- 172.21.15.7:0/3282291362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb81594c0 0x7faeb80aed30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:33.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.148+0000 7faebd56c700 1 -- 172.21.15.7:0/3282291362 >> 172.21.15.7:0/3282291362 conn(0x7faeb8067bc0 msgr2=0x7faeb80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:33.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.148+0000 7faebd56c700 1 -- 172.21.15.7:0/3282291362 shutdown_connections 2023-10-06T11:00:33.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.148+0000 7faebd56c700 1 -- 172.21.15.7:0/3282291362 wait complete. 2023-10-06T11:00:33.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.150+0000 7faebd56c700 1 Processor -- start 2023-10-06T11:00:33.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.150+0000 7faebd56c700 1 -- start start 2023-10-06T11:00:33.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faebd56c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeb80cb700 0x7faeb814f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:33.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faebd56c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb81594c0 0x7faeb8158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:33.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faebd56c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb8159890 0x7faeb8153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:33.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faebd56c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb814f720 con 0x7faeb80cb700 2023-10-06T11:00:33.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faebd56c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb8158d90 con 0x7faeb81594c0 2023-10-06T11:00:33.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faebd56c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb81574b0 con 0x7faeb8159890 2023-10-06T11:00:33.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faeb6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeb80cb700 0x7faeb814f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:33.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faeb6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeb80cb700 0x7faeb814f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59668/0 (socket says 172.21.15.7:59668) 2023-10-06T11:00:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faeb6ffd700 1 -- 172.21.15.7:0/3362811699 learned_addr learned my addr 172.21.15.7:0/3362811699 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faeb67fc700 1 --2- 172.21.15.7:0/3362811699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb81594c0 0x7faeb8158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faeb77fe700 1 --2- 172.21.15.7:0/3362811699 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb8159890 0x7faeb8153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faeb6ffd700 1 -- 172.21.15.7:0/3362811699 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb8159890 msgr2=0x7faeb8153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faeb6ffd700 1 --2- 172.21.15.7:0/3362811699 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb8159890 0x7faeb8153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faeb6ffd700 1 -- 172.21.15.7:0/3362811699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb81594c0 msgr2=0x7faeb8158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faeb6ffd700 1 --2- 172.21.15.7:0/3362811699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb81594c0 0x7faeb8158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.151+0000 7faeb6ffd700 1 -- 172.21.15.7:0/3362811699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8009420 con 0x7faeb80cb700 2023-10-06T11:00:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.152+0000 7faeb6ffd700 1 --2- 172.21.15.7:0/3362811699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeb80cb700 0x7faeb814f1e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faea8009f80 tx=0x7faea8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.152+0000 7fae9effd700 1 -- 172.21.15.7:0/3362811699 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800bb20 con 0x7faeb80cb700 2023-10-06T11:00:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.152+0000 7fae9effd700 1 -- 172.21.15.7:0/3362811699 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea8000c90 con 0x7faeb80cb700 2023-10-06T11:00:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.152+0000 7faebd56c700 1 -- 172.21.15.7:0/3362811699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb81568a0 con 0x7faeb80cb700 2023-10-06T11:00:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.152+0000 7fae9effd700 1 -- 172.21.15.7:0/3362811699 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8011650 con 0x7faeb80cb700 2023-10-06T11:00:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.152+0000 7faebd56c700 1 -- 172.21.15.7:0/3362811699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb8156e60 con 0x7faeb80cb700 2023-10-06T11:00:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.153+0000 7faebd56c700 1 -- 172.21.15.7:0/3362811699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb8070480 con 0x7faeb80cb700 2023-10-06T11:00:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.153+0000 7fae9effd700 1 -- 172.21.15.7:0/3362811699 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faea8011a00 con 0x7faeb80cb700 2023-10-06T11:00:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.154+0000 7fae9effd700 1 --2- 172.21.15.7:0/3362811699 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faea4066f30 0x7faea40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.154+0000 7fae9effd700 1 -- 172.21.15.7:0/3362811699 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7faea8085fd0 con 0x7faeb80cb700 2023-10-06T11:00:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.154+0000 7faeb67fc700 1 --2- 172.21.15.7:0/3362811699 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faea4066f30 0x7faea40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.154+0000 7faeb67fc700 1 --2- 172.21.15.7:0/3362811699 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faea4066f30 0x7faea40693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faeb8156490 tx=0x7faeac007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.158+0000 7fae9effd700 1 -- 172.21.15.7:0/3362811699 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faea8052e10 con 0x7faeb80cb700 2023-10-06T11:00:33.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.445+0000 7faebd56c700 1 -- 172.21.15.7:0/3362811699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7faeb8068be0 con 0x7faeb80cb700 2023-10-06T11:00:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.449+0000 7fae9effd700 1 -- 172.21.15.7:0/3362811699 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v16) v1 ==== 210+0+0 (secure 0 0 0) 0x7faea8011cb0 con 0x7faeb80cb700 2023-10-06T11:00:33.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.451+0000 7faebd56c700 1 -- 172.21.15.7:0/3362811699 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faea4066f30 msgr2=0x7faea40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:33.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.451+0000 7faebd56c700 1 --2- 172.21.15.7:0/3362811699 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faea4066f30 0x7faea40693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faeb8156490 tx=0x7faeac007d30 comp rx=0 tx=0).stop 2023-10-06T11:00:33.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.451+0000 7faebd56c700 1 -- 172.21.15.7:0/3362811699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeb80cb700 msgr2=0x7faeb814f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:33.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.451+0000 7faebd56c700 1 --2- 172.21.15.7:0/3362811699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeb80cb700 0x7faeb814f1e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faea8009f80 tx=0x7faea8017000 comp rx=0 tx=0).stop 2023-10-06T11:00:33.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.452+0000 7faebd56c700 1 -- 172.21.15.7:0/3362811699 shutdown_connections 2023-10-06T11:00:33.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.452+0000 7faebd56c700 1 --2- 172.21.15.7:0/3362811699 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faea4066f30 0x7faea40693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:33.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.452+0000 7faebd56c700 1 --2- 172.21.15.7:0/3362811699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeb80cb700 0x7faeb814f1e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:33.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.452+0000 7faebd56c700 1 --2- 172.21.15.7:0/3362811699 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb8159890 0x7faeb8153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:33.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.452+0000 7faebd56c700 1 --2- 172.21.15.7:0/3362811699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb81594c0 0x7faeb8158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:33.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.452+0000 7faebd56c700 1 -- 172.21.15.7:0/3362811699 >> 172.21.15.7:0/3362811699 conn(0x7faeb8067bc0 msgr2=0x7faeb80d0880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:33.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.452+0000 7faebd56c700 1 -- 172.21.15.7:0/3362811699 shutdown_connections 2023-10-06T11:00:33.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:33.452+0000 7faebd56c700 1 -- 172.21.15.7:0/3362811699 wait complete. 2023-10-06T11:00:33.454 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-06T11:00:33.465 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2023-10-06T11:00:33.466 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:00:33.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:33.505 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[135780]: fuse finished with error 0 and tester_r 0 2023-10-06T11:00:33.507 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T11:00:39.608 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T11:00:39.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:39.608 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:00:39.633 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:00:39.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.814+0000 7f4d2c6b9700 1 Processor -- start 2023-10-06T11:00:39.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.814+0000 7f4d2c6b9700 1 -- start start 2023-10-06T11:00:39.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.815+0000 7f4d2c6b9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d24159af0 0x7f4d24155c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:39.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.815+0000 7f4d2c6b9700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d24156bd0 con 0x7f4d24156190 2023-10-06T11:00:39.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.815+0000 7f4d2c6b9700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d24156610 con 0x7f4d240ae0e0 2023-10-06T11:00:39.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.815+0000 7f4d2c6b9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240c9550 con 0x7f4d24159af0 2023-10-06T11:00:39.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.815+0000 7f4d2ac56700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4d24156190 0x7f4d240caf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39044/0 (socket says 172.21.15.7:39044) 2023-10-06T11:00:39.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.815+0000 7f4d2ac56700 1 -- 172.21.15.7:0/4263306402 learned_addr learned my addr 172.21.15.7:0/4263306402 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:39.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.815+0000 7f4d29c54700 1 --2- 172.21.15.7:0/4263306402 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d24159af0 0x7f4d24155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:39.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.815+0000 7f4d29453700 1 -- 172.21.15.7:0/4263306402 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378907514 0 0) 0x7f4d24156bd0 con 0x7f4d24156190 2023-10-06T11:00:39.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.815+0000 7f4d29453700 1 -- 172.21.15.7:0/4263306402 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d10003570 con 0x7f4d24156190 2023-10-06T11:00:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.816+0000 7f4d29453700 1 -- 172.21.15.7:0/4263306402 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814216302 0 0) 0x7f4d24156610 con 0x7f4d240ae0e0 2023-10-06T11:00:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.816+0000 7f4d29453700 1 -- 172.21.15.7:0/4263306402 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d24156bd0 con 0x7f4d240ae0e0 2023-10-06T11:00:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.816+0000 7f4d29c54700 1 -- 172.21.15.7:0/4263306402 >> v1:172.21.15.50:6789/0 conn(0x7f4d240ae0e0 legacy=0x7f4d240c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.816+0000 7f4d29c54700 1 -- 172.21.15.7:0/4263306402 >> v1:172.21.15.7:6789/0 conn(0x7f4d24156190 legacy=0x7f4d240caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.816+0000 7f4d29c54700 1 -- 172.21.15.7:0/4263306402 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d241568f0 con 0x7f4d24159af0 2023-10-06T11:00:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.816+0000 7f4d29c54700 1 --2- 172.21.15.7:0/4263306402 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d24159af0 0x7f4d24155c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009910 tx=0x7f4d140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd13b057baf0d093 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.816+0000 7f4d29453700 1 -- 172.21.15.7:0/4263306402 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d14011630 con 0x7f4d24159af0 2023-10-06T11:00:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.816+0000 7f4d29453700 1 -- 172.21.15.7:0/4263306402 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d14011790 con 0x7f4d24159af0 2023-10-06T11:00:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.816+0000 7f4d29453700 1 -- 172.21.15.7:0/4263306402 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d14011b30 con 0x7f4d24159af0 2023-10-06T11:00:39.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.817+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/4263306402 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d24159af0 msgr2=0x7f4d24155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:39.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.817+0000 7f4d2c6b9700 1 --2- 172.21.15.7:0/4263306402 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d24159af0 0x7f4d24155c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009910 tx=0x7f4d140091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:39.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.817+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/4263306402 shutdown_connections 2023-10-06T11:00:39.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.817+0000 7f4d2c6b9700 1 --2- 172.21.15.7:0/4263306402 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d24159af0 0x7f4d24155c50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:39.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.817+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/4263306402 >> 172.21.15.7:0/4263306402 conn(0x7f4d240cc790 msgr2=0x7f4d240c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:39.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.817+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/4263306402 shutdown_connections 2023-10-06T11:00:39.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.817+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/4263306402 wait complete. 2023-10-06T11:00:39.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.818+0000 7f4d2c6b9700 1 Processor -- start 2023-10-06T11:00:39.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.818+0000 7f4d2c6b9700 1 -- start start 2023-10-06T11:00:39.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2c6b9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d240ae0e0 0x7f4d240c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:39.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2c6b9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d24159af0 0x7f4d240c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:39.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2c6b9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d24143630 0x7f4d24154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:39.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2c6b9700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2416dd10 con 0x7f4d240ae0e0 2023-10-06T11:00:39.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2c6b9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2416d140 con 0x7f4d24159af0 2023-10-06T11:00:39.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2c6b9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2414deb0 con 0x7f4d24143630 2023-10-06T11:00:39.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2a455700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d240ae0e0 0x7f4d240c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:39.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2a455700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d240ae0e0 0x7f4d240c2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59676/0 (socket says 172.21.15.7:59676) 2023-10-06T11:00:39.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2a455700 1 -- 172.21.15.7:0/3526056709 learned_addr learned my addr 172.21.15.7:0/3526056709 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:39.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d29c54700 1 --2- 172.21.15.7:0/3526056709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d24159af0 0x7f4d240c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:39.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2ac56700 1 --2- 172.21.15.7:0/3526056709 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d24143630 0x7f4d24154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:39.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2a455700 1 -- 172.21.15.7:0/3526056709 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d24143630 msgr2=0x7f4d24154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:39.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2a455700 1 --2- 172.21.15.7:0/3526056709 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d24143630 0x7f4d24154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:39.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2a455700 1 -- 172.21.15.7:0/3526056709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d24159af0 msgr2=0x7f4d240c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:39.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2a455700 1 --2- 172.21.15.7:0/3526056709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d24159af0 0x7f4d240c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:39.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.819+0000 7f4d2a455700 1 -- 172.21.15.7:0/3526056709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d14009420 con 0x7f4d240ae0e0 2023-10-06T11:00:39.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.820+0000 7f4d2a455700 1 --2- 172.21.15.7:0/3526056709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d240ae0e0 0x7f4d240c2d70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000c580 tx=0x7f4d20007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:39.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.820+0000 7f4d1a7fc700 1 -- 172.21.15.7:0/3526056709 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20010510 con 0x7f4d240ae0e0 2023-10-06T11:00:39.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.820+0000 7f4d1a7fc700 1 -- 172.21.15.7:0/3526056709 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d20010670 con 0x7f4d240ae0e0 2023-10-06T11:00:39.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.820+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/3526056709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2416d3e0 con 0x7f4d240ae0e0 2023-10-06T11:00:39.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.820+0000 7f4d1a7fc700 1 -- 172.21.15.7:0/3526056709 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20010a30 con 0x7f4d240ae0e0 2023-10-06T11:00:39.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.820+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/3526056709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2416d9a0 con 0x7f4d240ae0e0 2023-10-06T11:00:39.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.821+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/3526056709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d24070480 con 0x7f4d240ae0e0 2023-10-06T11:00:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.821+0000 7f4d1a7fc700 1 -- 172.21.15.7:0/3526056709 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d2001b400 con 0x7f4d240ae0e0 2023-10-06T11:00:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.822+0000 7f4d1a7fc700 1 --2- 172.21.15.7:0/3526056709 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4d08066f30 0x7f4d080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.822+0000 7f4d1a7fc700 1 -- 172.21.15.7:0/3526056709 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f4d200845f0 con 0x7f4d240ae0e0 2023-10-06T11:00:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.822+0000 7f4d29c54700 1 --2- 172.21.15.7:0/3526056709 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4d08066f30 0x7f4d080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.822+0000 7f4d29c54700 1 --2- 172.21.15.7:0/3526056709 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4d08066f30 0x7f4d080693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009860 tx=0x7f4d14017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:39.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:39.826+0000 7f4d1a7fc700 1 -- 172.21.15.7:0/3526056709 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d20051430 con 0x7f4d240ae0e0 2023-10-06T11:00:40.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:40.080+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/3526056709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4d240c0ae0 con 0x7f4d240ae0e0 2023-10-06T11:00:40.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:40.081+0000 7f4d1a7fc700 1 -- 172.21.15.7:0/3526056709 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+82 (secure 0 0 0) 0x7f4d20054a50 con 0x7f4d240ae0e0 2023-10-06T11:00:40.083 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2023-10-06T11:00:40.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:40.083+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/3526056709 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4d08066f30 msgr2=0x7f4d080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:40.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:40.083+0000 7f4d2c6b9700 1 --2- 172.21.15.7:0/3526056709 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4d08066f30 0x7f4d080693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009860 tx=0x7f4d14017000 comp rx=0 tx=0).stop 2023-10-06T11:00:40.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:40.083+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/3526056709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d240ae0e0 msgr2=0x7f4d240c2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:40.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:40.083+0000 7f4d2c6b9700 1 --2- 172.21.15.7:0/3526056709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d240ae0e0 0x7f4d240c2d70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000c580 tx=0x7f4d20007e10 comp rx=0 tx=0).stop 2023-10-06T11:00:40.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:40.083+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/3526056709 shutdown_connections 2023-10-06T11:00:40.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:40.083+0000 7f4d2c6b9700 1 --2- 172.21.15.7:0/3526056709 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4d08066f30 0x7f4d080693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:40.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:40.083+0000 7f4d2c6b9700 1 --2- 172.21.15.7:0/3526056709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d240ae0e0 0x7f4d240c2d70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:40.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:40.083+0000 7f4d2c6b9700 1 --2- 172.21.15.7:0/3526056709 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d24143630 0x7f4d24154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:40.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:40.083+0000 7f4d2c6b9700 1 --2- 172.21.15.7:0/3526056709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d24159af0 0x7f4d240c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:40.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:40.083+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/3526056709 >> 172.21.15.7:0/3526056709 conn(0x7f4d240cc790 msgr2=0x7f4d2406ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:40.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:40.083+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/3526056709 shutdown_connections 2023-10-06T11:00:40.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:40.083+0000 7f4d2c6b9700 1 -- 172.21.15.7:0/3526056709 wait complete. 2023-10-06T11:00:40.098 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:00:40.098 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:00:40.098 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-06T11:00:40.098 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:00:40.098 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:40.099 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:00:40.099 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:00:40.099 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:00:40.099 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:00:40.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:40.099 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-06T11:00:40.120 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:00:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:00:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:00:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-06T11:00:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:40.120 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:00:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-06T11:00:40.121 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:00:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-06T11:00:40.121 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:00:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-06T11:00:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:00:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42325sec preferred_lft 42325sec 2023-10-06T11:00:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-06T11:00:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:40.121 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:00:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-06T11:00:40.122 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:00:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 4e:b6:a2:96:c6:8a brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:00:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::10ea:76ff:fedd:887a/64 scope link 2023-10-06T11:00:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:40.122 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:00:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether b6:89:e7:77:c6:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:00:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::b489:e7ff:fe77:c63a/64 scope link 2023-10-06T11:00:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:40.123 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:00:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 4e:b6:a2:96:c6:8a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:00:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::4cb6:a2ff:fe96:c68a/64 scope link 2023-10-06T11:00:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:40.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:40.123 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:00:40.192 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-06T11:00:40.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:40.193 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-06T11:00:40.259 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-06T11:00:40.260 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:00:40.260 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:00:40.260 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:00:40.260 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:00:40.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:40.260 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T11:00:40.260 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T11:00:40.260 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:00:40.260 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:00:40.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:00:40.261 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T11:00:40.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:40.383 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-06T11:00:40.404 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:00:40.405 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:00:40.405 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:00:40.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:40.405 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-06T11:00:40.481 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:00:40.481 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:00:40.481 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:40.544 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:00:40.544 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:00:40.544 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:40.607 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T11:00:40.683 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:00:40.684 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:00:40.758 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:00:40.759 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:00:40.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:40.760 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T11:00:40.824 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:00:40.825 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:00:40.825 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:00:40.867 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:00:40.868 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T11:00:40.942 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:00:40.942 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:00:40.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2023-10-06T11:00:40.971+0000 7f4e8f0f7540 -1 init, newargv = 0x55944a34f1b0 newargc=15 2023-10-06T11:00:40.974 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[136705]: starting ceph client 2023-10-06T11:00:40.978 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[136705]: starting fuse 2023-10-06T11:00:41.006 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:00:41.006 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:00:41.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:41.007 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T11:00:41.069 INFO:teuthology.orchestra.run.smithi007.stdout:47 2023-10-06T11:00:41.069 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T11:00:41.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:00:41.069 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2023-10-06T11:00:41.069 DEBUG:teuthology.orchestra.run.smithi007:> import re 2023-10-06T11:00:41.069 DEBUG:teuthology.orchestra.run.smithi007:> import os 2023-10-06T11:00:41.069 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2023-10-06T11:00:41.070 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:00:41.070 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2023-10-06T11:00:41.070 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:00:41.070 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2023-10-06T11:00:41.070 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:00:41.070 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:00:41.070 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2023-10-06T11:00:41.070 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2023-10-06T11:00:41.070 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2023-10-06T11:00:41.070 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2023-10-06T11:00:41.070 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:00:41.071 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2023-10-06T11:00:41.071 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:00:41.071 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:00:41.071 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:00:41.071 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2023-10-06T11:00:41.071 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2023-10-06T11:00:41.071 DEBUG:teuthology.orchestra.run.smithi007:> return f 2023-10-06T11:00:41.071 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:00:41.071 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:00:41.071 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.0")) 2023-10-06T11:00:41.071 DEBUG:teuthology.orchestra.run.smithi007:> ' 2023-10-06T11:00:41.207 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.136705.asok 2023-10-06T11:00:41.389 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.136705.asok 2023-10-06T11:00:41.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:41.389 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.136705.asok status 2023-10-06T11:00:41.565 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:00:41.565 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2023-10-06T11:00:41.565 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:00:41.565 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:00:41.565 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2023-10-06T11:00:41.565 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2023-10-06T11:00:41.565 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:00:41.565 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "136705", 2023-10-06T11:00:41.565 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2023-10-06T11:00:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2023-10-06T11:00:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2023-10-06T11:00:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5343, 2023-10-06T11:00:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2023-10-06T11:00:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2023-10-06T11:00:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2023-10-06T11:00:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 5343 2023-10-06T11:00:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T11:00:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T11:00:41.567 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:00:41.567 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1935180836 2023-10-06T11:00:41.567 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:41.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:41.567 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T11:00:41.567 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T11:00:41.567 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:00:41.567 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1935180836 2023-10-06T11:00:41.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:41.567 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.5343 192.168.0.1:0/1935180836", 2023-10-06T11:00:41.567 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.1:0/1935180836", 2023-10-06T11:00:41.567 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2023-10-06T11:00:41.568 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 20, 2023-10-06T11:00:41.568 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 43, 2023-10-06T11:00:41.568 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:00:41.568 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2023-10-06T11:00:41.568 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2023-10-06T11:00:41.568 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:00:41.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:41.576 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2023-10-06T11:00:41.576 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:41.596 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2023-10-06T11:00:41.596 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:41.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:41.597 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:41.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:41.669 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-10-06T11:00:41.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:00:41.735 INFO:teuthology.orchestra.run.smithi007.stderr:setfattr: layoutfile: Permission denied 2023-10-06T11:00:41.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:41.735 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-10-06T11:00:41.800 INFO:teuthology.orchestra.run.smithi007.stderr:setfattr: layoutdir: Permission denied 2023-10-06T11:00:41.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:00:41.801 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2023-10-06T11:00:41.801 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:00:41.801 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:41.880 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[136705]: fuse finished with error 0 and tester_r 0 2023-10-06T11:00:41.882 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T11:00:41.967 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T11:00:41.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:41.967 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:00:41.991 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2023-10-06T11:00:42.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.177+0000 7fd4641a1700 1 Processor -- start 2023-10-06T11:00:42.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.177+0000 7fd4641a1700 1 -- start start 2023-10-06T11:00:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.178+0000 7fd4641a1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd45c0cbdd0 0x7fd45c0c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.178+0000 7fd4641a1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd45c0acab0 0x7fd45c0acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.178+0000 7fd4641a1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd45c0670f0 0x7fd45c06b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.178+0000 7fd4641a1700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45c068070 con 0x7fd45c0670f0 2023-10-06T11:00:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.178+0000 7fd4641a1700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45c0adb60 con 0x7fd45c0cbdd0 2023-10-06T11:00:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.178+0000 7fd4641a1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c0ad880 con 0x7fd45c0acab0 2023-10-06T11:00:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.178+0000 7fd46273e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd45c0670f0 0x7fd45c06b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.178+0000 7fd46273e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd45c0670f0 0x7fd45c06b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46064/0 (socket says 172.21.15.7:46064) 2023-10-06T11:00:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.178+0000 7fd46273e700 1 -- 172.21.15.7:0/74472929 learned_addr learned my addr 172.21.15.7:0/74472929 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:42.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.178+0000 7fd461f3d700 1 --2- 172.21.15.7:0/74472929 >> v2:172.21.15.50:3300/0 conn(0x7fd45c0cbdd0 0x7fd45c0c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:42.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.178+0000 7fd46173c700 1 --2- 172.21.15.7:0/74472929 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd45c0acab0 0x7fd45c0acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:42.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.179+0000 7fd46273e700 1 -- 172.21.15.7:0/74472929 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd45c0acab0 msgr2=0x7fd45c0acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:42.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.179+0000 7fd46273e700 1 --2- 172.21.15.7:0/74472929 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd45c0acab0 0x7fd45c0acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.179+0000 7fd46273e700 1 -- 172.21.15.7:0/74472929 >> v2:172.21.15.50:3300/0 conn(0x7fd45c0cbdd0 msgr2=0x7fd45c0c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:42.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.179+0000 7fd46273e700 1 --2- 172.21.15.7:0/74472929 >> v2:172.21.15.50:3300/0 conn(0x7fd45c0cbdd0 0x7fd45c0c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.179+0000 7fd46273e700 1 -- 172.21.15.7:0/74472929 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c067a20 con 0x7fd45c0670f0 2023-10-06T11:00:42.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.179+0000 7fd46173c700 1 --2- 172.21.15.7:0/74472929 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd45c0acab0 0x7fd45c0acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:42.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.179+0000 7fd46273e700 1 --2- 172.21.15.7:0/74472929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c0670f0 0x7fd45c06b8e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd45c06f8a0 tx=0x7fd454009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0df2861122eb5c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:42.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.179+0000 7fd460f3b700 1 -- 172.21.15.7:0/74472929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45400e070 con 0x7fd45c0670f0 2023-10-06T11:00:42.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.179+0000 7fd460f3b700 1 -- 172.21.15.7:0/74472929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45400bab0 con 0x7fd45c0670f0 2023-10-06T11:00:42.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.179+0000 7fd460f3b700 1 -- 172.21.15.7:0/74472929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540092e0 con 0x7fd45c0670f0 2023-10-06T11:00:42.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.180+0000 7fd4641a1700 1 -- 172.21.15.7:0/74472929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c0670f0 msgr2=0x7fd45c06b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:42.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.180+0000 7fd4641a1700 1 --2- 172.21.15.7:0/74472929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c0670f0 0x7fd45c06b8e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd45c06f8a0 tx=0x7fd454009840 comp rx=0 tx=0).stop 2023-10-06T11:00:42.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.180+0000 7fd4641a1700 1 -- 172.21.15.7:0/74472929 shutdown_connections 2023-10-06T11:00:42.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.180+0000 7fd4641a1700 1 --2- 172.21.15.7:0/74472929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c0670f0 0x7fd45c06b8e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.180+0000 7fd4641a1700 1 --2- 172.21.15.7:0/74472929 >> v2:172.21.15.50:3300/0 conn(0x7fd45c0cbdd0 0x7fd45c0c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.180+0000 7fd4641a1700 1 --2- 172.21.15.7:0/74472929 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd45c0acab0 0x7fd45c0acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.180+0000 7fd4641a1700 1 -- 172.21.15.7:0/74472929 >> 172.21.15.7:0/74472929 conn(0x7fd45c0cc560 msgr2=0x7fd45c0cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.180+0000 7fd4641a1700 1 -- 172.21.15.7:0/74472929 shutdown_connections 2023-10-06T11:00:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.180+0000 7fd4641a1700 1 -- 172.21.15.7:0/74472929 wait complete. 2023-10-06T11:00:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.181+0000 7fd4641a1700 1 Processor -- start 2023-10-06T11:00:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.181+0000 7fd4641a1700 1 -- start start 2023-10-06T11:00:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd4641a1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c0670f0 0x7fd45c0a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd4641a1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45c0acab0 0x7fd45c0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd4641a1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd45c0cbdd0 0x7fd45c151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd4641a1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c0ab2a0 con 0x7fd45c0670f0 2023-10-06T11:00:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd4641a1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c0aa410 con 0x7fd45c0acab0 2023-10-06T11:00:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd4641a1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c1522c0 con 0x7fd45c0cbdd0 2023-10-06T11:00:42.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd461f3d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c0670f0 0x7fd45c0a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:42.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd461f3d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c0670f0 0x7fd45c0a9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46072/0 (socket says 172.21.15.7:46072) 2023-10-06T11:00:42.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd461f3d700 1 -- 172.21.15.7:0/2100713402 learned_addr learned my addr 172.21.15.7:0/2100713402 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:42.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd46173c700 1 --2- 172.21.15.7:0/2100713402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45c0acab0 0x7fd45c0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:42.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd46273e700 1 --2- 172.21.15.7:0/2100713402 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd45c0cbdd0 0x7fd45c151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:42.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd461f3d700 1 -- 172.21.15.7:0/2100713402 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd45c0cbdd0 msgr2=0x7fd45c151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:42.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd461f3d700 1 --2- 172.21.15.7:0/2100713402 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd45c0cbdd0 0x7fd45c151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd461f3d700 1 -- 172.21.15.7:0/2100713402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45c0acab0 msgr2=0x7fd45c0687e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:42.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd461f3d700 1 --2- 172.21.15.7:0/2100713402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45c0acab0 0x7fd45c0687e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd461f3d700 1 -- 172.21.15.7:0/2100713402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd454009ae0 con 0x7fd45c0670f0 2023-10-06T11:00:42.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.182+0000 7fd461f3d700 1 --2- 172.21.15.7:0/2100713402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c0670f0 0x7fd45c0a9ed0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd45800e960 tx=0x7fd4580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:42.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.183+0000 7fd44dffb700 1 -- 172.21.15.7:0/2100713402 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458013680 con 0x7fd45c0670f0 2023-10-06T11:00:42.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.183+0000 7fd44dffb700 1 -- 172.21.15.7:0/2100713402 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4580137e0 con 0x7fd45c0670f0 2023-10-06T11:00:42.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.183+0000 7fd4641a1700 1 -- 172.21.15.7:0/2100713402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45c0aa690 con 0x7fd45c0670f0 2023-10-06T11:00:42.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.183+0000 7fd44dffb700 1 -- 172.21.15.7:0/2100713402 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458013b80 con 0x7fd45c0670f0 2023-10-06T11:00:42.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.183+0000 7fd4641a1700 1 -- 172.21.15.7:0/2100713402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45c0aaa20 con 0x7fd45c0670f0 2023-10-06T11:00:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.184+0000 7fd4641a1700 1 -- 172.21.15.7:0/2100713402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45c0ab080 con 0x7fd45c0670f0 2023-10-06T11:00:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.184+0000 7fd44dffb700 1 -- 172.21.15.7:0/2100713402 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4580123d0 con 0x7fd45c0670f0 2023-10-06T11:00:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.185+0000 7fd44dffb700 1 --2- 172.21.15.7:0/2100713402 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd440066f30 0x7fd4400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.185+0000 7fd44dffb700 1 -- 172.21.15.7:0/2100713402 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7fd458084a70 con 0x7fd45c0670f0 2023-10-06T11:00:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.185+0000 7fd46173c700 1 --2- 172.21.15.7:0/2100713402 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd440066f30 0x7fd4400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.185+0000 7fd46173c700 1 --2- 172.21.15.7:0/2100713402 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd440066f30 0x7fd4400693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd45c152b20 tx=0x7fd450008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:42.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.189+0000 7fd44dffb700 1 -- 172.21.15.7:0/2100713402 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4580518b0 con 0x7fd45c0670f0 2023-10-06T11:00:42.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.479+0000 7fd4641a1700 1 -- 172.21.15.7:0/2100713402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7fd45c070480 con 0x7fd45c0670f0 2023-10-06T11:00:42.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.483+0000 7fd44dffb700 1 -- 172.21.15.7:0/2100713402 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v17) v1 ==== 211+0+0 (secure 0 0 0) 0x7fd458054ed0 con 0x7fd45c0670f0 2023-10-06T11:00:42.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.485+0000 7fd4641a1700 1 -- 172.21.15.7:0/2100713402 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd440066f30 msgr2=0x7fd4400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:42.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.485+0000 7fd4641a1700 1 --2- 172.21.15.7:0/2100713402 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd440066f30 0x7fd4400693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd45c152b20 tx=0x7fd450008040 comp rx=0 tx=0).stop 2023-10-06T11:00:42.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.485+0000 7fd4641a1700 1 -- 172.21.15.7:0/2100713402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c0670f0 msgr2=0x7fd45c0a9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:42.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.485+0000 7fd4641a1700 1 --2- 172.21.15.7:0/2100713402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c0670f0 0x7fd45c0a9ed0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd45800e960 tx=0x7fd4580091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.485+0000 7fd4641a1700 1 -- 172.21.15.7:0/2100713402 shutdown_connections 2023-10-06T11:00:42.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.485+0000 7fd4641a1700 1 --2- 172.21.15.7:0/2100713402 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd440066f30 0x7fd4400693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.485+0000 7fd4641a1700 1 --2- 172.21.15.7:0/2100713402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c0670f0 0x7fd45c0a9ed0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.485+0000 7fd4641a1700 1 --2- 172.21.15.7:0/2100713402 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd45c0cbdd0 0x7fd45c151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.485+0000 7fd4641a1700 1 --2- 172.21.15.7:0/2100713402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45c0acab0 0x7fd45c0687e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.485+0000 7fd4641a1700 1 -- 172.21.15.7:0/2100713402 >> 172.21.15.7:0/2100713402 conn(0x7fd45c0cc560 msgr2=0x7fd45c159340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:42.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.486+0000 7fd4641a1700 1 -- 172.21.15.7:0/2100713402 shutdown_connections 2023-10-06T11:00:42.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.486+0000 7fd4641a1700 1 -- 172.21.15.7:0/2100713402 wait complete. 2023-10-06T11:00:42.489 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-06T11:00:42.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:00:42.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.630+0000 7f61b8c0d700 1 Processor -- start 2023-10-06T11:00:42.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.630+0000 7f61b8c0d700 1 -- start start 2023-10-06T11:00:42.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.631+0000 7f61b8c0d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61b40aaa40 0x7f61b40cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:42.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.631+0000 7f61b8c0d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b40ac8d0 0x7f61b4155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:42.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.631+0000 7f61b8c0d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b4069110 con 0x7f61b40ccda0 2023-10-06T11:00:42.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.631+0000 7f61b8c0d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b4068b30 con 0x7f61b40aaa40 2023-10-06T11:00:42.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.631+0000 7f61b8c0d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b40aafb0 con 0x7f61b40ac8d0 2023-10-06T11:00:42.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.631+0000 7f61b1d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61b40aaa40 0x7f61b40cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:42.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.631+0000 7f61b259c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f61b40ccda0 0x7f61b40aa330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44614/0 (socket says 172.21.15.7:44614) 2023-10-06T11:00:42.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.631+0000 7f61b259c700 1 -- 172.21.15.7:0/1922743867 learned_addr learned my addr 172.21.15.7:0/1922743867 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:42.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.632+0000 7f61b2d9d700 1 --2- 172.21.15.7:0/1922743867 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b40ac8d0 0x7f61b4155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:42.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.632+0000 7f61b1d9b700 1 -- 172.21.15.7:0/1922743867 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b40ac8d0 msgr2=0x7f61b4155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:42.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.632+0000 7f61b1d9b700 1 --2- 172.21.15.7:0/1922743867 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b40ac8d0 0x7f61b4155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.632+0000 7f61b1d9b700 1 -- 172.21.15.7:0/1922743867 >> v1:172.21.15.7:6789/0 conn(0x7f61b40ccda0 legacy=0x7f61b40aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:42.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.632+0000 7f61b1d9b700 1 -- 172.21.15.7:0/1922743867 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b4068da0 con 0x7f61b40aaa40 2023-10-06T11:00:42.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.632+0000 7f61b159a700 1 -- 172.21.15.7:0/1922743867 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482953019 0 0) 0x7f61b4069110 con 0x7f61b40ccda0 2023-10-06T11:00:42.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.632+0000 7f61b2d9d700 1 --2- 172.21.15.7:0/1922743867 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b40ac8d0 0x7f61b4155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:42.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.632+0000 7f61b1d9b700 1 --2- 172.21.15.7:0/1922743867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40aaa40 0x7f61b40cd170 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f619c0098e0 tx=0x7f619c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be21c84abf4516e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:42.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.632+0000 7f61b159a700 1 -- 172.21.15.7:0/1922743867 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c009e80 con 0x7f61b40aaa40 2023-10-06T11:00:42.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.632+0000 7f61b159a700 1 -- 172.21.15.7:0/1922743867 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c00b860 con 0x7f61b40aaa40 2023-10-06T11:00:42.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.632+0000 7f61b159a700 1 -- 172.21.15.7:0/1922743867 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c00bbe0 con 0x7f61b40aaa40 2023-10-06T11:00:42.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.633+0000 7f61b8c0d700 1 -- 172.21.15.7:0/1922743867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40aaa40 msgr2=0x7f61b40cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:42.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.633+0000 7f61b8c0d700 1 --2- 172.21.15.7:0/1922743867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40aaa40 0x7f61b40cd170 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f619c0098e0 tx=0x7f619c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.633+0000 7f61b8c0d700 1 -- 172.21.15.7:0/1922743867 shutdown_connections 2023-10-06T11:00:42.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.633+0000 7f61b8c0d700 1 --2- 172.21.15.7:0/1922743867 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b40ac8d0 0x7f61b4155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.633+0000 7f61b8c0d700 1 --2- 172.21.15.7:0/1922743867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40aaa40 0x7f61b40cd170 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.633+0000 7f61b8c0d700 1 -- 172.21.15.7:0/1922743867 >> 172.21.15.7:0/1922743867 conn(0x7f61b4096160 msgr2=0x7f61b40afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:42.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.633+0000 7f61b8c0d700 1 -- 172.21.15.7:0/1922743867 shutdown_connections 2023-10-06T11:00:42.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.633+0000 7f61b8c0d700 1 -- 172.21.15.7:0/1922743867 wait complete. 2023-10-06T11:00:42.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.634+0000 7f61b8c0d700 1 Processor -- start 2023-10-06T11:00:42.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.634+0000 7f61b8c0d700 1 -- start start 2023-10-06T11:00:42.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b8c0d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b40aaa40 0x7f61b41592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:42.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b8c0d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b40ac8d0 0x7f61b4067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:42.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b8c0d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40ccda0 0x7f61b414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:42.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b8c0d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b4159810 con 0x7f61b40ccda0 2023-10-06T11:00:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b8c0d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b4096ad0 con 0x7f61b40aaa40 2023-10-06T11:00:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b8c0d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b416d740 con 0x7f61b40ac8d0 2023-10-06T11:00:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b2d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40ccda0 0x7f61b414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b2d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40ccda0 0x7f61b414e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46096/0 (socket says 172.21.15.7:46096) 2023-10-06T11:00:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b2d9d700 1 -- 172.21.15.7:0/3316970194 learned_addr learned my addr 172.21.15.7:0/3316970194 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b259c700 1 --2- 172.21.15.7:0/3316970194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b40aaa40 0x7f61b41592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b1d9b700 1 --2- 172.21.15.7:0/3316970194 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b40ac8d0 0x7f61b4067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b2d9d700 1 -- 172.21.15.7:0/3316970194 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b40ac8d0 msgr2=0x7f61b4067b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b2d9d700 1 --2- 172.21.15.7:0/3316970194 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b40ac8d0 0x7f61b4067b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b2d9d700 1 -- 172.21.15.7:0/3316970194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b40aaa40 msgr2=0x7f61b41592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b2d9d700 1 --2- 172.21.15.7:0/3316970194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b40aaa40 0x7f61b41592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.635+0000 7f61b2d9d700 1 -- 172.21.15.7:0/3316970194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c009420 con 0x7f61b40ccda0 2023-10-06T11:00:42.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.636+0000 7f61b2d9d700 1 --2- 172.21.15.7:0/3316970194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40ccda0 0x7f61b414e4b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00a380 tx=0x7f61ac007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:42.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.636+0000 7f61aa7fc700 1 -- 172.21.15.7:0/3316970194 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac015440 con 0x7f61b40ccda0 2023-10-06T11:00:42.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.636+0000 7f61aa7fc700 1 -- 172.21.15.7:0/3316970194 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac0155a0 con 0x7f61b40ccda0 2023-10-06T11:00:42.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.636+0000 7f61b8c0d700 1 -- 172.21.15.7:0/3316970194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b416da20 con 0x7f61b40ccda0 2023-10-06T11:00:42.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.636+0000 7f61aa7fc700 1 -- 172.21.15.7:0/3316970194 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac015960 con 0x7f61b40ccda0 2023-10-06T11:00:42.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.636+0000 7f61b8c0d700 1 -- 172.21.15.7:0/3316970194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b416dfe0 con 0x7f61b40ccda0 2023-10-06T11:00:42.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.637+0000 7f61b8c0d700 1 -- 172.21.15.7:0/3316970194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b406b230 con 0x7f61b40ccda0 2023-10-06T11:00:42.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.637+0000 7f61aa7fc700 1 -- 172.21.15.7:0/3316970194 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61ac00d440 con 0x7f61b40ccda0 2023-10-06T11:00:42.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.638+0000 7f61aa7fc700 1 --2- 172.21.15.7:0/3316970194 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6194066f30 0x7f61940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:42.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.638+0000 7f61aa7fc700 1 -- 172.21.15.7:0/3316970194 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f61ac085440 con 0x7f61b40ccda0 2023-10-06T11:00:42.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.638+0000 7f61b259c700 1 --2- 172.21.15.7:0/3316970194 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6194066f30 0x7f61940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:42.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.638+0000 7f61b259c700 1 --2- 172.21.15.7:0/3316970194 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6194066f30 0x7f61940693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f61a4007160 tx=0x7f61a4007f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:42.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.642+0000 7f61aa7fc700 1 -- 172.21.15.7:0/3316970194 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61ac052280 con 0x7f61b40ccda0 2023-10-06T11:00:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.894+0000 7f61b8c0d700 1 -- 172.21.15.7:0/3316970194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f61b4070480 con 0x7f61b40ccda0 2023-10-06T11:00:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.895+0000 7f61aa7fc700 1 -- 172.21.15.7:0/3316970194 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+82 (secure 0 0 0) 0x7f61ac0558a0 con 0x7f61b40ccda0 2023-10-06T11:00:42.897 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2023-10-06T11:00:42.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.897+0000 7f61b8c0d700 1 -- 172.21.15.7:0/3316970194 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6194066f30 msgr2=0x7f61940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:42.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.897+0000 7f61b8c0d700 1 --2- 172.21.15.7:0/3316970194 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6194066f30 0x7f61940693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f61a4007160 tx=0x7f61a4007f50 comp rx=0 tx=0).stop 2023-10-06T11:00:42.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.897+0000 7f61b8c0d700 1 -- 172.21.15.7:0/3316970194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40ccda0 msgr2=0x7f61b414e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:42.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.897+0000 7f61b8c0d700 1 --2- 172.21.15.7:0/3316970194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40ccda0 0x7f61b414e4b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00a380 tx=0x7f61ac007900 comp rx=0 tx=0).stop 2023-10-06T11:00:42.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.897+0000 7f61b8c0d700 1 -- 172.21.15.7:0/3316970194 shutdown_connections 2023-10-06T11:00:42.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.897+0000 7f61b8c0d700 1 --2- 172.21.15.7:0/3316970194 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6194066f30 0x7f61940693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.897+0000 7f61b8c0d700 1 --2- 172.21.15.7:0/3316970194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40ccda0 0x7f61b414e4b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.897+0000 7f61b8c0d700 1 --2- 172.21.15.7:0/3316970194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b40aaa40 0x7f61b41592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.897+0000 7f61b8c0d700 1 --2- 172.21.15.7:0/3316970194 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b40ac8d0 0x7f61b4067b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:42.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.897+0000 7f61b8c0d700 1 -- 172.21.15.7:0/3316970194 >> 172.21.15.7:0/3316970194 conn(0x7f61b4096160 msgr2=0x7f61b414f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:42.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.897+0000 7f61b8c0d700 1 -- 172.21.15.7:0/3316970194 shutdown_connections 2023-10-06T11:00:42.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:42.897+0000 7f61b8c0d700 1 -- 172.21.15.7:0/3316970194 wait complete. 2023-10-06T11:00:42.912 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:00:42.912 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:00:42.913 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-06T11:00:42.913 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:00:42.913 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:42.913 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:00:42.913 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:00:42.913 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:00:42.913 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:00:42.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:42.913 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-06T11:00:42.934 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:00:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:00:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:00:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-06T11:00:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:42.935 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:00:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-06T11:00:42.935 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:00:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-06T11:00:42.936 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:00:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-06T11:00:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:00:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42323sec preferred_lft 42323sec 2023-10-06T11:00:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-06T11:00:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:42.936 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:00:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-06T11:00:42.936 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:00:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 4e:b6:a2:96:c6:8a brd ff:ff:ff:ff:ff:ff 2023-10-06T11:00:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:00:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::10ea:76ff:fedd:887a/64 scope link 2023-10-06T11:00:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:42.937 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:00:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether b6:89:e7:77:c6:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:00:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::b489:e7ff:fe77:c63a/64 scope link 2023-10-06T11:00:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:42.937 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:00:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 4e:b6:a2:96:c6:8a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:00:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::4cb6:a2ff:fe96:c68a/64 scope link 2023-10-06T11:00:42.938 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:00:42.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:42.938 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:00:43.005 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-06T11:00:43.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:43.007 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-06T11:00:43.073 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-06T11:00:43.073 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:00:43.074 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:00:43.074 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:00:43.074 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:00:43.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:43.074 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T11:00:43.074 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T11:00:43.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:00:43.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:00:43.075 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:00:43.075 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T11:00:43.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:43.198 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-06T11:00:43.219 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:00:43.219 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:00:43.219 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:00:43.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:43.219 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-06T11:00:43.295 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:00:43.296 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:00:43.296 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:43.359 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:00:43.359 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:00:43.359 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:43.422 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T11:00:43.498 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:00:43.498 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:00:43.573 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:00:43.574 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:00:43.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:43.575 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T11:00:43.638 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:00:43.638 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:00:43.680 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T11:00:43.715 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:00:43.715 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:00:43.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2023-10-06T11:00:43.780+0000 7f0cb7e66540 -1 init, newargv = 0x5569fe4f10c0 newargc=15 2023-10-06T11:00:43.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[137412]: starting ceph client 2023-10-06T11:00:43.788 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:00:43.788 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[137412]: starting fuse 2023-10-06T11:00:43.790 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:00:43.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:43.790 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T11:00:43.851 INFO:teuthology.orchestra.run.smithi007.stdout:47 2023-10-06T11:00:43.851 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T11:00:43.852 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:00:43.852 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2023-10-06T11:00:43.852 DEBUG:teuthology.orchestra.run.smithi007:> import re 2023-10-06T11:00:43.852 DEBUG:teuthology.orchestra.run.smithi007:> import os 2023-10-06T11:00:43.852 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2023-10-06T11:00:43.852 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:00:43.852 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2023-10-06T11:00:43.852 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:00:43.852 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2023-10-06T11:00:43.852 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:00:43.852 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:00:43.852 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2023-10-06T11:00:43.853 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2023-10-06T11:00:43.853 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2023-10-06T11:00:43.853 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2023-10-06T11:00:43.853 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:00:43.853 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2023-10-06T11:00:43.853 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:00:43.853 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:00:43.853 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:00:43.853 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2023-10-06T11:00:43.853 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2023-10-06T11:00:43.853 DEBUG:teuthology.orchestra.run.smithi007:> return f 2023-10-06T11:00:43.853 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:00:43.854 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:00:43.854 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.0")) 2023-10-06T11:00:43.854 DEBUG:teuthology.orchestra.run.smithi007:> ' 2023-10-06T11:00:43.990 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.137412.asok 2023-10-06T11:00:44.172 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.137412.asok 2023-10-06T11:00:44.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:44.172 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.137412.asok status 2023-10-06T11:00:44.346 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:00:44.346 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2023-10-06T11:00:44.347 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:00:44.347 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:00:44.347 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2023-10-06T11:00:44.347 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2023-10-06T11:00:44.347 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:00:44.347 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "137412", 2023-10-06T11:00:44.347 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2023-10-06T11:00:44.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:44.347 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2023-10-06T11:00:44.347 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2023-10-06T11:00:44.348 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5364, 2023-10-06T11:00:44.348 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2023-10-06T11:00:44.348 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2023-10-06T11:00:44.348 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2023-10-06T11:00:44.348 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 5364 2023-10-06T11:00:44.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:44.348 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T11:00:44.348 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T11:00:44.348 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:00:44.348 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3497661150 2023-10-06T11:00:44.348 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:44.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:44.348 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T11:00:44.349 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T11:00:44.349 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:00:44.349 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3497661150 2023-10-06T11:00:44.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:44.349 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.5364 192.168.0.1:0/3497661150", 2023-10-06T11:00:44.349 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.1:0/3497661150", 2023-10-06T11:00:44.349 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2023-10-06T11:00:44.349 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 20, 2023-10-06T11:00:44.349 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 43, 2023-10-06T11:00:44.349 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:00:44.349 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2023-10-06T11:00:44.349 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2023-10-06T11:00:44.350 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:00:44.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:44.357 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2023-10-06T11:00:44.357 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:44.377 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2023-10-06T11:00:44.378 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:44.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:44.378 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:44.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:44.451 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-10-06T11:00:44.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:00:44.516 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-10-06T11:00:44.584 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2023-10-06T11:00:44.584 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:00:44.584 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:00:44.672 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[137412]: fuse finished with error 0 and tester_r 0 2023-10-06T11:00:44.674 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T11:00:44.774 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T11:00:44.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:44.775 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:00:44.798 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2023-10-06T11:00:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.984+0000 7feead038700 1 Processor -- start 2023-10-06T11:00:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.984+0000 7feead038700 1 -- start start 2023-10-06T11:00:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.985+0000 7feead038700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feea80b01c0 0x7feea80cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.985+0000 7feead038700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea80cedc0 con 0x7feea80b0590 2023-10-06T11:00:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.985+0000 7feead038700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea80c9720 con 0x7feea80c91c0 2023-10-06T11:00:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.985+0000 7feead038700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea80c9a00 con 0x7feea80b01c0 2023-10-06T11:00:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.985+0000 7feea659c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7feea80b0590 0x7feea80c8ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44622/0 (socket says 172.21.15.7:44622) 2023-10-06T11:00:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.985+0000 7feea659c700 1 -- 172.21.15.7:0/1514594630 learned_addr learned my addr 172.21.15.7:0/1514594630 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.985+0000 7feea6d9d700 1 --2- 172.21.15.7:0/1514594630 >> v2:172.21.15.50:3300/0 conn(0x7feea80b01c0 0x7feea80cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.985+0000 7feea5d9b700 1 -- 172.21.15.7:0/1514594630 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041328269 0 0) 0x7feea80cedc0 con 0x7feea80b0590 2023-10-06T11:00:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.985+0000 7feea5d9b700 1 -- 172.21.15.7:0/1514594630 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee90003570 con 0x7feea80b0590 2023-10-06T11:00:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.986+0000 7feea5d9b700 1 -- 172.21.15.7:0/1514594630 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3928128651 0 0) 0x7fee90003570 con 0x7feea80b0590 2023-10-06T11:00:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.986+0000 7feea6d9d700 1 -- 172.21.15.7:0/1514594630 >> v1:172.21.15.50:6789/0 conn(0x7feea80c91c0 legacy=0x7feea8068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.986+0000 7feea6d9d700 1 -- 172.21.15.7:0/1514594630 >> v1:172.21.15.7:6789/0 conn(0x7feea80b0590 legacy=0x7feea80c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.986+0000 7feea6d9d700 1 -- 172.21.15.7:0/1514594630 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80c9ce0 con 0x7feea80b01c0 2023-10-06T11:00:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.986+0000 7feea6d9d700 1 --2- 172.21.15.7:0/1514594630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea80b01c0 0x7feea80cc500 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fee980098e0 tx=0x7fee980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=730e51e4960d57d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.986+0000 7feea5d9b700 1 -- 172.21.15.7:0/1514594630 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c001470 con 0x7feea80b01c0 2023-10-06T11:00:44.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.986+0000 7feea5d9b700 1 -- 172.21.15.7:0/1514594630 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee98011420 con 0x7feea80b01c0 2023-10-06T11:00:44.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.986+0000 7feea5d9b700 1 -- 172.21.15.7:0/1514594630 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee980117c0 con 0x7feea80b01c0 2023-10-06T11:00:44.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.987+0000 7feead038700 1 -- 172.21.15.7:0/1514594630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea80b01c0 msgr2=0x7feea80cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:44.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.987+0000 7feead038700 1 --2- 172.21.15.7:0/1514594630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea80b01c0 0x7feea80cc500 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fee980098e0 tx=0x7fee980091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:44.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.987+0000 7feead038700 1 -- 172.21.15.7:0/1514594630 shutdown_connections 2023-10-06T11:00:44.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.987+0000 7feead038700 1 --2- 172.21.15.7:0/1514594630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea80b01c0 0x7feea80cc500 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:44.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.987+0000 7feead038700 1 -- 172.21.15.7:0/1514594630 >> 172.21.15.7:0/1514594630 conn(0x7feea806cd00 msgr2=0x7feea80cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:44.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.987+0000 7feead038700 1 -- 172.21.15.7:0/1514594630 shutdown_connections 2023-10-06T11:00:44.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.987+0000 7feead038700 1 -- 172.21.15.7:0/1514594630 wait complete. 2023-10-06T11:00:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.988+0000 7feead038700 1 Processor -- start 2023-10-06T11:00:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.988+0000 7feead038700 1 -- start start 2023-10-06T11:00:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feead038700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feea80b01c0 0x7feea80b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feead038700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea80b0590 0x7feea816a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feead038700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea80c91c0 0x7feea80c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feead038700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea816ad10 con 0x7feea80b01c0 2023-10-06T11:00:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feead038700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80c69a0 con 0x7feea80c91c0 2023-10-06T11:00:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feead038700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea80c5900 con 0x7feea80b0590 2023-10-06T11:00:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feea6d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feea80b01c0 0x7feea80b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feea6d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feea80b01c0 0x7feea80b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46102/0 (socket says 172.21.15.7:46102) 2023-10-06T11:00:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feea6d9d700 1 -- 172.21.15.7:0/3951292437 learned_addr learned my addr 172.21.15.7:0/3951292437 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feea759e700 1 --2- 172.21.15.7:0/3951292437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea80c91c0 0x7feea80c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feea659c700 1 --2- 172.21.15.7:0/3951292437 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea80b0590 0x7feea816a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feea6d9d700 1 -- 172.21.15.7:0/3951292437 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea80b0590 msgr2=0x7feea816a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:44.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feea6d9d700 1 --2- 172.21.15.7:0/3951292437 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea80b0590 0x7feea816a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:44.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feea6d9d700 1 -- 172.21.15.7:0/3951292437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea80c91c0 msgr2=0x7feea80c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:44.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feea6d9d700 1 --2- 172.21.15.7:0/3951292437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea80c91c0 0x7feea80c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:44.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.989+0000 7feea6d9d700 1 -- 172.21.15.7:0/3951292437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee98009420 con 0x7feea80b01c0 2023-10-06T11:00:44.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.990+0000 7feea6d9d700 1 --2- 172.21.15.7:0/3951292437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feea80b01c0 0x7feea80b21e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7feea8067c00 tx=0x7fee98016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:44.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.990+0000 7fee8effd700 1 -- 172.21.15.7:0/3951292437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9801cc50 con 0x7feea80b01c0 2023-10-06T11:00:44.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.990+0000 7fee8effd700 1 -- 172.21.15.7:0/3951292437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9801cdd0 con 0x7feea80b01c0 2023-10-06T11:00:44.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.990+0000 7feead038700 1 -- 172.21.15.7:0/3951292437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea80c5be0 con 0x7feea80b01c0 2023-10-06T11:00:44.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.990+0000 7fee8effd700 1 -- 172.21.15.7:0/3951292437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9801a6a0 con 0x7feea80b01c0 2023-10-06T11:00:44.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.990+0000 7feead038700 1 -- 172.21.15.7:0/3951292437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea80c61a0 con 0x7feea80b01c0 2023-10-06T11:00:44.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.991+0000 7feead038700 1 -- 172.21.15.7:0/3951292437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea8070480 con 0x7feea80b01c0 2023-10-06T11:00:44.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.991+0000 7fee8effd700 1 -- 172.21.15.7:0/3951292437 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee9801aa50 con 0x7feea80b01c0 2023-10-06T11:00:44.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.992+0000 7fee8effd700 1 --2- 172.21.15.7:0/3951292437 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fee94066f30 0x7fee940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:44.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.992+0000 7fee8effd700 1 -- 172.21.15.7:0/3951292437 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7fee98086660 con 0x7feea80b01c0 2023-10-06T11:00:44.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.992+0000 7feea659c700 1 --2- 172.21.15.7:0/3951292437 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fee94066f30 0x7fee940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:44.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.992+0000 7feea659c700 1 --2- 172.21.15.7:0/3951292437 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fee94066f30 0x7fee940693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feea8157c40 tx=0x7fee9c001120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:44.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:44.996+0000 7fee8effd700 1 -- 172.21.15.7:0/3951292437 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee980534a0 con 0x7feea80b01c0 2023-10-06T11:00:45.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.280+0000 7feead038700 1 -- 172.21.15.7:0/3951292437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7feea80c9fc0 con 0x7feea80b01c0 2023-10-06T11:00:45.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.283+0000 7fee8effd700 1 -- 172.21.15.7:0/3951292437 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7fee98056ac0 con 0x7feea80b01c0 2023-10-06T11:00:45.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.285+0000 7feead038700 1 -- 172.21.15.7:0/3951292437 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fee94066f30 msgr2=0x7fee940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:45.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.285+0000 7feead038700 1 --2- 172.21.15.7:0/3951292437 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fee94066f30 0x7fee940693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feea8157c40 tx=0x7fee9c001120 comp rx=0 tx=0).stop 2023-10-06T11:00:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.285+0000 7feead038700 1 -- 172.21.15.7:0/3951292437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feea80b01c0 msgr2=0x7feea80b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.285+0000 7feead038700 1 --2- 172.21.15.7:0/3951292437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feea80b01c0 0x7feea80b21e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7feea8067c00 tx=0x7fee98016000 comp rx=0 tx=0).stop 2023-10-06T11:00:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.285+0000 7feead038700 1 -- 172.21.15.7:0/3951292437 shutdown_connections 2023-10-06T11:00:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.286+0000 7feead038700 1 --2- 172.21.15.7:0/3951292437 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fee94066f30 0x7fee940693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.286+0000 7feead038700 1 --2- 172.21.15.7:0/3951292437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feea80b01c0 0x7feea80b21e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.286+0000 7feead038700 1 --2- 172.21.15.7:0/3951292437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea80c91c0 0x7feea80c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.286+0000 7feead038700 1 --2- 172.21.15.7:0/3951292437 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea80b0590 0x7feea816a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.286+0000 7feead038700 1 -- 172.21.15.7:0/3951292437 >> 172.21.15.7:0/3951292437 conn(0x7feea806cd00 msgr2=0x7feea806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.286+0000 7feead038700 1 -- 172.21.15.7:0/3951292437 shutdown_connections 2023-10-06T11:00:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.286+0000 7feead038700 1 -- 172.21.15.7:0/3951292437 wait complete. 2023-10-06T11:00:45.289 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-06T11:00:45.301 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:00:45.301 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:00:45.346 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:00:45.398 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:00:45.398 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T11:00:45.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:45.399 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:00:45.420 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T11:00:45.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:00:45.421 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T11:00:45.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:45.421 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:00:45.443 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T11:00:45.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:00:45.444 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T11:00:45.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:45.445 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:00:45.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:00:45.485 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T11:00:45.485 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T11:00:45.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:00:45.485 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:00:45.508 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T11:00:45.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:00:45.509 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:00:45.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.664+0000 7f65dd7ac700 1 Processor -- start 2023-10-06T11:00:45.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.664+0000 7f65dd7ac700 1 -- start start 2023-10-06T11:00:45.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.665+0000 7f65dd7ac700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65d80691a0 0x7f65d80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:45.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.665+0000 7f65dd7ac700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65d80cc1c0 0x7f65d8142860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:45.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.665+0000 7f65dd7ac700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d80ceeb0 con 0x7f65d8069570 2023-10-06T11:00:45.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.665+0000 7f65dd7ac700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d80cf190 con 0x7f65d80691a0 2023-10-06T11:00:45.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.665+0000 7f65dd7ac700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d80cf470 con 0x7f65d80cc1c0 2023-10-06T11:00:45.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.665+0000 7f65d6ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65d80691a0 0x7f65d80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:45.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.665+0000 7f65d6ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65d80691a0 0x7f65d80ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46104/0 (socket says 172.21.15.7:46104) 2023-10-06T11:00:45.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.665+0000 7f65d6ffd700 1 -- 172.21.15.7:0/794683369 learned_addr learned my addr 172.21.15.7:0/794683369 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:45.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.665+0000 7f65d67fc700 1 --2- 172.21.15.7:0/794683369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65d80cc1c0 0x7f65d8142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:45.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.665+0000 7f65d6ffd700 1 -- 172.21.15.7:0/794683369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65d80cc1c0 msgr2=0x7f65d8142860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:45.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.665+0000 7f65d6ffd700 1 --2- 172.21.15.7:0/794683369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65d80cc1c0 0x7f65d8142860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:45.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.665+0000 7f65d6ffd700 1 -- 172.21.15.7:0/794683369 >> v1:172.21.15.50:6789/0 conn(0x7f65d8069570 legacy=0x7f65d815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:45.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.665+0000 7f65d6ffd700 1 -- 172.21.15.7:0/794683369 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d80cf750 con 0x7f65d80691a0 2023-10-06T11:00:45.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.665+0000 7f65d6ffd700 1 --2- 172.21.15.7:0/794683369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65d80691a0 0x7f65d80ce840 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f65c80099b0 tx=0x7f65c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55edaa2574fd63d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:45.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.666+0000 7f65d5ffb700 1 -- 172.21.15.7:0/794683369 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c800b820 con 0x7f65d80691a0 2023-10-06T11:00:45.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.666+0000 7f65d5ffb700 1 -- 172.21.15.7:0/794683369 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c800b980 con 0x7f65d80691a0 2023-10-06T11:00:45.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.666+0000 7f65d5ffb700 1 -- 172.21.15.7:0/794683369 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c800bd20 con 0x7f65d80691a0 2023-10-06T11:00:45.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.666+0000 7f65dd7ac700 1 -- 172.21.15.7:0/794683369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65d80691a0 msgr2=0x7f65d80ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:45.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.666+0000 7f65dd7ac700 1 --2- 172.21.15.7:0/794683369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65d80691a0 0x7f65d80ce840 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f65c80099b0 tx=0x7f65c8009250 comp rx=0 tx=0).stop 2023-10-06T11:00:45.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.666+0000 7f65dd7ac700 1 -- 172.21.15.7:0/794683369 shutdown_connections 2023-10-06T11:00:45.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.666+0000 7f65dd7ac700 1 --2- 172.21.15.7:0/794683369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65d80691a0 0x7f65d80ce840 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:45.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.666+0000 7f65dd7ac700 1 --2- 172.21.15.7:0/794683369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65d80cc1c0 0x7f65d8142860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:45.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.666+0000 7f65dd7ac700 1 -- 172.21.15.7:0/794683369 >> 172.21.15.7:0/794683369 conn(0x7f65d8067b90 msgr2=0x7f65d80b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:45.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.666+0000 7f65dd7ac700 1 -- 172.21.15.7:0/794683369 shutdown_connections 2023-10-06T11:00:45.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.666+0000 7f65dd7ac700 1 -- 172.21.15.7:0/794683369 wait complete. 2023-10-06T11:00:45.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.668+0000 7f65dd7ac700 1 Processor -- start 2023-10-06T11:00:45.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.668+0000 7f65dd7ac700 1 -- start start 2023-10-06T11:00:45.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.668+0000 7f65dd7ac700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65d80691a0 0x7f65d816a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:45.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65dd7ac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8069570 0x7f65d80c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:45.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65dd7ac700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65d80cc1c0 0x7f65d80ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:45.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65dd7ac700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d80a6b90 con 0x7f65d80691a0 2023-10-06T11:00:45.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65dd7ac700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d816a840 con 0x7f65d8069570 2023-10-06T11:00:45.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65dd7ac700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d80c8780 con 0x7f65d80cc1c0 2023-10-06T11:00:45.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65d6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65d80691a0 0x7f65d816a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:45.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65d6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65d80691a0 0x7f65d816a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46108/0 (socket says 172.21.15.7:46108) 2023-10-06T11:00:45.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65d6ffd700 1 -- 172.21.15.7:0/2563132110 learned_addr learned my addr 172.21.15.7:0/2563132110 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:45.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65d67fc700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8069570 0x7f65d80c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:45.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65d77fe700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65d80cc1c0 0x7f65d80ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:45.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65d6ffd700 1 -- 172.21.15.7:0/2563132110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65d80cc1c0 msgr2=0x7f65d80ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:45.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65d6ffd700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65d80cc1c0 0x7f65d80ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:45.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65d6ffd700 1 -- 172.21.15.7:0/2563132110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8069570 msgr2=0x7f65d80c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:45.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65d6ffd700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8069570 0x7f65d80c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:45.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65d6ffd700 1 -- 172.21.15.7:0/2563132110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c80094f0 con 0x7f65d80691a0 2023-10-06T11:00:45.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65d67fc700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8069570 0x7f65d80c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:45.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65d77fe700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65d80cc1c0 0x7f65d80ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:45.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65d6ffd700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65d80691a0 0x7f65d816a300 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f65c8009290 tx=0x7f65c8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:45.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65beffd700 1 -- 172.21.15.7:0/2563132110 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c8011d70 con 0x7f65d80691a0 2023-10-06T11:00:45.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65beffd700 1 -- 172.21.15.7:0/2563132110 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c8020070 con 0x7f65d80691a0 2023-10-06T11:00:45.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65dd7ac700 1 -- 172.21.15.7:0/2563132110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d80c7d30 con 0x7f65d80691a0 2023-10-06T11:00:45.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.669+0000 7f65beffd700 1 -- 172.21.15.7:0/2563132110 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c801b6a0 con 0x7f65d80691a0 2023-10-06T11:00:45.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.670+0000 7f65dd7ac700 1 -- 172.21.15.7:0/2563132110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d80c8130 con 0x7f65d80691a0 2023-10-06T11:00:45.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.670+0000 7f65dd7ac700 1 -- 172.21.15.7:0/2563132110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d80c7f80 con 0x7f65d80691a0 2023-10-06T11:00:45.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.672+0000 7f65beffd700 1 -- 172.21.15.7:0/2563132110 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65c8022030 con 0x7f65d80691a0 2023-10-06T11:00:45.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.672+0000 7f65beffd700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f65c4066f30 0x7f65c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:45.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.672+0000 7f65beffd700 1 -- 172.21.15.7:0/2563132110 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f65c8086d10 con 0x7f65d80691a0 2023-10-06T11:00:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.672+0000 7f65d67fc700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f65c4066f30 0x7f65c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.673+0000 7f65d67fc700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f65c4066f30 0x7f65c40693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f65d80caca0 tx=0x7f65cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:45.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.676+0000 7f65beffd700 1 -- 172.21.15.7:0/2563132110 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65c8053bd0 con 0x7f65d80691a0 2023-10-06T11:00:45.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.934+0000 7f65dd7ac700 1 -- 172.21.15.7:0/2563132110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65d80c7f80 con 0x7f65d80691a0 2023-10-06T11:00:45.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.934+0000 7f65beffd700 1 -- 172.21.15.7:0/2563132110 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4587 (secure 0 0 0) 0x7f65c80571f0 con 0x7f65d80691a0 2023-10-06T11:00:45.937 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:45.937 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/904048408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":904048408},{"type":"v1","addr":"172.21.15.50:6834","nonce":904048408}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5062,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/949655295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":949655295},{"type":"v1","addr":"172.21.15.50:6835","nonce":949655295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1576009113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1576009113},{"type":"v1","addr":"172.21.15.7:6835","nonce":1576009113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:00:21.179899+0000","modified":"2023-10-06T11:00:32.049499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5130":{"gid":5130,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1573170028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1573170028},{"type":"v1","addr":"172.21.15.7:6837","nonce":1573170028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:00:45.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.937+0000 7f65dd7ac700 1 -- 172.21.15.7:0/2563132110 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f65c4066f30 msgr2=0x7f65c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:45.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.937+0000 7f65dd7ac700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f65c4066f30 0x7f65c40693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f65d80caca0 tx=0x7f65cc008040 comp rx=0 tx=0).stop 2023-10-06T11:00:45.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.937+0000 7f65dd7ac700 1 -- 172.21.15.7:0/2563132110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65d80691a0 msgr2=0x7f65d816a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:45.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.937+0000 7f65dd7ac700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65d80691a0 0x7f65d816a300 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f65c8009290 tx=0x7f65c8016000 comp rx=0 tx=0).stop 2023-10-06T11:00:45.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.937+0000 7f65dd7ac700 1 -- 172.21.15.7:0/2563132110 shutdown_connections 2023-10-06T11:00:45.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.937+0000 7f65dd7ac700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f65c4066f30 0x7f65c40693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:45.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.937+0000 7f65dd7ac700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65d80691a0 0x7f65d816a300 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:45.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.937+0000 7f65dd7ac700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65d80cc1c0 0x7f65d80ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:45.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.937+0000 7f65dd7ac700 1 --2- 172.21.15.7:0/2563132110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8069570 0x7f65d80c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:45.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.937+0000 7f65dd7ac700 1 -- 172.21.15.7:0/2563132110 >> 172.21.15.7:0/2563132110 conn(0x7f65d8067b90 msgr2=0x7f65d8159b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:45.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.937+0000 7f65dd7ac700 1 -- 172.21.15.7:0/2563132110 shutdown_connections 2023-10-06T11:00:45.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:45.937+0000 7f65dd7ac700 1 -- 172.21.15.7:0/2563132110 wait complete. 2023-10-06T11:00:45.940 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 20 2023-10-06T11:00:45.952 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:00:46.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.083+0000 7fd46e434700 1 Processor -- start 2023-10-06T11:00:46.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.083+0000 7fd46e434700 1 -- start start 2023-10-06T11:00:46.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.084+0000 7fd46e434700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd46815ce10 0x7fd46815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.084+0000 7fd46e434700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4681594a0 0x7fd468159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.084+0000 7fd46e434700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4680694d0 con 0x7fd4681590d0 2023-10-06T11:00:46.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.084+0000 7fd46e434700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46815d7f0 con 0x7fd46815ce10 2023-10-06T11:00:46.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.084+0000 7fd46e434700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd468068990 con 0x7fd4681594a0 2023-10-06T11:00:46.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.084+0000 7fd4677fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd46815ce10 0x7fd46815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.084+0000 7fd467fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd4681590d0 0x7fd468069bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44630/0 (socket says 172.21.15.7:44630) 2023-10-06T11:00:46.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.084+0000 7fd467fff700 1 -- 172.21.15.7:0/1794155963 learned_addr learned my addr 172.21.15.7:0/1794155963 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:46.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.085+0000 7fd46c9d1700 1 --2- 172.21.15.7:0/1794155963 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4681594a0 0x7fd468159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.085+0000 7fd4677fe700 1 -- 172.21.15.7:0/1794155963 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4681594a0 msgr2=0x7fd468159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:46.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.085+0000 7fd4677fe700 1 --2- 172.21.15.7:0/1794155963 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4681594a0 0x7fd468159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.085+0000 7fd4677fe700 1 -- 172.21.15.7:0/1794155963 >> v1:172.21.15.7:6789/0 conn(0x7fd4681590d0 legacy=0x7fd468069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.085+0000 7fd4677fe700 1 -- 172.21.15.7:0/1794155963 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd468068ba0 con 0x7fd46815ce10 2023-10-06T11:00:46.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.085+0000 7fd466ffd700 1 -- 172.21.15.7:0/1794155963 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215493084 0 0) 0x7fd4680694d0 con 0x7fd4681590d0 2023-10-06T11:00:46.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.085+0000 7fd4677fe700 1 --2- 172.21.15.7:0/1794155963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd46815ce10 0x7fd46815d2b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0098e0 tx=0x7fd45c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f789db9d1952e4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:46.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.085+0000 7fd466ffd700 1 -- 172.21.15.7:0/1794155963 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c009e80 con 0x7fd46815ce10 2023-10-06T11:00:46.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.085+0000 7fd466ffd700 1 -- 172.21.15.7:0/1794155963 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c00b860 con 0x7fd46815ce10 2023-10-06T11:00:46.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.085+0000 7fd466ffd700 1 -- 172.21.15.7:0/1794155963 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c00bbe0 con 0x7fd46815ce10 2023-10-06T11:00:46.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.086+0000 7fd46e434700 1 -- 172.21.15.7:0/1794155963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd46815ce10 msgr2=0x7fd46815d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.086+0000 7fd46e434700 1 --2- 172.21.15.7:0/1794155963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd46815ce10 0x7fd46815d2b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0098e0 tx=0x7fd45c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.086+0000 7fd46e434700 1 -- 172.21.15.7:0/1794155963 shutdown_connections 2023-10-06T11:00:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.086+0000 7fd46e434700 1 --2- 172.21.15.7:0/1794155963 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4681594a0 0x7fd468159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.086+0000 7fd46e434700 1 --2- 172.21.15.7:0/1794155963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd46815ce10 0x7fd46815d2b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.086+0000 7fd46e434700 1 -- 172.21.15.7:0/1794155963 >> 172.21.15.7:0/1794155963 conn(0x7fd468096160 msgr2=0x7fd4680afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.086+0000 7fd46e434700 1 -- 172.21.15.7:0/1794155963 shutdown_connections 2023-10-06T11:00:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.086+0000 7fd46e434700 1 -- 172.21.15.7:0/1794155963 wait complete. 2023-10-06T11:00:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.087+0000 7fd46e434700 1 Processor -- start 2023-10-06T11:00:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.088+0000 7fd46e434700 1 -- start start 2023-10-06T11:00:46.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46e434700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4681590d0 0x7fd468097c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46e434700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4681594a0 0x7fd4681564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46e434700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd46815ce10 0x7fd4681569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46e434700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46815c9c0 con 0x7fd46815ce10 2023-10-06T11:00:46.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46e434700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd468155490 con 0x7fd4681590d0 2023-10-06T11:00:46.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46e434700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd468156010 con 0x7fd4681594a0 2023-10-06T11:00:46.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46c9d1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd46815ce10 0x7fd4681569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46c9d1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd46815ce10 0x7fd4681569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46120/0 (socket says 172.21.15.7:46120) 2023-10-06T11:00:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46c9d1700 1 -- 172.21.15.7:0/2628389318 learned_addr learned my addr 172.21.15.7:0/2628389318 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd4677fe700 1 --2- 172.21.15.7:0/2628389318 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4681594a0 0x7fd4681564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd467fff700 1 --2- 172.21.15.7:0/2628389318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4681590d0 0x7fd468097c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46c9d1700 1 -- 172.21.15.7:0/2628389318 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4681594a0 msgr2=0x7fd4681564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46c9d1700 1 --2- 172.21.15.7:0/2628389318 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4681594a0 0x7fd4681564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46c9d1700 1 -- 172.21.15.7:0/2628389318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4681590d0 msgr2=0x7fd468097c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46c9d1700 1 --2- 172.21.15.7:0/2628389318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4681590d0 0x7fd468097c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46c9d1700 1 -- 172.21.15.7:0/2628389318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c009420 con 0x7fd46815ce10 2023-10-06T11:00:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.089+0000 7fd46c9d1700 1 --2- 172.21.15.7:0/2628389318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd46815ce10 0x7fd4681569e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd460009fd0 tx=0x7fd460009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.090+0000 7fd44ffff700 1 -- 172.21.15.7:0/2628389318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46000ebf0 con 0x7fd46815ce10 2023-10-06T11:00:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.090+0000 7fd44ffff700 1 -- 172.21.15.7:0/2628389318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46000ed50 con 0x7fd46815ce10 2023-10-06T11:00:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.090+0000 7fd46e434700 1 -- 172.21.15.7:0/2628389318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4681556e0 con 0x7fd46815ce10 2023-10-06T11:00:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.090+0000 7fd44ffff700 1 -- 172.21.15.7:0/2628389318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460014670 con 0x7fd46815ce10 2023-10-06T11:00:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.090+0000 7fd46e434700 1 -- 172.21.15.7:0/2628389318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd468155d20 con 0x7fd46815ce10 2023-10-06T11:00:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.091+0000 7fd46e434700 1 -- 172.21.15.7:0/2628389318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd468096530 con 0x7fd46815ce10 2023-10-06T11:00:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.091+0000 7fd44ffff700 1 -- 172.21.15.7:0/2628389318 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4600149e0 con 0x7fd46815ce10 2023-10-06T11:00:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.092+0000 7fd44ffff700 1 --2- 172.21.15.7:0/2628389318 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd454066f30 0x7fd4540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.092+0000 7fd44ffff700 1 -- 172.21.15.7:0/2628389318 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7fd460084fd0 con 0x7fd46815ce10 2023-10-06T11:00:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.092+0000 7fd467fff700 1 --2- 172.21.15.7:0/2628389318 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd454066f30 0x7fd4540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.092+0000 7fd467fff700 1 --2- 172.21.15.7:0/2628389318 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd454066f30 0x7fd4540693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd458007fd0 tx=0x7fd458007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.096+0000 7fd44ffff700 1 -- 172.21.15.7:0/2628389318 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd460051e10 con 0x7fd46815ce10 2023-10-06T11:00:46.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.299+0000 7fd46e434700 1 -- 172.21.15.7:0/2628389318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd468070480 con 0x7fd46815ce10 2023-10-06T11:00:46.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.300+0000 7fd44ffff700 1 -- 172.21.15.7:0/2628389318 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18630 (secure 0 0 0) 0x7fd460055430 con 0x7fd46815ce10 2023-10-06T11:00:46.302 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:46.302 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":43,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:00:33.060575+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:00:18.763171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T11:00:20.149563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":8,"pool_name":"data_new","create_time":"2023-10-06T11:00:30.330717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:00:46.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.302+0000 7fd46e434700 1 -- 172.21.15.7:0/2628389318 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd454066f30 msgr2=0x7fd4540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.302+0000 7fd46e434700 1 --2- 172.21.15.7:0/2628389318 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd454066f30 0x7fd4540693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd458007fd0 tx=0x7fd458007d30 comp rx=0 tx=0).stop 2023-10-06T11:00:46.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.302+0000 7fd46e434700 1 -- 172.21.15.7:0/2628389318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd46815ce10 msgr2=0x7fd4681569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.302+0000 7fd46e434700 1 --2- 172.21.15.7:0/2628389318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd46815ce10 0x7fd4681569e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd460009fd0 tx=0x7fd460009900 comp rx=0 tx=0).stop 2023-10-06T11:00:46.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.303+0000 7fd46e434700 1 -- 172.21.15.7:0/2628389318 shutdown_connections 2023-10-06T11:00:46.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.303+0000 7fd46e434700 1 --2- 172.21.15.7:0/2628389318 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd454066f30 0x7fd4540693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.303+0000 7fd46e434700 1 --2- 172.21.15.7:0/2628389318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd46815ce10 0x7fd4681569e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.303+0000 7fd46e434700 1 --2- 172.21.15.7:0/2628389318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4681590d0 0x7fd468097c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.303+0000 7fd46e434700 1 --2- 172.21.15.7:0/2628389318 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4681594a0 0x7fd4681564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.303+0000 7fd46e434700 1 -- 172.21.15.7:0/2628389318 >> 172.21.15.7:0/2628389318 conn(0x7fd468096160 msgr2=0x7fd468152610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:46.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.303+0000 7fd46e434700 1 -- 172.21.15.7:0/2628389318 shutdown_connections 2023-10-06T11:00:46.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.303+0000 7fd46e434700 1 -- 172.21.15.7:0/2628389318 wait complete. 2023-10-06T11:00:46.318 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T10:58:55.224661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T10:58:56.032929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:00:18.763171+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:00:20.149563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 8, 'pool_name': 'data_new', 'create_time': '2023-10-06T11:00:30.330717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:00:46.319 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:00:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.452+0000 7f1ced3b7700 1 Processor -- start 2023-10-06T11:00:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.452+0000 7f1ced3b7700 1 -- start start 2023-10-06T11:00:46.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.453+0000 7f1ced3b7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ce8159890 0x7f1ce80cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.453+0000 7f1ced3b7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce80cf870 con 0x7f1ce80af440 2023-10-06T11:00:46.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.453+0000 7f1ced3b7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce80cecf0 con 0x7f1ce81594c0 2023-10-06T11:00:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.453+0000 7f1ced3b7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80b1030 con 0x7f1ce8159890 2023-10-06T11:00:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.453+0000 7f1ce67fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1ce80af440 0x7f1ce80caff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44642/0 (socket says 172.21.15.7:44642) 2023-10-06T11:00:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.453+0000 7f1ce67fc700 1 -- 172.21.15.7:0/3353331001 learned_addr learned my addr 172.21.15.7:0/3353331001 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.453+0000 7f1ce77fe700 1 --2- 172.21.15.7:0/3353331001 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ce8159890 0x7f1ce80cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.453+0000 7f1ce5ffb700 1 -- 172.21.15.7:0/3353331001 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268432495 0 0) 0x7f1ce80cf870 con 0x7f1ce80af440 2023-10-06T11:00:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.453+0000 7f1ce5ffb700 1 -- 172.21.15.7:0/3353331001 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd0003570 con 0x7f1ce80af440 2023-10-06T11:00:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.453+0000 7f1ce5ffb700 1 -- 172.21.15.7:0/3353331001 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554206685 0 0) 0x7f1ce80cecf0 con 0x7f1ce81594c0 2023-10-06T11:00:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.453+0000 7f1ce5ffb700 1 -- 172.21.15.7:0/3353331001 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce80cf870 con 0x7f1ce81594c0 2023-10-06T11:00:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.454+0000 7f1ce5ffb700 1 -- 172.21.15.7:0/3353331001 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1159270656 0 0) 0x7f1cd0003570 con 0x7f1ce80af440 2023-10-06T11:00:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.454+0000 7f1ce77fe700 1 -- 172.21.15.7:0/3353331001 >> v1:172.21.15.50:6789/0 conn(0x7f1ce81594c0 legacy=0x7f1ce80aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.454+0000 7f1ce77fe700 1 -- 172.21.15.7:0/3353331001 >> v1:172.21.15.7:6789/0 conn(0x7f1ce80af440 legacy=0x7f1ce80caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.454+0000 7f1ce77fe700 1 -- 172.21.15.7:0/3353331001 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce80cef40 con 0x7f1ce8159890 2023-10-06T11:00:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.454+0000 7f1ce77fe700 1 --2- 172.21.15.7:0/3353331001 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ce8159890 0x7f1ce80cb700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009e90 tx=0x7f1ce0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3ec2cb05d280f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.454+0000 7f1ce5ffb700 1 -- 172.21.15.7:0/3353331001 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000e070 con 0x7f1ce8159890 2023-10-06T11:00:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.454+0000 7f1ce5ffb700 1 -- 172.21.15.7:0/3353331001 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce000b870 con 0x7f1ce8159890 2023-10-06T11:00:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.454+0000 7f1ce5ffb700 1 -- 172.21.15.7:0/3353331001 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc001470 con 0x7f1ce8159890 2023-10-06T11:00:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.455+0000 7f1ced3b7700 1 -- 172.21.15.7:0/3353331001 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ce8159890 msgr2=0x7f1ce80cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.455+0000 7f1ced3b7700 1 --2- 172.21.15.7:0/3353331001 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ce8159890 0x7f1ce80cb700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009e90 tx=0x7f1ce0009780 comp rx=0 tx=0).stop 2023-10-06T11:00:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.455+0000 7f1ced3b7700 1 -- 172.21.15.7:0/3353331001 shutdown_connections 2023-10-06T11:00:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.455+0000 7f1ced3b7700 1 --2- 172.21.15.7:0/3353331001 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ce8159890 0x7f1ce80cb700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.455+0000 7f1ced3b7700 1 -- 172.21.15.7:0/3353331001 >> 172.21.15.7:0/3353331001 conn(0x7f1ce8067bc0 msgr2=0x7f1ce80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:46.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.455+0000 7f1ced3b7700 1 -- 172.21.15.7:0/3353331001 shutdown_connections 2023-10-06T11:00:46.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.455+0000 7f1ced3b7700 1 -- 172.21.15.7:0/3353331001 wait complete. 2023-10-06T11:00:46.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.456+0000 7f1ced3b7700 1 Processor -- start 2023-10-06T11:00:46.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.456+0000 7f1ced3b7700 1 -- start start 2023-10-06T11:00:46.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ced3b7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce80af440 0x7f1ce80b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ced3b7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ce81594c0 0x7f1ce815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ced3b7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ce8159890 0x7f1ce815bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ced3b7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80b5fb0 con 0x7f1ce80af440 2023-10-06T11:00:46.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ced3b7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80b4360 con 0x7f1ce81594c0 2023-10-06T11:00:46.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ced3b7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce815fa90 con 0x7f1ce8159890 2023-10-06T11:00:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ce6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce80af440 0x7f1ce80b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ce6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce80af440 0x7f1ce80b47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46132/0 (socket says 172.21.15.7:46132) 2023-10-06T11:00:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ce6ffd700 1 -- 172.21.15.7:0/794428129 learned_addr learned my addr 172.21.15.7:0/794428129 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ce67fc700 1 --2- 172.21.15.7:0/794428129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ce81594c0 0x7f1ce815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ce77fe700 1 --2- 172.21.15.7:0/794428129 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ce8159890 0x7f1ce815bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ce6ffd700 1 -- 172.21.15.7:0/794428129 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ce8159890 msgr2=0x7f1ce815bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ce6ffd700 1 --2- 172.21.15.7:0/794428129 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ce8159890 0x7f1ce815bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ce6ffd700 1 -- 172.21.15.7:0/794428129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ce81594c0 msgr2=0x7f1ce815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ce6ffd700 1 --2- 172.21.15.7:0/794428129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ce81594c0 0x7f1ce815baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.457+0000 7f1ce6ffd700 1 -- 172.21.15.7:0/794428129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce0009a20 con 0x7f1ce80af440 2023-10-06T11:00:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.458+0000 7f1ce6ffd700 1 --2- 172.21.15.7:0/794428129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce80af440 0x7f1ce80b47f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800c790 tx=0x7f1cd8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.458+0000 7f1cceffd700 1 -- 172.21.15.7:0/794428129 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8010510 con 0x7f1ce80af440 2023-10-06T11:00:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.458+0000 7f1cceffd700 1 -- 172.21.15.7:0/794428129 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd8010670 con 0x7f1ce80af440 2023-10-06T11:00:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.458+0000 7f1ced3b7700 1 -- 172.21.15.7:0/794428129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce815fd70 con 0x7f1ce80af440 2023-10-06T11:00:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.458+0000 7f1cceffd700 1 -- 172.21.15.7:0/794428129 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8010a10 con 0x7f1ce80af440 2023-10-06T11:00:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.458+0000 7f1ced3b7700 1 -- 172.21.15.7:0/794428129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce80b3ff0 con 0x7f1ce80af440 2023-10-06T11:00:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.459+0000 7f1ced3b7700 1 -- 172.21.15.7:0/794428129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce80b3b70 con 0x7f1ce80af440 2023-10-06T11:00:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.459+0000 7f1cceffd700 1 -- 172.21.15.7:0/794428129 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cd801b3b0 con 0x7f1ce80af440 2023-10-06T11:00:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.460+0000 7f1cceffd700 1 --2- 172.21.15.7:0/794428129 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.460+0000 7f1cceffd700 1 -- 172.21.15.7:0/794428129 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f1cd8084200 con 0x7f1ce80af440 2023-10-06T11:00:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.460+0000 7f1ce67fc700 1 --2- 172.21.15.7:0/794428129 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.460+0000 7f1ce67fc700 1 --2- 172.21.15.7:0/794428129 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1cd4066f30 0x7f1cd40693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1ce815b350 tx=0x7f1cdc000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.464+0000 7f1cceffd700 1 -- 172.21.15.7:0/794428129 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ce80b3b70 con 0x7f1ce80af440 2023-10-06T11:00:46.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.666+0000 7f1ced3b7700 1 -- 172.21.15.7:0/794428129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1ce80b3b70 con 0x7f1ce80af440 2023-10-06T11:00:46.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.667+0000 7f1cceffd700 1 -- 172.21.15.7:0/794428129 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1cd8017020 con 0x7f1ce80af440 2023-10-06T11:00:46.669 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-10-06T11:00:46.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.669+0000 7f1ced3b7700 1 -- 172.21.15.7:0/794428129 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1cd4066f30 msgr2=0x7f1cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.669+0000 7f1ced3b7700 1 --2- 172.21.15.7:0/794428129 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1cd4066f30 0x7f1cd40693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1ce815b350 tx=0x7f1cdc000bc0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.669+0000 7f1ced3b7700 1 -- 172.21.15.7:0/794428129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce80af440 msgr2=0x7f1ce80b47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.669+0000 7f1ced3b7700 1 --2- 172.21.15.7:0/794428129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce80af440 0x7f1ce80b47f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800c790 tx=0x7f1cd8007e10 comp rx=0 tx=0).stop 2023-10-06T11:00:46.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.669+0000 7f1ced3b7700 1 -- 172.21.15.7:0/794428129 shutdown_connections 2023-10-06T11:00:46.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.669+0000 7f1ced3b7700 1 --2- 172.21.15.7:0/794428129 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.669+0000 7f1ced3b7700 1 --2- 172.21.15.7:0/794428129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce80af440 0x7f1ce80b47f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.669+0000 7f1ced3b7700 1 --2- 172.21.15.7:0/794428129 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ce8159890 0x7f1ce815bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.669+0000 7f1ced3b7700 1 --2- 172.21.15.7:0/794428129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ce81594c0 0x7f1ce815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.669+0000 7f1ced3b7700 1 -- 172.21.15.7:0/794428129 >> 172.21.15.7:0/794428129 conn(0x7f1ce8067bc0 msgr2=0x7f1ce80c64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:46.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.669+0000 7f1ced3b7700 1 -- 172.21.15.7:0/794428129 shutdown_connections 2023-10-06T11:00:46.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.669+0000 7f1ced3b7700 1 -- 172.21.15.7:0/794428129 wait complete. 2023-10-06T11:00:46.684 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:00:46.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.817+0000 7fc812919700 1 Processor -- start 2023-10-06T11:00:46.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.817+0000 7fc812919700 1 -- start start 2023-10-06T11:00:46.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.818+0000 7fc812919700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc80c0cab40 0x7fc80c0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.818+0000 7fc812919700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc80c0b2430 0x7fc80c0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.818+0000 7fc812919700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80c0699e0 con 0x7fc80c0caf10 2023-10-06T11:00:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.818+0000 7fc812919700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80c069dd0 con 0x7fc80c0cab40 2023-10-06T11:00:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.818+0000 7fc812919700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80c06a070 con 0x7fc80c0b2430 2023-10-06T11:00:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.818+0000 7fc80bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc80c0cab40 0x7fc80c0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.818+0000 7fc80b7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc80c0caf10 0x7fc80c0b1d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44652/0 (socket says 172.21.15.7:44652) 2023-10-06T11:00:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.818+0000 7fc80b7fe700 1 -- 172.21.15.7:0/1284199075 learned_addr learned my addr 172.21.15.7:0/1284199075 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.818+0000 7fc810eb6700 1 --2- 172.21.15.7:0/1284199075 >> v2:172.21.15.50:3300/0 conn(0x7fc80c0b2430 0x7fc80c0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.818+0000 7fc80bfff700 1 -- 172.21.15.7:0/1284199075 >> v2:172.21.15.50:3300/0 conn(0x7fc80c0b2430 msgr2=0x7fc80c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.818+0000 7fc80bfff700 1 --2- 172.21.15.7:0/1284199075 >> v2:172.21.15.50:3300/0 conn(0x7fc80c0b2430 0x7fc80c0c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.818+0000 7fc80bfff700 1 -- 172.21.15.7:0/1284199075 >> v1:172.21.15.7:6789/0 conn(0x7fc80c0caf10 legacy=0x7fc80c0b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.818+0000 7fc80bfff700 1 -- 172.21.15.7:0/1284199075 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c06a350 con 0x7fc80c0cab40 2023-10-06T11:00:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.818+0000 7fc80affd700 1 -- 172.21.15.7:0/1284199075 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435437762 0 0) 0x7fc80c0699e0 con 0x7fc80c0caf10 2023-10-06T11:00:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.819+0000 7fc80bfff700 1 --2- 172.21.15.7:0/1284199075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc80c0cab40 0x7fc80c0694a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0ccd90 tx=0x7fc7fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1a0d277e46d9ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.819+0000 7fc80affd700 1 -- 172.21.15.7:0/1284199075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00b6b0 con 0x7fc80c0cab40 2023-10-06T11:00:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.819+0000 7fc80affd700 1 -- 172.21.15.7:0/1284199075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7fc00b810 con 0x7fc80c0cab40 2023-10-06T11:00:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.819+0000 7fc80affd700 1 -- 172.21.15.7:0/1284199075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00bbb0 con 0x7fc80c0cab40 2023-10-06T11:00:46.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.819+0000 7fc812919700 1 -- 172.21.15.7:0/1284199075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc80c0cab40 msgr2=0x7fc80c0694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.819+0000 7fc812919700 1 --2- 172.21.15.7:0/1284199075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc80c0cab40 0x7fc80c0694a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0ccd90 tx=0x7fc7fc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.819+0000 7fc812919700 1 -- 172.21.15.7:0/1284199075 shutdown_connections 2023-10-06T11:00:46.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.819+0000 7fc812919700 1 --2- 172.21.15.7:0/1284199075 >> v2:172.21.15.50:3300/0 conn(0x7fc80c0b2430 0x7fc80c0c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.819+0000 7fc812919700 1 --2- 172.21.15.7:0/1284199075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc80c0cab40 0x7fc80c0694a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.819+0000 7fc812919700 1 -- 172.21.15.7:0/1284199075 >> 172.21.15.7:0/1284199075 conn(0x7fc80c0afc90 msgr2=0x7fc80c0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:46.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.819+0000 7fc812919700 1 -- 172.21.15.7:0/1284199075 shutdown_connections 2023-10-06T11:00:46.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.819+0000 7fc812919700 1 -- 172.21.15.7:0/1284199075 wait complete. 2023-10-06T11:00:46.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.820+0000 7fc812919700 1 Processor -- start 2023-10-06T11:00:46.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.821+0000 7fc812919700 1 -- start start 2023-10-06T11:00:46.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.821+0000 7fc812919700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc80c0b2430 0x7fc80c0c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.821+0000 7fc812919700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc80c0cab40 0x7fc80c0c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.821+0000 7fc812919700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc80c0caf10 0x7fc80c168860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.821+0000 7fc812919700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c0c05c0 con 0x7fc80c0b2430 2023-10-06T11:00:46.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.821+0000 7fc812919700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c14fde0 con 0x7fc80c0caf10 2023-10-06T11:00:46.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.821+0000 7fc812919700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c0c1750 con 0x7fc80c0cab40 2023-10-06T11:00:46.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc80bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc80c0b2430 0x7fc80c0c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc80bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc80c0b2430 0x7fc80c0c1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46144/0 (socket says 172.21.15.7:46144) 2023-10-06T11:00:46.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc80bfff700 1 -- 172.21.15.7:0/2078223993 learned_addr learned my addr 172.21.15.7:0/2078223993 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:46.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc810eb6700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc80c0caf10 0x7fc80c168860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc80b7fe700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc80c0cab40 0x7fc80c0c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc80bfff700 1 -- 172.21.15.7:0/2078223993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc80c0cab40 msgr2=0x7fc80c0c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc80bfff700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc80c0cab40 0x7fc80c0c6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc80bfff700 1 -- 172.21.15.7:0/2078223993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc80c0caf10 msgr2=0x7fc80c168860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:46.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc80bfff700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc80c0caf10 0x7fc80c168860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc80bfff700 1 -- 172.21.15.7:0/2078223993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc009420 con 0x7fc80c0b2430 2023-10-06T11:00:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc810eb6700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc80c0caf10 0x7fc80c168860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc80bfff700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc80c0b2430 0x7fc80c0c1be0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00b0e0 tx=0x7fc7fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc7f3fff700 1 -- 172.21.15.7:0/2078223993 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc011420 con 0x7fc80c0b2430 2023-10-06T11:00:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc7f3fff700 1 -- 172.21.15.7:0/2078223993 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7fc011580 con 0x7fc80c0b2430 2023-10-06T11:00:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc812919700 1 -- 172.21.15.7:0/2078223993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80c0c2120 con 0x7fc80c0b2430 2023-10-06T11:00:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.822+0000 7fc7f3fff700 1 -- 172.21.15.7:0/2078223993 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc011940 con 0x7fc80c0b2430 2023-10-06T11:00:46.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.823+0000 7fc812919700 1 -- 172.21.15.7:0/2078223993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80c0c0e20 con 0x7fc80c0b2430 2023-10-06T11:00:46.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.824+0000 7fc7f3fff700 1 -- 172.21.15.7:0/2078223993 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7fc011d30 con 0x7fc80c0b2430 2023-10-06T11:00:46.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.824+0000 7fc812919700 1 -- 172.21.15.7:0/2078223993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80c070480 con 0x7fc80c0b2430 2023-10-06T11:00:46.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.824+0000 7fc7f3fff700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc7f8066f30 0x7fc7f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:46.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.825+0000 7fc7f3fff700 1 -- 172.21.15.7:0/2078223993 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7fc7fc086330 con 0x7fc80c0b2430 2023-10-06T11:00:46.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.825+0000 7fc80b7fe700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc7f8066f30 0x7fc7f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:46.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.825+0000 7fc80b7fe700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc7f8066f30 0x7fc7f80693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc80c153600 tx=0x7fc800009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:46.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:46.829+0000 7fc7f3fff700 1 -- 172.21.15.7:0/2078223993 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7fc053170 con 0x7fc80c0b2430 2023-10-06T11:00:47.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.032+0000 7fc812919700 1 -- 172.21.15.7:0/2078223993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc80c0c7360 con 0x7fc80c0b2430 2023-10-06T11:00:47.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.033+0000 7fc7f3fff700 1 -- 172.21.15.7:0/2078223993 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7fc056790 con 0x7fc80c0b2430 2023-10-06T11:00:47.035 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-06T11:00:47.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.035+0000 7fc812919700 1 -- 172.21.15.7:0/2078223993 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc7f8066f30 msgr2=0x7fc7f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.035+0000 7fc812919700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc7f8066f30 0x7fc7f80693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc80c153600 tx=0x7fc800009040 comp rx=0 tx=0).stop 2023-10-06T11:00:47.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.035+0000 7fc812919700 1 -- 172.21.15.7:0/2078223993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc80c0b2430 msgr2=0x7fc80c0c1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.035+0000 7fc812919700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc80c0b2430 0x7fc80c0c1be0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00b0e0 tx=0x7fc7fc017000 comp rx=0 tx=0).stop 2023-10-06T11:00:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.035+0000 7fc812919700 1 -- 172.21.15.7:0/2078223993 shutdown_connections 2023-10-06T11:00:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.035+0000 7fc812919700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc7f8066f30 0x7fc7f80693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.035+0000 7fc812919700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc80c0b2430 0x7fc80c0c1be0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.035+0000 7fc812919700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc80c0caf10 0x7fc80c168860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.035+0000 7fc812919700 1 --2- 172.21.15.7:0/2078223993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc80c0cab40 0x7fc80c0c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.035+0000 7fc812919700 1 -- 172.21.15.7:0/2078223993 >> 172.21.15.7:0/2078223993 conn(0x7fc80c0afc90 msgr2=0x7fc80c151720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.035+0000 7fc812919700 1 -- 172.21.15.7:0/2078223993 shutdown_connections 2023-10-06T11:00:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.035+0000 7fc812919700 1 -- 172.21.15.7:0/2078223993 wait complete. 2023-10-06T11:00:47.050 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:00:47.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.183+0000 7f6cdab82700 1 Processor -- start 2023-10-06T11:00:47.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.183+0000 7f6cdab82700 1 -- start start 2023-10-06T11:00:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.184+0000 7f6cdab82700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6cd40ae430 0x7f6cd40b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.184+0000 7f6cdab82700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6cd406c940 0x7f6cd40c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.184+0000 7f6cdab82700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd415b050 con 0x7f6cd40b0540 2023-10-06T11:00:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.184+0000 7f6cdab82700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd40af590 con 0x7f6cd40ae430 2023-10-06T11:00:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.184+0000 7f6cdab82700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd415bc60 con 0x7f6cd406c940 2023-10-06T11:00:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.184+0000 7f6cd891e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6cd40ae430 0x7f6cd40b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.184+0000 7f6cd3fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6cd40b0540 0x7f6cd406c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44660/0 (socket says 172.21.15.7:44660) 2023-10-06T11:00:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.184+0000 7f6cd3fff700 1 -- 172.21.15.7:0/1626451291 learned_addr learned my addr 172.21.15.7:0/1626451291 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.184+0000 7f6cd911f700 1 --2- 172.21.15.7:0/1626451291 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6cd406c940 0x7f6cd40c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.184+0000 7f6cd891e700 1 -- 172.21.15.7:0/1626451291 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6cd406c940 msgr2=0x7f6cd40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.184+0000 7f6cd891e700 1 --2- 172.21.15.7:0/1626451291 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6cd406c940 0x7f6cd40c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.185+0000 7f6cd891e700 1 -- 172.21.15.7:0/1626451291 >> v1:172.21.15.7:6789/0 conn(0x7f6cd40b0540 legacy=0x7f6cd406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.185+0000 7f6cd891e700 1 -- 172.21.15.7:0/1626451291 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd415b330 con 0x7f6cd40ae430 2023-10-06T11:00:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.185+0000 7f6cd37fe700 1 -- 172.21.15.7:0/1626451291 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139782546 0 0) 0x7f6cd415b050 con 0x7f6cd40b0540 2023-10-06T11:00:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.185+0000 7f6cd891e700 1 --2- 172.21.15.7:0/1626451291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd40ae430 0x7f6cd40b0000 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40098e0 tx=0x7f6cc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c212e7c9c62cc3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.185+0000 7f6cd37fe700 1 -- 172.21.15.7:0/1626451291 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4009e80 con 0x7f6cd40ae430 2023-10-06T11:00:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.185+0000 7f6cd37fe700 1 -- 172.21.15.7:0/1626451291 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc400b860 con 0x7f6cd40ae430 2023-10-06T11:00:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.185+0000 7f6cd37fe700 1 -- 172.21.15.7:0/1626451291 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc400bbe0 con 0x7f6cd40ae430 2023-10-06T11:00:47.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.185+0000 7f6cdab82700 1 -- 172.21.15.7:0/1626451291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd40ae430 msgr2=0x7f6cd40b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.185+0000 7f6cdab82700 1 --2- 172.21.15.7:0/1626451291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd40ae430 0x7f6cd40b0000 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40098e0 tx=0x7f6cc40091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.185+0000 7f6cdab82700 1 -- 172.21.15.7:0/1626451291 shutdown_connections 2023-10-06T11:00:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.185+0000 7f6cdab82700 1 --2- 172.21.15.7:0/1626451291 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6cd406c940 0x7f6cd40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.185+0000 7f6cdab82700 1 --2- 172.21.15.7:0/1626451291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd40ae430 0x7f6cd40b0000 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.185+0000 7f6cdab82700 1 -- 172.21.15.7:0/1626451291 >> 172.21.15.7:0/1626451291 conn(0x7f6cd40cded0 msgr2=0x7f6cd40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.186+0000 7f6cdab82700 1 -- 172.21.15.7:0/1626451291 shutdown_connections 2023-10-06T11:00:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.186+0000 7f6cdab82700 1 -- 172.21.15.7:0/1626451291 wait complete. 2023-10-06T11:00:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.187+0000 7f6cdab82700 1 Processor -- start 2023-10-06T11:00:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.187+0000 7f6cdab82700 1 -- start start 2023-10-06T11:00:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cdab82700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd406c940 0x7f6cd4146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cdab82700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cd40ae430 0x7f6cd4158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cdab82700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6cd40b0540 0x7f6cd41590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cdab82700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd41563c0 con 0x7f6cd406c940 2023-10-06T11:00:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cdab82700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd41566a0 con 0x7f6cd40ae430 2023-10-06T11:00:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cdab82700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd4156980 con 0x7f6cd40b0540 2023-10-06T11:00:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cd891e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd406c940 0x7f6cd4146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cd891e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd406c940 0x7f6cd4146280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46164/0 (socket says 172.21.15.7:46164) 2023-10-06T11:00:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cd891e700 1 -- 172.21.15.7:0/3084866521 learned_addr learned my addr 172.21.15.7:0/3084866521 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cd3fff700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cd40ae430 0x7f6cd4158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cd911f700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6cd40b0540 0x7f6cd41590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cd891e700 1 -- 172.21.15.7:0/3084866521 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6cd40b0540 msgr2=0x7f6cd41590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cd891e700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6cd40b0540 0x7f6cd41590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cd891e700 1 -- 172.21.15.7:0/3084866521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cd40ae430 msgr2=0x7f6cd4158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cd891e700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cd40ae430 0x7f6cd4158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cd891e700 1 -- 172.21.15.7:0/3084866521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc4009420 con 0x7f6cd406c940 2023-10-06T11:00:47.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cd3fff700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cd40ae430 0x7f6cd4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:47.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.188+0000 7f6cd891e700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd406c940 0x7f6cd4146280 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6cd406d300 tx=0x7f6cc4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:47.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.189+0000 7f6cd0ff9700 1 -- 172.21.15.7:0/3084866521 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc400bbe0 con 0x7f6cd406c940 2023-10-06T11:00:47.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.189+0000 7f6cd0ff9700 1 -- 172.21.15.7:0/3084866521 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc4011420 con 0x7f6cd406c940 2023-10-06T11:00:47.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.189+0000 7f6cd0ff9700 1 -- 172.21.15.7:0/3084866521 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40117e0 con 0x7f6cd406c940 2023-10-06T11:00:47.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.189+0000 7f6cdab82700 1 -- 172.21.15.7:0/3084866521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd40c1760 con 0x7f6cd406c940 2023-10-06T11:00:47.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.189+0000 7f6cdab82700 1 -- 172.21.15.7:0/3084866521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd41467c0 con 0x7f6cd406c940 2023-10-06T11:00:47.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.190+0000 7f6cdab82700 1 -- 172.21.15.7:0/3084866521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd4070480 con 0x7f6cd406c940 2023-10-06T11:00:47.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.190+0000 7f6cd0ff9700 1 -- 172.21.15.7:0/3084866521 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cc4011bd0 con 0x7f6cd406c940 2023-10-06T11:00:47.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.191+0000 7f6cd0ff9700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6cb4066f30 0x7f6cb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.191+0000 7f6cd0ff9700 1 -- 172.21.15.7:0/3084866521 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f6cc40863d0 con 0x7f6cd406c940 2023-10-06T11:00:47.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.191+0000 7f6cd3fff700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6cb4066f30 0x7f6cb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.191+0000 7f6cd3fff700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6cb4066f30 0x7f6cb40693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40c14e0 tx=0x7f6cbc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:47.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.195+0000 7f6cd0ff9700 1 -- 172.21.15.7:0/3084866521 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cc4053210 con 0x7f6cd406c940 2023-10-06T11:00:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.394+0000 7f6cdab82700 1 -- 172.21.15.7:0/3084866521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6cd40c85e0 con 0x7f6cd406c940 2023-10-06T11:00:47.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.395+0000 7f6cd0ff9700 1 -- 172.21.15.7:0/3084866521 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6cc405ae60 con 0x7f6cd406c940 2023-10-06T11:00:47.397 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T11:00:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.397+0000 7f6cdab82700 1 -- 172.21.15.7:0/3084866521 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6cb4066f30 msgr2=0x7f6cb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.397+0000 7f6cdab82700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6cb4066f30 0x7f6cb40693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40c14e0 tx=0x7f6cbc009040 comp rx=0 tx=0).stop 2023-10-06T11:00:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.397+0000 7f6cdab82700 1 -- 172.21.15.7:0/3084866521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd406c940 msgr2=0x7f6cd4146280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.397+0000 7f6cdab82700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd406c940 0x7f6cd4146280 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6cd406d300 tx=0x7f6cc4017000 comp rx=0 tx=0).stop 2023-10-06T11:00:47.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.397+0000 7f6cdab82700 1 -- 172.21.15.7:0/3084866521 shutdown_connections 2023-10-06T11:00:47.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.397+0000 7f6cdab82700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6cb4066f30 0x7f6cb40693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.397+0000 7f6cdab82700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd406c940 0x7f6cd4146280 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.397+0000 7f6cdab82700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6cd40b0540 0x7f6cd41590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.397+0000 7f6cdab82700 1 --2- 172.21.15.7:0/3084866521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cd40ae430 0x7f6cd4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.397+0000 7f6cdab82700 1 -- 172.21.15.7:0/3084866521 >> 172.21.15.7:0/3084866521 conn(0x7f6cd40cded0 msgr2=0x7f6cd40c9040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:47.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.397+0000 7f6cdab82700 1 -- 172.21.15.7:0/3084866521 shutdown_connections 2023-10-06T11:00:47.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.397+0000 7f6cdab82700 1 -- 172.21.15.7:0/3084866521 wait complete. 2023-10-06T11:00:47.412 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:00:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.546+0000 7f356322c700 1 Processor -- start 2023-10-06T11:00:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.546+0000 7f356322c700 1 -- start start 2023-10-06T11:00:47.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.547+0000 7f356322c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f355c1554e0 0x7f355c1558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.547+0000 7f356322c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f355c0b04a0 0x7f355c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.547+0000 7f356322c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355c0aeaa0 con 0x7f355c0c7e30 2023-10-06T11:00:47.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.547+0000 7f356322c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355c0af900 con 0x7f355c0b04a0 2023-10-06T11:00:47.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.547+0000 7f356322c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c0b0c40 con 0x7f355c1554e0 2023-10-06T11:00:47.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.547+0000 7f3560fc8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f355c1554e0 0x7f355c1558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.547+0000 7f35617c9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f355c0b04a0 0x7f355c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.547+0000 7f355bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f355c0c7e30 0x7f355c0afd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:43508/0 (socket says 172.21.15.7:43508) 2023-10-06T11:00:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.547+0000 7f35617c9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f355c0b04a0 0x7f355c0c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:49428/0 (socket says 172.21.15.7:49428) 2023-10-06T11:00:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.547+0000 7f355bfff700 1 -- 172.21.15.7:0/1901363446 learned_addr learned my addr 172.21.15.7:0/1901363446 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.548+0000 7f3560fc8700 1 -- 172.21.15.7:0/1901363446 >> v2:172.21.15.50:3300/0 conn(0x7f355c0b04a0 msgr2=0x7f355c0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.548+0000 7f3560fc8700 1 --2- 172.21.15.7:0/1901363446 >> v2:172.21.15.50:3300/0 conn(0x7f355c0b04a0 0x7f355c0c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.548+0000 7f3560fc8700 1 -- 172.21.15.7:0/1901363446 >> v1:172.21.15.50:6789/0 conn(0x7f355c0c7e30 legacy=0x7f355c0afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.548+0000 7f3560fc8700 1 -- 172.21.15.7:0/1901363446 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c0aecf0 con 0x7f355c1554e0 2023-10-06T11:00:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.548+0000 7f35617c9700 1 --2- 172.21.15.7:0/1901363446 >> v2:172.21.15.50:3300/0 conn(0x7f355c0b04a0 0x7f355c0c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.548+0000 7f355b7fe700 1 -- 172.21.15.7:0/1901363446 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044375149 0 0) 0x7f355c0aeaa0 con 0x7f355c0c7e30 2023-10-06T11:00:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.548+0000 7f3560fc8700 1 --2- 172.21.15.7:0/1901363446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f355c1554e0 0x7f355c1558b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f35500098e0 tx=0x7f35500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3921e2c9dad9aa4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.548+0000 7f355b7fe700 1 -- 172.21.15.7:0/1901363446 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000b640 con 0x7f355c1554e0 2023-10-06T11:00:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.548+0000 7f355b7fe700 1 -- 172.21.15.7:0/1901363446 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355000b7a0 con 0x7f355c1554e0 2023-10-06T11:00:47.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.548+0000 7f355b7fe700 1 -- 172.21.15.7:0/1901363446 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000bb40 con 0x7f355c1554e0 2023-10-06T11:00:47.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.549+0000 7f356322c700 1 -- 172.21.15.7:0/1901363446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f355c1554e0 msgr2=0x7f355c1558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.549+0000 7f356322c700 1 --2- 172.21.15.7:0/1901363446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f355c1554e0 0x7f355c1558b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f35500098e0 tx=0x7f35500091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.549+0000 7f356322c700 1 -- 172.21.15.7:0/1901363446 shutdown_connections 2023-10-06T11:00:47.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.549+0000 7f356322c700 1 --2- 172.21.15.7:0/1901363446 >> v2:172.21.15.50:3300/0 conn(0x7f355c0b04a0 0x7f355c0c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.549+0000 7f356322c700 1 --2- 172.21.15.7:0/1901363446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f355c1554e0 0x7f355c1558b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.549+0000 7f356322c700 1 -- 172.21.15.7:0/1901363446 >> 172.21.15.7:0/1901363446 conn(0x7f355c06ea40 msgr2=0x7f355c0670f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:47.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.549+0000 7f356322c700 1 -- 172.21.15.7:0/1901363446 shutdown_connections 2023-10-06T11:00:47.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.549+0000 7f356322c700 1 -- 172.21.15.7:0/1901363446 wait complete. 2023-10-06T11:00:47.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.550+0000 7f356322c700 1 Processor -- start 2023-10-06T11:00:47.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.551+0000 7f356322c700 1 -- start start 2023-10-06T11:00:47.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.551+0000 7f356322c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f355c0b04a0 0x7f355c0abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.551+0000 7f356322c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f355c0c7e30 0x7f355c169800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f356322c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f355c1554e0 0x7f355c1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f356322c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c0c4550 con 0x7f355c1554e0 2023-10-06T11:00:47.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f356322c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c16a730 con 0x7f355c0b04a0 2023-10-06T11:00:47.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f356322c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c16a170 con 0x7f355c0c7e30 2023-10-06T11:00:47.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f35617c9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f355c1554e0 0x7f355c1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f35617c9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f355c1554e0 0x7f355c1531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46176/0 (socket says 172.21.15.7:46176) 2023-10-06T11:00:47.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f35617c9700 1 -- 172.21.15.7:0/1435883682 learned_addr learned my addr 172.21.15.7:0/1435883682 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:47.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f355bfff700 1 --2- 172.21.15.7:0/1435883682 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f355c0c7e30 0x7f355c169800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f3560fc8700 1 --2- 172.21.15.7:0/1435883682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f355c0b04a0 0x7f355c0abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f35617c9700 1 -- 172.21.15.7:0/1435883682 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f355c0c7e30 msgr2=0x7f355c169800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f35617c9700 1 --2- 172.21.15.7:0/1435883682 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f355c0c7e30 0x7f355c169800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f35617c9700 1 -- 172.21.15.7:0/1435883682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f355c0b04a0 msgr2=0x7f355c0abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f35617c9700 1 --2- 172.21.15.7:0/1435883682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f355c0b04a0 0x7f355c0abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f35617c9700 1 -- 172.21.15.7:0/1435883682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3554009a20 con 0x7f355c1554e0 2023-10-06T11:00:47.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f35617c9700 1 --2- 172.21.15.7:0/1435883682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f355c1554e0 0x7f355c1531d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f355400c0f0 tx=0x7f355400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:47.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f3558ff9700 1 -- 172.21.15.7:0/1435883682 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554009d20 con 0x7f355c1554e0 2023-10-06T11:00:47.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.552+0000 7f3558ff9700 1 -- 172.21.15.7:0/1435883682 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355400f040 con 0x7f355c1554e0 2023-10-06T11:00:47.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.553+0000 7f356322c700 1 -- 172.21.15.7:0/1435883682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3550009420 con 0x7f355c1554e0 2023-10-06T11:00:47.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.553+0000 7f3558ff9700 1 -- 172.21.15.7:0/1435883682 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355400ce80 con 0x7f355c1554e0 2023-10-06T11:00:47.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.553+0000 7f356322c700 1 -- 172.21.15.7:0/1435883682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355c0ab9b0 con 0x7f355c1554e0 2023-10-06T11:00:47.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.553+0000 7f356322c700 1 -- 172.21.15.7:0/1435883682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355c0abbd0 con 0x7f355c1554e0 2023-10-06T11:00:47.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.554+0000 7f3558ff9700 1 -- 172.21.15.7:0/1435883682 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3554003020 con 0x7f355c1554e0 2023-10-06T11:00:47.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.554+0000 7f3558ff9700 1 --2- 172.21.15.7:0/1435883682 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3540066f30 0x7f35400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.555+0000 7f3558ff9700 1 -- 172.21.15.7:0/1435883682 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f3554085240 con 0x7f355c1554e0 2023-10-06T11:00:47.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.555+0000 7f3560fc8700 1 --2- 172.21.15.7:0/1435883682 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3540066f30 0x7f35400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.555+0000 7f3560fc8700 1 --2- 172.21.15.7:0/1435883682 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3540066f30 0x7f35400693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f35500093f0 tx=0x7f3550017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:47.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.559+0000 7f3558ff9700 1 -- 172.21.15.7:0/1435883682 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3554052080 con 0x7f355c1554e0 2023-10-06T11:00:47.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.762+0000 7f356322c700 1 -- 172.21.15.7:0/1435883682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f355c070480 con 0x7f355c1554e0 2023-10-06T11:00:47.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.762+0000 7f3558ff9700 1 -- 172.21.15.7:0/1435883682 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f35540556a0 con 0x7f355c1554e0 2023-10-06T11:00:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-06T11:00:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.764+0000 7f356322c700 1 -- 172.21.15.7:0/1435883682 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3540066f30 msgr2=0x7f35400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.764+0000 7f356322c700 1 --2- 172.21.15.7:0/1435883682 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3540066f30 0x7f35400693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f35500093f0 tx=0x7f3550017000 comp rx=0 tx=0).stop 2023-10-06T11:00:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.764+0000 7f356322c700 1 -- 172.21.15.7:0/1435883682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f355c1554e0 msgr2=0x7f355c1531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.764+0000 7f356322c700 1 --2- 172.21.15.7:0/1435883682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f355c1554e0 0x7f355c1531d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f355400c0f0 tx=0x7f355400b040 comp rx=0 tx=0).stop 2023-10-06T11:00:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.764+0000 7f356322c700 1 -- 172.21.15.7:0/1435883682 shutdown_connections 2023-10-06T11:00:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.764+0000 7f356322c700 1 --2- 172.21.15.7:0/1435883682 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3540066f30 0x7f35400693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.764+0000 7f356322c700 1 --2- 172.21.15.7:0/1435883682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f355c1554e0 0x7f355c1531d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.764+0000 7f356322c700 1 --2- 172.21.15.7:0/1435883682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f355c0b04a0 0x7f355c0abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.764+0000 7f356322c700 1 --2- 172.21.15.7:0/1435883682 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f355c0c7e30 0x7f355c169800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.764+0000 7f356322c700 1 -- 172.21.15.7:0/1435883682 >> 172.21.15.7:0/1435883682 conn(0x7f355c06ea40 msgr2=0x7f355c0c8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.765+0000 7f356322c700 1 -- 172.21.15.7:0/1435883682 shutdown_connections 2023-10-06T11:00:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.765+0000 7f356322c700 1 -- 172.21.15.7:0/1435883682 wait complete. 2023-10-06T11:00:47.779 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-10-06T11:00:47.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.915+0000 7f9a310d7700 1 Processor -- start 2023-10-06T11:00:47.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.915+0000 7f9a310d7700 1 -- start start 2023-10-06T11:00:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.916+0000 7f9a310d7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a2c0cbf20 0x7f9a2c0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.916+0000 7f9a310d7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9a2c0cb2b0 0x7f9a2c158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.916+0000 7f9a310d7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c0c8fe0 con 0x7f9a2c0cc2f0 2023-10-06T11:00:47.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.916+0000 7f9a310d7700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2c0ca790 con 0x7f9a2c0cb2b0 2023-10-06T11:00:47.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.916+0000 7f9a310d7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0c92c0 con 0x7f9a2c0cbf20 2023-10-06T11:00:47.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.916+0000 7f9a2b59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9a2c0cb2b0 0x7f9a2c158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.916+0000 7f9a2b59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9a2c0cb2b0 0x7f9a2c158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46182/0 (socket says 172.21.15.7:46182) 2023-10-06T11:00:47.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.916+0000 7f9a2b59e700 1 -- 172.21.15.7:0/1495422537 learned_addr learned my addr 172.21.15.7:0/1495422537 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:47.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.916+0000 7f9a2ad9d700 1 --2- 172.21.15.7:0/1495422537 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a2c0cbf20 0x7f9a2c0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.917+0000 7f9a2b59e700 1 -- 172.21.15.7:0/1495422537 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a2c0cbf20 msgr2=0x7f9a2c0c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:47.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.917+0000 7f9a2b59e700 1 --2- 172.21.15.7:0/1495422537 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a2c0cbf20 0x7f9a2c0c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.917+0000 7f9a2b59e700 1 -- 172.21.15.7:0/1495422537 >> v1:172.21.15.50:6789/0 conn(0x7f9a2c0cc2f0 legacy=0x7f9a2c0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.917+0000 7f9a2b59e700 1 -- 172.21.15.7:0/1495422537 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0c95a0 con 0x7f9a2c0cb2b0 2023-10-06T11:00:47.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.917+0000 7f9a2b59e700 1 --2- 172.21.15.7:0/1495422537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a2c0cb2b0 0x7f9a2c158ea0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009f20 tx=0x7f9a24009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0269c90ad4cc75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:47.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.917+0000 7f9a29d9b700 1 -- 172.21.15.7:0/1495422537 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2400e070 con 0x7f9a2c0cb2b0 2023-10-06T11:00:47.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.917+0000 7f9a29d9b700 1 -- 172.21.15.7:0/1495422537 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2400b9d0 con 0x7f9a2c0cb2b0 2023-10-06T11:00:47.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.917+0000 7f9a29d9b700 1 -- 172.21.15.7:0/1495422537 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a240092e0 con 0x7f9a2c0cb2b0 2023-10-06T11:00:47.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.917+0000 7f9a310d7700 1 -- 172.21.15.7:0/1495422537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a2c0cb2b0 msgr2=0x7f9a2c158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.917+0000 7f9a310d7700 1 --2- 172.21.15.7:0/1495422537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a2c0cb2b0 0x7f9a2c158ea0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009f20 tx=0x7f9a24009840 comp rx=0 tx=0).stop 2023-10-06T11:00:47.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.918+0000 7f9a310d7700 1 -- 172.21.15.7:0/1495422537 shutdown_connections 2023-10-06T11:00:47.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.918+0000 7f9a310d7700 1 --2- 172.21.15.7:0/1495422537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a2c0cb2b0 0x7f9a2c158ea0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.918+0000 7f9a310d7700 1 --2- 172.21.15.7:0/1495422537 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a2c0cbf20 0x7f9a2c0c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.918+0000 7f9a310d7700 1 -- 172.21.15.7:0/1495422537 >> 172.21.15.7:0/1495422537 conn(0x7f9a2c0afc90 msgr2=0x7f9a2c0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:47.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.918+0000 7f9a310d7700 1 -- 172.21.15.7:0/1495422537 shutdown_connections 2023-10-06T11:00:47.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.918+0000 7f9a310d7700 1 -- 172.21.15.7:0/1495422537 wait complete. 2023-10-06T11:00:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.919+0000 7f9a310d7700 1 Processor -- start 2023-10-06T11:00:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.920+0000 7f9a310d7700 1 -- start start 2023-10-06T11:00:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.920+0000 7f9a310d7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a2c0cb2b0 0x7f9a2c16c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.920+0000 7f9a310d7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a2c0cbf20 0x7f9a2c16cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a310d7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a2c0cc2f0 0x7f9a2c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a310d7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c15fcf0 con 0x7f9a2c0cc2f0 2023-10-06T11:00:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a310d7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c16aaa0 con 0x7f9a2c0cb2b0 2023-10-06T11:00:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a310d7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c16a170 con 0x7f9a2c0cbf20 2023-10-06T11:00:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a2b59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a2c0cc2f0 0x7f9a2c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a2b59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a2c0cc2f0 0x7f9a2c15efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46190/0 (socket says 172.21.15.7:46190) 2023-10-06T11:00:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a2b59e700 1 -- 172.21.15.7:0/2811323442 learned_addr learned my addr 172.21.15.7:0/2811323442 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a2a59c700 1 --2- 172.21.15.7:0/2811323442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a2c0cbf20 0x7f9a2c16cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a2ad9d700 1 --2- 172.21.15.7:0/2811323442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a2c0cb2b0 0x7f9a2c16c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a2b59e700 1 -- 172.21.15.7:0/2811323442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a2c0cbf20 msgr2=0x7f9a2c16cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a2b59e700 1 --2- 172.21.15.7:0/2811323442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a2c0cbf20 0x7f9a2c16cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a2b59e700 1 -- 172.21.15.7:0/2811323442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a2c0cb2b0 msgr2=0x7f9a2c16c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:47.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a2b59e700 1 --2- 172.21.15.7:0/2811323442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a2c0cb2b0 0x7f9a2c16c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:47.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a2b59e700 1 -- 172.21.15.7:0/2811323442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a24009ae0 con 0x7f9a2c0cc2f0 2023-10-06T11:00:47.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a2b59e700 1 --2- 172.21.15.7:0/2811323442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a2c0cc2f0 0x7f9a2c15efa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400b610 tx=0x7f9a24018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:47.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a22ffd700 1 -- 172.21.15.7:0/2811323442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24008c30 con 0x7f9a2c0cc2f0 2023-10-06T11:00:47.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a22ffd700 1 -- 172.21.15.7:0/2811323442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a24008d90 con 0x7f9a2c0cc2f0 2023-10-06T11:00:47.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.921+0000 7f9a310d7700 1 -- 172.21.15.7:0/2811323442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c16a450 con 0x7f9a2c0cc2f0 2023-10-06T11:00:47.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.922+0000 7f9a22ffd700 1 -- 172.21.15.7:0/2811323442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24026690 con 0x7f9a2c0cc2f0 2023-10-06T11:00:47.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.922+0000 7f9a310d7700 1 -- 172.21.15.7:0/2811323442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c15f4e0 con 0x7f9a2c0cc2f0 2023-10-06T11:00:47.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.923+0000 7f9a310d7700 1 -- 172.21.15.7:0/2811323442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2c16ac10 con 0x7f9a2c0cc2f0 2023-10-06T11:00:47.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.923+0000 7f9a22ffd700 1 -- 172.21.15.7:0/2811323442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a24003040 con 0x7f9a2c0cc2f0 2023-10-06T11:00:47.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.924+0000 7f9a22ffd700 1 --2- 172.21.15.7:0/2811323442 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9a0c066f30 0x7f9a0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:47.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.924+0000 7f9a2ad9d700 1 --2- 172.21.15.7:0/2811323442 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9a0c066f30 0x7f9a0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:47.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.924+0000 7f9a22ffd700 1 -- 172.21.15.7:0/2811323442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f9a24086920 con 0x7f9a2c0cc2f0 2023-10-06T11:00:47.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.924+0000 7f9a2ad9d700 1 --2- 172.21.15.7:0/2811323442 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9a0c066f30 0x7f9a0c0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009d40 tx=0x7f9a1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:47.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:47.928+0000 7f9a22ffd700 1 -- 172.21.15.7:0/2811323442 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a24053760 con 0x7f9a2c0cc2f0 2023-10-06T11:00:48.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.132+0000 7f9a310d7700 1 -- 172.21.15.7:0/2811323442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f9a2c070480 con 0x7f9a2c0cc2f0 2023-10-06T11:00:48.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.132+0000 7f9a22ffd700 1 -- 172.21.15.7:0/2811323442 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v43) v1 ==== 97+0+11 (secure 0 0 0) 0x7f9a24056d80 con 0x7f9a2c0cc2f0 2023-10-06T11:00:48.134 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T11:00:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.135+0000 7f9a310d7700 1 -- 172.21.15.7:0/2811323442 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9a0c066f30 msgr2=0x7f9a0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.135+0000 7f9a310d7700 1 --2- 172.21.15.7:0/2811323442 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9a0c066f30 0x7f9a0c0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009d40 tx=0x7f9a1c008040 comp rx=0 tx=0).stop 2023-10-06T11:00:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.135+0000 7f9a310d7700 1 -- 172.21.15.7:0/2811323442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a2c0cc2f0 msgr2=0x7f9a2c15efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.135+0000 7f9a310d7700 1 --2- 172.21.15.7:0/2811323442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a2c0cc2f0 0x7f9a2c15efa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400b610 tx=0x7f9a24018000 comp rx=0 tx=0).stop 2023-10-06T11:00:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.135+0000 7f9a310d7700 1 -- 172.21.15.7:0/2811323442 shutdown_connections 2023-10-06T11:00:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.135+0000 7f9a310d7700 1 --2- 172.21.15.7:0/2811323442 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9a0c066f30 0x7f9a0c0693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.135+0000 7f9a310d7700 1 --2- 172.21.15.7:0/2811323442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a2c0cc2f0 0x7f9a2c15efa0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.135+0000 7f9a310d7700 1 --2- 172.21.15.7:0/2811323442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a2c0cb2b0 0x7f9a2c16c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.135+0000 7f9a310d7700 1 --2- 172.21.15.7:0/2811323442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a2c0cbf20 0x7f9a2c16cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.135+0000 7f9a310d7700 1 -- 172.21.15.7:0/2811323442 >> 172.21.15.7:0/2811323442 conn(0x7f9a2c0afc90 msgr2=0x7f9a2c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:48.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.135+0000 7f9a310d7700 1 -- 172.21.15.7:0/2811323442 shutdown_connections 2023-10-06T11:00:48.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.135+0000 7f9a310d7700 1 -- 172.21.15.7:0/2811323442 wait complete. 2023-10-06T11:00:48.150 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:00:48.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.280+0000 7fa7c167e700 1 Processor -- start 2023-10-06T11:00:48.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.280+0000 7fa7c167e700 1 -- start start 2023-10-06T11:00:48.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.281+0000 7fa7c167e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7bc0cfb50 0x7fa7bc068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:48.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.281+0000 7fa7c167e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc0cf6c0 con 0x7fa7bc069420 2023-10-06T11:00:48.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.281+0000 7fa7c167e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc069860 con 0x7fa7bc0af320 2023-10-06T11:00:48.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.281+0000 7fa7c167e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7bc159c00 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.281+0000 7fa7bb7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa7bc069420 0x7fa7bc0afc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44662/0 (socket says 172.21.15.7:44662) 2023-10-06T11:00:48.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.281+0000 7fa7bb7fe700 1 -- 172.21.15.7:0/3822203732 learned_addr learned my addr 172.21.15.7:0/3822203732 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.281+0000 7fa7ba7fc700 1 --2- 172.21.15.7:0/3822203732 >> v2:172.21.15.50:3300/0 conn(0x7fa7bc0cfb50 0x7fa7bc068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.281+0000 7fa7b9ffb700 1 -- 172.21.15.7:0/3822203732 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825354826 0 0) 0x7fa7bc0cf6c0 con 0x7fa7bc069420 2023-10-06T11:00:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.281+0000 7fa7b9ffb700 1 -- 172.21.15.7:0/3822203732 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7a4003570 con 0x7fa7bc069420 2023-10-06T11:00:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.281+0000 7fa7ba7fc700 1 -- 172.21.15.7:0/3822203732 >> v1:172.21.15.50:6789/0 conn(0x7fa7bc0af320 legacy=0x7fa7bc0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.281+0000 7fa7ba7fc700 1 -- 172.21.15.7:0/3822203732 >> v1:172.21.15.7:6789/0 conn(0x7fa7bc069420 legacy=0x7fa7bc0afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.281+0000 7fa7ba7fc700 1 -- 172.21.15.7:0/3822203732 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0cb750 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.282+0000 7fa7ba7fc700 1 --2- 172.21.15.7:0/3822203732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7bc0cfb50 0x7fa7bc068ee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00098e0 tx=0x7fa7b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98e35efb0b564dec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.282+0000 7fa7b9ffb700 1 -- 172.21.15.7:0/3822203732 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000b6d0 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.282+0000 7fa7b9ffb700 1 -- 172.21.15.7:0/3822203732 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b000b830 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.282+0000 7fa7b9ffb700 1 -- 172.21.15.7:0/3822203732 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000bbd0 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.282+0000 7fa7c167e700 1 -- 172.21.15.7:0/3822203732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7bc0cfb50 msgr2=0x7fa7bc068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.282+0000 7fa7c167e700 1 --2- 172.21.15.7:0/3822203732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7bc0cfb50 0x7fa7bc068ee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00098e0 tx=0x7fa7b00091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.282+0000 7fa7c167e700 1 -- 172.21.15.7:0/3822203732 shutdown_connections 2023-10-06T11:00:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.282+0000 7fa7c167e700 1 --2- 172.21.15.7:0/3822203732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7bc0cfb50 0x7fa7bc068ee0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.282+0000 7fa7c167e700 1 -- 172.21.15.7:0/3822203732 >> 172.21.15.7:0/3822203732 conn(0x7fa7bc067b80 msgr2=0x7fa7bc0d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.282+0000 7fa7c167e700 1 -- 172.21.15.7:0/3822203732 shutdown_connections 2023-10-06T11:00:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.282+0000 7fa7c167e700 1 -- 172.21.15.7:0/3822203732 wait complete. 2023-10-06T11:00:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.284+0000 7fa7c167e700 1 Processor -- start 2023-10-06T11:00:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.284+0000 7fa7c167e700 1 -- start start 2023-10-06T11:00:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7c167e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa7bc069420 0x7fa7bc0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7c167e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7bc0af320 0x7fa7bc0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7c167e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7bc0cfb50 0x7fa7bc14f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:48.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7c167e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0b2800 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7c167e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0b1820 con 0x7fa7bc0af320 2023-10-06T11:00:48.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7c167e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0b1b00 con 0x7fa7bc069420 2023-10-06T11:00:48.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7bb7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7bc0cfb50 0x7fa7bc14f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:48.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7bb7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7bc0cfb50 0x7fa7bc14f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46206/0 (socket says 172.21.15.7:46206) 2023-10-06T11:00:48.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7bb7fe700 1 -- 172.21.15.7:0/2432271463 learned_addr learned my addr 172.21.15.7:0/2432271463 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:48.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7baffd700 1 --2- 172.21.15.7:0/2432271463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa7bc069420 0x7fa7bc0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:48.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7ba7fc700 1 --2- 172.21.15.7:0/2432271463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7bc0af320 0x7fa7bc0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:48.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7bb7fe700 1 -- 172.21.15.7:0/2432271463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa7bc069420 msgr2=0x7fa7bc0b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:48.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7bb7fe700 1 --2- 172.21.15.7:0/2432271463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa7bc069420 0x7fa7bc0b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7bb7fe700 1 -- 172.21.15.7:0/2432271463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7bc0af320 msgr2=0x7fa7bc0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7bb7fe700 1 --2- 172.21.15.7:0/2432271463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7bc0af320 0x7fa7bc0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7bb7fe700 1 -- 172.21.15.7:0/2432271463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b0009420 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7bb7fe700 1 --2- 172.21.15.7:0/2432271463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7bc0cfb50 0x7fa7bc14f680 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4001460 tx=0x7fa7b4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7a2ffd700 1 -- 172.21.15.7:0/2432271463 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400a890 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7a2ffd700 1 -- 172.21.15.7:0/2432271463 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b400a9f0 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7c167e700 1 -- 172.21.15.7:0/2432271463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7bc0c7840 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.285+0000 7fa7a2ffd700 1 -- 172.21.15.7:0/2432271463 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400ad70 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.286+0000 7fa7c167e700 1 -- 172.21.15.7:0/2432271463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc0c7530 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.287+0000 7fa7c167e700 1 -- 172.21.15.7:0/2432271463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7bc0b1cc0 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.287+0000 7fa7a2ffd700 1 -- 172.21.15.7:0/2432271463 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7b4007300 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.287+0000 7fa7a2ffd700 1 --2- 172.21.15.7:0/2432271463 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa7a8066f30 0x7fa7a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.287+0000 7fa7a2ffd700 1 -- 172.21.15.7:0/2432271463 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7fa7b4084d80 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.287+0000 7fa7baffd700 1 --2- 172.21.15.7:0/2432271463 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa7a8066f30 0x7fa7a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.288+0000 7fa7baffd700 1 --2- 172.21.15.7:0/2432271463 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa7a8066f30 0x7fa7a80693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac003a80 tx=0x7fa7ac007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:48.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.292+0000 7fa7a2ffd700 1 -- 172.21.15.7:0/2432271463 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7bc0b1cc0 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.542+0000 7fa7c167e700 1 -- 172.21.15.7:0/2432271463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7bc0b1cc0 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.543+0000 7fa7a2ffd700 1 -- 172.21.15.7:0/2432271463 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4587 (secure 0 0 0) 0x7fa7bc0b1cc0 con 0x7fa7bc0cfb50 2023-10-06T11:00:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:48.545 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/904048408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":904048408},{"type":"v1","addr":"172.21.15.50:6834","nonce":904048408}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5062,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/949655295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":949655295},{"type":"v1","addr":"172.21.15.50:6835","nonce":949655295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1576009113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1576009113},{"type":"v1","addr":"172.21.15.7:6835","nonce":1576009113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:00:21.179899+0000","modified":"2023-10-06T11:00:32.049499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5130":{"gid":5130,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1573170028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1573170028},{"type":"v1","addr":"172.21.15.7:6837","nonce":1573170028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:00:48.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.545+0000 7fa7c167e700 1 -- 172.21.15.7:0/2432271463 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa7a8066f30 msgr2=0x7fa7a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:48.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.545+0000 7fa7c167e700 1 --2- 172.21.15.7:0/2432271463 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa7a8066f30 0x7fa7a80693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac003a80 tx=0x7fa7ac007ec0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.545+0000 7fa7c167e700 1 -- 172.21.15.7:0/2432271463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7bc0cfb50 msgr2=0x7fa7bc14f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:48.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.545+0000 7fa7c167e700 1 --2- 172.21.15.7:0/2432271463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7bc0cfb50 0x7fa7bc14f680 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4001460 tx=0x7fa7b4001ae0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.545+0000 7fa7c167e700 1 -- 172.21.15.7:0/2432271463 shutdown_connections 2023-10-06T11:00:48.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.545+0000 7fa7c167e700 1 --2- 172.21.15.7:0/2432271463 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa7a8066f30 0x7fa7a80693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.545+0000 7fa7c167e700 1 --2- 172.21.15.7:0/2432271463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7bc0cfb50 0x7fa7bc14f680 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.545+0000 7fa7c167e700 1 --2- 172.21.15.7:0/2432271463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa7bc069420 0x7fa7bc0b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.545+0000 7fa7c167e700 1 --2- 172.21.15.7:0/2432271463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7bc0af320 0x7fa7bc0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.545+0000 7fa7c167e700 1 -- 172.21.15.7:0/2432271463 >> 172.21.15.7:0/2432271463 conn(0x7fa7bc067b80 msgr2=0x7fa7bc150d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:48.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.545+0000 7fa7c167e700 1 -- 172.21.15.7:0/2432271463 shutdown_connections 2023-10-06T11:00:48.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.545+0000 7fa7c167e700 1 -- 172.21.15.7:0/2432271463 wait complete. 2023-10-06T11:00:48.548 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 20 2023-10-06T11:00:48.560 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:00:48.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.691+0000 7f0bfd7af700 1 Processor -- start 2023-10-06T11:00:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.692+0000 7f0bfd7af700 1 -- start start 2023-10-06T11:00:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.692+0000 7f0bfd7af700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0bf80af320 0x7f0bf80cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.692+0000 7f0bfd7af700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0bf80695f0 0x7f0bf80afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.692+0000 7f0bfd7af700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf80cf6c0 con 0x7f0bf80cb580 2023-10-06T11:00:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.692+0000 7f0bfd7af700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf8159c00 con 0x7f0bf80695f0 2023-10-06T11:00:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.692+0000 7f0bfd7af700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80ceab0 con 0x7f0bf80af320 2023-10-06T11:00:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.693+0000 7f0bf77fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0bf80695f0 0x7f0bf80afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.693+0000 7f0bf77fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0bf80695f0 0x7f0bf80afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46212/0 (socket says 172.21.15.7:46212) 2023-10-06T11:00:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.693+0000 7f0bf77fe700 1 -- 172.21.15.7:0/3884081617 learned_addr learned my addr 172.21.15.7:0/3884081617 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.693+0000 7f0bf6ffd700 1 --2- 172.21.15.7:0/3884081617 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0bf80af320 0x7f0bf80cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.693+0000 7f0bf77fe700 1 -- 172.21.15.7:0/3884081617 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0bf80af320 msgr2=0x7f0bf80cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.693+0000 7f0bf77fe700 1 --2- 172.21.15.7:0/3884081617 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0bf80af320 0x7f0bf80cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.693+0000 7f0bf77fe700 1 -- 172.21.15.7:0/3884081617 >> v1:172.21.15.50:6789/0 conn(0x7f0bf80cb580 legacy=0x7f0bf8068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.693+0000 7f0bf77fe700 1 -- 172.21.15.7:0/3884081617 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf80ced90 con 0x7f0bf80695f0 2023-10-06T11:00:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.693+0000 7f0bf77fe700 1 --2- 172.21.15.7:0/3884081617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bf80695f0 0x7f0bf80afc90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0009f20 tx=0x7f0bf0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734e24ef517efa40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.693+0000 7f0bf67fc700 1 -- 172.21.15.7:0/3884081617 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000e070 con 0x7f0bf80695f0 2023-10-06T11:00:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.693+0000 7f0bf67fc700 1 -- 172.21.15.7:0/3884081617 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000bad0 con 0x7f0bf80695f0 2023-10-06T11:00:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.693+0000 7f0bf67fc700 1 -- 172.21.15.7:0/3884081617 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf00092e0 con 0x7f0bf80695f0 2023-10-06T11:00:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.694+0000 7f0bfd7af700 1 -- 172.21.15.7:0/3884081617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bf80695f0 msgr2=0x7f0bf80afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.694+0000 7f0bfd7af700 1 --2- 172.21.15.7:0/3884081617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bf80695f0 0x7f0bf80afc90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0009f20 tx=0x7f0bf0009840 comp rx=0 tx=0).stop 2023-10-06T11:00:48.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.694+0000 7f0bfd7af700 1 -- 172.21.15.7:0/3884081617 shutdown_connections 2023-10-06T11:00:48.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.694+0000 7f0bfd7af700 1 --2- 172.21.15.7:0/3884081617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bf80695f0 0x7f0bf80afc90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.694+0000 7f0bfd7af700 1 --2- 172.21.15.7:0/3884081617 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0bf80af320 0x7f0bf80cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.694+0000 7f0bfd7af700 1 -- 172.21.15.7:0/3884081617 >> 172.21.15.7:0/3884081617 conn(0x7f0bf8067b80 msgr2=0x7f0bf80d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:48.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.694+0000 7f0bfd7af700 1 -- 172.21.15.7:0/3884081617 shutdown_connections 2023-10-06T11:00:48.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.694+0000 7f0bfd7af700 1 -- 172.21.15.7:0/3884081617 wait complete. 2023-10-06T11:00:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.695+0000 7f0bfd7af700 1 Processor -- start 2023-10-06T11:00:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.695+0000 7f0bfd7af700 1 -- start start 2023-10-06T11:00:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.696+0000 7f0bfd7af700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bf80695f0 0x7f0bf81550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.696+0000 7f0bfd7af700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bf80af320 0x7f0bf8158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.696+0000 7f0bfd7af700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0bf80cb580 0x7f0bf815b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.696+0000 7f0bfd7af700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf815a7d0 con 0x7f0bf80695f0 2023-10-06T11:00:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.696+0000 7f0bfd7af700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf815aab0 con 0x7f0bf80af320 2023-10-06T11:00:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.696+0000 7f0bfd7af700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf815ad90 con 0x7f0bf80cb580 2023-10-06T11:00:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.696+0000 7f0bf6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bf80695f0 0x7f0bf81550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.696+0000 7f0bf6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bf80695f0 0x7f0bf81550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46220/0 (socket says 172.21.15.7:46220) 2023-10-06T11:00:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.696+0000 7f0bf6ffd700 1 -- 172.21.15.7:0/1192724216 learned_addr learned my addr 172.21.15.7:0/1192724216 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.697+0000 7f0bf77fe700 1 --2- 172.21.15.7:0/1192724216 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0bf80cb580 0x7f0bf815b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.697+0000 7f0bee7fc700 1 --2- 172.21.15.7:0/1192724216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bf80af320 0x7f0bf8158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.697+0000 7f0bf6ffd700 1 -- 172.21.15.7:0/1192724216 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0bf80cb580 msgr2=0x7f0bf815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.697+0000 7f0bf6ffd700 1 --2- 172.21.15.7:0/1192724216 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0bf80cb580 0x7f0bf815b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.697+0000 7f0bf6ffd700 1 -- 172.21.15.7:0/1192724216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bf80af320 msgr2=0x7f0bf8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.697+0000 7f0bf6ffd700 1 --2- 172.21.15.7:0/1192724216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bf80af320 0x7f0bf8158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.697+0000 7f0bf6ffd700 1 -- 172.21.15.7:0/1192724216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf0009ae0 con 0x7f0bf80695f0 2023-10-06T11:00:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.697+0000 7f0bf6ffd700 1 --2- 172.21.15.7:0/1192724216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bf80695f0 0x7f0bf81550a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0be800c7d0 tx=0x7f0be8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.697+0000 7f0bef7fe700 1 -- 172.21.15.7:0/1192724216 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8011600 con 0x7f0bf80695f0 2023-10-06T11:00:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.697+0000 7f0bef7fe700 1 -- 172.21.15.7:0/1192724216 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be8011760 con 0x7f0bf80695f0 2023-10-06T11:00:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.697+0000 7f0bef7fe700 1 -- 172.21.15.7:0/1192724216 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8011b20 con 0x7f0bf80695f0 2023-10-06T11:00:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.697+0000 7f0bfd7af700 1 -- 172.21.15.7:0/1192724216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf815b070 con 0x7f0bf80695f0 2023-10-06T11:00:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.697+0000 7f0bfd7af700 1 -- 172.21.15.7:0/1192724216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf81555e0 con 0x7f0bf80695f0 2023-10-06T11:00:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.698+0000 7f0bfd7af700 1 -- 172.21.15.7:0/1192724216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf8070480 con 0x7f0bf80695f0 2023-10-06T11:00:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.699+0000 7f0bef7fe700 1 -- 172.21.15.7:0/1192724216 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0be80193f0 con 0x7f0bf80695f0 2023-10-06T11:00:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.699+0000 7f0bef7fe700 1 --2- 172.21.15.7:0/1192724216 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0bd8066f60 0x7f0bd8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.699+0000 7f0bef7fe700 1 -- 172.21.15.7:0/1192724216 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f0be8084d10 con 0x7f0bf80695f0 2023-10-06T11:00:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.699+0000 7f0bee7fc700 1 --2- 172.21.15.7:0/1192724216 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0bd8066f60 0x7f0bd8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:48.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.700+0000 7f0bee7fc700 1 --2- 172.21.15.7:0/1192724216 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0bd8066f60 0x7f0bd8069410 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0be000a8a0 tx=0x7f0be0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:48.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.704+0000 7f0bef7fe700 1 -- 172.21.15.7:0/1192724216 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0be8051b50 con 0x7f0bf80695f0 2023-10-06T11:00:48.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.911+0000 7f0bfd7af700 1 -- 172.21.15.7:0/1192724216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bf80cf070 con 0x7f0bf80695f0 2023-10-06T11:00:48.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.912+0000 7f0bef7fe700 1 -- 172.21.15.7:0/1192724216 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18630 (secure 0 0 0) 0x7f0be8055170 con 0x7f0bf80695f0 2023-10-06T11:00:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:48.914 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":43,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:00:33.060575+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:00:18.763171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T11:00:20.149563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":8,"pool_name":"data_new","create_time":"2023-10-06T11:00:30.330717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:00:48.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.915+0000 7f0bfd7af700 1 -- 172.21.15.7:0/1192724216 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0bd8066f60 msgr2=0x7f0bd8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.915+0000 7f0bfd7af700 1 --2- 172.21.15.7:0/1192724216 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0bd8066f60 0x7f0bd8069410 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0be000a8a0 tx=0x7f0be0008040 comp rx=0 tx=0).stop 2023-10-06T11:00:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.915+0000 7f0bfd7af700 1 -- 172.21.15.7:0/1192724216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bf80695f0 msgr2=0x7f0bf81550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.915+0000 7f0bfd7af700 1 --2- 172.21.15.7:0/1192724216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bf80695f0 0x7f0bf81550a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0be800c7d0 tx=0x7f0be8008040 comp rx=0 tx=0).stop 2023-10-06T11:00:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.915+0000 7f0bfd7af700 1 -- 172.21.15.7:0/1192724216 shutdown_connections 2023-10-06T11:00:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.915+0000 7f0bfd7af700 1 --2- 172.21.15.7:0/1192724216 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0bd8066f60 0x7f0bd8069410 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.915+0000 7f0bfd7af700 1 --2- 172.21.15.7:0/1192724216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bf80695f0 0x7f0bf81550a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.915+0000 7f0bfd7af700 1 --2- 172.21.15.7:0/1192724216 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0bf80cb580 0x7f0bf815b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.915+0000 7f0bfd7af700 1 --2- 172.21.15.7:0/1192724216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bf80af320 0x7f0bf8158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.915+0000 7f0bfd7af700 1 -- 172.21.15.7:0/1192724216 >> 172.21.15.7:0/1192724216 conn(0x7f0bf8067b80 msgr2=0x7f0bf80b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.915+0000 7f0bfd7af700 1 -- 172.21.15.7:0/1192724216 shutdown_connections 2023-10-06T11:00:48.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:48.915+0000 7f0bfd7af700 1 -- 172.21.15.7:0/1192724216 wait complete. 2023-10-06T11:00:48.930 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:00:48.930 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:00:49.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.060+0000 7ffbe0097700 1 Processor -- start 2023-10-06T11:00:49.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.060+0000 7ffbe0097700 1 -- start start 2023-10-06T11:00:49.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.061+0000 7ffbe0097700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffbd8159240 0x7ffbd815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.061+0000 7ffbe0097700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbd815ced0 0x7ffbd815d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.061+0000 7ffbe0097700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd815b210 con 0x7ffbd80cc8e0 2023-10-06T11:00:49.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.061+0000 7ffbe0097700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd8068a90 con 0x7ffbd8159240 2023-10-06T11:00:49.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.061+0000 7ffbe0097700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80698b0 con 0x7ffbd815ced0 2023-10-06T11:00:49.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.062+0000 7ffbdd632700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbd815ced0 0x7ffbd815d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.062+0000 7ffbdde33700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffbd8159240 0x7ffbd815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.062+0000 7ffbde634700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffbd80cc8e0 0x7ffbd80ccd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:43544/0 (socket says 172.21.15.7:43544) 2023-10-06T11:00:49.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.062+0000 7ffbdd632700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbd815ced0 0x7ffbd815d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:56872/0 (socket says 172.21.15.7:56872) 2023-10-06T11:00:49.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.062+0000 7ffbde634700 1 -- 172.21.15.7:0/3271929078 learned_addr learned my addr 172.21.15.7:0/3271929078 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:49.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.062+0000 7ffbdd632700 1 -- 172.21.15.7:0/3271929078 >> v2:172.21.15.50:3300/0 conn(0x7ffbd8159240 msgr2=0x7ffbd815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:49.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.062+0000 7ffbdd632700 1 --2- 172.21.15.7:0/3271929078 >> v2:172.21.15.50:3300/0 conn(0x7ffbd8159240 0x7ffbd815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.062+0000 7ffbdd632700 1 -- 172.21.15.7:0/3271929078 >> v1:172.21.15.50:6789/0 conn(0x7ffbd80cc8e0 legacy=0x7ffbd80ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.062+0000 7ffbdd632700 1 -- 172.21.15.7:0/3271929078 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd815d880 con 0x7ffbd815ced0 2023-10-06T11:00:49.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.062+0000 7ffbdde33700 1 --2- 172.21.15.7:0/3271929078 >> v2:172.21.15.50:3300/0 conn(0x7ffbd8159240 0x7ffbd815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:49.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.062+0000 7ffbdd632700 1 --2- 172.21.15.7:0/3271929078 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbd815ced0 0x7ffbd815d340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80098e0 tx=0x7ffbc80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=115084c435370011 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:49.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.062+0000 7ffbdce31700 1 -- 172.21.15.7:0/3271929078 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800b640 con 0x7ffbd815ced0 2023-10-06T11:00:49.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.063+0000 7ffbdce31700 1 -- 172.21.15.7:0/3271929078 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc800b7a0 con 0x7ffbd815ced0 2023-10-06T11:00:49.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.063+0000 7ffbdce31700 1 -- 172.21.15.7:0/3271929078 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800bb40 con 0x7ffbd815ced0 2023-10-06T11:00:49.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.063+0000 7ffbe0097700 1 -- 172.21.15.7:0/3271929078 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbd815ced0 msgr2=0x7ffbd815d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.063+0000 7ffbe0097700 1 --2- 172.21.15.7:0/3271929078 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbd815ced0 0x7ffbd815d340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80098e0 tx=0x7ffbc80091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.063+0000 7ffbe0097700 1 -- 172.21.15.7:0/3271929078 shutdown_connections 2023-10-06T11:00:49.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.063+0000 7ffbe0097700 1 --2- 172.21.15.7:0/3271929078 >> v2:172.21.15.50:3300/0 conn(0x7ffbd8159240 0x7ffbd815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.063+0000 7ffbe0097700 1 --2- 172.21.15.7:0/3271929078 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbd815ced0 0x7ffbd815d340 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.063+0000 7ffbe0097700 1 -- 172.21.15.7:0/3271929078 >> 172.21.15.7:0/3271929078 conn(0x7ffbd8087920 msgr2=0x7ffbd8097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:49.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.063+0000 7ffbe0097700 1 -- 172.21.15.7:0/3271929078 shutdown_connections 2023-10-06T11:00:49.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.063+0000 7ffbe0097700 1 -- 172.21.15.7:0/3271929078 wait complete. 2023-10-06T11:00:49.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.064+0000 7ffbe0097700 1 Processor -- start 2023-10-06T11:00:49.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.064+0000 7ffbe0097700 1 -- start start 2023-10-06T11:00:49.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.065+0000 7ffbe0097700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbd80cc8e0 0x7ffbd80c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.065+0000 7ffbe0097700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbd8159240 0x7ffbd8157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.065+0000 7ffbe0097700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd815ced0 0x7ffbd81582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.065+0000 7ffbe0097700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd816dc30 con 0x7ffbd815ced0 2023-10-06T11:00:49.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.065+0000 7ffbe0097700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd816d320 con 0x7ffbd8159240 2023-10-06T11:00:49.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.065+0000 7ffbe0097700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd816ab30 con 0x7ffbd80cc8e0 2023-10-06T11:00:49.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.065+0000 7ffbde634700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd815ced0 0x7ffbd81582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.065+0000 7ffbde634700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd815ced0 0x7ffbd81582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46228/0 (socket says 172.21.15.7:46228) 2023-10-06T11:00:49.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.065+0000 7ffbde634700 1 -- 172.21.15.7:0/4111726895 learned_addr learned my addr 172.21.15.7:0/4111726895 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:49.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.065+0000 7ffbdde33700 1 --2- 172.21.15.7:0/4111726895 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbd80cc8e0 0x7ffbd80c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.065+0000 7ffbdd632700 1 --2- 172.21.15.7:0/4111726895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbd8159240 0x7ffbd8157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.066+0000 7ffbde634700 1 -- 172.21.15.7:0/4111726895 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbd80cc8e0 msgr2=0x7ffbd80c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.066+0000 7ffbde634700 1 --2- 172.21.15.7:0/4111726895 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbd80cc8e0 0x7ffbd80c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.066+0000 7ffbde634700 1 -- 172.21.15.7:0/4111726895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbd8159240 msgr2=0x7ffbd8157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.066+0000 7ffbde634700 1 --2- 172.21.15.7:0/4111726895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbd8159240 0x7ffbd8157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.066+0000 7ffbde634700 1 -- 172.21.15.7:0/4111726895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd40093c0 con 0x7ffbd815ced0 2023-10-06T11:00:49.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.066+0000 7ffbde634700 1 --2- 172.21.15.7:0/4111726895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd815ced0 0x7ffbd81582c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000cbc0 tx=0x7ffbd00019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:49.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.066+0000 7ffbcdffb700 1 -- 172.21.15.7:0/4111726895 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd000a7e0 con 0x7ffbd815ced0 2023-10-06T11:00:49.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.066+0000 7ffbcdffb700 1 -- 172.21.15.7:0/4111726895 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd000a940 con 0x7ffbd815ced0 2023-10-06T11:00:49.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.066+0000 7ffbe0097700 1 -- 172.21.15.7:0/4111726895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc8009420 con 0x7ffbd815ced0 2023-10-06T11:00:49.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.066+0000 7ffbcdffb700 1 -- 172.21.15.7:0/4111726895 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd000acc0 con 0x7ffbd815ced0 2023-10-06T11:00:49.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.066+0000 7ffbe0097700 1 -- 172.21.15.7:0/4111726895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd816d8c0 con 0x7ffbd815ced0 2023-10-06T11:00:49.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.068+0000 7ffbe0097700 1 -- 172.21.15.7:0/4111726895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd816dde0 con 0x7ffbd815ced0 2023-10-06T11:00:49.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.068+0000 7ffbcdffb700 1 -- 172.21.15.7:0/4111726895 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffbd0007300 con 0x7ffbd815ced0 2023-10-06T11:00:49.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.068+0000 7ffbcdffb700 1 --2- 172.21.15.7:0/4111726895 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ffbbc066f30 0x7ffbbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.069+0000 7ffbdde33700 1 --2- 172.21.15.7:0/4111726895 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ffbbc066f30 0x7ffbbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.069+0000 7ffbcdffb700 1 -- 172.21.15.7:0/4111726895 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7ffbd0084c30 con 0x7ffbd815ced0 2023-10-06T11:00:49.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.069+0000 7ffbdde33700 1 --2- 172.21.15.7:0/4111726895 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ffbbc066f30 0x7ffbbc0693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8063a50 tx=0x7ffbd4009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:49.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.073+0000 7ffbcdffb700 1 -- 172.21.15.7:0/4111726895 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffbd816dde0 con 0x7ffbd815ced0 2023-10-06T11:00:49.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.322+0000 7ffbe0097700 1 -- 172.21.15.7:0/4111726895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbd8070480 con 0x7ffbd815ced0 2023-10-06T11:00:49.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.323+0000 7ffbcdffb700 1 -- 172.21.15.7:0/4111726895 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4587 (secure 0 0 0) 0x7ffbd00519e0 con 0x7ffbd815ced0 2023-10-06T11:00:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:49.325 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/904048408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":904048408},{"type":"v1","addr":"172.21.15.50:6834","nonce":904048408}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5062,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/949655295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":949655295},{"type":"v1","addr":"172.21.15.50:6835","nonce":949655295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1576009113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1576009113},{"type":"v1","addr":"172.21.15.7:6835","nonce":1576009113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:00:21.179899+0000","modified":"2023-10-06T11:00:32.049499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5130":{"gid":5130,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1573170028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1573170028},{"type":"v1","addr":"172.21.15.7:6837","nonce":1573170028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:00:49.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.325+0000 7ffbe0097700 1 -- 172.21.15.7:0/4111726895 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ffbbc066f30 msgr2=0x7ffbbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.325+0000 7ffbe0097700 1 --2- 172.21.15.7:0/4111726895 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ffbbc066f30 0x7ffbbc0693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8063a50 tx=0x7ffbd4009120 comp rx=0 tx=0).stop 2023-10-06T11:00:49.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.325+0000 7ffbe0097700 1 -- 172.21.15.7:0/4111726895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd815ced0 msgr2=0x7ffbd81582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.325+0000 7ffbe0097700 1 --2- 172.21.15.7:0/4111726895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd815ced0 0x7ffbd81582c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000cbc0 tx=0x7ffbd00019c0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.325+0000 7ffbe0097700 1 -- 172.21.15.7:0/4111726895 shutdown_connections 2023-10-06T11:00:49.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.325+0000 7ffbe0097700 1 --2- 172.21.15.7:0/4111726895 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ffbbc066f30 0x7ffbbc0693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.325+0000 7ffbe0097700 1 --2- 172.21.15.7:0/4111726895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd815ced0 0x7ffbd81582c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.325+0000 7ffbe0097700 1 --2- 172.21.15.7:0/4111726895 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbd80cc8e0 0x7ffbd80c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.325+0000 7ffbe0097700 1 --2- 172.21.15.7:0/4111726895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbd8159240 0x7ffbd8157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.325+0000 7ffbe0097700 1 -- 172.21.15.7:0/4111726895 >> 172.21.15.7:0/4111726895 conn(0x7ffbd8087920 msgr2=0x7ffbd8156080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:49.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.325+0000 7ffbe0097700 1 -- 172.21.15.7:0/4111726895 shutdown_connections 2023-10-06T11:00:49.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.325+0000 7ffbe0097700 1 -- 172.21.15.7:0/4111726895 wait complete. 2023-10-06T11:00:49.328 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 20 2023-10-06T11:00:49.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:00:49.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.471+0000 7f6a676fe700 1 Processor -- start 2023-10-06T11:00:49.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.471+0000 7f6a676fe700 1 -- start start 2023-10-06T11:00:49.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a676fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a6015d5e0 0x7f6a6015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a676fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a600cc8e0 0x7f6a600ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a676fe700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6015b210 con 0x7f6a60159240 2023-10-06T11:00:49.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a676fe700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a60068a90 con 0x7f6a6015d5e0 2023-10-06T11:00:49.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a676fe700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600698b0 con 0x7f6a600cc8e0 2023-10-06T11:00:49.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a64c99700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a6015d5e0 0x7f6a6015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a6549a700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6a60159240 0x7f6a6015ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44664/0 (socket says 172.21.15.7:44664) 2023-10-06T11:00:49.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a6549a700 1 -- 172.21.15.7:0/66979354 learned_addr learned my addr 172.21.15.7:0/66979354 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:49.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a65c9b700 1 --2- 172.21.15.7:0/66979354 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a600cc8e0 0x7f6a600ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a57fff700 1 -- 172.21.15.7:0/66979354 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846773406 0 0) 0x7f6a6015b210 con 0x7f6a60159240 2023-10-06T11:00:49.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a57fff700 1 -- 172.21.15.7:0/66979354 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a4c003570 con 0x7f6a60159240 2023-10-06T11:00:49.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a64c99700 1 -- 172.21.15.7:0/66979354 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a600cc8e0 msgr2=0x7f6a600ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:49.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a64c99700 1 --2- 172.21.15.7:0/66979354 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a600cc8e0 0x7f6a600ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a64c99700 1 -- 172.21.15.7:0/66979354 >> v1:172.21.15.7:6789/0 conn(0x7f6a60159240 legacy=0x7f6a6015ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.472+0000 7f6a64c99700 1 -- 172.21.15.7:0/66979354 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a600cd280 con 0x7f6a6015d5e0 2023-10-06T11:00:49.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.473+0000 7f6a64c99700 1 --2- 172.21.15.7:0/66979354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a6015d5e0 0x7f6a6015acd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6a500098e0 tx=0x7f6a500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182efb7808437325 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.473+0000 7f6a57fff700 1 -- 172.21.15.7:0/66979354 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000b640 con 0x7f6a6015d5e0 2023-10-06T11:00:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.473+0000 7f6a57fff700 1 -- 172.21.15.7:0/66979354 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5000b7a0 con 0x7f6a6015d5e0 2023-10-06T11:00:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.473+0000 7f6a57fff700 1 -- 172.21.15.7:0/66979354 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000bb40 con 0x7f6a6015d5e0 2023-10-06T11:00:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.473+0000 7f6a676fe700 1 -- 172.21.15.7:0/66979354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a6015d5e0 msgr2=0x7f6a6015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.473+0000 7f6a676fe700 1 --2- 172.21.15.7:0/66979354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a6015d5e0 0x7f6a6015acd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6a500098e0 tx=0x7f6a500091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.473+0000 7f6a676fe700 1 -- 172.21.15.7:0/66979354 shutdown_connections 2023-10-06T11:00:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.473+0000 7f6a676fe700 1 --2- 172.21.15.7:0/66979354 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a600cc8e0 0x7f6a600ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.473+0000 7f6a676fe700 1 --2- 172.21.15.7:0/66979354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a6015d5e0 0x7f6a6015acd0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.473+0000 7f6a676fe700 1 -- 172.21.15.7:0/66979354 >> 172.21.15.7:0/66979354 conn(0x7f6a60087920 msgr2=0x7f6a60097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.473+0000 7f6a676fe700 1 -- 172.21.15.7:0/66979354 shutdown_connections 2023-10-06T11:00:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.473+0000 7f6a676fe700 1 -- 172.21.15.7:0/66979354 wait complete. 2023-10-06T11:00:49.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.475+0000 7f6a676fe700 1 Processor -- start 2023-10-06T11:00:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.475+0000 7f6a676fe700 1 -- start start 2023-10-06T11:00:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a676fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a600cc8e0 0x7f6a60157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a676fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a60159240 0x7f6a60158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a676fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a6015d5e0 0x7f6a60169af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a676fe700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600b3690 con 0x7f6a6015d5e0 2023-10-06T11:00:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a676fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600b3b20 con 0x7f6a60159240 2023-10-06T11:00:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a676fe700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600b2a80 con 0x7f6a600cc8e0 2023-10-06T11:00:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a65c9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a6015d5e0 0x7f6a60169af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a65c9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a6015d5e0 0x7f6a60169af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46244/0 (socket says 172.21.15.7:46244) 2023-10-06T11:00:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a65c9b700 1 -- 172.21.15.7:0/2571887207 learned_addr learned my addr 172.21.15.7:0/2571887207 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a6549a700 1 --2- 172.21.15.7:0/2571887207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a600cc8e0 0x7f6a60157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a64c99700 1 --2- 172.21.15.7:0/2571887207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a60159240 0x7f6a60158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a65c9b700 1 -- 172.21.15.7:0/2571887207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a600cc8e0 msgr2=0x7f6a60157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a65c9b700 1 --2- 172.21.15.7:0/2571887207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a600cc8e0 0x7f6a60157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a65c9b700 1 -- 172.21.15.7:0/2571887207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a60159240 msgr2=0x7f6a60158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a65c9b700 1 --2- 172.21.15.7:0/2571887207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a60159240 0x7f6a60158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a65c9b700 1 -- 172.21.15.7:0/2571887207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a50009420 con 0x7f6a6015d5e0 2023-10-06T11:00:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a65c9b700 1 --2- 172.21.15.7:0/2571887207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a6015d5e0 0x7f6a60169af0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009fa0 tx=0x7f6a58009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.476+0000 7f6a557fa700 1 -- 172.21.15.7:0/2571887207 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800ebc0 con 0x7f6a6015d5e0 2023-10-06T11:00:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.477+0000 7f6a557fa700 1 -- 172.21.15.7:0/2571887207 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5800ed20 con 0x7f6a6015d5e0 2023-10-06T11:00:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.477+0000 7f6a676fe700 1 -- 172.21.15.7:0/2571887207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a600b2d60 con 0x7f6a6015d5e0 2023-10-06T11:00:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.477+0000 7f6a557fa700 1 -- 172.21.15.7:0/2571887207 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58014670 con 0x7f6a6015d5e0 2023-10-06T11:00:49.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.477+0000 7f6a676fe700 1 -- 172.21.15.7:0/2571887207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a600b3320 con 0x7f6a6015d5e0 2023-10-06T11:00:49.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.477+0000 7f6a676fe700 1 -- 172.21.15.7:0/2571887207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a600b3800 con 0x7f6a6015d5e0 2023-10-06T11:00:49.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.478+0000 7f6a557fa700 1 -- 172.21.15.7:0/2571887207 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a580149e0 con 0x7f6a6015d5e0 2023-10-06T11:00:49.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.478+0000 7f6a557fa700 1 --2- 172.21.15.7:0/2571887207 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a44066f30 0x7f6a440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.479+0000 7f6a557fa700 1 -- 172.21.15.7:0/2571887207 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f6a58085000 con 0x7f6a6015d5e0 2023-10-06T11:00:49.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.479+0000 7f6a6549a700 1 --2- 172.21.15.7:0/2571887207 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a44066f30 0x7f6a440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.479+0000 7f6a6549a700 1 --2- 172.21.15.7:0/2571887207 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a44066f30 0x7f6a440693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6a600c6e20 tx=0x7f6a5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.483+0000 7f6a557fa700 1 -- 172.21.15.7:0/2571887207 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a58051e40 con 0x7f6a6015d5e0 2023-10-06T11:00:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.731+0000 7f6a676fe700 1 -- 172.21.15.7:0/2571887207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a60070480 con 0x7f6a6015d5e0 2023-10-06T11:00:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.732+0000 7f6a557fa700 1 -- 172.21.15.7:0/2571887207 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4587 (secure 0 0 0) 0x7f6a58055460 con 0x7f6a6015d5e0 2023-10-06T11:00:49.734 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:49.734 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/904048408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":904048408},{"type":"v1","addr":"172.21.15.50:6834","nonce":904048408}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5062,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/949655295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":949655295},{"type":"v1","addr":"172.21.15.50:6835","nonce":949655295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1576009113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1576009113},{"type":"v1","addr":"172.21.15.7:6835","nonce":1576009113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:00:21.179899+0000","modified":"2023-10-06T11:00:32.049499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5130":{"gid":5130,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1573170028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1573170028},{"type":"v1","addr":"172.21.15.7:6837","nonce":1573170028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:00:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.734+0000 7f6a676fe700 1 -- 172.21.15.7:0/2571887207 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a44066f30 msgr2=0x7f6a440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.734+0000 7f6a676fe700 1 --2- 172.21.15.7:0/2571887207 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a44066f30 0x7f6a440693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6a600c6e20 tx=0x7f6a5c009040 comp rx=0 tx=0).stop 2023-10-06T11:00:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.734+0000 7f6a676fe700 1 -- 172.21.15.7:0/2571887207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a6015d5e0 msgr2=0x7f6a60169af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.734+0000 7f6a676fe700 1 --2- 172.21.15.7:0/2571887207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a6015d5e0 0x7f6a60169af0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009fa0 tx=0x7f6a58009900 comp rx=0 tx=0).stop 2023-10-06T11:00:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.734+0000 7f6a676fe700 1 -- 172.21.15.7:0/2571887207 shutdown_connections 2023-10-06T11:00:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.734+0000 7f6a676fe700 1 --2- 172.21.15.7:0/2571887207 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a44066f30 0x7f6a440693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.734+0000 7f6a676fe700 1 --2- 172.21.15.7:0/2571887207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a6015d5e0 0x7f6a60169af0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.734+0000 7f6a676fe700 1 --2- 172.21.15.7:0/2571887207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a600cc8e0 0x7f6a60157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.734+0000 7f6a676fe700 1 --2- 172.21.15.7:0/2571887207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a60159240 0x7f6a60158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.734+0000 7f6a676fe700 1 -- 172.21.15.7:0/2571887207 >> 172.21.15.7:0/2571887207 conn(0x7f6a60087920 msgr2=0x7f6a6015aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:49.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.734+0000 7f6a676fe700 1 -- 172.21.15.7:0/2571887207 shutdown_connections 2023-10-06T11:00:49.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.734+0000 7f6a676fe700 1 -- 172.21.15.7:0/2571887207 wait complete. 2023-10-06T11:00:49.737 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 20 2023-10-06T11:00:49.749 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:00:49.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.880+0000 7f4ad5a53700 1 Processor -- start 2023-10-06T11:00:49.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.880+0000 7f4ad5a53700 1 -- start start 2023-10-06T11:00:49.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.880+0000 7f4ad5a53700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4ad00b25d0 0x7f4ad00cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.880+0000 7f4ad5a53700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad00680e0 con 0x7f4ad0140bb0 2023-10-06T11:00:49.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.880+0000 7f4ad5a53700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad00683c0 con 0x7f4ad01407e0 2023-10-06T11:00:49.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.880+0000 7f4ad5a53700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad00cc490 con 0x7f4ad00b25d0 2023-10-06T11:00:49.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.881+0000 7f4acf7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4ad00b25d0 0x7f4ad00cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.881+0000 7f4ace7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4ad0140bb0 0x7f4ad00cb760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44666/0 (socket says 172.21.15.7:44666) 2023-10-06T11:00:49.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.881+0000 7f4ace7fc700 1 -- 172.21.15.7:0/2980955286 learned_addr learned my addr 172.21.15.7:0/2980955286 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:49.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.881+0000 7f4acf7fe700 1 -- 172.21.15.7:0/2980955286 >> v1:172.21.15.50:6789/0 conn(0x7f4ad01407e0 legacy=0x7f4ad00b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.881+0000 7f4acf7fe700 1 -- 172.21.15.7:0/2980955286 >> v1:172.21.15.7:6789/0 conn(0x7f4ad0140bb0 legacy=0x7f4ad00cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.881+0000 7f4acf7fe700 1 -- 172.21.15.7:0/2980955286 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad00cc770 con 0x7f4ad00b25d0 2023-10-06T11:00:49.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.881+0000 7f4acdffb700 1 -- 172.21.15.7:0/2980955286 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701156328 0 0) 0x7f4ad00680e0 con 0x7f4ad0140bb0 2023-10-06T11:00:49.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.881+0000 7f4acf7fe700 1 --2- 172.21.15.7:0/2980955286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad00b25d0 0x7f4ad00cbe70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009e60 tx=0x7f4ac8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1c2765524db9f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:49.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.881+0000 7f4acdffb700 1 -- 172.21.15.7:0/2980955286 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800e070 con 0x7f4ad00b25d0 2023-10-06T11:00:49.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.881+0000 7f4acdffb700 1 -- 172.21.15.7:0/2980955286 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac800bc30 con 0x7f4ad00b25d0 2023-10-06T11:00:49.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.881+0000 7f4acdffb700 1 -- 172.21.15.7:0/2980955286 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8012430 con 0x7f4ad00b25d0 2023-10-06T11:00:49.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.882+0000 7f4ad5a53700 1 -- 172.21.15.7:0/2980955286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad00b25d0 msgr2=0x7f4ad00cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.882+0000 7f4ad5a53700 1 --2- 172.21.15.7:0/2980955286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad00b25d0 0x7f4ad00cbe70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009e60 tx=0x7f4ac8009780 comp rx=0 tx=0).stop 2023-10-06T11:00:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.882+0000 7f4ad5a53700 1 -- 172.21.15.7:0/2980955286 shutdown_connections 2023-10-06T11:00:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.882+0000 7f4ad5a53700 1 --2- 172.21.15.7:0/2980955286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad00b25d0 0x7f4ad00cbe70 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.882+0000 7f4ad5a53700 1 -- 172.21.15.7:0/2980955286 >> 172.21.15.7:0/2980955286 conn(0x7f4ad00ccdf0 msgr2=0x7f4ad00cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.882+0000 7f4ad5a53700 1 -- 172.21.15.7:0/2980955286 shutdown_connections 2023-10-06T11:00:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.882+0000 7f4ad5a53700 1 -- 172.21.15.7:0/2980955286 wait complete. 2023-10-06T11:00:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.884+0000 7f4ad5a53700 1 Processor -- start 2023-10-06T11:00:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.884+0000 7f4ad5a53700 1 -- start start 2023-10-06T11:00:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.884+0000 7f4ad5a53700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ad00b25d0 0x7f4ad013d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.884+0000 7f4ad5a53700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad01407e0 0x7f4ad00aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.884+0000 7f4ad5a53700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad0140bb0 0x7f4ad00cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.884+0000 7f4ad5a53700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad013dc30 con 0x7f4ad0140bb0 2023-10-06T11:00:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.884+0000 7f4ad5a53700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00ab040 con 0x7f4ad01407e0 2023-10-06T11:00:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.884+0000 7f4ad5a53700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0169860 con 0x7f4ad00b25d0 2023-10-06T11:00:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4acf7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad0140bb0 0x7f4ad00cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4acf7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad0140bb0 0x7f4ad00cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46268/0 (socket says 172.21.15.7:46268) 2023-10-06T11:00:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4acf7fe700 1 -- 172.21.15.7:0/81132290 learned_addr learned my addr 172.21.15.7:0/81132290 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4ace7fc700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad01407e0 0x7f4ad00aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4aceffd700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ad00b25d0 0x7f4ad013d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4acf7fe700 1 -- 172.21.15.7:0/81132290 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ad00b25d0 msgr2=0x7f4ad013d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4acf7fe700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ad00b25d0 0x7f4ad013d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4acf7fe700 1 -- 172.21.15.7:0/81132290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad01407e0 msgr2=0x7f4ad00aa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4acf7fe700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad01407e0 0x7f4ad00aa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4acf7fe700 1 -- 172.21.15.7:0/81132290 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac8009a20 con 0x7f4ad0140bb0 2023-10-06T11:00:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4aceffd700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ad00b25d0 0x7f4ad013d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:49.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4acf7fe700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad0140bb0 0x7f4ad00cb680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80099f0 tx=0x7f4ac8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:49.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4ab6ffd700 1 -- 172.21.15.7:0/81132290 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac801d630 con 0x7f4ad0140bb0 2023-10-06T11:00:49.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4ab6ffd700 1 -- 172.21.15.7:0/81132290 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac801d7b0 con 0x7f4ad0140bb0 2023-10-06T11:00:49.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4ab6ffd700 1 -- 172.21.15.7:0/81132290 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac801db70 con 0x7f4ad0140bb0 2023-10-06T11:00:49.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4ad5a53700 1 -- 172.21.15.7:0/81132290 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad0169b40 con 0x7f4ad0140bb0 2023-10-06T11:00:49.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.885+0000 7f4ad5a53700 1 -- 172.21.15.7:0/81132290 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad0169540 con 0x7f4ad0140bb0 2023-10-06T11:00:49.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.887+0000 7f4ad5a53700 1 -- 172.21.15.7:0/81132290 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad016a060 con 0x7f4ad0140bb0 2023-10-06T11:00:49.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.887+0000 7f4ab6ffd700 1 -- 172.21.15.7:0/81132290 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ac8024070 con 0x7f4ad0140bb0 2023-10-06T11:00:49.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.887+0000 7f4ab6ffd700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4abc066f30 0x7f4abc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:49.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.887+0000 7f4ab6ffd700 1 -- 172.21.15.7:0/81132290 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f4ac80871a0 con 0x7f4ad0140bb0 2023-10-06T11:00:49.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.887+0000 7f4aceffd700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4abc066f30 0x7f4abc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:49.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.888+0000 7f4aceffd700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4abc066f30 0x7f4abc0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0007fd0 tx=0x7f4ac0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:49.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:49.892+0000 7f4ab6ffd700 1 -- 172.21.15.7:0/81132290 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ad016a060 con 0x7f4ad0140bb0 2023-10-06T11:00:50.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.102+0000 7f4ad5a53700 1 -- 172.21.15.7:0/81132290 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ad016a060 con 0x7f4ad0140bb0 2023-10-06T11:00:50.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.103+0000 7f4ab6ffd700 1 -- 172.21.15.7:0/81132290 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18630 (secure 0 0 0) 0x7f4ad016a060 con 0x7f4ad0140bb0 2023-10-06T11:00:50.105 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:50.105 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":43,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:00:33.060575+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:00:18.763171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T11:00:20.149563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":8,"pool_name":"data_new","create_time":"2023-10-06T11:00:30.330717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:00:50.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.106+0000 7f4ad5a53700 1 -- 172.21.15.7:0/81132290 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4abc066f30 msgr2=0x7f4abc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:50.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.106+0000 7f4ad5a53700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4abc066f30 0x7f4abc0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0007fd0 tx=0x7f4ac0009040 comp rx=0 tx=0).stop 2023-10-06T11:00:50.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.106+0000 7f4ad5a53700 1 -- 172.21.15.7:0/81132290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad0140bb0 msgr2=0x7f4ad00cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:50.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.106+0000 7f4ad5a53700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad0140bb0 0x7f4ad00cb680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80099f0 tx=0x7f4ac8019000 comp rx=0 tx=0).stop 2023-10-06T11:00:50.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.106+0000 7f4ad5a53700 1 -- 172.21.15.7:0/81132290 shutdown_connections 2023-10-06T11:00:50.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.106+0000 7f4ad5a53700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4abc066f30 0x7f4abc0693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.106+0000 7f4ad5a53700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad0140bb0 0x7f4ad00cb680 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.106+0000 7f4ad5a53700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ad00b25d0 0x7f4ad013d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.106+0000 7f4ad5a53700 1 --2- 172.21.15.7:0/81132290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad01407e0 0x7f4ad00aa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.106+0000 7f4ad5a53700 1 -- 172.21.15.7:0/81132290 >> 172.21.15.7:0/81132290 conn(0x7f4ad00ccdf0 msgr2=0x7f4ad013f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:50.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.106+0000 7f4ad5a53700 1 -- 172.21.15.7:0/81132290 shutdown_connections 2023-10-06T11:00:50.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.106+0000 7f4ad5a53700 1 -- 172.21.15.7:0/81132290 wait complete. 2023-10-06T11:00:50.122 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:00:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.253+0000 7fbc020d1700 1 Processor -- start 2023-10-06T11:00:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.253+0000 7fbc020d1700 1 -- start start 2023-10-06T11:00:50.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.254+0000 7fbc020d1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbbfc158120 0x7fbbfc0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:50.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.254+0000 7fbc020d1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbbfc0c8ba0 0x7fbbfc0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:50.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.254+0000 7fbc020d1700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc0cbd10 con 0x7fbbfc0cac60 2023-10-06T11:00:50.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.254+0000 7fbc020d1700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0cb9e0 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.254+0000 7fbc020d1700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0c9300 con 0x7fbbfc158120 2023-10-06T11:00:50.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.254+0000 7fbbfbfff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbbfc0cac60 0x7fbbfc15ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49838/0 (socket says 172.21.15.7:49838) 2023-10-06T11:00:50.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.254+0000 7fbbfaffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbbfc0c8ba0 0x7fbbfc0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:50.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.254+0000 7fbbfbfff700 1 -- 172.21.15.7:0/1892460150 learned_addr learned my addr 172.21.15.7:0/1892460150 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:50.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.255+0000 7fbbfb7fe700 1 --2- 172.21.15.7:0/1892460150 >> v2:172.21.15.50:3300/0 conn(0x7fbbfc158120 0x7fbbfc0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:50.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.255+0000 7fbbfa7fc700 1 -- 172.21.15.7:0/1892460150 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489229790 0 0) 0x7fbbfc0cbd10 con 0x7fbbfc0cac60 2023-10-06T11:00:50.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.255+0000 7fbbfa7fc700 1 -- 172.21.15.7:0/1892460150 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe8003570 con 0x7fbbfc0cac60 2023-10-06T11:00:50.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.255+0000 7fbbfaffd700 1 -- 172.21.15.7:0/1892460150 >> v2:172.21.15.50:3300/0 conn(0x7fbbfc158120 msgr2=0x7fbbfc0c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:50.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.255+0000 7fbbfaffd700 1 --2- 172.21.15.7:0/1892460150 >> v2:172.21.15.50:3300/0 conn(0x7fbbfc158120 0x7fbbfc0c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.255+0000 7fbbfaffd700 1 -- 172.21.15.7:0/1892460150 >> v1:172.21.15.7:6789/0 conn(0x7fbbfc0cac60 legacy=0x7fbbfc15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:50.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.255+0000 7fbbfaffd700 1 -- 172.21.15.7:0/1892460150 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc0c95e0 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.255+0000 7fbbfb7fe700 1 --2- 172.21.15.7:0/1892460150 >> v2:172.21.15.50:3300/0 conn(0x7fbbfc158120 0x7fbbfc0c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:50.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.255+0000 7fbbfaffd700 1 --2- 172.21.15.7:0/1892460150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbfc0c8ba0 0x7fbbfc0ca720 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc06ec50 tx=0x7fbbe40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b71f4d9df51058 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:50.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.255+0000 7fbbfa7fc700 1 -- 172.21.15.7:0/1892460150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4011630 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.255+0000 7fbbfa7fc700 1 -- 172.21.15.7:0/1892460150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4011790 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.255+0000 7fbbfa7fc700 1 -- 172.21.15.7:0/1892460150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4011b10 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.256+0000 7fbc020d1700 1 -- 172.21.15.7:0/1892460150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbfc0c8ba0 msgr2=0x7fbbfc0ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:50.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.256+0000 7fbc020d1700 1 --2- 172.21.15.7:0/1892460150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbfc0c8ba0 0x7fbbfc0ca720 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc06ec50 tx=0x7fbbe40091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.256+0000 7fbc020d1700 1 -- 172.21.15.7:0/1892460150 shutdown_connections 2023-10-06T11:00:50.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.256+0000 7fbc020d1700 1 --2- 172.21.15.7:0/1892460150 >> v2:172.21.15.50:3300/0 conn(0x7fbbfc158120 0x7fbbfc0c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.256+0000 7fbc020d1700 1 --2- 172.21.15.7:0/1892460150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbfc0c8ba0 0x7fbbfc0ca720 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.256+0000 7fbc020d1700 1 -- 172.21.15.7:0/1892460150 >> 172.21.15.7:0/1892460150 conn(0x7fbbfc087920 msgr2=0x7fbbfc097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:50.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.256+0000 7fbc020d1700 1 -- 172.21.15.7:0/1892460150 shutdown_connections 2023-10-06T11:00:50.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.256+0000 7fbc020d1700 1 -- 172.21.15.7:0/1892460150 wait complete. 2023-10-06T11:00:50.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.257+0000 7fbc020d1700 1 Processor -- start 2023-10-06T11:00:50.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.257+0000 7fbc020d1700 1 -- start start 2023-10-06T11:00:50.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbc020d1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbfc0c8ba0 0x7fbbfc0af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:50.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbc020d1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0cac60 0x7fbbfc0af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:50.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbc020d1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc158120 0x7fbbfc167200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:50.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbc020d1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0afee0 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbc020d1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc169180 con 0x7fbbfc158120 2023-10-06T11:00:50.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbc020d1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc168570 con 0x7fbbfc0cac60 2023-10-06T11:00:50.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbbfb7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbfc0c8ba0 0x7fbbfc0af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:50.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbbfb7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbfc0c8ba0 0x7fbbfc0af460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45858/0 (socket says 172.21.15.7:45858) 2023-10-06T11:00:50.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbbfb7fe700 1 -- 172.21.15.7:0/2394862916 learned_addr learned my addr 172.21.15.7:0/2394862916 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:50.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbbfbfff700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc158120 0x7fbbfc167200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:50.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbbfaffd700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0cac60 0x7fbbfc0af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:50.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbbfb7fe700 1 -- 172.21.15.7:0/2394862916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0cac60 msgr2=0x7fbbfc0af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:50.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbbfb7fe700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0cac60 0x7fbbfc0af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbbfb7fe700 1 -- 172.21.15.7:0/2394862916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc158120 msgr2=0x7fbbfc167200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:50.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbbfb7fe700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc158120 0x7fbbfc167200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbbfb7fe700 1 -- 172.21.15.7:0/2394862916 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe4009420 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.258+0000 7fbbfbfff700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc158120 0x7fbbfc167200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:50.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.259+0000 7fbbfb7fe700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbfc0c8ba0 0x7fbbfc0af460 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00d890 tx=0x7fbbec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:50.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.259+0000 7fbbf37fe700 1 -- 172.21.15.7:0/2394862916 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec005a00 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.259+0000 7fbbf37fe700 1 -- 172.21.15.7:0/2394862916 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec005b60 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.259+0000 7fbc020d1700 1 -- 172.21.15.7:0/2394862916 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc168850 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.259+0000 7fbbf37fe700 1 -- 172.21.15.7:0/2394862916 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0125f0 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.259+0000 7fbc020d1700 1 -- 172.21.15.7:0/2394862916 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc168e10 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.260+0000 7fbc020d1700 1 -- 172.21.15.7:0/2394862916 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbfc070480 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.260+0000 7fbbf37fe700 1 -- 172.21.15.7:0/2394862916 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbec0129a0 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.261+0000 7fbbf37fe700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbbdc066f30 0x7fbbdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:50.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.261+0000 7fbbf37fe700 1 -- 172.21.15.7:0/2394862916 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7fbbec084bb0 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.261+0000 7fbbfaffd700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbbdc066f30 0x7fbbdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:50.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.261+0000 7fbbfaffd700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbbdc066f30 0x7fbbdc0693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40091e0 tx=0x7fbbe4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:50.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.266+0000 7fbbf37fe700 1 -- 172.21.15.7:0/2394862916 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbec051aa0 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.513+0000 7fbc020d1700 1 -- 172.21.15.7:0/2394862916 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbbfc0c98c0 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.515 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-06T11:00:50.513+0000 7f516a233700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:00:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.519+0000 7fbbf37fe700 1 -- 172.21.15.7:0/2394862916 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbbec0550c0 con 0x7fbbfc0c8ba0 2023-10-06T11:00:50.522 INFO:tasks.ceph.mds.a.smithi007.stderr: -2657> 2023-10-06T11:00:27.722+0000 7f009b0d0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:00:50.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.522+0000 7fbc020d1700 1 -- 172.21.15.7:0/2394862916 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbbdc066f30 msgr2=0x7fbbdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.522+0000 7fbc020d1700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbbdc066f30 0x7fbbdc0693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40091e0 tx=0x7fbbe4017000 comp rx=0 tx=0).stop 2023-10-06T11:00:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.522+0000 7fbc020d1700 1 -- 172.21.15.7:0/2394862916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbfc0c8ba0 msgr2=0x7fbbfc0af460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.522+0000 7fbc020d1700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbfc0c8ba0 0x7fbbfc0af460 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00d890 tx=0x7fbbec008040 comp rx=0 tx=0).stop 2023-10-06T11:00:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.522+0000 7fbc020d1700 1 -- 172.21.15.7:0/2394862916 shutdown_connections 2023-10-06T11:00:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.522+0000 7fbc020d1700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbbdc066f30 0x7fbbdc0693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.522+0000 7fbc020d1700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbfc0c8ba0 0x7fbbfc0af460 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.522+0000 7fbc020d1700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc158120 0x7fbbfc167200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.522+0000 7fbc020d1700 1 --2- 172.21.15.7:0/2394862916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0cac60 0x7fbbfc0af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.522+0000 7fbc020d1700 1 -- 172.21.15.7:0/2394862916 >> 172.21.15.7:0/2394862916 conn(0x7fbbfc087920 msgr2=0x7fbbfc0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.522+0000 7fbc020d1700 1 -- 172.21.15.7:0/2394862916 shutdown_connections 2023-10-06T11:00:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.522+0000 7fbc020d1700 1 -- 172.21.15.7:0/2394862916 wait complete. 2023-10-06T11:00:50.527 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:00:50.539 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:00:50.549 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-06T11:00:50.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.672+0000 7f306ca25700 1 Processor -- start 2023-10-06T11:00:50.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.672+0000 7f306ca25700 1 -- start start 2023-10-06T11:00:50.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.673+0000 7f306ca25700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30680cab40 0x7f30680694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:50.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.673+0000 7f306ca25700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30680caf10 0x7f30680b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:50.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.673+0000 7f306ca25700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30680b2260 0x7f30680b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:50.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.673+0000 7f306ca25700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30680699e0 con 0x7f30680cab40 2023-10-06T11:00:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.673+0000 7f306ca25700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3068069dd0 con 0x7f30680b2260 2023-10-06T11:00:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.673+0000 7f306ca25700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306806a070 con 0x7f30680caf10 2023-10-06T11:00:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.673+0000 7f306659c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30680cab40 0x7f30680694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.674+0000 7f306659c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30680cab40 0x7f30680694a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45896/0 (socket says 172.21.15.7:45896) 2023-10-06T11:00:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.674+0000 7f306659c700 1 -- 172.21.15.7:0/3382035289 learned_addr learned my addr 172.21.15.7:0/3382035289 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.674+0000 7f3065d9b700 1 --2- 172.21.15.7:0/3382035289 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30680caf10 0x7f30680b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.674+0000 7f3066d9d700 1 --2- 172.21.15.7:0/3382035289 >> v2:172.21.15.50:3300/0 conn(0x7f30680b2260 0x7f30680b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.674+0000 7f306659c700 1 -- 172.21.15.7:0/3382035289 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30680caf10 msgr2=0x7f30680b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.674+0000 7f306659c700 1 --2- 172.21.15.7:0/3382035289 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30680caf10 0x7f30680b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.674+0000 7f306659c700 1 -- 172.21.15.7:0/3382035289 >> v2:172.21.15.50:3300/0 conn(0x7f30680b2260 msgr2=0x7f30680b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:50.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.674+0000 7f306659c700 1 --2- 172.21.15.7:0/3382035289 >> v2:172.21.15.50:3300/0 conn(0x7f30680b2260 0x7f30680b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.674+0000 7f306659c700 1 -- 172.21.15.7:0/3382035289 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306806a350 con 0x7f30680cab40 2023-10-06T11:00:50.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.674+0000 7f306659c700 1 --2- 172.21.15.7:0/3382035289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cab40 0x7f30680694a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f306806a660 tx=0x7f3058009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3095084f4e55ca9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:50.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.674+0000 7f306559a700 1 -- 172.21.15.7:0/3382035289 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305800b640 con 0x7f30680cab40 2023-10-06T11:00:50.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.674+0000 7f306559a700 1 -- 172.21.15.7:0/3382035289 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305800b7a0 con 0x7f30680cab40 2023-10-06T11:00:50.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.674+0000 7f306559a700 1 -- 172.21.15.7:0/3382035289 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305800bb60 con 0x7f30680cab40 2023-10-06T11:00:50.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.675+0000 7f306ca25700 1 -- 172.21.15.7:0/3382035289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cab40 msgr2=0x7f30680694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:50.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.675+0000 7f306ca25700 1 --2- 172.21.15.7:0/3382035289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cab40 0x7f30680694a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f306806a660 tx=0x7f3058009250 comp rx=0 tx=0).stop 2023-10-06T11:00:50.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.675+0000 7f306ca25700 1 -- 172.21.15.7:0/3382035289 shutdown_connections 2023-10-06T11:00:50.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.675+0000 7f306ca25700 1 --2- 172.21.15.7:0/3382035289 >> v2:172.21.15.50:3300/0 conn(0x7f30680b2260 0x7f30680b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.675+0000 7f306ca25700 1 --2- 172.21.15.7:0/3382035289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cab40 0x7f30680694a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.675+0000 7f306ca25700 1 --2- 172.21.15.7:0/3382035289 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30680caf10 0x7f30680b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.675+0000 7f306ca25700 1 -- 172.21.15.7:0/3382035289 >> 172.21.15.7:0/3382035289 conn(0x7f30680afc90 msgr2=0x7f30680b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:50.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.675+0000 7f306ca25700 1 -- 172.21.15.7:0/3382035289 shutdown_connections 2023-10-06T11:00:50.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.675+0000 7f306ca25700 1 -- 172.21.15.7:0/3382035289 wait complete. 2023-10-06T11:00:50.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.677+0000 7f306ca25700 1 Processor -- start 2023-10-06T11:00:50.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.677+0000 7f306ca25700 1 -- start start 2023-10-06T11:00:50.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306ca25700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680b2260 0x7f306816a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:50.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306ca25700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30680cab40 0x7f3068148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:50.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306ca25700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30680caf10 0x7f306815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:50.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306ca25700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30680c95d0 con 0x7f30680b2260 2023-10-06T11:00:50.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306ca25700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30680c8e50 con 0x7f30680cab40 2023-10-06T11:00:50.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306ca25700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306816ad30 con 0x7f30680caf10 2023-10-06T11:00:50.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680b2260 0x7f306816a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:50.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680b2260 0x7f306816a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45898/0 (socket says 172.21.15.7:45898) 2023-10-06T11:00:50.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306659c700 1 -- 172.21.15.7:0/2426940347 learned_addr learned my addr 172.21.15.7:0/2426940347 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:50.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f3065d9b700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30680cab40 0x7f3068148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:50.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f3066d9d700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30680caf10 0x7f306815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:50.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306659c700 1 -- 172.21.15.7:0/2426940347 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30680caf10 msgr2=0x7f306815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:50.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306659c700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30680caf10 0x7f306815aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306659c700 1 -- 172.21.15.7:0/2426940347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30680cab40 msgr2=0x7f3068148440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:50.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306659c700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30680cab40 0x7f3068148440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:50.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306659c700 1 -- 172.21.15.7:0/2426940347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580094f0 con 0x7f30680b2260 2023-10-06T11:00:50.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f3066d9d700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30680caf10 0x7f306815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:50.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.678+0000 7f306659c700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680b2260 0x7f306816a7f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f306806e0b0 tx=0x7f3058017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:50.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.679+0000 7f30567fc700 1 -- 172.21.15.7:0/2426940347 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058000d10 con 0x7f30680b2260 2023-10-06T11:00:50.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.679+0000 7f30567fc700 1 -- 172.21.15.7:0/2426940347 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305800bb20 con 0x7f30680b2260 2023-10-06T11:00:50.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.679+0000 7f30567fc700 1 -- 172.21.15.7:0/2426940347 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058011670 con 0x7f30680b2260 2023-10-06T11:00:50.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.679+0000 7f306ca25700 1 -- 172.21.15.7:0/2426940347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30680c8240 con 0x7f30680b2260 2023-10-06T11:00:50.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.679+0000 7f306ca25700 1 -- 172.21.15.7:0/2426940347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30680c8800 con 0x7f30680b2260 2023-10-06T11:00:50.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.680+0000 7f306ca25700 1 -- 172.21.15.7:0/2426940347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3068070480 con 0x7f30680b2260 2023-10-06T11:00:50.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.680+0000 7f30567fc700 1 -- 172.21.15.7:0/2426940347 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30580119e0 con 0x7f30680b2260 2023-10-06T11:00:50.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.680+0000 7f30567fc700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3048066f30 0x7f30480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:50.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.681+0000 7f30567fc700 1 -- 172.21.15.7:0/2426940347 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6859+0+0 (secure 0 0 0) 0x7f3058086100 con 0x7f30680b2260 2023-10-06T11:00:50.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.681+0000 7f3065d9b700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3048066f30 0x7f30480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:50.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.681+0000 7f3065d9b700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3048066f30 0x7f30480693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f30681549b0 tx=0x7f305c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:50.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.685+0000 7f30567fc700 1 -- 172.21.15.7:0/2426940347 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3058052ef0 con 0x7f30680b2260 2023-10-06T11:00:50.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:50.936+0000 7f306ca25700 1 -- 172.21.15.7:0/2426940347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f306806c700 con 0x7f30680b2260 2023-10-06T11:00:51.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.530+0000 7f30567fc700 1 -- 172.21.15.7:0/2426940347 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3058056510 con 0x7f30680b2260 2023-10-06T11:00:51.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.534+0000 7f306ca25700 1 -- 172.21.15.7:0/2426940347 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3048066f30 msgr2=0x7f30480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:51.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.534+0000 7f306ca25700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3048066f30 0x7f30480693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f30681549b0 tx=0x7f305c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:51.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.534+0000 7f306ca25700 1 -- 172.21.15.7:0/2426940347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680b2260 msgr2=0x7f306816a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:51.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.534+0000 7f306ca25700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680b2260 0x7f306816a7f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f306806e0b0 tx=0x7f3058017000 comp rx=0 tx=0).stop 2023-10-06T11:00:51.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.534+0000 7f306ca25700 1 -- 172.21.15.7:0/2426940347 shutdown_connections 2023-10-06T11:00:51.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.534+0000 7f306ca25700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3048066f30 0x7f30480693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:51.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.534+0000 7f306ca25700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680b2260 0x7f306816a7f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:51.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.534+0000 7f306ca25700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f30680caf10 0x7f306815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:51.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.534+0000 7f306ca25700 1 --2- 172.21.15.7:0/2426940347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30680cab40 0x7f3068148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:51.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.534+0000 7f306ca25700 1 -- 172.21.15.7:0/2426940347 >> 172.21.15.7:0/2426940347 conn(0x7f30680afc90 msgr2=0x7f306806be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:51.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.535+0000 7f306ca25700 1 -- 172.21.15.7:0/2426940347 shutdown_connections 2023-10-06T11:00:51.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.535+0000 7f306ca25700 1 -- 172.21.15.7:0/2426940347 wait complete. 2023-10-06T11:00:51.552 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:00:51.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.733+0000 7f75c8ed2700 1 Processor -- start 2023-10-06T11:00:51.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.733+0000 7f75c8ed2700 1 -- start start 2023-10-06T11:00:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.734+0000 7f75c8ed2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75c4151750 0x7f75c40ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.734+0000 7f75c8ed2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f75c40cad10 0x7f75c40cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.734+0000 7f75c8ed2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c40c8d70 con 0x7f75c4151380 2023-10-06T11:00:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.734+0000 7f75c8ed2700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c40c8fe0 con 0x7f75c40cad10 2023-10-06T11:00:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.734+0000 7f75c8ed2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c40c92a0 con 0x7f75c4151750 2023-10-06T11:00:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.734+0000 7f75c2d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f75c40cad10 0x7f75c40cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.734+0000 7f75c2d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f75c40cad10 0x7f75c40cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45904/0 (socket says 172.21.15.7:45904) 2023-10-06T11:00:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.734+0000 7f75c2d9d700 1 -- 172.21.15.7:0/2569662062 learned_addr learned my addr 172.21.15.7:0/2569662062 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.734+0000 7f75c1d9b700 1 --2- 172.21.15.7:0/2569662062 >> v2:172.21.15.50:3300/0 conn(0x7f75c4151750 0x7f75c40ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:51.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.735+0000 7f75c2d9d700 1 -- 172.21.15.7:0/2569662062 >> v2:172.21.15.50:3300/0 conn(0x7f75c4151750 msgr2=0x7f75c40ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:51.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.735+0000 7f75c2d9d700 1 --2- 172.21.15.7:0/2569662062 >> v2:172.21.15.50:3300/0 conn(0x7f75c4151750 0x7f75c40ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:51.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.735+0000 7f75c2d9d700 1 -- 172.21.15.7:0/2569662062 >> v1:172.21.15.50:6789/0 conn(0x7f75c4151380 legacy=0x7f75c40c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:51.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.735+0000 7f75c2d9d700 1 -- 172.21.15.7:0/2569662062 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c40c9580 con 0x7f75c40cad10 2023-10-06T11:00:51.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.735+0000 7f75c2d9d700 1 --2- 172.21.15.7:0/2569662062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75c40cad10 0x7f75c40cbdc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f75c40b0a20 tx=0x7f75bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be49935ba7af7cf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:51.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.735+0000 7f75c159a700 1 -- 172.21.15.7:0/2569662062 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00e070 con 0x7f75c40cad10 2023-10-06T11:00:51.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.735+0000 7f75c159a700 1 -- 172.21.15.7:0/2569662062 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc00ba20 con 0x7f75c40cad10 2023-10-06T11:00:51.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.735+0000 7f75c159a700 1 -- 172.21.15.7:0/2569662062 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0092e0 con 0x7f75c40cad10 2023-10-06T11:00:51.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.736+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2569662062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75c40cad10 msgr2=0x7f75c40cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:51.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.736+0000 7f75c8ed2700 1 --2- 172.21.15.7:0/2569662062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75c40cad10 0x7f75c40cbdc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f75c40b0a20 tx=0x7f75bc009840 comp rx=0 tx=0).stop 2023-10-06T11:00:51.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.736+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2569662062 shutdown_connections 2023-10-06T11:00:51.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.736+0000 7f75c8ed2700 1 --2- 172.21.15.7:0/2569662062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75c40cad10 0x7f75c40cbdc0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:51.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.736+0000 7f75c8ed2700 1 --2- 172.21.15.7:0/2569662062 >> v2:172.21.15.50:3300/0 conn(0x7f75c4151750 0x7f75c40ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:51.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.736+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2569662062 >> 172.21.15.7:0/2569662062 conn(0x7f75c4087920 msgr2=0x7f75c4097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:51.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.736+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2569662062 shutdown_connections 2023-10-06T11:00:51.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.736+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2569662062 wait complete. 2023-10-06T11:00:51.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.737+0000 7f75c8ed2700 1 Processor -- start 2023-10-06T11:00:51.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.737+0000 7f75c8ed2700 1 -- start start 2023-10-06T11:00:51.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c8ed2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75c40cad10 0x7f75c414d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:51.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c8ed2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75c4151380 0x7f75c4169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:51.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c8ed2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75c4151750 0x7f75c4156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:51.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c8ed2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c416a3b0 con 0x7f75c4151750 2023-10-06T11:00:51.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c8ed2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c414f390 con 0x7f75c4151380 2023-10-06T11:00:51.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c8ed2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c414f670 con 0x7f75c40cad10 2023-10-06T11:00:51.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c2d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75c4151750 0x7f75c4156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:51.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c2d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75c4151750 0x7f75c4156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45918/0 (socket says 172.21.15.7:45918) 2023-10-06T11:00:51.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c2d9d700 1 -- 172.21.15.7:0/2577363261 learned_addr learned my addr 172.21.15.7:0/2577363261 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:51.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c1d9b700 1 --2- 172.21.15.7:0/2577363261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75c4151380 0x7f75c4169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:51.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c259c700 1 --2- 172.21.15.7:0/2577363261 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75c40cad10 0x7f75c414d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:51.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c2d9d700 1 -- 172.21.15.7:0/2577363261 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75c40cad10 msgr2=0x7f75c414d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:51.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c2d9d700 1 --2- 172.21.15.7:0/2577363261 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75c40cad10 0x7f75c414d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:51.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c2d9d700 1 -- 172.21.15.7:0/2577363261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75c4151380 msgr2=0x7f75c4169e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:51.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c2d9d700 1 --2- 172.21.15.7:0/2577363261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75c4151380 0x7f75c4169e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:51.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.738+0000 7f75c2d9d700 1 -- 172.21.15.7:0/2577363261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc009ae0 con 0x7f75c4151750 2023-10-06T11:00:51.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.739+0000 7f75c2d9d700 1 --2- 172.21.15.7:0/2577363261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75c4151750 0x7f75c4156030 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009df0 tx=0x7f75bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:51.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.739+0000 7f75ba7fc700 1 -- 172.21.15.7:0/2577363261 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc008a80 con 0x7f75c4151750 2023-10-06T11:00:51.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.739+0000 7f75ba7fc700 1 -- 172.21.15.7:0/2577363261 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc008be0 con 0x7f75c4151750 2023-10-06T11:00:51.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.739+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2577363261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c414f950 con 0x7f75c4151750 2023-10-06T11:00:51.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.739+0000 7f75ba7fc700 1 -- 172.21.15.7:0/2577363261 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc026460 con 0x7f75c4151750 2023-10-06T11:00:51.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.739+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2577363261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c414ff10 con 0x7f75c4151750 2023-10-06T11:00:51.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.740+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2577363261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c4070480 con 0x7f75c4151750 2023-10-06T11:00:51.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.740+0000 7f75ba7fc700 1 -- 172.21.15.7:0/2577363261 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f75bc003040 con 0x7f75c4151750 2023-10-06T11:00:51.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.741+0000 7f75ba7fc700 1 --2- 172.21.15.7:0/2577363261 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f75a4066f30 0x7f75a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:51.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.741+0000 7f75ba7fc700 1 -- 172.21.15.7:0/2577363261 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f75bc086890 con 0x7f75c4151750 2023-10-06T11:00:51.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.741+0000 7f75c259c700 1 --2- 172.21.15.7:0/2577363261 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f75a4066f30 0x7f75a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:51.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.741+0000 7f75c259c700 1 --2- 172.21.15.7:0/2577363261 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f75a4066f30 0x7f75a40693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f75c414de60 tx=0x7f75b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:51.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.746+0000 7f75ba7fc700 1 -- 172.21.15.7:0/2577363261 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75bc0535a0 con 0x7f75c4151750 2023-10-06T11:00:51.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:51.948+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2577363261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f75c40c9860 con 0x7f75c4151750 2023-10-06T11:00:52.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.537+0000 7f75ba7fc700 1 -- 172.21.15.7:0/2577363261 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) v1 ==== 181+0+0 (secure 0 0 0) 0x7f75bc0210d0 con 0x7f75c4151750 2023-10-06T11:00:52.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.542+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2577363261 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f75a4066f30 msgr2=0x7f75a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:52.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.542+0000 7f75c8ed2700 1 --2- 172.21.15.7:0/2577363261 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f75a4066f30 0x7f75a40693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f75c414de60 tx=0x7f75b4009040 comp rx=0 tx=0).stop 2023-10-06T11:00:52.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.542+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2577363261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75c4151750 msgr2=0x7f75c4156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:52.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.542+0000 7f75c8ed2700 1 --2- 172.21.15.7:0/2577363261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75c4151750 0x7f75c4156030 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009df0 tx=0x7f75bc018000 comp rx=0 tx=0).stop 2023-10-06T11:00:52.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.542+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2577363261 shutdown_connections 2023-10-06T11:00:52.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.542+0000 7f75c8ed2700 1 --2- 172.21.15.7:0/2577363261 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f75a4066f30 0x7f75a40693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.542+0000 7f75c8ed2700 1 --2- 172.21.15.7:0/2577363261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75c4151750 0x7f75c4156030 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.542+0000 7f75c8ed2700 1 --2- 172.21.15.7:0/2577363261 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75c40cad10 0x7f75c414d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.542+0000 7f75c8ed2700 1 --2- 172.21.15.7:0/2577363261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75c4151380 0x7f75c4169e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.542+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2577363261 >> 172.21.15.7:0/2577363261 conn(0x7f75c4087920 msgr2=0x7f75c40b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.542+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2577363261 shutdown_connections 2023-10-06T11:00:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.542+0000 7f75c8ed2700 1 -- 172.21.15.7:0/2577363261 wait complete. 2023-10-06T11:00:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:00:52.560 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:00:52.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.697+0000 7f84b532e700 1 Processor -- start 2023-10-06T11:00:52.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.697+0000 7f84b532e700 1 -- start start 2023-10-06T11:00:52.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84b532e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b0159650 0x7f84b00caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:52.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84b532e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b00cdcd0 con 0x7f84b0159280 2023-10-06T11:00:52.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84b532e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b00ce570 con 0x7f84b00cb480 2023-10-06T11:00:52.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84b532e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00cb8d0 con 0x7f84b0159650 2023-10-06T11:00:52.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84aeffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f84b0159280 0x7f84b00aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49858/0 (socket says 172.21.15.7:49858) 2023-10-06T11:00:52.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84aeffd700 1 -- 172.21.15.7:0/1673767122 learned_addr learned my addr 172.21.15.7:0/1673767122 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:52.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84ae7fc700 1 --2- 172.21.15.7:0/1673767122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b0159650 0x7f84b00caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:52.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004108912 0 0) 0x7f84b00cdcd0 con 0x7f84b0159280 2023-10-06T11:00:52.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8498003570 con 0x7f84b0159280 2023-10-06T11:00:52.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081609087 0 0) 0x7f84b00ce570 con 0x7f84b00cb480 2023-10-06T11:00:52.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b00cdcd0 con 0x7f84b00cb480 2023-10-06T11:00:52.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1574261945 0 0) 0x7f8498003570 con 0x7f84b0159280 2023-10-06T11:00:52.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b0159650 msgr2=0x7f84b00caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:52.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84adffb700 1 --2- 172.21.15.7:0/1673767122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b0159650 0x7f84b00caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:52.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 >> v1:172.21.15.50:6789/0 conn(0x7f84b00cb480 legacy=0x7f84b00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:52.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00cd4d0 con 0x7f84b0159280 2023-10-06T11:00:52.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f84a0001470 con 0x7f84b0159280 2023-10-06T11:00:52.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 >> v1:172.21.15.7:6789/0 conn(0x7f84b0159280 legacy=0x7f84b00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:52.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.698+0000 7f84adffb700 1 --2- 172.21.15.7:0/1673767122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8498003c20 0x7f8498004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:52.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84adffb700 1 --2- 172.21.15.7:0/1673767122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8498004810 0x7f8498004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:52.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84adffb700 1 --2- 172.21.15.7:0/1673767122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b0159650 0x7f8498005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:52.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00cb8d0 con 0x7f8498004810 2023-10-06T11:00:52.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849800bbf0 con 0x7f8498003c20 2023-10-06T11:00:52.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849800bdb0 con 0x7f84b0159650 2023-10-06T11:00:52.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84ae7fc700 1 --2- 172.21.15.7:0/1673767122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8498004810 0x7f8498004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:52.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84aeffd700 1 --2- 172.21.15.7:0/1673767122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8498003c20 0x7f8498004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:52.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84af7fe700 1 --2- 172.21.15.7:0/1673767122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b0159650 0x7f8498005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:52.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84ae7fc700 1 -- 172.21.15.7:0/1673767122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b0159650 msgr2=0x7f8498005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:52.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84ae7fc700 1 --2- 172.21.15.7:0/1673767122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b0159650 0x7f8498005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:52.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84ae7fc700 1 -- 172.21.15.7:0/1673767122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8498003c20 msgr2=0x7f8498004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:52.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84ae7fc700 1 --2- 172.21.15.7:0/1673767122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8498003c20 0x7f8498004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:52.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84ae7fc700 1 -- 172.21.15.7:0/1673767122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8498003570 con 0x7f8498004810 2023-10-06T11:00:52.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84ae7fc700 1 --2- 172.21.15.7:0/1673767122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8498004810 0x7f8498004c80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009c00 tx=0x7f84a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fec93d34a108cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:52.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a400e710 con 0x7f8498004810 2023-10-06T11:00:52.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a400e870 con 0x7f8498004810 2023-10-06T11:00:52.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.699+0000 7f84adffb700 1 -- 172.21.15.7:0/1673767122 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a400ec30 con 0x7f8498004810 2023-10-06T11:00:52.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.700+0000 7f84b532e700 1 -- 172.21.15.7:0/1673767122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8498004810 msgr2=0x7f8498004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:52.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.700+0000 7f84b532e700 1 --2- 172.21.15.7:0/1673767122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8498004810 0x7f8498004c80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009c00 tx=0x7f84a40091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:52.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.700+0000 7f84af7fe700 1 -- 172.21.15.7:0/1673767122 reap_dead start 2023-10-06T11:00:52.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.700+0000 7f84b532e700 1 -- 172.21.15.7:0/1673767122 shutdown_connections 2023-10-06T11:00:52.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.700+0000 7f84b532e700 1 -- 172.21.15.7:0/1673767122 >> 172.21.15.7:0/1673767122 conn(0x7f84b00d0b80 msgr2=0x7f84b00ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:52.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.700+0000 7f84b532e700 1 -- 172.21.15.7:0/1673767122 shutdown_connections 2023-10-06T11:00:52.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.700+0000 7f84b532e700 1 -- 172.21.15.7:0/1673767122 wait complete. 2023-10-06T11:00:52.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.701+0000 7f84b532e700 1 Processor -- start 2023-10-06T11:00:52.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.701+0000 7f84b532e700 1 -- start start 2023-10-06T11:00:52.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.702+0000 7f84b532e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8498004810 0x7f84b0148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:52.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.702+0000 7f84b532e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84b00c53e0 0x7f84b00c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:52.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.702+0000 7f84b532e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b00c8940 0x7f84b00c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:52.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.702+0000 7f84b532e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00c5d90 con 0x7f84b00c53e0 2023-10-06T11:00:52.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.702+0000 7f84b532e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00c9320 con 0x7f8498004810 2023-10-06T11:00:52.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.702+0000 7f84b532e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00c7330 con 0x7f84b00c8940 2023-10-06T11:00:52.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.702+0000 7f84ae7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84b00c53e0 0x7f84b00c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:52.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.702+0000 7f84ae7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84b00c53e0 0x7f84b00c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45944/0 (socket says 172.21.15.7:45944) 2023-10-06T11:00:52.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.702+0000 7f84ae7fc700 1 -- 172.21.15.7:0/2859556654 learned_addr learned my addr 172.21.15.7:0/2859556654 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:52.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.703+0000 7f84af7fe700 1 --2- 172.21.15.7:0/2859556654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b00c8940 0x7f84b00c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:52.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.703+0000 7f84aeffd700 1 --2- 172.21.15.7:0/2859556654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8498004810 0x7f84b0148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:52.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.703+0000 7f84ae7fc700 1 -- 172.21.15.7:0/2859556654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b00c8940 msgr2=0x7f84b00c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:52.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.703+0000 7f84ae7fc700 1 --2- 172.21.15.7:0/2859556654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b00c8940 0x7f84b00c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:52.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.703+0000 7f84ae7fc700 1 -- 172.21.15.7:0/2859556654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8498004810 msgr2=0x7f84b0148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:52.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.703+0000 7f84ae7fc700 1 --2- 172.21.15.7:0/2859556654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8498004810 0x7f84b0148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:52.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.703+0000 7f84ae7fc700 1 -- 172.21.15.7:0/2859556654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00c7610 con 0x7f84b00c53e0 2023-10-06T11:00:52.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.703+0000 7f84ae7fc700 1 --2- 172.21.15.7:0/2859556654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84b00c53e0 0x7f84b00c5850 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f84980057f0 tx=0x7f84a401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:52.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.703+0000 7f8496ffd700 1 -- 172.21.15.7:0/2859556654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4023070 con 0x7f84b00c53e0 2023-10-06T11:00:52.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.703+0000 7f8496ffd700 1 -- 172.21.15.7:0/2859556654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a400ec10 con 0x7f84b00c53e0 2023-10-06T11:00:52.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.703+0000 7f8496ffd700 1 -- 172.21.15.7:0/2859556654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a400e710 con 0x7f84b00c53e0 2023-10-06T11:00:52.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.703+0000 7f84b532e700 1 -- 172.21.15.7:0/2859556654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b00c78f0 con 0x7f84b00c53e0 2023-10-06T11:00:52.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.703+0000 7f84b532e700 1 -- 172.21.15.7:0/2859556654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b0149270 con 0x7f84b00c53e0 2023-10-06T11:00:52.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.704+0000 7f84b532e700 1 -- 172.21.15.7:0/2859556654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b0070480 con 0x7f84b00c53e0 2023-10-06T11:00:52.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.705+0000 7f8496ffd700 1 -- 172.21.15.7:0/2859556654 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84a4013680 con 0x7f84b00c53e0 2023-10-06T11:00:52.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.705+0000 7f8496ffd700 1 --2- 172.21.15.7:0/2859556654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f849c066f30 0x7f849c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:52.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.705+0000 7f8496ffd700 1 -- 172.21.15.7:0/2859556654 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6479+0+0 (secure 0 0 0) 0x7f84a4085f90 con 0x7f84b00c53e0 2023-10-06T11:00:52.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.705+0000 7f84aeffd700 1 --2- 172.21.15.7:0/2859556654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f849c066f30 0x7f849c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:52.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.706+0000 7f84aeffd700 1 --2- 172.21.15.7:0/2859556654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f849c066f30 0x7f849c0693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f84a0001bd0 tx=0x7f84a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:52.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.710+0000 7f8496ffd700 1 -- 172.21.15.7:0/2859556654 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84a40b75a0 con 0x7f84b00c53e0 2023-10-06T11:00:52.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:52.919+0000 7f84b532e700 1 -- 172.21.15.7:0/2859556654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f84b00c5d90 con 0x7f84b00c53e0 2023-10-06T11:00:53.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.535+0000 7f8496ffd700 1 -- 172.21.15.7:0/2859556654 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) v1 ==== 169+0+0 (secure 0 0 0) 0x7f84a4052f00 con 0x7f84b00c53e0 2023-10-06T11:00:53.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.544+0000 7f84b532e700 1 -- 172.21.15.7:0/2859556654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f849c066f30 msgr2=0x7f849c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:53.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.544+0000 7f84b532e700 1 --2- 172.21.15.7:0/2859556654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f849c066f30 0x7f849c0693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f84a0001bd0 tx=0x7f84a0009040 comp rx=0 tx=0).stop 2023-10-06T11:00:53.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.544+0000 7f84b532e700 1 -- 172.21.15.7:0/2859556654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84b00c53e0 msgr2=0x7f84b00c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:53.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.544+0000 7f84b532e700 1 --2- 172.21.15.7:0/2859556654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84b00c53e0 0x7f84b00c5850 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f84980057f0 tx=0x7f84a401a000 comp rx=0 tx=0).stop 2023-10-06T11:00:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.545+0000 7f84b532e700 1 -- 172.21.15.7:0/2859556654 shutdown_connections 2023-10-06T11:00:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.545+0000 7f84b532e700 1 --2- 172.21.15.7:0/2859556654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f849c066f30 0x7f849c0693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.545+0000 7f84b532e700 1 --2- 172.21.15.7:0/2859556654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b00c8940 0x7f84b00c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.545+0000 7f84b532e700 1 --2- 172.21.15.7:0/2859556654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8498004810 0x7f84b0148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.545+0000 7f84b532e700 1 --2- 172.21.15.7:0/2859556654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84b00c53e0 0x7f84b00c5850 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.545+0000 7f84b532e700 1 -- 172.21.15.7:0/2859556654 >> 172.21.15.7:0/2859556654 conn(0x7f84b00d0b80 msgr2=0x7f84b0068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:53.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.545+0000 7f84b532e700 1 -- 172.21.15.7:0/2859556654 shutdown_connections 2023-10-06T11:00:53.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.546+0000 7f84b532e700 1 -- 172.21.15.7:0/2859556654 wait complete. 2023-10-06T11:00:53.550 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-10-06T11:00:53.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2023-10-06T11:00:53.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.705+0000 7f4dd4510700 1 Processor -- start 2023-10-06T11:00:53.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.705+0000 7f4dd4510700 1 -- start start 2023-10-06T11:00:53.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.706+0000 7f4dd4510700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dcc069e80 0x7f4dcc159460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:53.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.706+0000 7f4dd4510700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dcc0c99b0 con 0x7f4dcc0caa90 2023-10-06T11:00:53.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.706+0000 7f4dd4510700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dcc0cc280 con 0x7f4dcc0c94b0 2023-10-06T11:00:53.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.706+0000 7f4dd4510700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc0c9c70 con 0x7f4dcc069e80 2023-10-06T11:00:53.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.706+0000 7f4dd22ac700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4dcc0caa90 0x7f4dcc0c8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49874/0 (socket says 172.21.15.7:49874) 2023-10-06T11:00:53.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.706+0000 7f4dd22ac700 1 -- 172.21.15.7:0/1783786000 learned_addr learned my addr 172.21.15.7:0/1783786000 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:53.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.706+0000 7f4dd2aad700 1 --2- 172.21.15.7:0/1783786000 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dcc069e80 0x7f4dcc159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:53.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.706+0000 7f4dd12aa700 1 -- 172.21.15.7:0/1783786000 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009300906 0 0) 0x7f4dcc0c99b0 con 0x7f4dcc0caa90 2023-10-06T11:00:53.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.706+0000 7f4dd12aa700 1 -- 172.21.15.7:0/1783786000 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4db8003570 con 0x7f4dcc0caa90 2023-10-06T11:00:53.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.707+0000 7f4dd12aa700 1 -- 172.21.15.7:0/1783786000 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027362303 0 0) 0x7f4dcc0cc280 con 0x7f4dcc0c94b0 2023-10-06T11:00:53.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.707+0000 7f4dd12aa700 1 -- 172.21.15.7:0/1783786000 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dcc0c99b0 con 0x7f4dcc0c94b0 2023-10-06T11:00:53.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.707+0000 7f4dd12aa700 1 -- 172.21.15.7:0/1783786000 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1731197879 0 0) 0x7f4db8003570 con 0x7f4dcc0caa90 2023-10-06T11:00:53.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.707+0000 7f4dd2aad700 1 -- 172.21.15.7:0/1783786000 >> v1:172.21.15.50:6789/0 conn(0x7f4dcc0c94b0 legacy=0x7f4dcc158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:53.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.707+0000 7f4dd2aad700 1 -- 172.21.15.7:0/1783786000 >> v1:172.21.15.7:6789/0 conn(0x7f4dcc0caa90 legacy=0x7f4dcc0c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:53.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.707+0000 7f4dd2aad700 1 -- 172.21.15.7:0/1783786000 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc0c9f50 con 0x7f4dcc069e80 2023-10-06T11:00:53.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.707+0000 7f4dd2aad700 1 --2- 172.21.15.7:0/1783786000 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dcc069e80 0x7f4dcc159460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009e90 tx=0x7f4dc4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94a4ae0a3cac128d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:53.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.707+0000 7f4dd12aa700 1 -- 172.21.15.7:0/1783786000 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc400e070 con 0x7f4dcc069e80 2023-10-06T11:00:53.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.707+0000 7f4dd12aa700 1 -- 172.21.15.7:0/1783786000 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc400b870 con 0x7f4dcc069e80 2023-10-06T11:00:53.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.707+0000 7f4dd12aa700 1 -- 172.21.15.7:0/1783786000 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0001470 con 0x7f4dcc069e80 2023-10-06T11:00:53.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.708+0000 7f4dd4510700 1 -- 172.21.15.7:0/1783786000 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dcc069e80 msgr2=0x7f4dcc159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:53.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.708+0000 7f4dd4510700 1 --2- 172.21.15.7:0/1783786000 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dcc069e80 0x7f4dcc159460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009e90 tx=0x7f4dc4009780 comp rx=0 tx=0).stop 2023-10-06T11:00:53.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.708+0000 7f4dd4510700 1 -- 172.21.15.7:0/1783786000 shutdown_connections 2023-10-06T11:00:53.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.708+0000 7f4dd4510700 1 --2- 172.21.15.7:0/1783786000 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dcc069e80 0x7f4dcc159460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:53.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.708+0000 7f4dd4510700 1 -- 172.21.15.7:0/1783786000 >> 172.21.15.7:0/1783786000 conn(0x7f4dcc087920 msgr2=0x7f4dcc097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:53.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.708+0000 7f4dd4510700 1 -- 172.21.15.7:0/1783786000 shutdown_connections 2023-10-06T11:00:53.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.708+0000 7f4dd4510700 1 -- 172.21.15.7:0/1783786000 wait complete. 2023-10-06T11:00:53.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.709+0000 7f4dd4510700 1 Processor -- start 2023-10-06T11:00:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.710+0000 7f4dd4510700 1 -- start start 2023-10-06T11:00:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd4510700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dcc069e80 0x7f4dcc14b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd4510700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dcc0c94b0 0x7f4dcc0c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd4510700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dcc0caa90 0x7f4dcc0c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd4510700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc0c3560 con 0x7f4dcc069e80 2023-10-06T11:00:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd4510700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc0c39f0 con 0x7f4dcc0c94b0 2023-10-06T11:00:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd4510700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc0c2950 con 0x7f4dcc0caa90 2023-10-06T11:00:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd22ac700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dcc069e80 0x7f4dcc14b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd22ac700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dcc069e80 0x7f4dcc14b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45956/0 (socket says 172.21.15.7:45956) 2023-10-06T11:00:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd22ac700 1 -- 172.21.15.7:0/1342462956 learned_addr learned my addr 172.21.15.7:0/1342462956 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd1aab700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dcc0c94b0 0x7f4dcc0c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd2aad700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dcc0caa90 0x7f4dcc0c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd22ac700 1 -- 172.21.15.7:0/1342462956 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dcc0caa90 msgr2=0x7f4dcc0c20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd22ac700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dcc0caa90 0x7f4dcc0c20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd22ac700 1 -- 172.21.15.7:0/1342462956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dcc0c94b0 msgr2=0x7f4dcc0c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd22ac700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dcc0c94b0 0x7f4dcc0c1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd22ac700 1 -- 172.21.15.7:0/1342462956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4009a20 con 0x7f4dcc069e80 2023-10-06T11:00:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd2aad700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dcc0caa90 0x7f4dcc0c20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dd22ac700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dcc069e80 0x7f4dcc14b1f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000c7f0 tx=0x7f4dc0001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.711+0000 7f4dbe7fc700 1 -- 172.21.15.7:0/1342462956 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0007360 con 0x7f4dcc069e80 2023-10-06T11:00:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.712+0000 7f4dd4510700 1 -- 172.21.15.7:0/1342462956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dcc0c2c30 con 0x7f4dcc069e80 2023-10-06T11:00:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.712+0000 7f4dd4510700 1 -- 172.21.15.7:0/1342462956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dcc0c31f0 con 0x7f4dcc069e80 2023-10-06T11:00:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.712+0000 7f4dbe7fc700 1 -- 172.21.15.7:0/1342462956 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc00076d0 con 0x7f4dcc069e80 2023-10-06T11:00:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.712+0000 7f4dbe7fc700 1 -- 172.21.15.7:0/1342462956 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0004830 con 0x7f4dcc069e80 2023-10-06T11:00:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.712+0000 7f4dd4510700 1 -- 172.21.15.7:0/1342462956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db40052b0 con 0x7f4dcc069e80 2023-10-06T11:00:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.713+0000 7f4dbe7fc700 1 -- 172.21.15.7:0/1342462956 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4dc0004990 con 0x7f4dcc069e80 2023-10-06T11:00:53.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.714+0000 7f4dbe7fc700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4db0066f30 0x7f4db00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:53.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.714+0000 7f4dbe7fc700 1 -- 172.21.15.7:0/1342462956 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6007+0+0 (secure 0 0 0) 0x7f4dc0083a70 con 0x7f4dcc069e80 2023-10-06T11:00:53.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.714+0000 7f4dd1aab700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4db0066f30 0x7f4db00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:53.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.714+0000 7f4dd1aab700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4db0066f30 0x7f4db00693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8007fd0 tx=0x7f4dc8007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:53.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.718+0000 7f4dbe7fc700 1 -- 172.21.15.7:0/1342462956 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4dc004c5a0 con 0x7f4dcc069e80 2023-10-06T11:00:53.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:53.924+0000 7f4dd4510700 1 -- 172.21.15.7:0/1342462956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4db4005830 con 0x7f4dcc069e80 2023-10-06T11:00:54.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.550+0000 7f4dbe7fc700 1 -- 172.21.15.7:0/1342462956 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v48) v1 ==== 160+0+0 (secure 0 0 0) 0x7f4dc0018020 con 0x7f4dcc069e80 2023-10-06T11:00:54.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.555+0000 7f4dd4510700 1 -- 172.21.15.7:0/1342462956 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4db0066f30 msgr2=0x7f4db00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:54.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.555+0000 7f4dd4510700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4db0066f30 0x7f4db00693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8007fd0 tx=0x7f4dc8007d10 comp rx=0 tx=0).stop 2023-10-06T11:00:54.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.555+0000 7f4dd4510700 1 -- 172.21.15.7:0/1342462956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dcc069e80 msgr2=0x7f4dcc14b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:54.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.555+0000 7f4dd4510700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dcc069e80 0x7f4dcc14b1f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000c7f0 tx=0x7f4dc0001a10 comp rx=0 tx=0).stop 2023-10-06T11:00:54.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.555+0000 7f4dd4510700 1 -- 172.21.15.7:0/1342462956 shutdown_connections 2023-10-06T11:00:54.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.555+0000 7f4dd4510700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4db0066f30 0x7f4db00693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.555+0000 7f4dd4510700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dcc069e80 0x7f4dcc14b1f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.555+0000 7f4dd4510700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dcc0caa90 0x7f4dcc0c20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.555+0000 7f4dd4510700 1 --2- 172.21.15.7:0/1342462956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dcc0c94b0 0x7f4dcc0c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.555+0000 7f4dd4510700 1 -- 172.21.15.7:0/1342462956 >> 172.21.15.7:0/1342462956 conn(0x7f4dcc087920 msgr2=0x7f4dcc0b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:54.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.555+0000 7f4dd4510700 1 -- 172.21.15.7:0/1342462956 shutdown_connections 2023-10-06T11:00:54.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.555+0000 7f4dd4510700 1 -- 172.21.15.7:0/1342462956 wait complete. 2023-10-06T11:00:54.559 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'data_new' removed 2023-10-06T11:00:54.573 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:00:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.711+0000 7fdd25669700 1 Processor -- start 2023-10-06T11:00:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.711+0000 7fdd25669700 1 -- start start 2023-10-06T11:00:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.712+0000 7fdd25669700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd201594c0 0x7fdd200aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.712+0000 7fdd25669700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd200cb700 0x7fdd200af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.712+0000 7fdd25669700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd200cf870 con 0x7fdd20159890 2023-10-06T11:00:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.712+0000 7fdd25669700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd200cecf0 con 0x7fdd200cb700 2023-10-06T11:00:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.712+0000 7fdd25669700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200b1030 con 0x7fdd201594c0 2023-10-06T11:00:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.712+0000 7fdd1e7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdd20159890 0x7fdd200caff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49884/0 (socket says 172.21.15.7:49884) 2023-10-06T11:00:54.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.712+0000 7fdd1e7fc700 1 -- 172.21.15.7:0/1646601479 learned_addr learned my addr 172.21.15.7:0/1646601479 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:54.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.712+0000 7fdd1effd700 1 --2- 172.21.15.7:0/1646601479 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd201594c0 0x7fdd200aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:54.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.712+0000 7fdd1f7fe700 1 --2- 172.21.15.7:0/1646601479 >> v2:172.21.15.50:3300/0 conn(0x7fdd200cb700 0x7fdd200af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:54.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.712+0000 7fdd1dffb700 1 -- 172.21.15.7:0/1646601479 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958930868 0 0) 0x7fdd200cf870 con 0x7fdd20159890 2023-10-06T11:00:54.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.712+0000 7fdd1dffb700 1 -- 172.21.15.7:0/1646601479 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd08003570 con 0x7fdd20159890 2023-10-06T11:00:54.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.713+0000 7fdd1effd700 1 -- 172.21.15.7:0/1646601479 >> v2:172.21.15.50:3300/0 conn(0x7fdd200cb700 msgr2=0x7fdd200af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:54.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.713+0000 7fdd1effd700 1 --2- 172.21.15.7:0/1646601479 >> v2:172.21.15.50:3300/0 conn(0x7fdd200cb700 0x7fdd200af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.713+0000 7fdd1effd700 1 -- 172.21.15.7:0/1646601479 >> v1:172.21.15.7:6789/0 conn(0x7fdd20159890 legacy=0x7fdd200caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:54.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.713+0000 7fdd1dffb700 1 -- 172.21.15.7:0/1646601479 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3356198320 0 0) 0x7fdd08003570 con 0x7fdd20159890 2023-10-06T11:00:54.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.713+0000 7fdd1effd700 1 -- 172.21.15.7:0/1646601479 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd200cef40 con 0x7fdd201594c0 2023-10-06T11:00:54.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.713+0000 7fdd1f7fe700 1 --2- 172.21.15.7:0/1646601479 >> v2:172.21.15.50:3300/0 conn(0x7fdd200cb700 0x7fdd200af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:54.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.713+0000 7fdd1effd700 1 --2- 172.21.15.7:0/1646601479 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd201594c0 0x7fdd200aed30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdd100098e0 tx=0x7fdd100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c28812e5dd043ede server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:54.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.713+0000 7fdd1dffb700 1 -- 172.21.15.7:0/1646601479 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10011630 con 0x7fdd201594c0 2023-10-06T11:00:54.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.713+0000 7fdd1dffb700 1 -- 172.21.15.7:0/1646601479 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd10011790 con 0x7fdd201594c0 2023-10-06T11:00:54.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.713+0000 7fdd1dffb700 1 -- 172.21.15.7:0/1646601479 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10011b30 con 0x7fdd201594c0 2023-10-06T11:00:54.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.714+0000 7fdd25669700 1 -- 172.21.15.7:0/1646601479 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd201594c0 msgr2=0x7fdd200aed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:54.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.714+0000 7fdd25669700 1 --2- 172.21.15.7:0/1646601479 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd201594c0 0x7fdd200aed30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdd100098e0 tx=0x7fdd100091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.714+0000 7fdd25669700 1 -- 172.21.15.7:0/1646601479 shutdown_connections 2023-10-06T11:00:54.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.714+0000 7fdd25669700 1 --2- 172.21.15.7:0/1646601479 >> v2:172.21.15.50:3300/0 conn(0x7fdd200cb700 0x7fdd200af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.714+0000 7fdd25669700 1 --2- 172.21.15.7:0/1646601479 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd201594c0 0x7fdd200aed30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.714+0000 7fdd25669700 1 -- 172.21.15.7:0/1646601479 >> 172.21.15.7:0/1646601479 conn(0x7fdd20067bc0 msgr2=0x7fdd200d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:54.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.714+0000 7fdd25669700 1 -- 172.21.15.7:0/1646601479 shutdown_connections 2023-10-06T11:00:54.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.714+0000 7fdd25669700 1 -- 172.21.15.7:0/1646601479 wait complete. 2023-10-06T11:00:54.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.716+0000 7fdd25669700 1 Processor -- start 2023-10-06T11:00:54.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.716+0000 7fdd25669700 1 -- start start 2023-10-06T11:00:54.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd25669700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd200cb700 0x7fdd20154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:54.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd25669700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd201594c0 0x7fdd200b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:54.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd25669700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd20159890 0x7fdd2015b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:54.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd25669700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd20154d60 con 0x7fdd200cb700 2023-10-06T11:00:54.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd25669700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200b5f70 con 0x7fdd201594c0 2023-10-06T11:00:54.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd25669700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2015d440 con 0x7fdd20159890 2023-10-06T11:00:54.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd1effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd200cb700 0x7fdd20154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:54.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd1effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd200cb700 0x7fdd20154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45972/0 (socket says 172.21.15.7:45972) 2023-10-06T11:00:54.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd1effd700 1 -- 172.21.15.7:0/1096419295 learned_addr learned my addr 172.21.15.7:0/1096419295 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:54.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd1e7fc700 1 --2- 172.21.15.7:0/1096419295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd201594c0 0x7fdd200b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:54.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd1f7fe700 1 --2- 172.21.15.7:0/1096419295 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd20159890 0x7fdd2015b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:54.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd1effd700 1 -- 172.21.15.7:0/1096419295 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd20159890 msgr2=0x7fdd2015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:54.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd1effd700 1 --2- 172.21.15.7:0/1096419295 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd20159890 0x7fdd2015b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd1effd700 1 -- 172.21.15.7:0/1096419295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd201594c0 msgr2=0x7fdd200b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd1effd700 1 --2- 172.21.15.7:0/1096419295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd201594c0 0x7fdd200b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd1effd700 1 -- 172.21.15.7:0/1096419295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd18009a20 con 0x7fdd200cb700 2023-10-06T11:00:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd1effd700 1 --2- 172.21.15.7:0/1096419295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd200cb700 0x7fdd20154820 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdd200b1170 tx=0x7fdd10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.717+0000 7fdd06ffd700 1 -- 172.21.15.7:0/1096419295 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1001f070 con 0x7fdd200cb700 2023-10-06T11:00:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.718+0000 7fdd06ffd700 1 -- 172.21.15.7:0/1096419295 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd10011900 con 0x7fdd200cb700 2023-10-06T11:00:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.718+0000 7fdd25669700 1 -- 172.21.15.7:0/1096419295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd10009420 con 0x7fdd200cb700 2023-10-06T11:00:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.718+0000 7fdd06ffd700 1 -- 172.21.15.7:0/1096419295 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10023410 con 0x7fdd200cb700 2023-10-06T11:00:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.718+0000 7fdd25669700 1 -- 172.21.15.7:0/1096419295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2015da00 con 0x7fdd200cb700 2023-10-06T11:00:54.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.719+0000 7fdd25669700 1 -- 172.21.15.7:0/1096419295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd20070480 con 0x7fdd200cb700 2023-10-06T11:00:54.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.719+0000 7fdd06ffd700 1 -- 172.21.15.7:0/1096419295 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd100237e0 con 0x7fdd200cb700 2023-10-06T11:00:54.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.719+0000 7fdd06ffd700 1 --2- 172.21.15.7:0/1096419295 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdd0c066f30 0x7fdd0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:54.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.720+0000 7fdd06ffd700 1 -- 172.21.15.7:0/1096419295 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fdd10085730 con 0x7fdd200cb700 2023-10-06T11:00:54.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.720+0000 7fdd1e7fc700 1 --2- 172.21.15.7:0/1096419295 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdd0c066f30 0x7fdd0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:54.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.720+0000 7fdd1e7fc700 1 --2- 172.21.15.7:0/1096419295 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdd0c066f30 0x7fdd0c0693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdd2015fb40 tx=0x7fdd140059e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:54.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.724+0000 7fdd06ffd700 1 -- 172.21.15.7:0/1096419295 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd10052960 con 0x7fdd200cb700 2023-10-06T11:00:54.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.925+0000 7fdd25669700 1 -- 172.21.15.7:0/1096419295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdd200ce9a0 con 0x7fdd200cb700 2023-10-06T11:00:54.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.929+0000 7fdd06ffd700 1 -- 172.21.15.7:0/1096419295 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdd10055f80 con 0x7fdd200cb700 2023-10-06T11:00:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.932+0000 7fdd25669700 1 -- 172.21.15.7:0/1096419295 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdd0c066f30 msgr2=0x7fdd0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.932+0000 7fdd25669700 1 --2- 172.21.15.7:0/1096419295 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdd0c066f30 0x7fdd0c0693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdd2015fb40 tx=0x7fdd140059e0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.932+0000 7fdd25669700 1 -- 172.21.15.7:0/1096419295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd200cb700 msgr2=0x7fdd20154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.932+0000 7fdd25669700 1 --2- 172.21.15.7:0/1096419295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd200cb700 0x7fdd20154820 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdd200b1170 tx=0x7fdd10017000 comp rx=0 tx=0).stop 2023-10-06T11:00:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.932+0000 7fdd25669700 1 -- 172.21.15.7:0/1096419295 shutdown_connections 2023-10-06T11:00:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.932+0000 7fdd25669700 1 --2- 172.21.15.7:0/1096419295 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdd0c066f30 0x7fdd0c0693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.932+0000 7fdd25669700 1 --2- 172.21.15.7:0/1096419295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd200cb700 0x7fdd20154820 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.932+0000 7fdd25669700 1 --2- 172.21.15.7:0/1096419295 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd20159890 0x7fdd2015b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.932+0000 7fdd25669700 1 --2- 172.21.15.7:0/1096419295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd201594c0 0x7fdd200b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.932+0000 7fdd25669700 1 -- 172.21.15.7:0/1096419295 >> 172.21.15.7:0/1096419295 conn(0x7fdd20067bc0 msgr2=0x7fdd200cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:54.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.932+0000 7fdd25669700 1 -- 172.21.15.7:0/1096419295 shutdown_connections 2023-10-06T11:00:54.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:54.932+0000 7fdd25669700 1 -- 172.21.15.7:0/1096419295 wait complete. 2023-10-06T11:00:54.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-10-06T11:00:55.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.077+0000 7ff853a1a700 1 Processor -- start 2023-10-06T11:00:55.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.077+0000 7ff853a1a700 1 -- start start 2023-10-06T11:00:55.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.078+0000 7ff853a1a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff84c158120 0x7ff84c0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:55.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.078+0000 7ff853a1a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff84c0c8ba0 0x7ff84c0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:55.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.078+0000 7ff853a1a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84c0cbd10 con 0x7ff84c0cac60 2023-10-06T11:00:55.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.078+0000 7ff853a1a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84c0cb9e0 con 0x7ff84c0c8ba0 2023-10-06T11:00:55.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.078+0000 7ff853a1a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c0c9300 con 0x7ff84c158120 2023-10-06T11:00:55.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.078+0000 7ff850fb5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff84c0c8ba0 0x7ff84c0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:55.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.078+0000 7ff850fb5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff84c0c8ba0 0x7ff84c0ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45982/0 (socket says 172.21.15.7:45982) 2023-10-06T11:00:55.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.078+0000 7ff850fb5700 1 -- 172.21.15.7:0/1046627618 learned_addr learned my addr 172.21.15.7:0/1046627618 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:55.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.079+0000 7ff8517b6700 1 --2- 172.21.15.7:0/1046627618 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff84c158120 0x7ff84c0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:55.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.079+0000 7ff850fb5700 1 -- 172.21.15.7:0/1046627618 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff84c158120 msgr2=0x7ff84c0c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:55.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.079+0000 7ff850fb5700 1 --2- 172.21.15.7:0/1046627618 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff84c158120 0x7ff84c0c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:55.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.079+0000 7ff850fb5700 1 -- 172.21.15.7:0/1046627618 >> v1:172.21.15.50:6789/0 conn(0x7ff84c0cac60 legacy=0x7ff84c15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:55.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.079+0000 7ff850fb5700 1 -- 172.21.15.7:0/1046627618 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c0c95e0 con 0x7ff84c0c8ba0 2023-10-06T11:00:55.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.079+0000 7ff850fb5700 1 --2- 172.21.15.7:0/1046627618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84c0c8ba0 0x7ff84c0ca720 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0099b0 tx=0x7ff83c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e5f8a836b98b61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:55.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.079+0000 7ff843fff700 1 -- 172.21.15.7:0/1046627618 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00b860 con 0x7ff84c0c8ba0 2023-10-06T11:00:55.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.079+0000 7ff843fff700 1 -- 172.21.15.7:0/1046627618 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c00b9c0 con 0x7ff84c0c8ba0 2023-10-06T11:00:55.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.079+0000 7ff843fff700 1 -- 172.21.15.7:0/1046627618 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00bd60 con 0x7ff84c0c8ba0 2023-10-06T11:00:55.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.080+0000 7ff853a1a700 1 -- 172.21.15.7:0/1046627618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84c0c8ba0 msgr2=0x7ff84c0ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:55.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.080+0000 7ff853a1a700 1 --2- 172.21.15.7:0/1046627618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84c0c8ba0 0x7ff84c0ca720 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0099b0 tx=0x7ff83c009250 comp rx=0 tx=0).stop 2023-10-06T11:00:55.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.080+0000 7ff853a1a700 1 -- 172.21.15.7:0/1046627618 shutdown_connections 2023-10-06T11:00:55.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.080+0000 7ff853a1a700 1 --2- 172.21.15.7:0/1046627618 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff84c158120 0x7ff84c0c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:55.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.080+0000 7ff853a1a700 1 --2- 172.21.15.7:0/1046627618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84c0c8ba0 0x7ff84c0ca720 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:55.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.080+0000 7ff853a1a700 1 -- 172.21.15.7:0/1046627618 >> 172.21.15.7:0/1046627618 conn(0x7ff84c087920 msgr2=0x7ff84c097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:55.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.080+0000 7ff853a1a700 1 -- 172.21.15.7:0/1046627618 shutdown_connections 2023-10-06T11:00:55.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.080+0000 7ff853a1a700 1 -- 172.21.15.7:0/1046627618 wait complete. 2023-10-06T11:00:55.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.081+0000 7ff853a1a700 1 Processor -- start 2023-10-06T11:00:55.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.081+0000 7ff853a1a700 1 -- start start 2023-10-06T11:00:55.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.082+0000 7ff853a1a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff84c0c8ba0 0x7ff84c06a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:55.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.082+0000 7ff853a1a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff84c0cac60 0x7ff84c0af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:55.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.082+0000 7ff853a1a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84c158120 0x7ff84c0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:55.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.082+0000 7ff853a1a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c14b880 con 0x7ff84c158120 2023-10-06T11:00:55.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.082+0000 7ff853a1a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c068b30 con 0x7ff84c0c8ba0 2023-10-06T11:00:55.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.082+0000 7ff853a1a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c068e10 con 0x7ff84c0cac60 2023-10-06T11:00:55.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.082+0000 7ff851fb7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84c158120 0x7ff84c0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:55.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.082+0000 7ff851fb7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84c158120 0x7ff84c0afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45990/0 (socket says 172.21.15.7:45990) 2023-10-06T11:00:55.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.082+0000 7ff851fb7700 1 -- 172.21.15.7:0/2112003412 learned_addr learned my addr 172.21.15.7:0/2112003412 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:55.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.082+0000 7ff8517b6700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff84c0c8ba0 0x7ff84c06a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:55.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.082+0000 7ff850fb5700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff84c0cac60 0x7ff84c0af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:55.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.083+0000 7ff851fb7700 1 -- 172.21.15.7:0/2112003412 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff84c0cac60 msgr2=0x7ff84c0af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:55.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.083+0000 7ff851fb7700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff84c0cac60 0x7ff84c0af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:55.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.083+0000 7ff851fb7700 1 -- 172.21.15.7:0/2112003412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff84c0c8ba0 msgr2=0x7ff84c06a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:55.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.083+0000 7ff851fb7700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff84c0c8ba0 0x7ff84c06a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:55.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.083+0000 7ff851fb7700 1 -- 172.21.15.7:0/2112003412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c0094f0 con 0x7ff84c158120 2023-10-06T11:00:55.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.083+0000 7ff850fb5700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff84c0cac60 0x7ff84c0af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:55.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.083+0000 7ff851fb7700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84c158120 0x7ff84c0afbb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff84400c8e0 tx=0x7ff844001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:55.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.083+0000 7ff8417fa700 1 -- 172.21.15.7:0/2112003412 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff844012630 con 0x7ff84c158120 2023-10-06T11:00:55.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.083+0000 7ff8417fa700 1 -- 172.21.15.7:0/2112003412 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff844012790 con 0x7ff84c158120 2023-10-06T11:00:55.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.083+0000 7ff853a1a700 1 -- 172.21.15.7:0/2112003412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84c0690f0 con 0x7ff84c158120 2023-10-06T11:00:55.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.083+0000 7ff8417fa700 1 -- 172.21.15.7:0/2112003412 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff844012b50 con 0x7ff84c158120 2023-10-06T11:00:55.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.083+0000 7ff853a1a700 1 -- 172.21.15.7:0/2112003412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84c150900 con 0x7ff84c158120 2023-10-06T11:00:55.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.084+0000 7ff853a1a700 1 -- 172.21.15.7:0/2112003412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84c070480 con 0x7ff84c158120 2023-10-06T11:00:55.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.085+0000 7ff8417fa700 1 -- 172.21.15.7:0/2112003412 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff844024420 con 0x7ff84c158120 2023-10-06T11:00:55.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.086+0000 7ff8417fa700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff830066f30 0x7ff8300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:55.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.086+0000 7ff8417fa700 1 -- 172.21.15.7:0/2112003412 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5612+0+0 (secure 0 0 0) 0x7ff844084f30 con 0x7ff84c158120 2023-10-06T11:00:55.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.086+0000 7ff8517b6700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff830066f30 0x7ff8300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:55.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.086+0000 7ff8517b6700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff830066f30 0x7ff8300693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff8480061f0 tx=0x7ff848008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:55.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.089+0000 7ff8417fa700 1 -- 172.21.15.7:0/2112003412 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff844052280 con 0x7ff84c158120 2023-10-06T11:00:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.379+0000 7ff853a1a700 1 -- 172.21.15.7:0/2112003412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7ff84c0c98c0 con 0x7ff84c158120 2023-10-06T11:00:55.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.550+0000 7ff8417fa700 1 -- 172.21.15.7:0/2112003412 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v119) v1 ==== 147+0+0 (secure 0 0 0) 0x7ff8440558a0 con 0x7ff84c158120 2023-10-06T11:00:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.553+0000 7ff853a1a700 1 -- 172.21.15.7:0/2112003412 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff830066f30 msgr2=0x7ff8300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.553+0000 7ff853a1a700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff830066f30 0x7ff8300693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff8480061f0 tx=0x7ff848008040 comp rx=0 tx=0).stop 2023-10-06T11:00:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.553+0000 7ff853a1a700 1 -- 172.21.15.7:0/2112003412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84c158120 msgr2=0x7ff84c0afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.553+0000 7ff853a1a700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84c158120 0x7ff84c0afbb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff84400c8e0 tx=0x7ff844001710 comp rx=0 tx=0).stop 2023-10-06T11:00:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.553+0000 7ff853a1a700 1 -- 172.21.15.7:0/2112003412 shutdown_connections 2023-10-06T11:00:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.553+0000 7ff853a1a700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff830066f30 0x7ff8300693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:55.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.553+0000 7ff853a1a700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84c158120 0x7ff84c0afbb0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:55.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.553+0000 7ff853a1a700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff84c0c8ba0 0x7ff84c06a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:55.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.553+0000 7ff853a1a700 1 --2- 172.21.15.7:0/2112003412 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff84c0cac60 0x7ff84c0af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:55.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.553+0000 7ff853a1a700 1 -- 172.21.15.7:0/2112003412 >> 172.21.15.7:0/2112003412 conn(0x7ff84c087920 msgr2=0x7ff84c0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:55.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.553+0000 7ff853a1a700 1 -- 172.21.15.7:0/2112003412 shutdown_connections 2023-10-06T11:00:55.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.553+0000 7ff853a1a700 1 -- 172.21.15.7:0/2112003412 wait complete. 2023-10-06T11:00:55.570 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2023-10-06T11:00:55.571 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-10-06T11:00:55.571 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-10-06T11:00:55.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.708+0000 7f03cb355700 1 Processor -- start 2023-10-06T11:00:55.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.708+0000 7f03cb355700 1 -- start start 2023-10-06T11:00:55.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.709+0000 7f03cb355700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f03c40c8d70 0x7f03c40ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:55.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.709+0000 7f03cb355700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03c40cac60 0x7f03c40cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:55.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.709+0000 7f03cb355700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c40cbd10 con 0x7f03c4158120 2023-10-06T11:00:55.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.709+0000 7f03cb355700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c40cb9e0 con 0x7f03c40c8d70 2023-10-06T11:00:55.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.709+0000 7f03cb355700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40c9300 con 0x7f03c40cac60 2023-10-06T11:00:55.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.709+0000 7f03c88f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f03c40c8d70 0x7f03c40ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:55.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.709+0000 7f03c98f2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03c40cac60 0x7f03c40cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:55.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.709+0000 7f03c90f1700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f03c4158120 0x7f03c40c8660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:33508/0 (socket says 172.21.15.7:33508) 2023-10-06T11:00:55.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.709+0000 7f03c88f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f03c40c8d70 0x7f03c40ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:52988/0 (socket says 172.21.15.7:52988) 2023-10-06T11:00:55.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.709+0000 7f03c98f2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03c40cac60 0x7f03c40cc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:51718/0 (socket says 172.21.15.7:51718) 2023-10-06T11:00:55.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.709+0000 7f03c90f1700 1 -- 172.21.15.7:0/1055706294 learned_addr learned my addr 172.21.15.7:0/1055706294 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:55.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.710+0000 7f03b7fff700 1 -- 172.21.15.7:0/1055706294 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329491292 0 0) 0x7f03c40cbd10 con 0x7f03c4158120 2023-10-06T11:00:55.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.710+0000 7f03b7fff700 1 -- 172.21.15.7:0/1055706294 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03b0003570 con 0x7f03c4158120 2023-10-06T11:00:55.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.710+0000 7f03c98f2700 1 -- 172.21.15.7:0/1055706294 >> v2:172.21.15.50:3300/0 conn(0x7f03c40c8d70 msgr2=0x7f03c40ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:55.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.710+0000 7f03c98f2700 1 --2- 172.21.15.7:0/1055706294 >> v2:172.21.15.50:3300/0 conn(0x7f03c40c8d70 0x7f03c40ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:55.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.710+0000 7f03c98f2700 1 -- 172.21.15.7:0/1055706294 >> v1:172.21.15.50:6789/0 conn(0x7f03c4158120 legacy=0x7f03c40c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:55.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.710+0000 7f03c98f2700 1 -- 172.21.15.7:0/1055706294 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c40c95e0 con 0x7f03c40cac60 2023-10-06T11:00:55.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.710+0000 7f03c88f0700 1 --2- 172.21.15.7:0/1055706294 >> v2:172.21.15.50:3300/0 conn(0x7f03c40c8d70 0x7f03c40ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:55.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.710+0000 7f03c98f2700 1 --2- 172.21.15.7:0/1055706294 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03c40cac60 0x7f03c40cc1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009e60 tx=0x7f03bc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3ba67ebd71293c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:55.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.710+0000 7f03b7fff700 1 -- 172.21.15.7:0/1055706294 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc00e070 con 0x7f03c40cac60 2023-10-06T11:00:55.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.710+0000 7f03b7fff700 1 -- 172.21.15.7:0/1055706294 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc00bab0 con 0x7f03c40cac60 2023-10-06T11:00:55.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.710+0000 7f03b7fff700 1 -- 172.21.15.7:0/1055706294 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc00be30 con 0x7f03c40cac60 2023-10-06T11:00:55.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.711+0000 7f03cb355700 1 -- 172.21.15.7:0/1055706294 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03c40cac60 msgr2=0x7f03c40cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:55.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.711+0000 7f03cb355700 1 --2- 172.21.15.7:0/1055706294 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03c40cac60 0x7f03c40cc1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009e60 tx=0x7f03bc009780 comp rx=0 tx=0).stop 2023-10-06T11:00:55.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.711+0000 7f03cb355700 1 -- 172.21.15.7:0/1055706294 shutdown_connections 2023-10-06T11:00:55.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.711+0000 7f03cb355700 1 --2- 172.21.15.7:0/1055706294 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03c40cac60 0x7f03c40cc1a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:55.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.711+0000 7f03cb355700 1 --2- 172.21.15.7:0/1055706294 >> v2:172.21.15.50:3300/0 conn(0x7f03c40c8d70 0x7f03c40ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:55.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.711+0000 7f03cb355700 1 -- 172.21.15.7:0/1055706294 >> 172.21.15.7:0/1055706294 conn(0x7f03c4087920 msgr2=0x7f03c4097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:55.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.711+0000 7f03cb355700 1 -- 172.21.15.7:0/1055706294 shutdown_connections 2023-10-06T11:00:55.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.711+0000 7f03cb355700 1 -- 172.21.15.7:0/1055706294 wait complete. 2023-10-06T11:00:55.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.712+0000 7f03cb355700 1 Processor -- start 2023-10-06T11:00:55.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.712+0000 7f03cb355700 1 -- start start 2023-10-06T11:00:55.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.713+0000 7f03cb355700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03c40c8d70 0x7f03c40c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:55.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.713+0000 7f03cb355700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c40cac60 0x7f03c4167640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.713+0000 7f03cb355700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03c4158120 0x7f03c4167b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.713+0000 7f03cb355700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40c44c0 con 0x7f03c40cac60 2023-10-06T11:00:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.713+0000 7f03cb355700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40c38b0 con 0x7f03c4158120 2023-10-06T11:00:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.713+0000 7f03cb355700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40c3b90 con 0x7f03c40c8d70 2023-10-06T11:00:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.713+0000 7f03c88f0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c40cac60 0x7f03c4167640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.713+0000 7f03c88f0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c40cac60 0x7f03c4167640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46004/0 (socket says 172.21.15.7:46004) 2023-10-06T11:00:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.713+0000 7f03c88f0700 1 -- 172.21.15.7:0/3103858938 learned_addr learned my addr 172.21.15.7:0/3103858938 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.714+0000 7f03c90f1700 1 --2- 172.21.15.7:0/3103858938 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03c40c8d70 0x7f03c40c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.714+0000 7f03c98f2700 1 --2- 172.21.15.7:0/3103858938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03c4158120 0x7f03c4167b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.714+0000 7f03c88f0700 1 -- 172.21.15.7:0/3103858938 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03c40c8d70 msgr2=0x7f03c40c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.714+0000 7f03c88f0700 1 --2- 172.21.15.7:0/3103858938 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03c40c8d70 0x7f03c40c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.714+0000 7f03c88f0700 1 -- 172.21.15.7:0/3103858938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03c4158120 msgr2=0x7f03c4167b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.714+0000 7f03c88f0700 1 --2- 172.21.15.7:0/3103858938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03c4158120 0x7f03c4167b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.714+0000 7f03c88f0700 1 -- 172.21.15.7:0/3103858938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c0009420 con 0x7f03c40cac60 2023-10-06T11:00:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.714+0000 7f03c88f0700 1 --2- 172.21.15.7:0/3103858938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c40cac60 0x7f03c4167640 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f03c000ec80 tx=0x7f03c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.714+0000 7f03b57fa700 1 -- 172.21.15.7:0/3103858938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c000c850 con 0x7f03c40cac60 2023-10-06T11:00:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.714+0000 7f03b57fa700 1 -- 172.21.15.7:0/3103858938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c000c9b0 con 0x7f03c40cac60 2023-10-06T11:00:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.714+0000 7f03b57fa700 1 -- 172.21.15.7:0/3103858938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c000cd30 con 0x7f03c40cac60 2023-10-06T11:00:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.714+0000 7f03cb355700 1 -- 172.21.15.7:0/3103858938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03bc009a20 con 0x7f03c40cac60 2023-10-06T11:00:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.714+0000 7f03cb355700 1 -- 172.21.15.7:0/3103858938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c40c4150 con 0x7f03c40cac60 2023-10-06T11:00:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.715+0000 7f03cb355700 1 -- 172.21.15.7:0/3103858938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c4070480 con 0x7f03c40cac60 2023-10-06T11:00:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.716+0000 7f03b57fa700 1 -- 172.21.15.7:0/3103858938 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03c0013680 con 0x7f03c40cac60 2023-10-06T11:00:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.716+0000 7f03b57fa700 1 --2- 172.21.15.7:0/3103858938 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f03a8066f30 0x7f03a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.716+0000 7f03b57fa700 1 -- 172.21.15.7:0/3103858938 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f03c0084710 con 0x7f03c40cac60 2023-10-06T11:00:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.716+0000 7f03c90f1700 1 --2- 172.21.15.7:0/3103858938 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f03a8066f30 0x7f03a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.717+0000 7f03c90f1700 1 --2- 172.21.15.7:0/3103858938 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f03a8066f30 0x7f03a80693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f03b8000c00 tx=0x7f03b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:55.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:55.721+0000 7f03b57fa700 1 -- 172.21.15.7:0/3103858938 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03c0055470 con 0x7f03c40cac60 2023-10-06T11:00:56.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.010+0000 7f03cb355700 1 -- 172.21.15.7:0/3103858938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7f03c40c98c0 con 0x7f03c40cac60 2023-10-06T11:00:56.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.554+0000 7f03b57fa700 1 -- 172.21.15.7:0/3103858938 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v120) v1 ==== 137+0+0 (secure 0 0 0) 0x7f03c0055000 con 0x7f03c40cac60 2023-10-06T11:00:56.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.556+0000 7f03cb355700 1 -- 172.21.15.7:0/3103858938 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f03a8066f30 msgr2=0x7f03a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:56.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.556+0000 7f03cb355700 1 --2- 172.21.15.7:0/3103858938 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f03a8066f30 0x7f03a80693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f03b8000c00 tx=0x7f03b8009040 comp rx=0 tx=0).stop 2023-10-06T11:00:56.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.556+0000 7f03cb355700 1 -- 172.21.15.7:0/3103858938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c40cac60 msgr2=0x7f03c4167640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:56.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.556+0000 7f03cb355700 1 --2- 172.21.15.7:0/3103858938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c40cac60 0x7f03c4167640 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f03c000ec80 tx=0x7f03c00091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:56.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.556+0000 7f03cb355700 1 -- 172.21.15.7:0/3103858938 shutdown_connections 2023-10-06T11:00:56.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.556+0000 7f03cb355700 1 --2- 172.21.15.7:0/3103858938 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f03a8066f30 0x7f03a80693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:56.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.557+0000 7f03cb355700 1 --2- 172.21.15.7:0/3103858938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03c4158120 0x7f03c4167b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:56.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.557+0000 7f03cb355700 1 --2- 172.21.15.7:0/3103858938 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03c40c8d70 0x7f03c40c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:56.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.557+0000 7f03cb355700 1 --2- 172.21.15.7:0/3103858938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c40cac60 0x7f03c4167640 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:56.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.557+0000 7f03cb355700 1 -- 172.21.15.7:0/3103858938 >> 172.21.15.7:0/3103858938 conn(0x7f03c4087920 msgr2=0x7f03c40ac040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:56.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.557+0000 7f03cb355700 1 -- 172.21.15.7:0/3103858938 shutdown_connections 2023-10-06T11:00:56.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.557+0000 7f03cb355700 1 -- 172.21.15.7:0/3103858938 wait complete. 2023-10-06T11:00:56.574 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:00:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.710+0000 7f54127f9700 1 Processor -- start 2023-10-06T11:00:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.710+0000 7f54127f9700 1 -- start start 2023-10-06T11:00:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.711+0000 7f54127f9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f540c06c850 0x7f540c158d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.711+0000 7f54127f9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f540c1592b0 0x7f540c0690f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.711+0000 7f54127f9700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c0c8510 con 0x7f540c06c480 2023-10-06T11:00:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.711+0000 7f54127f9700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c0c96c0 con 0x7f540c1592b0 2023-10-06T11:00:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.711+0000 7f54127f9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c069e20 con 0x7f540c06c850 2023-10-06T11:00:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.712+0000 7f540b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f540c06c850 0x7f540c158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.712+0000 7f5410d96700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f540c1592b0 0x7f540c0690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.712+0000 7f540bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f540c06c480 0x7f540c0c8fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:33516/0 (socket says 172.21.15.7:33516) 2023-10-06T11:00:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.712+0000 7f540bfff700 1 -- 172.21.15.7:0/818739557 learned_addr learned my addr 172.21.15.7:0/818739557 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:56.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.712+0000 7f540affd700 1 -- 172.21.15.7:0/818739557 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705937996 0 0) 0x7f540c0c8510 con 0x7f540c06c480 2023-10-06T11:00:56.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.712+0000 7f540affd700 1 -- 172.21.15.7:0/818739557 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53f4003570 con 0x7f540c06c480 2023-10-06T11:00:56.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.712+0000 7f5410d96700 1 -- 172.21.15.7:0/818739557 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f540c06c850 msgr2=0x7f540c158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:56.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.712+0000 7f5410d96700 1 --2- 172.21.15.7:0/818739557 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f540c06c850 0x7f540c158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:56.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.712+0000 7f5410d96700 1 -- 172.21.15.7:0/818739557 >> v1:172.21.15.50:6789/0 conn(0x7f540c06c480 legacy=0x7f540c0c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:56.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.712+0000 7f5410d96700 1 -- 172.21.15.7:0/818739557 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c0c87b0 con 0x7f540c1592b0 2023-10-06T11:00:56.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.712+0000 7f540b7fe700 1 --2- 172.21.15.7:0/818739557 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f540c06c850 0x7f540c158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:56.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.713+0000 7f5410d96700 1 --2- 172.21.15.7:0/818739557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c1592b0 0x7f540c0690f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5404009e60 tx=0x7f5404009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f7760f8cf232d8f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:56.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.713+0000 7f540affd700 1 -- 172.21.15.7:0/818739557 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400e070 con 0x7f540c1592b0 2023-10-06T11:00:56.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.713+0000 7f540affd700 1 -- 172.21.15.7:0/818739557 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540400bab0 con 0x7f540c1592b0 2023-10-06T11:00:56.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.713+0000 7f540affd700 1 -- 172.21.15.7:0/818739557 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400be70 con 0x7f540c1592b0 2023-10-06T11:00:56.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.713+0000 7f54127f9700 1 -- 172.21.15.7:0/818739557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c1592b0 msgr2=0x7f540c0690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:56.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.713+0000 7f54127f9700 1 --2- 172.21.15.7:0/818739557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c1592b0 0x7f540c0690f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5404009e60 tx=0x7f5404009780 comp rx=0 tx=0).stop 2023-10-06T11:00:56.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.713+0000 7f54127f9700 1 -- 172.21.15.7:0/818739557 shutdown_connections 2023-10-06T11:00:56.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.713+0000 7f54127f9700 1 --2- 172.21.15.7:0/818739557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c1592b0 0x7f540c0690f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:56.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.713+0000 7f54127f9700 1 --2- 172.21.15.7:0/818739557 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f540c06c850 0x7f540c158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:56.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.713+0000 7f54127f9700 1 -- 172.21.15.7:0/818739557 >> 172.21.15.7:0/818739557 conn(0x7f540c0cded0 msgr2=0x7f540c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:56.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.713+0000 7f54127f9700 1 -- 172.21.15.7:0/818739557 shutdown_connections 2023-10-06T11:00:56.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.714+0000 7f54127f9700 1 -- 172.21.15.7:0/818739557 wait complete. 2023-10-06T11:00:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.715+0000 7f54127f9700 1 Processor -- start 2023-10-06T11:00:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.715+0000 7f54127f9700 1 -- start start 2023-10-06T11:00:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.716+0000 7f54127f9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f540c06c480 0x7f540c1553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.716+0000 7f54127f9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f540c06c850 0x7f540c0b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.716+0000 7f54127f9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c1592b0 0x7f540c0b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.716+0000 7f54127f9700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0b1f70 con 0x7f540c06c480 2023-10-06T11:00:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.716+0000 7f54127f9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0b19b0 con 0x7f540c1592b0 2023-10-06T11:00:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.716+0000 7f54127f9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0b1c90 con 0x7f540c06c850 2023-10-06T11:00:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.716+0000 7f540bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f540c06c480 0x7f540c1553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.716+0000 7f540bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f540c06c480 0x7f540c1553e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46010/0 (socket says 172.21.15.7:46010) 2023-10-06T11:00:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.716+0000 7f540bfff700 1 -- 172.21.15.7:0/3160165036 learned_addr learned my addr 172.21.15.7:0/3160165036 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.716+0000 7f5410d96700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c1592b0 0x7f540c0b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.717+0000 7f540b7fe700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f540c06c850 0x7f540c0b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.717+0000 7f540bfff700 1 -- 172.21.15.7:0/3160165036 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f540c06c850 msgr2=0x7f540c0b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.717+0000 7f540bfff700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f540c06c850 0x7f540c0b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.717+0000 7f540bfff700 1 -- 172.21.15.7:0/3160165036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c1592b0 msgr2=0x7f540c0b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.717+0000 7f540bfff700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c1592b0 0x7f540c0b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.717+0000 7f540bfff700 1 -- 172.21.15.7:0/3160165036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5400009420 con 0x7f540c06c480 2023-10-06T11:00:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.717+0000 7f5410d96700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c1592b0 0x7f540c0b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:00:56.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.717+0000 7f540bfff700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f540c06c480 0x7f540c1553e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00c7c0 tx=0x7f53fc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:56.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.717+0000 7f53f3fff700 1 -- 172.21.15.7:0/3160165036 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc005b30 con 0x7f540c06c480 2023-10-06T11:00:56.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.717+0000 7f53f3fff700 1 -- 172.21.15.7:0/3160165036 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc005c90 con 0x7f540c06c480 2023-10-06T11:00:56.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.717+0000 7f54127f9700 1 -- 172.21.15.7:0/3160165036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5404009a20 con 0x7f540c06c480 2023-10-06T11:00:56.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.717+0000 7f53f3fff700 1 -- 172.21.15.7:0/3160165036 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc007340 con 0x7f540c06c480 2023-10-06T11:00:56.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.717+0000 7f54127f9700 1 -- 172.21.15.7:0/3160165036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c0c67f0 con 0x7f540c06c480 2023-10-06T11:00:56.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.718+0000 7f54127f9700 1 -- 172.21.15.7:0/3160165036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c0c6370 con 0x7f540c06c480 2023-10-06T11:00:56.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.719+0000 7f53f3fff700 1 -- 172.21.15.7:0/3160165036 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53fc01b400 con 0x7f540c06c480 2023-10-06T11:00:56.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.719+0000 7f53f3fff700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f53f8066f30 0x7f53f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:56.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.719+0000 7f540b7fe700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f53f8066f30 0x7f53f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:56.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.719+0000 7f53f3fff700 1 -- 172.21.15.7:0/3160165036 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f53fc083f70 con 0x7f540c06c480 2023-10-06T11:00:56.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.720+0000 7f540b7fe700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f53f8066f30 0x7f53f80693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f54000093f0 tx=0x7f5400008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:56.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.724+0000 7f53f3fff700 1 -- 172.21.15.7:0/3160165036 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f540c0c6370 con 0x7f540c06c480 2023-10-06T11:00:56.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.924+0000 7f54127f9700 1 -- 172.21.15.7:0/3160165036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f540c0c6370 con 0x7f540c06c480 2023-10-06T11:00:56.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.928+0000 7f53f3fff700 1 -- 172.21.15.7:0/3160165036 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f540c0c6370 con 0x7f540c06c480 2023-10-06T11:00:56.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.930+0000 7f54127f9700 1 -- 172.21.15.7:0/3160165036 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f53f8066f30 msgr2=0x7f53f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:56.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.930+0000 7f54127f9700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f53f8066f30 0x7f53f80693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f54000093f0 tx=0x7f5400008040 comp rx=0 tx=0).stop 2023-10-06T11:00:56.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.930+0000 7f54127f9700 1 -- 172.21.15.7:0/3160165036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f540c06c480 msgr2=0x7f540c1553e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.930+0000 7f54127f9700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f540c06c480 0x7f540c1553e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00c7c0 tx=0x7f53fc007e00 comp rx=0 tx=0).stop 2023-10-06T11:00:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.930+0000 7f54127f9700 1 -- 172.21.15.7:0/3160165036 shutdown_connections 2023-10-06T11:00:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.930+0000 7f54127f9700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f53f8066f30 0x7f53f80693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.930+0000 7f54127f9700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f540c06c480 0x7f540c1553e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.930+0000 7f54127f9700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c1592b0 0x7f540c0b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.930+0000 7f54127f9700 1 --2- 172.21.15.7:0/3160165036 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f540c06c850 0x7f540c0b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.930+0000 7f54127f9700 1 -- 172.21.15.7:0/3160165036 >> 172.21.15.7:0/3160165036 conn(0x7f540c0cded0 msgr2=0x7f540c1562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.930+0000 7f54127f9700 1 -- 172.21.15.7:0/3160165036 shutdown_connections 2023-10-06T11:00:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:56.930+0000 7f54127f9700 1 -- 172.21.15.7:0/3160165036 wait complete. 2023-10-06T11:00:56.945 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:00:56.946 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:00:56.992 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:00:57.045 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:00:57.046 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:00:57.046 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:00:57.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.182+0000 7f287bc23700 1 Processor -- start 2023-10-06T11:00:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.182+0000 7f287bc23700 1 -- start start 2023-10-06T11:00:57.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.183+0000 7f287bc23700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28741590d0 0x7f2874069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:57.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.183+0000 7f287bc23700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f287415d520 0x7f28741594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:57.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.183+0000 7f287bc23700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28740694d0 con 0x7f287406a0f0 2023-10-06T11:00:57.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.183+0000 7f287bc23700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2874068990 con 0x7f28741590d0 2023-10-06T11:00:57.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.183+0000 7f287bc23700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2874068ba0 con 0x7f287415d520 2023-10-06T11:00:57.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.184+0000 7f28799bf700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28741590d0 0x7f2874069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:57.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.184+0000 7f287a1c0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f287415d520 0x7f28741594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:57.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.184+0000 7f28791be700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f287406a0f0 0x7f287415ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:33524/0 (socket says 172.21.15.7:33524) 2023-10-06T11:00:57.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.184+0000 7f28799bf700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28741590d0 0x7f2874069bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:53012/0 (socket says 172.21.15.7:53012) 2023-10-06T11:00:57.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.184+0000 7f28791be700 1 -- 172.21.15.7:0/698758664 learned_addr learned my addr 172.21.15.7:0/698758664 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.185+0000 7f28799bf700 1 -- 172.21.15.7:0/698758664 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f287415d520 msgr2=0x7f28741594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.185+0000 7f28799bf700 1 --2- 172.21.15.7:0/698758664 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f287415d520 0x7f28741594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.185+0000 7f28799bf700 1 -- 172.21.15.7:0/698758664 >> v1:172.21.15.50:6789/0 conn(0x7f287406a0f0 legacy=0x7f287415ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.185+0000 7f28799bf700 1 -- 172.21.15.7:0/698758664 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874068e80 con 0x7f28741590d0 2023-10-06T11:00:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.185+0000 7f28789bd700 1 -- 172.21.15.7:0/698758664 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719646018 0 0) 0x7f28740694d0 con 0x7f287406a0f0 2023-10-06T11:00:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.185+0000 7f287a1c0700 1 --2- 172.21.15.7:0/698758664 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f287415d520 0x7f28741594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.185+0000 7f28799bf700 1 --2- 172.21.15.7:0/698758664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28741590d0 0x7f2874069bb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f28700098e0 tx=0x7f28700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b22e710f4564477 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.185+0000 7f28789bd700 1 -- 172.21.15.7:0/698758664 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287000b640 con 0x7f28741590d0 2023-10-06T11:00:57.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.185+0000 7f28789bd700 1 -- 172.21.15.7:0/698758664 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287000b7a0 con 0x7f28741590d0 2023-10-06T11:00:57.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.185+0000 7f28789bd700 1 -- 172.21.15.7:0/698758664 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287000bb40 con 0x7f28741590d0 2023-10-06T11:00:57.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.186+0000 7f287bc23700 1 -- 172.21.15.7:0/698758664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28741590d0 msgr2=0x7f2874069bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:57.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.186+0000 7f287bc23700 1 --2- 172.21.15.7:0/698758664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28741590d0 0x7f2874069bb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f28700098e0 tx=0x7f28700091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.186+0000 7f287bc23700 1 -- 172.21.15.7:0/698758664 shutdown_connections 2023-10-06T11:00:57.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.186+0000 7f287bc23700 1 --2- 172.21.15.7:0/698758664 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f287415d520 0x7f28741594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.186+0000 7f287bc23700 1 --2- 172.21.15.7:0/698758664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28741590d0 0x7f2874069bb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.186+0000 7f287bc23700 1 -- 172.21.15.7:0/698758664 >> 172.21.15.7:0/698758664 conn(0x7f2874096160 msgr2=0x7f28740afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:57.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.186+0000 7f287bc23700 1 -- 172.21.15.7:0/698758664 shutdown_connections 2023-10-06T11:00:57.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.186+0000 7f287bc23700 1 -- 172.21.15.7:0/698758664 wait complete. 2023-10-06T11:00:57.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.187+0000 7f287bc23700 1 Processor -- start 2023-10-06T11:00:57.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.187+0000 7f287bc23700 1 -- start start 2023-10-06T11:00:57.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f287bc23700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f287406a0f0 0x7f287416d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:57.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f287bc23700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28741590d0 0x7f2874151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:57.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f287bc23700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f287415d520 0x7f28740b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:57.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f287bc23700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287409ab60 con 0x7f28741590d0 2023-10-06T11:00:57.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f287bc23700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287416d0b0 con 0x7f287406a0f0 2023-10-06T11:00:57.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f287bc23700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287409a5a0 con 0x7f287415d520 2023-10-06T11:00:57.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f28791be700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28741590d0 0x7f2874151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:57.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f28799bf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f287406a0f0 0x7f287416d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:57.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f28791be700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28741590d0 0x7f2874151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46024/0 (socket says 172.21.15.7:46024) 2023-10-06T11:00:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f28791be700 1 -- 172.21.15.7:0/1867916622 learned_addr learned my addr 172.21.15.7:0/1867916622 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f287a1c0700 1 --2- 172.21.15.7:0/1867916622 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f287415d520 0x7f28740b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f28799bf700 1 -- 172.21.15.7:0/1867916622 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f287415d520 msgr2=0x7f28740b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f28799bf700 1 --2- 172.21.15.7:0/1867916622 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f287415d520 0x7f28740b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f28799bf700 1 -- 172.21.15.7:0/1867916622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28741590d0 msgr2=0x7f2874151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f28799bf700 1 --2- 172.21.15.7:0/1867916622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28741590d0 0x7f2874151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f28799bf700 1 -- 172.21.15.7:0/1867916622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c009a20 con 0x7f287406a0f0 2023-10-06T11:00:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.188+0000 7f28791be700 1 --2- 172.21.15.7:0/1867916622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28741590d0 0x7f2874151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.189+0000 7f28799bf700 1 --2- 172.21.15.7:0/1867916622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f287406a0f0 0x7f287416d540 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2870016000 tx=0x7f2870017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.189+0000 7f2869ffb700 1 -- 172.21.15.7:0/1867916622 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870000c40 con 0x7f287406a0f0 2023-10-06T11:00:57.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.189+0000 7f2869ffb700 1 -- 172.21.15.7:0/1867916622 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287000b910 con 0x7f287406a0f0 2023-10-06T11:00:57.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.189+0000 7f287bc23700 1 -- 172.21.15.7:0/1867916622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2870009420 con 0x7f287406a0f0 2023-10-06T11:00:57.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.189+0000 7f2869ffb700 1 -- 172.21.15.7:0/1867916622 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870025420 con 0x7f287406a0f0 2023-10-06T11:00:57.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.189+0000 7f287bc23700 1 -- 172.21.15.7:0/1867916622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287416cd40 con 0x7f287406a0f0 2023-10-06T11:00:57.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.190+0000 7f287bc23700 1 -- 172.21.15.7:0/1867916622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287416cba0 con 0x7f287406a0f0 2023-10-06T11:00:57.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.191+0000 7f2869ffb700 1 -- 172.21.15.7:0/1867916622 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2870023070 con 0x7f287406a0f0 2023-10-06T11:00:57.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.191+0000 7f2869ffb700 1 --2- 172.21.15.7:0/1867916622 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2858066f60 0x7f2858069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:57.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.191+0000 7f2869ffb700 1 -- 172.21.15.7:0/1867916622 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f2870085970 con 0x7f287406a0f0 2023-10-06T11:00:57.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.191+0000 7f28791be700 1 --2- 172.21.15.7:0/1867916622 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2858066f60 0x7f2858069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:57.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.192+0000 7f28791be700 1 --2- 172.21.15.7:0/1867916622 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2858066f60 0x7f2858069410 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2864007fd0 tx=0x7f2864007db0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.196+0000 7f2869ffb700 1 -- 172.21.15.7:0/1867916622 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f287416cba0 con 0x7f287406a0f0 2023-10-06T11:00:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.445+0000 7f287bc23700 1 -- 172.21.15.7:0/1867916622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f287416cba0 con 0x7f287406a0f0 2023-10-06T11:00:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.446+0000 7f2869ffb700 1 -- 172.21.15.7:0/1867916622 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+3517 (secure 0 0 0) 0x7f2870015dd0 con 0x7f287406a0f0 2023-10-06T11:00:57.447 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:57.448 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/904048408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":904048408},{"type":"v1","addr":"172.21.15.50:6834","nonce":904048408}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5062,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/949655295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":949655295},{"type":"v1","addr":"172.21.15.50:6835","nonce":949655295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1576009113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1576009113},{"type":"v1","addr":"172.21.15.7:6835","nonce":1576009113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3771543526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3771543526},{"type":"v1","addr":"172.21.15.7:6837","nonce":3771543526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[]} 2023-10-06T11:00:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.448+0000 7f287bc23700 1 -- 172.21.15.7:0/1867916622 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2858066f60 msgr2=0x7f2858069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.448+0000 7f287bc23700 1 --2- 172.21.15.7:0/1867916622 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2858066f60 0x7f2858069410 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2864007fd0 tx=0x7f2864007db0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.448+0000 7f287bc23700 1 -- 172.21.15.7:0/1867916622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f287406a0f0 msgr2=0x7f287416d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.448+0000 7f287bc23700 1 --2- 172.21.15.7:0/1867916622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f287406a0f0 0x7f287416d540 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2870016000 tx=0x7f2870017000 comp rx=0 tx=0).stop 2023-10-06T11:00:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.448+0000 7f287bc23700 1 -- 172.21.15.7:0/1867916622 shutdown_connections 2023-10-06T11:00:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.448+0000 7f287bc23700 1 --2- 172.21.15.7:0/1867916622 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f2858066f60 0x7f2858069410 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.448+0000 7f287bc23700 1 --2- 172.21.15.7:0/1867916622 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f287415d520 0x7f28740b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.448+0000 7f287bc23700 1 --2- 172.21.15.7:0/1867916622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f287406a0f0 0x7f287416d540 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.448+0000 7f287bc23700 1 --2- 172.21.15.7:0/1867916622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28741590d0 0x7f2874151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.448+0000 7f287bc23700 1 -- 172.21.15.7:0/1867916622 >> 172.21.15.7:0/1867916622 conn(0x7f2874096160 msgr2=0x7f287406b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.448+0000 7f287bc23700 1 -- 172.21.15.7:0/1867916622 shutdown_connections 2023-10-06T11:00:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.448+0000 7f287bc23700 1 -- 172.21.15.7:0/1867916622 wait complete. 2023-10-06T11:00:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 22 2023-10-06T11:00:57.463 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:00:57.463 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:00:57.464 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:00:57.464 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:00:57.464 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:00:57.464 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:00:57.464 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:00:57.464 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:00:57.465 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:00:57.465 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:00:57.465 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:00:57.465 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:00:57.465 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:00:57.465 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:00:57.465 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:00:57.466 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:00:57.476 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:00:57.476 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:00:57.477 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:00:57.477 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:00:57.478 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:00:57.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:00:57.480 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:00:57.480 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:00:57.522 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:00:57.523 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:00:57.523 DEBUG:teuthology.parallel:result is None 2023-10-06T11:00:57.523 DEBUG:teuthology.parallel:result is None 2023-10-06T11:00:57.526 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:00:57.526 DEBUG:teuthology.parallel:result is None 2023-10-06T11:00:57.527 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:00:57.527 DEBUG:teuthology.parallel:result is None 2023-10-06T11:00:57.527 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:00:57.609 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-06T11:00:57.609 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-06T11:00:57.609 INFO:tasks.ceph.mds.c.smithi007.stderr:2023-10-06T11:00:57.608+0000 7f6334187700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T11:00:57.619 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2023-10-06T11:00:57.619 INFO:tasks.ceph.mds.d.smithi050.stdout:starting mds.d at 2023-10-06T11:00:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.666+0000 7fc7706a0700 1 Processor -- start 2023-10-06T11:00:57.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.666+0000 7fc7706a0700 1 -- start start 2023-10-06T11:00:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc7706a0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc768159360 0x7fc7680afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc7706a0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc768068100 0x7fc768162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc7706a0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7680aeba0 con 0x7fc7680ac7f0 2023-10-06T11:00:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc7706a0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc768159730 con 0x7fc768068100 2023-10-06T11:00:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc7706a0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680ae270 con 0x7fc768159360 2023-10-06T11:00:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc76e43c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc768159360 0x7fc7680afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc76ec3d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc768068100 0x7fc768162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc76dc3b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc7680ac7f0 0x7fc7680a6980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:33538/0 (socket says 172.21.15.7:33538) 2023-10-06T11:00:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc76dc3b700 1 -- 172.21.15.7:0/2411175692 learned_addr learned my addr 172.21.15.7:0/2411175692 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:57.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc76d43a700 1 -- 172.21.15.7:0/2411175692 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1295512076 0 0) 0x7fc7680aeba0 con 0x7fc7680ac7f0 2023-10-06T11:00:57.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc76d43a700 1 -- 172.21.15.7:0/2411175692 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc754003570 con 0x7fc7680ac7f0 2023-10-06T11:00:57.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc76e43c700 1 -- 172.21.15.7:0/2411175692 >> v2:172.21.15.50:3300/0 conn(0x7fc768068100 msgr2=0x7fc768162ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:57.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc76e43c700 1 --2- 172.21.15.7:0/2411175692 >> v2:172.21.15.50:3300/0 conn(0x7fc768068100 0x7fc768162ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc76e43c700 1 -- 172.21.15.7:0/2411175692 >> v1:172.21.15.50:6789/0 conn(0x7fc7680ac7f0 legacy=0x7fc7680a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:57.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.667+0000 7fc76e43c700 1 -- 172.21.15.7:0/2411175692 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7680ae550 con 0x7fc768159360 2023-10-06T11:00:57.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.668+0000 7fc76ec3d700 1 --2- 172.21.15.7:0/2411175692 >> v2:172.21.15.50:3300/0 conn(0x7fc768068100 0x7fc768162ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:57.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.668+0000 7fc76e43c700 1 --2- 172.21.15.7:0/2411175692 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc768159360 0x7fc7680afb40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc7640098e0 tx=0x7fc7640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=419b2f075fed76ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:57.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.668+0000 7fc76d43a700 1 -- 172.21.15.7:0/2411175692 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764011630 con 0x7fc768159360 2023-10-06T11:00:57.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.668+0000 7fc76d43a700 1 -- 172.21.15.7:0/2411175692 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc764011790 con 0x7fc768159360 2023-10-06T11:00:57.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.668+0000 7fc76d43a700 1 -- 172.21.15.7:0/2411175692 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764011b30 con 0x7fc768159360 2023-10-06T11:00:57.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.668+0000 7fc7706a0700 1 -- 172.21.15.7:0/2411175692 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc768159360 msgr2=0x7fc7680afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:57.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.668+0000 7fc7706a0700 1 --2- 172.21.15.7:0/2411175692 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc768159360 0x7fc7680afb40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc7640098e0 tx=0x7fc7640091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.669+0000 7fc7706a0700 1 -- 172.21.15.7:0/2411175692 shutdown_connections 2023-10-06T11:00:57.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.669+0000 7fc7706a0700 1 --2- 172.21.15.7:0/2411175692 >> v2:172.21.15.50:3300/0 conn(0x7fc768068100 0x7fc768162ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.669+0000 7fc7706a0700 1 --2- 172.21.15.7:0/2411175692 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc768159360 0x7fc7680afb40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.669+0000 7fc7706a0700 1 -- 172.21.15.7:0/2411175692 >> 172.21.15.7:0/2411175692 conn(0x7fc768095a70 msgr2=0x7fc7680af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:57.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.669+0000 7fc7706a0700 1 -- 172.21.15.7:0/2411175692 shutdown_connections 2023-10-06T11:00:57.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.669+0000 7fc7706a0700 1 -- 172.21.15.7:0/2411175692 wait complete. 2023-10-06T11:00:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.670+0000 7fc7706a0700 1 Processor -- start 2023-10-06T11:00:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.670+0000 7fc7706a0700 1 -- start start 2023-10-06T11:00:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.670+0000 7fc7706a0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc768068100 0x7fc768098ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc7706a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7680ac7f0 0x7fc768151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc7706a0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc768159360 0x7fc7680965a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc7706a0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc768169530 con 0x7fc7680ac7f0 2023-10-06T11:00:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc7706a0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680991d0 con 0x7fc768159360 2023-10-06T11:00:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc7706a0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680994b0 con 0x7fc768068100 2023-10-06T11:00:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc76dc3b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7680ac7f0 0x7fc768151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc76dc3b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7680ac7f0 0x7fc768151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46062/0 (socket says 172.21.15.7:46062) 2023-10-06T11:00:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc76dc3b700 1 -- 172.21.15.7:0/2814993848 learned_addr learned my addr 172.21.15.7:0/2814993848 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:57.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc76ec3d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc768159360 0x7fc7680965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:57.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc76e43c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc768068100 0x7fc768098ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:57.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc76dc3b700 1 -- 172.21.15.7:0/2814993848 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc768068100 msgr2=0x7fc768098ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:57.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc76dc3b700 1 --2- 172.21.15.7:0/2814993848 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc768068100 0x7fc768098ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc76dc3b700 1 -- 172.21.15.7:0/2814993848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc768159360 msgr2=0x7fc7680965a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:57.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc76dc3b700 1 --2- 172.21.15.7:0/2814993848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc768159360 0x7fc7680965a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:57.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc76dc3b700 1 -- 172.21.15.7:0/2814993848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc760009a20 con 0x7fc7680ac7f0 2023-10-06T11:00:57.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc76e43c700 1 --2- 172.21.15.7:0/2814993848 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc768068100 0x7fc768098ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:00:57.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc76dc3b700 1 --2- 172.21.15.7:0/2814993848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7680ac7f0 0x7fc768151af0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc75800c7c0 tx=0x7fc758007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:57.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc75e7fc700 1 -- 172.21.15.7:0/2814993848 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc758005c00 con 0x7fc7680ac7f0 2023-10-06T11:00:57.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc75e7fc700 1 -- 172.21.15.7:0/2814993848 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc758005d60 con 0x7fc7680ac7f0 2023-10-06T11:00:57.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc75e7fc700 1 -- 172.21.15.7:0/2814993848 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc758007300 con 0x7fc7680ac7f0 2023-10-06T11:00:57.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.671+0000 7fc7706a0700 1 -- 172.21.15.7:0/2814993848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc764009420 con 0x7fc7680ac7f0 2023-10-06T11:00:57.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.672+0000 7fc7706a0700 1 -- 172.21.15.7:0/2814993848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc768169a20 con 0x7fc7680ac7f0 2023-10-06T11:00:57.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.672+0000 7fc7706a0700 1 -- 172.21.15.7:0/2814993848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc768070480 con 0x7fc7680ac7f0 2023-10-06T11:00:57.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.673+0000 7fc75e7fc700 1 -- 172.21.15.7:0/2814993848 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc75801b3b0 con 0x7fc7680ac7f0 2023-10-06T11:00:57.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.673+0000 7fc75e7fc700 1 --2- 172.21.15.7:0/2814993848 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc74c066f30 0x7fc74c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:57.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.674+0000 7fc75e7fc700 1 -- 172.21.15.7:0/2814993848 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fc758083910 con 0x7fc7680ac7f0 2023-10-06T11:00:57.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.674+0000 7fc76e43c700 1 --2- 172.21.15.7:0/2814993848 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc74c066f30 0x7fc74c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:57.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.674+0000 7fc76e43c700 1 --2- 172.21.15.7:0/2814993848 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc74c066f30 0x7fc74c0693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc7640091e0 tx=0x7fc764017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.678+0000 7fc75e7fc700 1 -- 172.21.15.7:0/2814993848 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc758050ca0 con 0x7fc7680ac7f0 2023-10-06T11:00:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:57.895+0000 7fc7706a0700 1 -- 172.21.15.7:0/2814993848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc768099680 con 0x7fc7680ac7f0 2023-10-06T11:00:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.508+0000 7fc75e7fc700 1 -- 172.21.15.7:0/2814993848 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v53) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc758017020 con 0x7fc7680ac7f0 2023-10-06T11:00:59.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.511+0000 7fc7706a0700 1 -- 172.21.15.7:0/2814993848 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc74c066f30 msgr2=0x7fc74c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:59.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.511+0000 7fc7706a0700 1 --2- 172.21.15.7:0/2814993848 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc74c066f30 0x7fc74c0693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc7640091e0 tx=0x7fc764017000 comp rx=0 tx=0).stop 2023-10-06T11:00:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.511+0000 7fc7706a0700 1 -- 172.21.15.7:0/2814993848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7680ac7f0 msgr2=0x7fc768151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.511+0000 7fc7706a0700 1 --2- 172.21.15.7:0/2814993848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7680ac7f0 0x7fc768151af0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc75800c7c0 tx=0x7fc758007dd0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.511+0000 7fc7706a0700 1 -- 172.21.15.7:0/2814993848 shutdown_connections 2023-10-06T11:00:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.511+0000 7fc7706a0700 1 --2- 172.21.15.7:0/2814993848 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc74c066f30 0x7fc74c0693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.511+0000 7fc7706a0700 1 --2- 172.21.15.7:0/2814993848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc768159360 0x7fc7680965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.511+0000 7fc7706a0700 1 --2- 172.21.15.7:0/2814993848 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc768068100 0x7fc768098ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.511+0000 7fc7706a0700 1 --2- 172.21.15.7:0/2814993848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7680ac7f0 0x7fc768151af0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.511+0000 7fc7706a0700 1 -- 172.21.15.7:0/2814993848 >> 172.21.15.7:0/2814993848 conn(0x7fc768095a70 msgr2=0x7fc76815a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.511+0000 7fc7706a0700 1 -- 172.21.15.7:0/2814993848 shutdown_connections 2023-10-06T11:00:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.511+0000 7fc7706a0700 1 -- 172.21.15.7:0/2814993848 wait complete. 2023-10-06T11:00:59.515 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2023-10-06T11:00:59.528 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:00:59.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.664+0000 7f7fef1a0700 1 Processor -- start 2023-10-06T11:00:59.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.664+0000 7f7fef1a0700 1 -- start start 2023-10-06T11:00:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.666+0000 7f7fef1a0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fe80b0e40 0x7f7fe8156f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.666+0000 7f7fef1a0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe80afb50 con 0x7f7fe8156b70 2023-10-06T11:00:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.666+0000 7f7fef1a0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe80b09b0 con 0x7f7fe8067b20 2023-10-06T11:00:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.666+0000 7f7fef1a0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe80afda0 con 0x7f7fe80b0e40 2023-10-06T11:00:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.666+0000 7f7fee19e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7fe8156b70 0x7f7fe80c86d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49896/0 (socket says 172.21.15.7:49896) 2023-10-06T11:00:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.666+0000 7f7fee19e700 1 -- 172.21.15.7:0/4098169683 learned_addr learned my addr 172.21.15.7:0/4098169683 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:00:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.666+0000 7f7fed99d700 1 --2- 172.21.15.7:0/4098169683 >> v2:172.21.15.50:3300/0 conn(0x7f7fe80b0e40 0x7f7fe8156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.666+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757915146 0 0) 0x7f7fe80afb50 con 0x7f7fe8156b70 2023-10-06T11:00:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.666+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fd4003570 con 0x7f7fe8156b70 2023-10-06T11:00:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933780860 0 0) 0x7f7fe80b09b0 con 0x7f7fe8067b20 2023-10-06T11:00:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fe80afb50 con 0x7f7fe8067b20 2023-10-06T11:00:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3846022241 0 0) 0x7f7fd4003570 con 0x7f7fe8156b70 2023-10-06T11:00:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 >> v2:172.21.15.50:3300/0 conn(0x7f7fe80b0e40 msgr2=0x7f7fe8156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 --2- 172.21.15.7:0/4098169683 >> v2:172.21.15.50:3300/0 conn(0x7f7fe80b0e40 0x7f7fe8156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 >> v1:172.21.15.50:6789/0 conn(0x7f7fe8067b20 legacy=0x7f7fe8067f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe80b0080 con 0x7f7fe8156b70 2023-10-06T11:00:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f7fe4001470 con 0x7f7fe8156b70 2023-10-06T11:00:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 >> v1:172.21.15.7:6789/0 conn(0x7f7fe8156b70 legacy=0x7f7fe80c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 --2- 172.21.15.7:0/4098169683 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7fd4003c40 0x7f7fd4004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 --2- 172.21.15.7:0/4098169683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fd4004810 0x7f7fd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 --2- 172.21.15.7:0/4098169683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd4005210 0x7f7fd400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80afda0 con 0x7f7fd4004810 2023-10-06T11:00:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd400c130 con 0x7f7fd4005210 2023-10-06T11:00:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd400c2c0 con 0x7f7fd4003c40 2023-10-06T11:00:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed99d700 1 --2- 172.21.15.7:0/4098169683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fd4004810 0x7f7fd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fee99f700 1 --2- 172.21.15.7:0/4098169683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd4005210 0x7f7fd400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fee19e700 1 --2- 172.21.15.7:0/4098169683 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7fd4003c40 0x7f7fd4004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed99d700 1 -- 172.21.15.7:0/4098169683 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7fd4003c40 msgr2=0x7f7fd4004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed99d700 1 --2- 172.21.15.7:0/4098169683 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7fd4003c40 0x7f7fd4004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed99d700 1 -- 172.21.15.7:0/4098169683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd4005210 msgr2=0x7f7fd400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:00:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed99d700 1 --2- 172.21.15.7:0/4098169683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd4005210 0x7f7fd400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fee99f700 1 -- 172.21.15.7:0/4098169683 reap_dead start 2023-10-06T11:00:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed99d700 1 -- 172.21.15.7:0/4098169683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd4003570 con 0x7f7fd4004810 2023-10-06T11:00:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.667+0000 7f7fed99d700 1 --2- 172.21.15.7:0/4098169683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fd4004810 0x7f7fd4004c80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8006f00 tx=0x7f7fd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e712875ec6a43bf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.668+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800e710 con 0x7f7fd4004810 2023-10-06T11:00:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.668+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd800e870 con 0x7f7fd4004810 2023-10-06T11:00:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.668+0000 7f7fed19c700 1 -- 172.21.15.7:0/4098169683 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800ec30 con 0x7f7fd4004810 2023-10-06T11:00:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.668+0000 7f7fef1a0700 1 -- 172.21.15.7:0/4098169683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fd4004810 msgr2=0x7f7fd4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.668+0000 7f7fef1a0700 1 --2- 172.21.15.7:0/4098169683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fd4004810 0x7f7fd4004c80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8006f00 tx=0x7f7fd80091a0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.668+0000 7f7fef1a0700 1 -- 172.21.15.7:0/4098169683 shutdown_connections 2023-10-06T11:00:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.668+0000 7f7fef1a0700 1 --2- 172.21.15.7:0/4098169683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fd4004810 0x7f7fd4004c80 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.668+0000 7f7fef1a0700 1 -- 172.21.15.7:0/4098169683 >> 172.21.15.7:0/4098169683 conn(0x7f7fe80cc3f0 msgr2=0x7f7fe80cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.668+0000 7f7fef1a0700 1 -- 172.21.15.7:0/4098169683 shutdown_connections 2023-10-06T11:00:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.668+0000 7f7fef1a0700 1 -- 172.21.15.7:0/4098169683 wait complete. 2023-10-06T11:00:59.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.670+0000 7f7fef1a0700 1 Processor -- start 2023-10-06T11:00:59.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.670+0000 7f7fef1a0700 1 -- start start 2023-10-06T11:00:59.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fef1a0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd4004810 0x7f7fe8152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:59.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fef1a0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7fe8155800 0x7f7fe806e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:59.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fef1a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe816a500 0x7f7fe806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:59.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fef1a0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8154500 con 0x7f7fe816a500 2023-10-06T11:00:59.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fef1a0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe81538f0 con 0x7f7fd4004810 2023-10-06T11:00:59.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fef1a0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8153bd0 con 0x7f7fe8155800 2023-10-06T11:00:59.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fee99f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe816a500 0x7f7fe806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:59.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fee99f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe816a500 0x7f7fe806ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46084/0 (socket says 172.21.15.7:46084) 2023-10-06T11:00:59.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fee99f700 1 -- 172.21.15.7:0/953257117 learned_addr learned my addr 172.21.15.7:0/953257117 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:00:59.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fee19e700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd4004810 0x7f7fe8152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:59.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fed99d700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7fe8155800 0x7f7fe806e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:59.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fee99f700 1 -- 172.21.15.7:0/953257117 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7fe8155800 msgr2=0x7f7fe806e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:59.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fee99f700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7fe8155800 0x7f7fe806e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fee99f700 1 -- 172.21.15.7:0/953257117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd4004810 msgr2=0x7f7fe8152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:59.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fee99f700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd4004810 0x7f7fe8152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.671+0000 7f7fee99f700 1 -- 172.21.15.7:0/953257117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe8153eb0 con 0x7f7fe816a500 2023-10-06T11:00:59.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.672+0000 7f7fee19e700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd4004810 0x7f7fe8152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:59.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.672+0000 7f7fed99d700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7fe8155800 0x7f7fe806e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:00:59.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.672+0000 7f7fee99f700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe816a500 0x7f7fe806ecc0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7fe806e1d0 tx=0x7f7fe00017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:59.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.672+0000 7f7fde7fc700 1 -- 172.21.15.7:0/953257117 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0006e80 con 0x7f7fe816a500 2023-10-06T11:00:59.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.672+0000 7f7fde7fc700 1 -- 172.21.15.7:0/953257117 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe000c5a0 con 0x7f7fe816a500 2023-10-06T11:00:59.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.672+0000 7f7fef1a0700 1 -- 172.21.15.7:0/953257117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe8154190 con 0x7f7fe816a500 2023-10-06T11:00:59.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.672+0000 7f7fde7fc700 1 -- 172.21.15.7:0/953257117 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe000c960 con 0x7f7fe816a500 2023-10-06T11:00:59.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.672+0000 7f7fef1a0700 1 -- 172.21.15.7:0/953257117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe81536a0 con 0x7f7fe816a500 2023-10-06T11:00:59.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.673+0000 7f7fef1a0700 1 -- 172.21.15.7:0/953257117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe8154670 con 0x7f7fe816a500 2023-10-06T11:00:59.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.673+0000 7f7fde7fc700 1 -- 172.21.15.7:0/953257117 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7fe000cd10 con 0x7f7fe816a500 2023-10-06T11:00:59.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.674+0000 7f7fde7fc700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7fcc066f30 0x7f7fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:00:59.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.674+0000 7f7fde7fc700 1 -- 172.21.15.7:0/953257117 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7fe0084410 con 0x7f7fe816a500 2023-10-06T11:00:59.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.674+0000 7f7fee19e700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7fcc066f30 0x7f7fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:00:59.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.674+0000 7f7fee19e700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7fcc066f30 0x7f7fcc0693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4001bb0 tx=0x7f7fe4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:00:59.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.678+0000 7f7fde7fc700 1 -- 172.21.15.7:0/953257117 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fe00517b0 con 0x7f7fe816a500 2023-10-06T11:00:59.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.971+0000 7f7fef1a0700 1 -- 172.21.15.7:0/953257117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7fe8070480 con 0x7f7fe816a500 2023-10-06T11:00:59.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.971+0000 7f7fde7fc700 1 -- 172.21.15.7:0/953257117 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f7fe0054dd0 con 0x7f7fe816a500 2023-10-06T11:00:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:00:59.973 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:00:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2023-10-06T11:00:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2023-10-06T11:00:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBF6B9lf5xzHxAAcz6DUCcDKY6kqw35Uk+wNA==", 2023-10-06T11:00:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-06T11:00:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-06T11:00:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2023-10-06T11:00:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBF6B9lr+TCLRAAS8X7U4CDijgiLkeY3N1k5A==", 2023-10-06T11:00:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-06T11:00:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-06T11:00:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2023-10-06T11:00:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBF6B9ldTW9JxAAi47qjerSGEuRhjY8dyhP1g==", 2023-10-06T11:00:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-06T11:00:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-06T11:00:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2023-10-06T11:00:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBF6B9lwoERNhAAi2s7pUC6Zw8QUPImXW/Bkw==", 2023-10-06T11:00:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-06T11:00:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-06T11:00:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2023-10-06T11:00:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBH6B9lgM4tHBAAK3+2wwnrUqtSS6DfeIljpA==", 2023-10-06T11:00:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2023-10-06T11:00:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBK6B9lK3gPGxAAs2vbC573ltq2FmhRYwRleg==", 2023-10-06T11:00:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2023-10-06T11:00:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBN6B9lAyLxGRAA7C972ijYflialIb63Kh74Q==", 2023-10-06T11:00:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2023-10-06T11:00:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBQ6B9lcKtyGBAAF05nCK/0waipy/gXdPtTig==", 2023-10-06T11:00:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2023-10-06T11:00:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBU6B9l8A1DIRAAiLVOvw89tvLJ/V4TAM8QUg==", 2023-10-06T11:00:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2023-10-06T11:00:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBX6B9lPjwFIBAANzBcrS6icTB7itpK6dQOJA==", 2023-10-06T11:00:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2023-10-06T11:00:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBa6B9lSwCtHhAAc9ckOLHeRYVEHIRVF2K0yw==", 2023-10-06T11:00:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2023-10-06T11:00:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBd6B9l3ueTHRAAsF+CSsK+R8ZqoAYsIGb2dQ==", 2023-10-06T11:00:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-06T11:00:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-06T11:00:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2023-10-06T11:00:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBF6B9lV+s+OxAA7FiireHQ6epyLCxHc9NRQA==", 2023-10-06T11:00:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2023-10-06T11:00:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw pool=cephfs_data" 2023-10-06T11:00:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2023-10-06T11:00:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBG6B9lJYM8BxAA0QUkFcKZNYlc9lNFaJlbKg==", 2023-10-06T11:00:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-06T11:00:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-06T11:00:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-06T11:00:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2023-10-06T11:00:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBG6B9ly+ZgAxAA9yXfZP3XEMbnUpSm/WDsgw==", 2023-10-06T11:00:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-06T11:00:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-06T11:00:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-06T11:00:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2023-10-06T11:00:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBG6B9l/ijxChAAeSzF0/kDS6iEj++8bIK70Q==", 2023-10-06T11:00:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-06T11:00:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-06T11:00:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-06T11:00:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-06T11:00:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2023-10-06T11:00:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBE6B9l/D1zLxAAcwgiWE7+MJYefQp+vfT2mA==", 2023-10-06T11:00:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-06T11:00:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-06T11:00:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-06T11:00:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2023-10-06T11:00:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBF6B9lFqRxGxAAHsNDZAUE+we7WAUW6w0tYg==", 2023-10-06T11:00:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-06T11:00:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-06T11:00:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:00:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:00:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2023-10-06T11:00:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBF6B9lf8gqERAA3eufSjBI2rAsqsjudLpE7g==", 2023-10-06T11:00:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-06T11:00:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-06T11:00:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-06T11:00:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-06T11:00:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:00:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-06T11:00:59.989 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:00:59.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.973+0000 7f7fef1a0700 1 -- 172.21.15.7:0/953257117 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7fcc066f30 msgr2=0x7f7fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:59.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.973+0000 7f7fef1a0700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7fcc066f30 0x7f7fcc0693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4001bb0 tx=0x7f7fe4009040 comp rx=0 tx=0).stop 2023-10-06T11:00:59.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.973+0000 7f7fef1a0700 1 -- 172.21.15.7:0/953257117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe816a500 msgr2=0x7f7fe806ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:00:59.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.973+0000 7f7fef1a0700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe816a500 0x7f7fe806ecc0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7fe806e1d0 tx=0x7f7fe00017a0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.973+0000 7f7fef1a0700 1 -- 172.21.15.7:0/953257117 shutdown_connections 2023-10-06T11:00:59.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.973+0000 7f7fef1a0700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f7fcc066f30 0x7f7fcc0693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.973+0000 7f7fef1a0700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe816a500 0x7f7fe806ecc0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.973+0000 7f7fef1a0700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd4004810 0x7f7fe8152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.973+0000 7f7fef1a0700 1 --2- 172.21.15.7:0/953257117 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7fe8155800 0x7f7fe806e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:00:59.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.973+0000 7f7fef1a0700 1 -- 172.21.15.7:0/953257117 >> 172.21.15.7:0/953257117 conn(0x7f7fe80cc3f0 msgr2=0x7f7fe81501c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:00:59.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.974+0000 7f7fef1a0700 1 -- 172.21.15.7:0/953257117 shutdown_connections 2023-10-06T11:00:59.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:00:59.974+0000 7f7fef1a0700 1 -- 172.21.15.7:0/953257117 wait complete. 2023-10-06T11:00:59.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:01:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.123+0000 7faf169ba700 1 Processor -- start 2023-10-06T11:01:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.123+0000 7faf169ba700 1 -- start start 2023-10-06T11:01:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.124+0000 7faf169ba700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faf1015b830 0x7faf10157110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.124+0000 7faf169ba700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf100cdc30 con 0x7faf100ac180 2023-10-06T11:01:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.124+0000 7faf169ba700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf10068d60 con 0x7faf100abdb0 2023-10-06T11:01:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.124+0000 7faf169ba700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf100cd390 con 0x7faf1015b830 2023-10-06T11:01:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.124+0000 7faf0f7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7faf100ac180 0x7faf10156a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42600/0 (socket says 172.21.15.7:42600) 2023-10-06T11:01:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.124+0000 7faf0f7fe700 1 -- 172.21.15.7:0/1810593267 learned_addr learned my addr 172.21.15.7:0/1810593267 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf14f57700 1 --2- 172.21.15.7:0/1810593267 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faf1015b830 0x7faf10157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759345777 0 0) 0x7faf100cdc30 con 0x7faf100ac180 2023-10-06T11:01:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faefc003570 con 0x7faf100ac180 2023-10-06T11:01:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534967546 0 0) 0x7faf10068d60 con 0x7faf100abdb0 2023-10-06T11:01:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf100cdc30 con 0x7faf100abdb0 2023-10-06T11:01:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2923952238 0 0) 0x7faefc003570 con 0x7faf100ac180 2023-10-06T11:01:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faf1015b830 msgr2=0x7faf10157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 --2- 172.21.15.7:0/1810593267 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faf1015b830 0x7faf10157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 >> v1:172.21.15.50:6789/0 conn(0x7faf100abdb0 legacy=0x7faf100ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf100cd670 con 0x7faf100ac180 2023-10-06T11:01:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7faef8001470 con 0x7faf100ac180 2023-10-06T11:01:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 >> v1:172.21.15.7:6789/0 conn(0x7faf100ac180 legacy=0x7faf10156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 --2- 172.21.15.7:0/1810593267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faefc003c20 0x7faefc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 --2- 172.21.15.7:0/1810593267 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faf1015b830 0x7faefc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 --2- 172.21.15.7:0/1810593267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faefc004d50 0x7faefc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf100cd390 con 0x7faefc003c20 2023-10-06T11:01:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc00bb40 con 0x7faefc004d50 2023-10-06T11:01:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc00bd00 con 0x7faf1015b830 2023-10-06T11:01:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0ffff700 1 --2- 172.21.15.7:0/1810593267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faefc003c20 0x7faefc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf0f7fe700 1 --2- 172.21.15.7:0/1810593267 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faf1015b830 0x7faefc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.125+0000 7faf14f57700 1 --2- 172.21.15.7:0/1810593267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faefc004d50 0x7faefc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.126+0000 7faf0ffff700 1 -- 172.21.15.7:0/1810593267 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faf1015b830 msgr2=0x7faefc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.126+0000 7faf0ffff700 1 --2- 172.21.15.7:0/1810593267 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faf1015b830 0x7faefc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.126+0000 7faf0ffff700 1 -- 172.21.15.7:0/1810593267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faefc004d50 msgr2=0x7faefc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.126+0000 7faf0ffff700 1 --2- 172.21.15.7:0/1810593267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faefc004d50 0x7faefc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.126+0000 7faf0ffff700 1 -- 172.21.15.7:0/1810593267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc003570 con 0x7faefc003c20 2023-10-06T11:01:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.126+0000 7faf0ffff700 1 --2- 172.21.15.7:0/1810593267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faefc003c20 0x7faefc004010 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faf00001a10 tx=0x7faf00007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b4255e1f35437b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.126+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0000c5d0 con 0x7faefc003c20 2023-10-06T11:01:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.126+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0000c730 con 0x7faefc003c20 2023-10-06T11:01:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.126+0000 7faf0effd700 1 -- 172.21.15.7:0/1810593267 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0000cad0 con 0x7faefc003c20 2023-10-06T11:01:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.126+0000 7faf169ba700 1 -- 172.21.15.7:0/1810593267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faefc003c20 msgr2=0x7faefc004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.126+0000 7faf169ba700 1 --2- 172.21.15.7:0/1810593267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faefc003c20 0x7faefc004010 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faf00001a10 tx=0x7faf00007d30 comp rx=0 tx=0).stop 2023-10-06T11:01:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.126+0000 7faf14f57700 1 -- 172.21.15.7:0/1810593267 reap_dead start 2023-10-06T11:01:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.127+0000 7faf169ba700 1 -- 172.21.15.7:0/1810593267 shutdown_connections 2023-10-06T11:01:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.127+0000 7faf169ba700 1 -- 172.21.15.7:0/1810593267 >> 172.21.15.7:0/1810593267 conn(0x7faf10096160 msgr2=0x7faf100afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.127+0000 7faf169ba700 1 -- 172.21.15.7:0/1810593267 shutdown_connections 2023-10-06T11:01:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.127+0000 7faf169ba700 1 -- 172.21.15.7:0/1810593267 wait complete. 2023-10-06T11:01:00.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.128+0000 7faf169ba700 1 Processor -- start 2023-10-06T11:01:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.128+0000 7faf169ba700 1 -- start start 2023-10-06T11:01:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf169ba700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faefc003c20 0x7faf1016d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf169ba700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1016a6d0 0x7faf1014b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf169ba700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100a9a00 0x7faf10067940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf169ba700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf100cbb80 con 0x7faf1016a6d0 2023-10-06T11:01:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf169ba700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10169a00 con 0x7faf100a9a00 2023-10-06T11:01:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf169ba700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1016a240 con 0x7faefc003c20 2023-10-06T11:01:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf0f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1016a6d0 0x7faf1014b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf0f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1016a6d0 0x7faf1014b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60166/0 (socket says 172.21.15.7:60166) 2023-10-06T11:01:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf0f7fe700 1 -- 172.21.15.7:0/3455036747 learned_addr learned my addr 172.21.15.7:0/3455036747 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf14f57700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100a9a00 0x7faf10067940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf0ffff700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faefc003c20 0x7faf1016d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf0f7fe700 1 -- 172.21.15.7:0/3455036747 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faefc003c20 msgr2=0x7faf1016d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf0f7fe700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faefc003c20 0x7faf1016d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf0f7fe700 1 -- 172.21.15.7:0/3455036747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100a9a00 msgr2=0x7faf10067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf0f7fe700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100a9a00 0x7faf10067940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf0f7fe700 1 -- 172.21.15.7:0/3455036747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1016def0 con 0x7faf1016a6d0 2023-10-06T11:01:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf14f57700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100a9a00 0x7faf10067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.129+0000 7faf0f7fe700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1016a6d0 0x7faf1014b900 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faef80073c0 tx=0x7faef8001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.130+0000 7faf07fff700 1 -- 172.21.15.7:0/3455036747 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8007780 con 0x7faf1016a6d0 2023-10-06T11:01:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.130+0000 7faf07fff700 1 -- 172.21.15.7:0/3455036747 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef800f8d0 con 0x7faf1016a6d0 2023-10-06T11:01:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.130+0000 7faf169ba700 1 -- 172.21.15.7:0/3455036747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf100a9f50 con 0x7faf1016a6d0 2023-10-06T11:01:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.130+0000 7faf07fff700 1 -- 172.21.15.7:0/3455036747 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef800fc90 con 0x7faf1016a6d0 2023-10-06T11:01:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.130+0000 7faf169ba700 1 -- 172.21.15.7:0/3455036747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf10169ed0 con 0x7faf1016a6d0 2023-10-06T11:01:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.131+0000 7faf169ba700 1 -- 172.21.15.7:0/3455036747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1016a3b0 con 0x7faf1016a6d0 2023-10-06T11:01:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.131+0000 7faf07fff700 1 -- 172.21.15.7:0/3455036747 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faef80133b0 con 0x7faf1016a6d0 2023-10-06T11:01:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.131+0000 7faf07fff700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faef0066f30 0x7faef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.132+0000 7faf07fff700 1 -- 172.21.15.7:0/3455036747 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5526+0+0 (secure 0 0 0) 0x7faef8083d20 con 0x7faf1016a6d0 2023-10-06T11:01:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.132+0000 7faf0ffff700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faef0066f30 0x7faef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.132+0000 7faf0ffff700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faef0066f30 0x7faef00693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faf00001ed0 tx=0x7faf00015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.136+0000 7faf07fff700 1 -- 172.21.15.7:0/3455036747 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faef8051040 con 0x7faf1016a6d0 2023-10-06T11:01:00.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.337+0000 7faf169ba700 1 -- 172.21.15.7:0/3455036747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf10070480 con 0x7faf1016a6d0 2023-10-06T11:01:00.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.338+0000 7faf07fff700 1 -- 172.21.15.7:0/3455036747 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+13855 (secure 0 0 0) 0x7faef801a090 con 0x7faf1016a6d0 2023-10-06T11:01:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:00.340 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":53,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:00:59.505915+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:01:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.340+0000 7faf169ba700 1 -- 172.21.15.7:0/3455036747 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faef0066f30 msgr2=0x7faef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.340+0000 7faf169ba700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faef0066f30 0x7faef00693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faf00001ed0 tx=0x7faf00015000 comp rx=0 tx=0).stop 2023-10-06T11:01:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.340+0000 7faf169ba700 1 -- 172.21.15.7:0/3455036747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1016a6d0 msgr2=0x7faf1014b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.340+0000 7faf169ba700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1016a6d0 0x7faf1014b900 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faef80073c0 tx=0x7faef8001df0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.340+0000 7faf169ba700 1 -- 172.21.15.7:0/3455036747 shutdown_connections 2023-10-06T11:01:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.340+0000 7faf169ba700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7faef0066f30 0x7faef00693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.340+0000 7faf169ba700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100a9a00 0x7faf10067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.340+0000 7faf169ba700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faefc003c20 0x7faf1016d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.340+0000 7faf169ba700 1 --2- 172.21.15.7:0/3455036747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1016a6d0 0x7faf1014b900 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.340+0000 7faf169ba700 1 -- 172.21.15.7:0/3455036747 >> 172.21.15.7:0/3455036747 conn(0x7faf10096160 msgr2=0x7faf1015c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.340+0000 7faf169ba700 1 -- 172.21.15.7:0/3455036747 shutdown_connections 2023-10-06T11:01:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.340+0000 7faf169ba700 1 -- 172.21.15.7:0/3455036747 wait complete. 2023-10-06T11:01:00.355 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T10:58:55.224661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T10:58:56.032929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:01:00.356 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:01:00.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.489+0000 7f9ff41ef700 1 Processor -- start 2023-10-06T11:01:00.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.489+0000 7f9ff41ef700 1 -- start start 2023-10-06T11:01:00.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.490+0000 7f9ff41ef700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9fec0cab40 0x7f9fec0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.490+0000 7f9ff41ef700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9fec0b2430 0x7f9fec0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.490+0000 7f9ff41ef700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec0699e0 con 0x7f9fec0caf10 2023-10-06T11:01:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.490+0000 7f9ff41ef700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec069dd0 con 0x7f9fec0b2430 2023-10-06T11:01:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.490+0000 7f9ff41ef700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec06a070 con 0x7f9fec0cab40 2023-10-06T11:01:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.490+0000 7f9ff278c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9fec0b2430 0x7f9fec0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.490+0000 7f9ff278c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9fec0b2430 0x7f9fec0c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60172/0 (socket says 172.21.15.7:60172) 2023-10-06T11:01:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.490+0000 7f9ff278c700 1 -- 172.21.15.7:0/3176429071 learned_addr learned my addr 172.21.15.7:0/3176429071 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.490+0000 7f9ff1f8b700 1 --2- 172.21.15.7:0/3176429071 >> v2:172.21.15.50:3300/0 conn(0x7f9fec0cab40 0x7f9fec0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.490+0000 7f9ff278c700 1 -- 172.21.15.7:0/3176429071 >> v2:172.21.15.50:3300/0 conn(0x7f9fec0cab40 msgr2=0x7f9fec0694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.490+0000 7f9ff278c700 1 --2- 172.21.15.7:0/3176429071 >> v2:172.21.15.50:3300/0 conn(0x7f9fec0cab40 0x7f9fec0694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.490+0000 7f9ff278c700 1 -- 172.21.15.7:0/3176429071 >> v1:172.21.15.50:6789/0 conn(0x7f9fec0caf10 legacy=0x7f9fec0b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.490+0000 7f9ff278c700 1 -- 172.21.15.7:0/3176429071 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec06a350 con 0x7f9fec0b2430 2023-10-06T11:01:00.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.491+0000 7f9ff278c700 1 --2- 172.21.15.7:0/3176429071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fec0b2430 0x7f9fec0c7e40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9fec06de70 tx=0x7f9fe4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d95994c7ae40ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:00.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.491+0000 7f9ff0f89700 1 -- 172.21.15.7:0/3176429071 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe400e070 con 0x7f9fec0b2430 2023-10-06T11:01:00.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.491+0000 7f9ff0f89700 1 -- 172.21.15.7:0/3176429071 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe400ba50 con 0x7f9fec0b2430 2023-10-06T11:01:00.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.491+0000 7f9ff0f89700 1 -- 172.21.15.7:0/3176429071 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40092e0 con 0x7f9fec0b2430 2023-10-06T11:01:00.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.491+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3176429071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fec0b2430 msgr2=0x7f9fec0c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.491+0000 7f9ff41ef700 1 --2- 172.21.15.7:0/3176429071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fec0b2430 0x7f9fec0c7e40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9fec06de70 tx=0x7f9fe4009840 comp rx=0 tx=0).stop 2023-10-06T11:01:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.491+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3176429071 shutdown_connections 2023-10-06T11:01:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.491+0000 7f9ff41ef700 1 --2- 172.21.15.7:0/3176429071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fec0b2430 0x7f9fec0c7e40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.491+0000 7f9ff41ef700 1 --2- 172.21.15.7:0/3176429071 >> v2:172.21.15.50:3300/0 conn(0x7f9fec0cab40 0x7f9fec0694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.491+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3176429071 >> 172.21.15.7:0/3176429071 conn(0x7f9fec0afc90 msgr2=0x7f9fec0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.492+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3176429071 shutdown_connections 2023-10-06T11:01:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.492+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3176429071 wait complete. 2023-10-06T11:01:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.493+0000 7f9ff41ef700 1 Processor -- start 2023-10-06T11:01:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.493+0000 7f9ff41ef700 1 -- start start 2023-10-06T11:01:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.493+0000 7f9ff41ef700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fec0b2430 0x7f9fec0c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.493+0000 7f9ff41ef700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fec0cab40 0x7f9fec14e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.493+0000 7f9ff41ef700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fec0caf10 0x7f9fec0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.493+0000 7f9ff41ef700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0c6c10 con 0x7f9fec0caf10 2023-10-06T11:01:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9ff41ef700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec14eae0 con 0x7f9fec0cab40 2023-10-06T11:01:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9ff41ef700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0c4060 con 0x7f9fec0b2430 2023-10-06T11:01:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9ff278c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fec0caf10 0x7f9fec0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9ff278c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fec0caf10 0x7f9fec0c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60184/0 (socket says 172.21.15.7:60184) 2023-10-06T11:01:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9ff278c700 1 -- 172.21.15.7:0/3856386060 learned_addr learned my addr 172.21.15.7:0/3856386060 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9ff1f8b700 1 --2- 172.21.15.7:0/3856386060 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fec0b2430 0x7f9fec0c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9ff178a700 1 --2- 172.21.15.7:0/3856386060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fec0cab40 0x7f9fec14e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9ff278c700 1 -- 172.21.15.7:0/3856386060 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fec0b2430 msgr2=0x7f9fec0c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9ff278c700 1 --2- 172.21.15.7:0/3856386060 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fec0b2430 0x7f9fec0c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9ff278c700 1 -- 172.21.15.7:0/3856386060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fec0cab40 msgr2=0x7f9fec14e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9ff278c700 1 --2- 172.21.15.7:0/3856386060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fec0cab40 0x7f9fec14e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9ff278c700 1 -- 172.21.15.7:0/3856386060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe4009ae0 con 0x7f9fec0caf10 2023-10-06T11:01:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9ff278c700 1 --2- 172.21.15.7:0/3856386060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fec0caf10 0x7f9fec0c8b30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9fec06e0b0 tx=0x7f9fe4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9fe1ffb700 1 -- 172.21.15.7:0/3856386060 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40094e0 con 0x7f9fec0caf10 2023-10-06T11:01:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9fe1ffb700 1 -- 172.21.15.7:0/3856386060 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe400be60 con 0x7f9fec0caf10 2023-10-06T11:01:00.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3856386060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec0c5b70 con 0x7f9fec0caf10 2023-10-06T11:01:00.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.494+0000 7f9fe1ffb700 1 -- 172.21.15.7:0/3856386060 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4026460 con 0x7f9fec0caf10 2023-10-06T11:01:00.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.495+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3856386060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec0c6130 con 0x7f9fec0caf10 2023-10-06T11:01:00.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.496+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3856386060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec070480 con 0x7f9fec0caf10 2023-10-06T11:01:00.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.496+0000 7f9fe1ffb700 1 -- 172.21.15.7:0/3856386060 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fe4003040 con 0x7f9fec0caf10 2023-10-06T11:01:00.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.496+0000 7f9fe1ffb700 1 --2- 172.21.15.7:0/3856386060 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9fd0066f30 0x7f9fd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.497+0000 7f9fe1ffb700 1 -- 172.21.15.7:0/3856386060 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f9fe40862c0 con 0x7f9fec0caf10 2023-10-06T11:01:00.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.497+0000 7f9ff1f8b700 1 --2- 172.21.15.7:0/3856386060 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9fd0066f30 0x7f9fd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.497+0000 7f9ff1f8b700 1 --2- 172.21.15.7:0/3856386060 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9fd0066f30 0x7f9fd00693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8006fd0 tx=0x7f9fe8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:00.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.501+0000 7f9fe1ffb700 1 -- 172.21.15.7:0/3856386060 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fe40535e0 con 0x7f9fec0caf10 2023-10-06T11:01:00.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.705+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3856386060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9fec0c7360 con 0x7f9fec0caf10 2023-10-06T11:01:00.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.706+0000 7f9fe1ffb700 1 -- 172.21.15.7:0/3856386060 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9fe4009940 con 0x7f9fec0caf10 2023-10-06T11:01:00.708 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-10-06T11:01:00.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.708+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3856386060 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9fd0066f30 msgr2=0x7f9fd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.708+0000 7f9ff41ef700 1 --2- 172.21.15.7:0/3856386060 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9fd0066f30 0x7f9fd00693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8006fd0 tx=0x7f9fe8008040 comp rx=0 tx=0).stop 2023-10-06T11:01:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.708+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3856386060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fec0caf10 msgr2=0x7f9fec0c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.708+0000 7f9ff41ef700 1 --2- 172.21.15.7:0/3856386060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fec0caf10 0x7f9fec0c8b30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9fec06e0b0 tx=0x7f9fe4018000 comp rx=0 tx=0).stop 2023-10-06T11:01:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.708+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3856386060 shutdown_connections 2023-10-06T11:01:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.708+0000 7f9ff41ef700 1 --2- 172.21.15.7:0/3856386060 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9fd0066f30 0x7f9fd00693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.708+0000 7f9ff41ef700 1 --2- 172.21.15.7:0/3856386060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fec0caf10 0x7f9fec0c8b30 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.708+0000 7f9ff41ef700 1 --2- 172.21.15.7:0/3856386060 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fec0b2430 0x7f9fec0c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.708+0000 7f9ff41ef700 1 --2- 172.21.15.7:0/3856386060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fec0cab40 0x7f9fec14e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.708+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3856386060 >> 172.21.15.7:0/3856386060 conn(0x7f9fec0afc90 msgr2=0x7f9fec150370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.708+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3856386060 shutdown_connections 2023-10-06T11:01:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.708+0000 7f9ff41ef700 1 -- 172.21.15.7:0/3856386060 wait complete. 2023-10-06T11:01:00.723 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:01:00.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.856+0000 7f1f7aca1700 1 Processor -- start 2023-10-06T11:01:00.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.856+0000 7f1f7aca1700 1 -- start start 2023-10-06T11:01:00.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.857+0000 7f1f7aca1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1f7406ad30 0x7f1f740670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.857+0000 7f1f7aca1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f740ae130 0x7f1f740ae590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.857+0000 7f1f7aca1700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f740aead0 con 0x7f1f7415a200 2023-10-06T11:01:00.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.857+0000 7f1f7aca1700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f740cb110 con 0x7f1f7406ad30 2023-10-06T11:01:00.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.857+0000 7f1f7aca1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7406c070 con 0x7f1f740ae130 2023-10-06T11:01:00.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.857+0000 7f1f73fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1f7406ad30 0x7f1f740670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.857+0000 7f1f73fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1f7406ad30 0x7f1f740670f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60190/0 (socket says 172.21.15.7:60190) 2023-10-06T11:01:00.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.857+0000 7f1f73fff700 1 -- 172.21.15.7:0/2650396223 learned_addr learned my addr 172.21.15.7:0/2650396223 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:00.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.857+0000 7f1f7923e700 1 --2- 172.21.15.7:0/2650396223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f740ae130 0x7f1f740ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.857+0000 7f1f73fff700 1 -- 172.21.15.7:0/2650396223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f740ae130 msgr2=0x7f1f740ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:00.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.857+0000 7f1f737fe700 1 -- 172.21.15.7:0/2650396223 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728123898 0 0) 0x7f1f68001110 con 0x7f1f7415a200 2023-10-06T11:01:00.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.857+0000 7f1f73fff700 1 --2- 172.21.15.7:0/2650396223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f740ae130 0x7f1f740ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.857+0000 7f1f73fff700 1 -- 172.21.15.7:0/2650396223 >> v1:172.21.15.50:6789/0 conn(0x7f1f7415a200 legacy=0x7f1f7415a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.857+0000 7f1f73fff700 1 -- 172.21.15.7:0/2650396223 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f740c90d0 con 0x7f1f7406ad30 2023-10-06T11:01:00.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.858+0000 7f1f73fff700 1 --2- 172.21.15.7:0/2650396223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7406ad30 0x7f1f740670f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1f600099b0 tx=0x7f1f60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd252ef6f3cb6bba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:00.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.858+0000 7f1f737fe700 1 -- 172.21.15.7:0/2650396223 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f60009ea0 con 0x7f1f7406ad30 2023-10-06T11:01:00.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.858+0000 7f1f737fe700 1 -- 172.21.15.7:0/2650396223 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6000b860 con 0x7f1f7406ad30 2023-10-06T11:01:00.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.858+0000 7f1f737fe700 1 -- 172.21.15.7:0/2650396223 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6000bc00 con 0x7f1f7406ad30 2023-10-06T11:01:00.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.858+0000 7f1f7aca1700 1 -- 172.21.15.7:0/2650396223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7406ad30 msgr2=0x7f1f740670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.858+0000 7f1f7aca1700 1 --2- 172.21.15.7:0/2650396223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7406ad30 0x7f1f740670f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1f600099b0 tx=0x7f1f60009250 comp rx=0 tx=0).stop 2023-10-06T11:01:00.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.858+0000 7f1f7aca1700 1 -- 172.21.15.7:0/2650396223 shutdown_connections 2023-10-06T11:01:00.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.858+0000 7f1f7aca1700 1 --2- 172.21.15.7:0/2650396223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f740ae130 0x7f1f740ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.858+0000 7f1f7aca1700 1 --2- 172.21.15.7:0/2650396223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7406ad30 0x7f1f740670f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.858+0000 7f1f7aca1700 1 -- 172.21.15.7:0/2650396223 >> 172.21.15.7:0/2650396223 conn(0x7f1f740cc560 msgr2=0x7f1f740cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:00.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.858+0000 7f1f7aca1700 1 -- 172.21.15.7:0/2650396223 shutdown_connections 2023-10-06T11:01:00.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.858+0000 7f1f7aca1700 1 -- 172.21.15.7:0/2650396223 wait complete. 2023-10-06T11:01:00.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.859+0000 7f1f7aca1700 1 Processor -- start 2023-10-06T11:01:00.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.860+0000 7f1f7aca1700 1 -- start start 2023-10-06T11:01:00.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.860+0000 7f1f7aca1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f7406ad30 0x7f1f7414f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.860+0000 7f1f7aca1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f740ae130 0x7f1f74157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.860+0000 7f1f7aca1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7415a200 0x7f1f74157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.860+0000 7f1f7aca1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74152920 con 0x7f1f7415a200 2023-10-06T11:01:00.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f7aca1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740a7740 con 0x7f1f740ae130 2023-10-06T11:01:00.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f7aca1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74152080 con 0x7f1f7406ad30 2023-10-06T11:01:00.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f7923e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7415a200 0x7f1f74157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f7923e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7415a200 0x7f1f74157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60196/0 (socket says 172.21.15.7:60196) 2023-10-06T11:01:00.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f7923e700 1 -- 172.21.15.7:0/1530630985 learned_addr learned my addr 172.21.15.7:0/1530630985 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:00.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f73fff700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f740ae130 0x7f1f74157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f78a3d700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f7406ad30 0x7f1f7414f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f7923e700 1 -- 172.21.15.7:0/1530630985 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f7406ad30 msgr2=0x7f1f7414f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f7923e700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f7406ad30 0x7f1f7414f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f7923e700 1 -- 172.21.15.7:0/1530630985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f740ae130 msgr2=0x7f1f74157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:00.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f7923e700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f740ae130 0x7f1f74157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:00.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f7923e700 1 -- 172.21.15.7:0/1530630985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f600094f0 con 0x7f1f7415a200 2023-10-06T11:01:00.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f78a3d700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f7406ad30 0x7f1f7414f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:00.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f7923e700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7415a200 0x7f1f74157790 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009e90 tx=0x7f1f6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:00.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f70ff9700 1 -- 172.21.15.7:0/1530630985 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c00cc20 con 0x7f1f7415a200 2023-10-06T11:01:00.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f70ff9700 1 -- 172.21.15.7:0/1530630985 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c00f040 con 0x7f1f7415a200 2023-10-06T11:01:00.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f7aca1700 1 -- 172.21.15.7:0/1530630985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f74152360 con 0x7f1f7415a200 2023-10-06T11:01:00.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f70ff9700 1 -- 172.21.15.7:0/1530630985 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c014480 con 0x7f1f7415a200 2023-10-06T11:01:00.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.861+0000 7f1f7aca1700 1 -- 172.21.15.7:0/1530630985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f74151c70 con 0x7f1f7415a200 2023-10-06T11:01:00.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.862+0000 7f1f7aca1700 1 -- 172.21.15.7:0/1530630985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f740a78b0 con 0x7f1f7415a200 2023-10-06T11:01:00.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.863+0000 7f1f70ff9700 1 -- 172.21.15.7:0/1530630985 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f6c014830 con 0x7f1f7415a200 2023-10-06T11:01:00.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.863+0000 7f1f70ff9700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1f58066f30 0x7f1f580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:00.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.864+0000 7f1f78a3d700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1f58066f30 0x7f1f580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:00.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.864+0000 7f1f70ff9700 1 -- 172.21.15.7:0/1530630985 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f1f6c084e50 con 0x7f1f7415a200 2023-10-06T11:01:00.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.864+0000 7f1f78a3d700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1f58066f30 0x7f1f580693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1f68001820 tx=0x7f1f68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:00.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:00.868+0000 7f1f70ff9700 1 -- 172.21.15.7:0/1530630985 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f6c052170 con 0x7f1f7415a200 2023-10-06T11:01:01.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.069+0000 7f1f7aca1700 1 -- 172.21.15.7:0/1530630985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f74070480 con 0x7f1f7415a200 2023-10-06T11:01:01.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.070+0000 7f1f70ff9700 1 -- 172.21.15.7:0/1530630985 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f6c0180a0 con 0x7f1f7415a200 2023-10-06T11:01:01.072 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-06T11:01:01.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.072+0000 7f1f7aca1700 1 -- 172.21.15.7:0/1530630985 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1f58066f30 msgr2=0x7f1f580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:01.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.072+0000 7f1f7aca1700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1f58066f30 0x7f1f580693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1f68001820 tx=0x7f1f68009040 comp rx=0 tx=0).stop 2023-10-06T11:01:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.072+0000 7f1f7aca1700 1 -- 172.21.15.7:0/1530630985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7415a200 msgr2=0x7f1f74157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.072+0000 7f1f7aca1700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7415a200 0x7f1f74157790 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009e90 tx=0x7f1f6c00b040 comp rx=0 tx=0).stop 2023-10-06T11:01:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.072+0000 7f1f7aca1700 1 -- 172.21.15.7:0/1530630985 shutdown_connections 2023-10-06T11:01:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.072+0000 7f1f7aca1700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1f58066f30 0x7f1f580693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.072+0000 7f1f7aca1700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7415a200 0x7f1f74157790 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.072+0000 7f1f7aca1700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f7406ad30 0x7f1f7414f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.072+0000 7f1f7aca1700 1 --2- 172.21.15.7:0/1530630985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f740ae130 0x7f1f74157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.072+0000 7f1f7aca1700 1 -- 172.21.15.7:0/1530630985 >> 172.21.15.7:0/1530630985 conn(0x7f1f740cc560 msgr2=0x7f1f740b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:01.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.072+0000 7f1f7aca1700 1 -- 172.21.15.7:0/1530630985 shutdown_connections 2023-10-06T11:01:01.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.072+0000 7f1f7aca1700 1 -- 172.21.15.7:0/1530630985 wait complete. 2023-10-06T11:01:01.087 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:01:01.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.218+0000 7fa6a6c85700 1 Processor -- start 2023-10-06T11:01:01.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.218+0000 7fa6a6c85700 1 -- start start 2023-10-06T11:01:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.219+0000 7fa6a6c85700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6a01590d0 0x7fa6a0069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.219+0000 7fa6a6c85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6a015d520 0x7fa6a01594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.219+0000 7fa6a6c85700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a00694d0 con 0x7fa6a006a0f0 2023-10-06T11:01:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.219+0000 7fa6a6c85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a0068990 con 0x7fa6a015d520 2023-10-06T11:01:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.219+0000 7fa6a6c85700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a0068ba0 con 0x7fa6a01590d0 2023-10-06T11:01:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.219+0000 7fa69ffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa6a006a0f0 0x7fa6a015ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42612/0 (socket says 172.21.15.7:42612) 2023-10-06T11:01:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.219+0000 7fa69ffff700 1 -- 172.21.15.7:0/2706451692 learned_addr learned my addr 172.21.15.7:0/2706451692 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.219+0000 7fa6a4a21700 1 --2- 172.21.15.7:0/2706451692 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6a01590d0 0x7fa6a0069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.219+0000 7fa6a5222700 1 --2- 172.21.15.7:0/2706451692 >> v2:172.21.15.50:3300/0 conn(0x7fa6a015d520 0x7fa6a01594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.219+0000 7fa69f7fe700 1 -- 172.21.15.7:0/2706451692 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591197644 0 0) 0x7fa6a00694d0 con 0x7fa6a006a0f0 2023-10-06T11:01:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.220+0000 7fa69f7fe700 1 -- 172.21.15.7:0/2706451692 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa690003570 con 0x7fa6a006a0f0 2023-10-06T11:01:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.220+0000 7fa6a5222700 1 -- 172.21.15.7:0/2706451692 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6a01590d0 msgr2=0x7fa6a0069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.220+0000 7fa6a5222700 1 --2- 172.21.15.7:0/2706451692 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6a01590d0 0x7fa6a0069bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.220+0000 7fa6a5222700 1 -- 172.21.15.7:0/2706451692 >> v1:172.21.15.7:6789/0 conn(0x7fa6a006a0f0 legacy=0x7fa6a015ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.220+0000 7fa69f7fe700 1 -- 172.21.15.7:0/2706451692 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3516637018 0 0) 0x7fa690003570 con 0x7fa6a006a0f0 2023-10-06T11:01:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.220+0000 7fa6a5222700 1 -- 172.21.15.7:0/2706451692 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a0068e80 con 0x7fa6a015d520 2023-10-06T11:01:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.220+0000 7fa6a4a21700 1 --2- 172.21.15.7:0/2706451692 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6a01590d0 0x7fa6a0069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:01:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.220+0000 7fa6a5222700 1 --2- 172.21.15.7:0/2706451692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6a015d520 0x7fa6a01594a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa698009e60 tx=0x7fa698009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7c2968f314ec442 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:01.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.220+0000 7fa69f7fe700 1 -- 172.21.15.7:0/2706451692 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69800e070 con 0x7fa6a015d520 2023-10-06T11:01:01.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.220+0000 7fa69f7fe700 1 -- 172.21.15.7:0/2706451692 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69800b7a0 con 0x7fa6a015d520 2023-10-06T11:01:01.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.220+0000 7fa69f7fe700 1 -- 172.21.15.7:0/2706451692 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c001470 con 0x7fa6a015d520 2023-10-06T11:01:01.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.221+0000 7fa6a6c85700 1 -- 172.21.15.7:0/2706451692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6a015d520 msgr2=0x7fa6a01594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:01.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.221+0000 7fa6a6c85700 1 --2- 172.21.15.7:0/2706451692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6a015d520 0x7fa6a01594a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa698009e60 tx=0x7fa698009780 comp rx=0 tx=0).stop 2023-10-06T11:01:01.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.221+0000 7fa6a6c85700 1 -- 172.21.15.7:0/2706451692 shutdown_connections 2023-10-06T11:01:01.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.221+0000 7fa6a6c85700 1 --2- 172.21.15.7:0/2706451692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6a015d520 0x7fa6a01594a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.221+0000 7fa6a6c85700 1 --2- 172.21.15.7:0/2706451692 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6a01590d0 0x7fa6a0069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.221+0000 7fa6a6c85700 1 -- 172.21.15.7:0/2706451692 >> 172.21.15.7:0/2706451692 conn(0x7fa6a0096160 msgr2=0x7fa6a00afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:01.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.221+0000 7fa6a6c85700 1 -- 172.21.15.7:0/2706451692 shutdown_connections 2023-10-06T11:01:01.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.221+0000 7fa6a6c85700 1 -- 172.21.15.7:0/2706451692 wait complete. 2023-10-06T11:01:01.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.222+0000 7fa6a6c85700 1 Processor -- start 2023-10-06T11:01:01.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.222+0000 7fa6a6c85700 1 -- start start 2023-10-06T11:01:01.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.223+0000 7fa6a6c85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6a006a0f0 0x7fa6a014c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:01.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.223+0000 7fa6a6c85700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6a01590d0 0x7fa6a014db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:01.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.223+0000 7fa6a6c85700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6a015d520 0x7fa6a0169650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:01.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.223+0000 7fa6a6c85700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a016a870 con 0x7fa6a015d520 2023-10-06T11:01:01.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.223+0000 7fa6a6c85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a014e580 con 0x7fa6a006a0f0 2023-10-06T11:01:01.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.223+0000 7fa6a6c85700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a014e860 con 0x7fa6a01590d0 2023-10-06T11:01:01.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.223+0000 7fa6a5222700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6a015d520 0x7fa6a0169650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:01.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.223+0000 7fa6a5222700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6a015d520 0x7fa6a0169650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60200/0 (socket says 172.21.15.7:60200) 2023-10-06T11:01:01.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.223+0000 7fa6a5222700 1 -- 172.21.15.7:0/3113240503 learned_addr learned my addr 172.21.15.7:0/3113240503 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:01.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.223+0000 7fa6a4a21700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6a006a0f0 0x7fa6a014c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:01.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.224+0000 7fa69ffff700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6a01590d0 0x7fa6a014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:01.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.224+0000 7fa6a5222700 1 -- 172.21.15.7:0/3113240503 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6a01590d0 msgr2=0x7fa6a014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:01.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.224+0000 7fa6a5222700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6a01590d0 0x7fa6a014db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.224+0000 7fa6a5222700 1 -- 172.21.15.7:0/3113240503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6a006a0f0 msgr2=0x7fa6a014c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:01.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.224+0000 7fa6a5222700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6a006a0f0 0x7fa6a014c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.224+0000 7fa6a5222700 1 -- 172.21.15.7:0/3113240503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa694009420 con 0x7fa6a015d520 2023-10-06T11:01:01.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.224+0000 7fa6a4a21700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6a006a0f0 0x7fa6a014c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:01.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.224+0000 7fa6a5222700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6a015d520 0x7fa6a0169650 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00b2e50 tx=0x7fa698018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:01.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.224+0000 7fa69cff9700 1 -- 172.21.15.7:0/3113240503 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698012d20 con 0x7fa6a015d520 2023-10-06T11:01:01.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.224+0000 7fa69cff9700 1 -- 172.21.15.7:0/3113240503 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa698012e80 con 0x7fa6a015d520 2023-10-06T11:01:01.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.224+0000 7fa6a6c85700 1 -- 172.21.15.7:0/3113240503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa698009a20 con 0x7fa6a015d520 2023-10-06T11:01:01.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.224+0000 7fa69cff9700 1 -- 172.21.15.7:0/3113240503 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69801e680 con 0x7fa6a015d520 2023-10-06T11:01:01.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.224+0000 7fa6a6c85700 1 -- 172.21.15.7:0/3113240503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a014ee20 con 0x7fa6a015d520 2023-10-06T11:01:01.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.225+0000 7fa6a6c85700 1 -- 172.21.15.7:0/3113240503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a016a9e0 con 0x7fa6a015d520 2023-10-06T11:01:01.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.226+0000 7fa69cff9700 1 -- 172.21.15.7:0/3113240503 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa69801ea70 con 0x7fa6a015d520 2023-10-06T11:01:01.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.226+0000 7fa69cff9700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa684066f30 0x7fa6840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:01.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.226+0000 7fa69cff9700 1 -- 172.21.15.7:0/3113240503 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fa698086610 con 0x7fa6a015d520 2023-10-06T11:01:01.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.226+0000 7fa6a4a21700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa684066f30 0x7fa6840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:01.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.227+0000 7fa6a4a21700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa684066f30 0x7fa6840693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa6940093f0 tx=0x7fa694008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:01.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.231+0000 7fa69cff9700 1 -- 172.21.15.7:0/3113240503 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa698053930 con 0x7fa6a015d520 2023-10-06T11:01:01.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.434+0000 7fa6a6c85700 1 -- 172.21.15.7:0/3113240503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa6a0070480 con 0x7fa6a015d520 2023-10-06T11:01:01.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.434+0000 7fa69cff9700 1 -- 172.21.15.7:0/3113240503 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa698056f50 con 0x7fa6a015d520 2023-10-06T11:01:01.436 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:01.436 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-06T11:01:01.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:01:01.436 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-06T11:01:01.436 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": "rbd" 2023-10-06T11:01:01.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:01:01.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-06T11:01:01.437 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 2, 2023-10-06T11:01:01.437 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-06T11:01:01.437 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:01:01.437 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-06T11:01:01.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.436+0000 7fa6a6c85700 1 -- 172.21.15.7:0/3113240503 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa684066f30 msgr2=0x7fa6840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:01.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.436+0000 7fa6a6c85700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa684066f30 0x7fa6840693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa6940093f0 tx=0x7fa694008040 comp rx=0 tx=0).stop 2023-10-06T11:01:01.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.436+0000 7fa6a6c85700 1 -- 172.21.15.7:0/3113240503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6a015d520 msgr2=0x7fa6a0169650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:01.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.436+0000 7fa6a6c85700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6a015d520 0x7fa6a0169650 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00b2e50 tx=0x7fa698018000 comp rx=0 tx=0).stop 2023-10-06T11:01:01.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.436+0000 7fa6a6c85700 1 -- 172.21.15.7:0/3113240503 shutdown_connections 2023-10-06T11:01:01.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.436+0000 7fa6a6c85700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa684066f30 0x7fa6840693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.436+0000 7fa6a6c85700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6a015d520 0x7fa6a0169650 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.436+0000 7fa6a6c85700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6a006a0f0 0x7fa6a014c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.436+0000 7fa6a6c85700 1 --2- 172.21.15.7:0/3113240503 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6a01590d0 0x7fa6a014db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.436+0000 7fa6a6c85700 1 -- 172.21.15.7:0/3113240503 >> 172.21.15.7:0/3113240503 conn(0x7fa6a0096160 msgr2=0x7fa6a00abe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:01.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.437+0000 7fa6a6c85700 1 -- 172.21.15.7:0/3113240503 shutdown_connections 2023-10-06T11:01:01.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.437+0000 7fa6a6c85700 1 -- 172.21.15.7:0/3113240503 wait complete. 2023-10-06T11:01:01.451 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:01:01.452 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:01:01.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.587+0000 7f6a9dc75700 1 Processor -- start 2023-10-06T11:01:01.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.587+0000 7f6a9dc75700 1 -- start start 2023-10-06T11:01:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a9dc75700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a981570b0 0x7f6a98068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a9dc75700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a980690e0 0x7f6a98069880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a9dc75700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a98069550 con 0x7f6a98069dc0 2023-10-06T11:01:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a9dc75700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a980cd720 con 0x7f6a980690e0 2023-10-06T11:01:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a9dc75700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a980ccb50 con 0x7f6a981570b0 2023-10-06T11:01:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a96ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a980690e0 0x7f6a98069880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a96ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a980690e0 0x7f6a98069880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60202/0 (socket says 172.21.15.7:60202) 2023-10-06T11:01:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a96ffd700 1 -- 172.21.15.7:0/2319308395 learned_addr learned my addr 172.21.15.7:0/2319308395 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a977fe700 1 --2- 172.21.15.7:0/2319308395 >> v2:172.21.15.50:3300/0 conn(0x7f6a981570b0 0x7f6a98068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a96ffd700 1 -- 172.21.15.7:0/2319308395 >> v2:172.21.15.50:3300/0 conn(0x7f6a981570b0 msgr2=0x7f6a98068ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a96ffd700 1 --2- 172.21.15.7:0/2319308395 >> v2:172.21.15.50:3300/0 conn(0x7f6a981570b0 0x7f6a98068ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a96ffd700 1 -- 172.21.15.7:0/2319308395 >> v1:172.21.15.50:6789/0 conn(0x7f6a98069dc0 legacy=0x7f6a98067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a96ffd700 1 -- 172.21.15.7:0/2319308395 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a980cdbb0 con 0x7f6a980690e0 2023-10-06T11:01:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a977fe700 1 --2- 172.21.15.7:0/2319308395 >> v2:172.21.15.50:3300/0 conn(0x7f6a981570b0 0x7f6a98068ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.588+0000 7f6a96ffd700 1 --2- 172.21.15.7:0/2319308395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a980690e0 0x7f6a98069880 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6a9806e8c0 tx=0x7f6a88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afccba39147bc0fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.589+0000 7f6a967fc700 1 -- 172.21.15.7:0/2319308395 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800b820 con 0x7f6a980690e0 2023-10-06T11:01:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.589+0000 7f6a967fc700 1 -- 172.21.15.7:0/2319308395 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8800b980 con 0x7f6a980690e0 2023-10-06T11:01:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.589+0000 7f6a967fc700 1 -- 172.21.15.7:0/2319308395 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800bd20 con 0x7f6a980690e0 2023-10-06T11:01:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.589+0000 7f6a9dc75700 1 -- 172.21.15.7:0/2319308395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a980690e0 msgr2=0x7f6a98069880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.589+0000 7f6a9dc75700 1 --2- 172.21.15.7:0/2319308395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a980690e0 0x7f6a98069880 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6a9806e8c0 tx=0x7f6a88009250 comp rx=0 tx=0).stop 2023-10-06T11:01:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.589+0000 7f6a9dc75700 1 -- 172.21.15.7:0/2319308395 shutdown_connections 2023-10-06T11:01:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.589+0000 7f6a9dc75700 1 --2- 172.21.15.7:0/2319308395 >> v2:172.21.15.50:3300/0 conn(0x7f6a981570b0 0x7f6a98068ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.589+0000 7f6a9dc75700 1 --2- 172.21.15.7:0/2319308395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a980690e0 0x7f6a98069880 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.589+0000 7f6a9dc75700 1 -- 172.21.15.7:0/2319308395 >> 172.21.15.7:0/2319308395 conn(0x7f6a98096160 msgr2=0x7f6a980afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.589+0000 7f6a9dc75700 1 -- 172.21.15.7:0/2319308395 shutdown_connections 2023-10-06T11:01:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.589+0000 7f6a9dc75700 1 -- 172.21.15.7:0/2319308395 wait complete. 2023-10-06T11:01:01.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.591+0000 7f6a9dc75700 1 Processor -- start 2023-10-06T11:01:01.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.591+0000 7f6a9dc75700 1 -- start start 2023-10-06T11:01:01.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a9dc75700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a980690e0 0x7f6a98140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:01.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a9dc75700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a98069dc0 0x7f6a98159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:01.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a9dc75700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a981570b0 0x7f6a980c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:01.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a9dc75700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a98158b40 con 0x7f6a981570b0 2023-10-06T11:01:01.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a9dc75700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a981412f0 con 0x7f6a98069dc0 2023-10-06T11:01:01.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a9dc75700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a98159960 con 0x7f6a980690e0 2023-10-06T11:01:01.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a97fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a981570b0 0x7f6a980c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:01.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a97fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a981570b0 0x7f6a980c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60210/0 (socket says 172.21.15.7:60210) 2023-10-06T11:01:01.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a97fff700 1 -- 172.21.15.7:0/3307100037 learned_addr learned my addr 172.21.15.7:0/3307100037 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:01.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a977fe700 1 --2- 172.21.15.7:0/3307100037 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a980690e0 0x7f6a98140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:01.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a96ffd700 1 --2- 172.21.15.7:0/3307100037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a98069dc0 0x7f6a98159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:01.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a97fff700 1 -- 172.21.15.7:0/3307100037 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a980690e0 msgr2=0x7f6a98140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:01.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a97fff700 1 --2- 172.21.15.7:0/3307100037 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a980690e0 0x7f6a98140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a97fff700 1 -- 172.21.15.7:0/3307100037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a98069dc0 msgr2=0x7f6a98159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:01.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a97fff700 1 --2- 172.21.15.7:0/3307100037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a98069dc0 0x7f6a98159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:01.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a97fff700 1 -- 172.21.15.7:0/3307100037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a880094f0 con 0x7f6a981570b0 2023-10-06T11:01:01.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a97fff700 1 --2- 172.21.15.7:0/3307100037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a981570b0 0x7f6a980c95f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000c960 tx=0x7f6a900026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:01.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a8f7fe700 1 -- 172.21.15.7:0/3307100037 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90012630 con 0x7f6a981570b0 2023-10-06T11:01:01.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.592+0000 7f6a8f7fe700 1 -- 172.21.15.7:0/3307100037 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a90012790 con 0x7f6a981570b0 2023-10-06T11:01:01.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.593+0000 7f6a9dc75700 1 -- 172.21.15.7:0/3307100037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a98158d50 con 0x7f6a981570b0 2023-10-06T11:01:01.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.593+0000 7f6a8f7fe700 1 -- 172.21.15.7:0/3307100037 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90012b50 con 0x7f6a981570b0 2023-10-06T11:01:01.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.593+0000 7f6a9dc75700 1 -- 172.21.15.7:0/3307100037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a98159310 con 0x7f6a981570b0 2023-10-06T11:01:01.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.594+0000 7f6a9dc75700 1 -- 172.21.15.7:0/3307100037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a98159ad0 con 0x7f6a981570b0 2023-10-06T11:01:01.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.594+0000 7f6a8f7fe700 1 -- 172.21.15.7:0/3307100037 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a9001b400 con 0x7f6a981570b0 2023-10-06T11:01:01.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.594+0000 7f6a8f7fe700 1 --2- 172.21.15.7:0/3307100037 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a78066f30 0x7f6a780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:01.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.595+0000 7f6a8f7fe700 1 -- 172.21.15.7:0/3307100037 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f6a900846e0 con 0x7f6a981570b0 2023-10-06T11:01:01.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.595+0000 7f6a977fe700 1 --2- 172.21.15.7:0/3307100037 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a78066f30 0x7f6a780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:01.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.595+0000 7f6a977fe700 1 --2- 172.21.15.7:0/3307100037 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a78066f30 0x7f6a780693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000adc0 tx=0x7f6a80006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:01.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.599+0000 7f6a8f7fe700 1 -- 172.21.15.7:0/3307100037 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a90055540 con 0x7f6a981570b0 2023-10-06T11:01:01.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:01.806+0000 7f6a9dc75700 1 -- 172.21.15.7:0/3307100037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6a98070480 con 0x7f6a981570b0 2023-10-06T11:01:02.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.572+0000 7f6a8f7fe700 1 -- 172.21.15.7:0/3307100037 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6a900550d0 con 0x7f6a981570b0 2023-10-06T11:01:02.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.576+0000 7f6a9dc75700 1 -- 172.21.15.7:0/3307100037 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a78066f30 msgr2=0x7f6a780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:02.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.576+0000 7f6a9dc75700 1 --2- 172.21.15.7:0/3307100037 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a78066f30 0x7f6a780693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000adc0 tx=0x7f6a80006f90 comp rx=0 tx=0).stop 2023-10-06T11:01:02.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.576+0000 7f6a9dc75700 1 -- 172.21.15.7:0/3307100037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a981570b0 msgr2=0x7f6a980c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:02.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.576+0000 7f6a9dc75700 1 --2- 172.21.15.7:0/3307100037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a981570b0 0x7f6a980c95f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000c960 tx=0x7f6a900026e0 comp rx=0 tx=0).stop 2023-10-06T11:01:02.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.577+0000 7f6a9dc75700 1 -- 172.21.15.7:0/3307100037 shutdown_connections 2023-10-06T11:01:02.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.577+0000 7f6a9dc75700 1 --2- 172.21.15.7:0/3307100037 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6a78066f30 0x7f6a780693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:02.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.577+0000 7f6a9dc75700 1 --2- 172.21.15.7:0/3307100037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a981570b0 0x7f6a980c95f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:02.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.577+0000 7f6a9dc75700 1 --2- 172.21.15.7:0/3307100037 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a980690e0 0x7f6a98140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:02.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.577+0000 7f6a9dc75700 1 --2- 172.21.15.7:0/3307100037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a98069dc0 0x7f6a98159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:02.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.577+0000 7f6a9dc75700 1 -- 172.21.15.7:0/3307100037 >> 172.21.15.7:0/3307100037 conn(0x7f6a98096160 msgr2=0x7f6a9806bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:02.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.577+0000 7f6a9dc75700 1 -- 172.21.15.7:0/3307100037 shutdown_connections 2023-10-06T11:01:02.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.577+0000 7f6a9dc75700 1 -- 172.21.15.7:0/3307100037 wait complete. 2023-10-06T11:01:02.584 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-06T11:01:02.596 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:01:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.739+0000 7f450799f700 1 Processor -- start 2023-10-06T11:01:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.739+0000 7f450799f700 1 -- start start 2023-10-06T11:01:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.740+0000 7f450799f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f450006dac0 0x7f450015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.740+0000 7f450799f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450015bb80 con 0x7f450006de90 2023-10-06T11:01:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.740+0000 7f450799f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45000cc1e0 con 0x7f450015b190 2023-10-06T11:01:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.740+0000 7f450799f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45000c92c0 con 0x7f450006dac0 2023-10-06T11:01:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.740+0000 7f4504f3a700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f450006de90 0x7f45000cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42618/0 (socket says 172.21.15.7:42618) 2023-10-06T11:01:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.740+0000 7f4504f3a700 1 -- 172.21.15.7:0/3184093612 learned_addr learned my addr 172.21.15.7:0/3184093612 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.740+0000 7f450573b700 1 --2- 172.21.15.7:0/3184093612 >> v2:172.21.15.50:3300/0 conn(0x7f450006dac0 0x7f450015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454250859 0 0) 0x7f450015bb80 con 0x7f450006de90 2023-10-06T11:01:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44ec003570 con 0x7f450006de90 2023-10-06T11:01:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808381247 0 0) 0x7f45000cc1e0 con 0x7f450015b190 2023-10-06T11:01:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f450015bb80 con 0x7f450015b190 2023-10-06T11:01:02.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3154502569 0 0) 0x7f44ec003570 con 0x7f450006de90 2023-10-06T11:01:02.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 >> v2:172.21.15.50:3300/0 conn(0x7f450006dac0 msgr2=0x7f450015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:02.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 --2- 172.21.15.7:0/3184093612 >> v2:172.21.15.50:3300/0 conn(0x7f450006dac0 0x7f450015ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:02.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 >> v1:172.21.15.50:6789/0 conn(0x7f450015b190 legacy=0x7f4500157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:02.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450015b5d0 con 0x7f450006de90 2023-10-06T11:01:02.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f44f0001470 con 0x7f450006de90 2023-10-06T11:01:02.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 >> v1:172.21.15.7:6789/0 conn(0x7f450006de90 legacy=0x7f45000cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:02.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 --2- 172.21.15.7:0/3184093612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44ec003bf0 0x7f44ec003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:02.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 --2- 172.21.15.7:0/3184093612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44ec004810 0x7f44ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:02.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 --2- 172.21.15.7:0/3184093612 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44ec0051c0 0x7f44ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:02.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45000c92c0 con 0x7f44ec004810 2023-10-06T11:01:02.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec00c0b0 con 0x7f44ec003bf0 2023-10-06T11:01:02.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec00c270 con 0x7f44ec0051c0 2023-10-06T11:01:02.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f450573b700 1 --2- 172.21.15.7:0/3184093612 >> v2:172.21.15.50:3300/0 conn(0x7f450006dac0 0x7f450015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:01:02.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f4504f3a700 1 --2- 172.21.15.7:0/3184093612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44ec004810 0x7f44ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:02.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f4505f3c700 1 --2- 172.21.15.7:0/3184093612 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44ec0051c0 0x7f44ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:02.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.741+0000 7f450573b700 1 --2- 172.21.15.7:0/3184093612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44ec003bf0 0x7f44ec003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:02.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.742+0000 7f4504f3a700 1 -- 172.21.15.7:0/3184093612 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44ec0051c0 msgr2=0x7f44ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:02.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.742+0000 7f4504f3a700 1 --2- 172.21.15.7:0/3184093612 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44ec0051c0 0x7f44ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:02.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.742+0000 7f4504f3a700 1 -- 172.21.15.7:0/3184093612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44ec003bf0 msgr2=0x7f44ec003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:02.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.742+0000 7f4504f3a700 1 --2- 172.21.15.7:0/3184093612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44ec003bf0 0x7f44ec003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:02.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.742+0000 7f4504f3a700 1 -- 172.21.15.7:0/3184093612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec003570 con 0x7f44ec004810 2023-10-06T11:01:02.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.742+0000 7f4505f3c700 1 -- 172.21.15.7:0/3184093612 reap_dead start 2023-10-06T11:01:02.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.742+0000 7f4504f3a700 1 --2- 172.21.15.7:0/3184093612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44ec004810 0x7f44ec004c80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c2d0 tx=0x7f44f0001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3522f8a8415e298 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:02.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.742+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f000cba0 con 0x7f44ec004810 2023-10-06T11:01:02.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.742+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f000cd20 con 0x7f44ec004810 2023-10-06T11:01:02.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.742+0000 7f44f7fff700 1 -- 172.21.15.7:0/3184093612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0005b70 con 0x7f44ec004810 2023-10-06T11:01:02.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.743+0000 7f450799f700 1 -- 172.21.15.7:0/3184093612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44ec004810 msgr2=0x7f44ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:02.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.743+0000 7f450799f700 1 --2- 172.21.15.7:0/3184093612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44ec004810 0x7f44ec004c80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c2d0 tx=0x7f44f0001e10 comp rx=0 tx=0).stop 2023-10-06T11:01:02.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.743+0000 7f450799f700 1 -- 172.21.15.7:0/3184093612 shutdown_connections 2023-10-06T11:01:02.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.743+0000 7f450799f700 1 --2- 172.21.15.7:0/3184093612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44ec004810 0x7f44ec004c80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:02.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.743+0000 7f450799f700 1 -- 172.21.15.7:0/3184093612 >> 172.21.15.7:0/3184093612 conn(0x7f450006cd00 msgr2=0x7f45000cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:02.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.743+0000 7f450799f700 1 -- 172.21.15.7:0/3184093612 shutdown_connections 2023-10-06T11:01:02.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.743+0000 7f450799f700 1 -- 172.21.15.7:0/3184093612 wait complete. 2023-10-06T11:01:02.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.744+0000 7f450799f700 1 Processor -- start 2023-10-06T11:01:02.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.744+0000 7f450799f700 1 -- start start 2023-10-06T11:01:02.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f450799f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44ec004810 0x7f4500152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:02.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f450799f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45000c59c0 0x7f45000acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:02.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f450799f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000c5e30 0x7f45000ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:02.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f450799f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4500068a90 con 0x7f45000c5e30 2023-10-06T11:01:02.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f450799f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45000ae870 con 0x7f45000c59c0 2023-10-06T11:01:02.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f450799f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45000c7930 con 0x7f44ec004810 2023-10-06T11:01:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f4505f3c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000c5e30 0x7f45000ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f4505f3c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000c5e30 0x7f45000ad490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60230/0 (socket says 172.21.15.7:60230) 2023-10-06T11:01:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f4505f3c700 1 -- 172.21.15.7:0/3375813870 learned_addr learned my addr 172.21.15.7:0/3375813870 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f4504f3a700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45000c59c0 0x7f45000acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f450573b700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44ec004810 0x7f4500152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f4505f3c700 1 -- 172.21.15.7:0/3375813870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44ec004810 msgr2=0x7f4500152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f4505f3c700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44ec004810 0x7f4500152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f4505f3c700 1 -- 172.21.15.7:0/3375813870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45000c59c0 msgr2=0x7f45000acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f4505f3c700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45000c59c0 0x7f45000acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f4505f3c700 1 -- 172.21.15.7:0/3375813870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45000c7c10 con 0x7f45000c5e30 2023-10-06T11:01:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.745+0000 7f4504f3a700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45000c59c0 0x7f45000acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.746+0000 7f4505f3c700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000c5e30 0x7f45000ad490 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f450015b560 tx=0x7f44f80017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.746+0000 7f44f57fa700 1 -- 172.21.15.7:0/3375813870 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8006db0 con 0x7f45000c5e30 2023-10-06T11:01:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.746+0000 7f44f57fa700 1 -- 172.21.15.7:0/3375813870 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f800c610 con 0x7f45000c5e30 2023-10-06T11:01:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.746+0000 7f450799f700 1 -- 172.21.15.7:0/3375813870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4500068ce0 con 0x7f45000c5e30 2023-10-06T11:01:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.746+0000 7f44f57fa700 1 -- 172.21.15.7:0/3375813870 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800c9d0 con 0x7f45000c5e30 2023-10-06T11:01:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.746+0000 7f450799f700 1 -- 172.21.15.7:0/3375813870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45000c75e0 con 0x7f45000c5e30 2023-10-06T11:01:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.747+0000 7f450799f700 1 -- 172.21.15.7:0/3375813870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45000691e0 con 0x7f45000c5e30 2023-10-06T11:01:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.747+0000 7f44f57fa700 1 -- 172.21.15.7:0/3375813870 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44f8007070 con 0x7f45000c5e30 2023-10-06T11:01:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.748+0000 7f44f57fa700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f44e4066f30 0x7f44e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.748+0000 7f44f57fa700 1 -- 172.21.15.7:0/3375813870 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f44f8083ff0 con 0x7f45000c5e30 2023-10-06T11:01:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.748+0000 7f450573b700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f44e4066f30 0x7f44e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.748+0000 7f450573b700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f44e4066f30 0x7f44e40693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f44fc006ed0 tx=0x7f44fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.753+0000 7f44f57fa700 1 -- 172.21.15.7:0/3375813870 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44f80511a0 con 0x7f45000c5e30 2023-10-06T11:01:02.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:02.954+0000 7f450799f700 1 -- 172.21.15.7:0/3375813870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4500070480 con 0x7f45000c5e30 2023-10-06T11:01:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.577+0000 7f44f57fa700 1 -- 172.21.15.7:0/3375813870 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) v1 ==== 170+0+0 (secure 0 0 0) 0x7f44f80190d0 con 0x7f45000c5e30 2023-10-06T11:01:03.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.585+0000 7f450799f700 1 -- 172.21.15.7:0/3375813870 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f44e4066f30 msgr2=0x7f44e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:03.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.585+0000 7f450799f700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f44e4066f30 0x7f44e40693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f44fc006ed0 tx=0x7f44fc008040 comp rx=0 tx=0).stop 2023-10-06T11:01:03.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.585+0000 7f450799f700 1 -- 172.21.15.7:0/3375813870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000c5e30 msgr2=0x7f45000ad490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:03.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.585+0000 7f450799f700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000c5e30 0x7f45000ad490 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f450015b560 tx=0x7f44f80017a0 comp rx=0 tx=0).stop 2023-10-06T11:01:03.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.587+0000 7f450799f700 1 -- 172.21.15.7:0/3375813870 shutdown_connections 2023-10-06T11:01:03.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.587+0000 7f450799f700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f44e4066f30 0x7f44e40693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:03.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.587+0000 7f450799f700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000c5e30 0x7f45000ad490 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:03.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.587+0000 7f450799f700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44ec004810 0x7f4500152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:03.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.587+0000 7f450799f700 1 --2- 172.21.15.7:0/3375813870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45000c59c0 0x7f45000acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:03.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.587+0000 7f450799f700 1 -- 172.21.15.7:0/3375813870 >> 172.21.15.7:0/3375813870 conn(0x7f450006cd00 msgr2=0x7f4500153360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.589+0000 7f450799f700 1 -- 172.21.15.7:0/3375813870 shutdown_connections 2023-10-06T11:01:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.590+0000 7f450799f700 1 -- 172.21.15.7:0/3375813870 wait complete. 2023-10-06T11:01:03.597 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-06T11:01:03.611 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:01:03.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.748+0000 7f09b11f8700 1 Processor -- start 2023-10-06T11:01:03.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.748+0000 7f09b11f8700 1 -- start start 2023-10-06T11:01:03.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.749+0000 7f09b11f8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f09ac0c9de0 0x7f09ac156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:03.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.749+0000 7f09b11f8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09ac1571c0 0x7f09ac0c8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:03.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.749+0000 7f09b11f8700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ac0c7fd0 con 0x7f09ac0c9a10 2023-10-06T11:01:03.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.749+0000 7f09b11f8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ac0c7400 con 0x7f09ac0c9de0 2023-10-06T11:01:03.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.749+0000 7f09b11f8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac0c76a0 con 0x7f09ac1571c0 2023-10-06T11:01:03.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.749+0000 7f09aad9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f09ac0c9a10 0x7f09ac069d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42634/0 (socket says 172.21.15.7:42634) 2023-10-06T11:01:03.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.749+0000 7f09aad9d700 1 -- 172.21.15.7:0/2385529248 learned_addr learned my addr 172.21.15.7:0/2385529248 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:03.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09ab59e700 1 --2- 172.21.15.7:0/2385529248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09ac1571c0 0x7f09ac0c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:03.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09aa59c700 1 --2- 172.21.15.7:0/2385529248 >> v2:172.21.15.50:3300/0 conn(0x7f09ac0c9de0 0x7f09ac156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:03.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 -- 172.21.15.7:0/2385529248 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371560249 0 0) 0x7f09ac0c7fd0 con 0x7f09ac0c9a10 2023-10-06T11:01:03.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 -- 172.21.15.7:0/2385529248 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0994003570 con 0x7f09ac0c9a10 2023-10-06T11:01:03.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 -- 172.21.15.7:0/2385529248 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 558448199 0 0) 0x7f0994003570 con 0x7f09ac0c9a10 2023-10-06T11:01:03.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 -- 172.21.15.7:0/2385529248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09ac1571c0 msgr2=0x7f09ac0c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:03.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 --2- 172.21.15.7:0/2385529248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09ac1571c0 0x7f09ac0c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:03.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 -- 172.21.15.7:0/2385529248 >> v2:172.21.15.50:3300/0 conn(0x7f09ac0c9de0 msgr2=0x7f09ac156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:03.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 --2- 172.21.15.7:0/2385529248 >> v2:172.21.15.50:3300/0 conn(0x7f09ac0c9de0 0x7f09ac156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:03.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 -- 172.21.15.7:0/2385529248 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac0c7980 con 0x7f09ac0c9a10 2023-10-06T11:01:03.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 -- 172.21.15.7:0/2385529248 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f099c001470 con 0x7f09ac0c9a10 2023-10-06T11:01:03.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 -- 172.21.15.7:0/2385529248 >> v1:172.21.15.7:6789/0 conn(0x7f09ac0c9a10 legacy=0x7f09ac069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:03.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 --2- 172.21.15.7:0/2385529248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0994003a60 0x7f0994003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:03.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 --2- 172.21.15.7:0/2385529248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0994004810 0x7f0994004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:03.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 --2- 172.21.15.7:0/2385529248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09940051c0 0x7f099400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:03.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 -- 172.21.15.7:0/2385529248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac0c7400 con 0x7f0994004810 2023-10-06T11:01:03.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 -- 172.21.15.7:0/2385529248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac0c76a0 con 0x7f0994003a60 2023-10-06T11:01:03.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09a9d9b700 1 -- 172.21.15.7:0/2385529248 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099400bfa0 con 0x7f09940051c0 2023-10-06T11:01:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09ab59e700 1 --2- 172.21.15.7:0/2385529248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09ac1571c0 0x7f09ac0c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:01:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09aa59c700 1 --2- 172.21.15.7:0/2385529248 >> v2:172.21.15.50:3300/0 conn(0x7f09ac0c9de0 0x7f09ac156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:01:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09aad9d700 1 --2- 172.21.15.7:0/2385529248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0994003a60 0x7f0994003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09aa59c700 1 --2- 172.21.15.7:0/2385529248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0994004810 0x7f0994004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.750+0000 7f09ab59e700 1 --2- 172.21.15.7:0/2385529248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09940051c0 0x7f099400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.751+0000 7f09aa59c700 1 -- 172.21.15.7:0/2385529248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09940051c0 msgr2=0x7f099400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.751+0000 7f09aa59c700 1 --2- 172.21.15.7:0/2385529248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f09940051c0 0x7f099400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.751+0000 7f09aa59c700 1 -- 172.21.15.7:0/2385529248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0994003a60 msgr2=0x7f0994003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.751+0000 7f09aa59c700 1 --2- 172.21.15.7:0/2385529248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0994003a60 0x7f0994003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.751+0000 7f09aa59c700 1 -- 172.21.15.7:0/2385529248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994003570 con 0x7f0994004810 2023-10-06T11:01:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.751+0000 7f09aad9d700 1 --2- 172.21.15.7:0/2385529248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0994003a60 0x7f0994003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:01:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.751+0000 7f09aa59c700 1 --2- 172.21.15.7:0/2385529248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0994004810 0x7f0994004c80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009db0 tx=0x7f09a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b1fcb66fc7ca81 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.751+0000 7f09a9d9b700 1 -- 172.21.15.7:0/2385529248 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0009740 con 0x7f0994004810 2023-10-06T11:01:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.751+0000 7f09a9d9b700 1 -- 172.21.15.7:0/2385529248 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a000e920 con 0x7f0994004810 2023-10-06T11:01:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.751+0000 7f09a9d9b700 1 -- 172.21.15.7:0/2385529248 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a000eca0 con 0x7f0994004810 2023-10-06T11:01:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.751+0000 7f09b11f8700 1 -- 172.21.15.7:0/2385529248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0994004810 msgr2=0x7f0994004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.751+0000 7f09b11f8700 1 --2- 172.21.15.7:0/2385529248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0994004810 0x7f0994004c80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009db0 tx=0x7f09a00091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.751+0000 7f09ab59e700 1 -- 172.21.15.7:0/2385529248 reap_dead start 2023-10-06T11:01:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.751+0000 7f09b11f8700 1 -- 172.21.15.7:0/2385529248 shutdown_connections 2023-10-06T11:01:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.752+0000 7f09b11f8700 1 -- 172.21.15.7:0/2385529248 >> 172.21.15.7:0/2385529248 conn(0x7f09ac0afc90 msgr2=0x7f09ac0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.752+0000 7f09b11f8700 1 -- 172.21.15.7:0/2385529248 shutdown_connections 2023-10-06T11:01:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.752+0000 7f09b11f8700 1 -- 172.21.15.7:0/2385529248 wait complete. 2023-10-06T11:01:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.753+0000 7f09b11f8700 1 Processor -- start 2023-10-06T11:01:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.753+0000 7f09b11f8700 1 -- start start 2023-10-06T11:01:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09b11f8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0994004810 0x7f09ac15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09b11f8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09ac15a2f0 0x7f09ac152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09b11f8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09ac15c380 0x7f09ac15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09b11f8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac15bef0 con 0x7f09ac15a2f0 2023-10-06T11:01:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09b11f8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac15b2e0 con 0x7f09ac15c380 2023-10-06T11:01:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09b11f8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac15b5c0 con 0x7f0994004810 2023-10-06T11:01:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09aa59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09ac15a2f0 0x7f09ac152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09aa59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09ac15a2f0 0x7f09ac152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60240/0 (socket says 172.21.15.7:60240) 2023-10-06T11:01:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09aa59c700 1 -- 172.21.15.7:0/3664971820 learned_addr learned my addr 172.21.15.7:0/3664971820 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09aad9d700 1 --2- 172.21.15.7:0/3664971820 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0994004810 0x7f09ac15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09ab59e700 1 --2- 172.21.15.7:0/3664971820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09ac15c380 0x7f09ac15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09aa59c700 1 -- 172.21.15.7:0/3664971820 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0994004810 msgr2=0x7f09ac15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09aa59c700 1 --2- 172.21.15.7:0/3664971820 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0994004810 0x7f09ac15aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09aa59c700 1 -- 172.21.15.7:0/3664971820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09ac15c380 msgr2=0x7f09ac15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09aa59c700 1 --2- 172.21.15.7:0/3664971820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09ac15c380 0x7f09ac15c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.754+0000 7f09aa59c700 1 -- 172.21.15.7:0/3664971820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac15b8a0 con 0x7f09ac15a2f0 2023-10-06T11:01:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.755+0000 7f09aa59c700 1 --2- 172.21.15.7:0/3664971820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09ac15a2f0 0x7f09ac152450 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f09940046c0 tx=0x7f09a0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.755+0000 7f0992ffd700 1 -- 172.21.15.7:0/3664971820 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a00253f0 con 0x7f09ac15a2f0 2023-10-06T11:01:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.755+0000 7f0992ffd700 1 -- 172.21.15.7:0/3664971820 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a0021040 con 0x7f09ac15a2f0 2023-10-06T11:01:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.755+0000 7f09b11f8700 1 -- 172.21.15.7:0/3664971820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ac15bb80 con 0x7f09ac15a2f0 2023-10-06T11:01:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.755+0000 7f0992ffd700 1 -- 172.21.15.7:0/3664971820 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a00257c0 con 0x7f09ac15a2f0 2023-10-06T11:01:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.755+0000 7f09b11f8700 1 -- 172.21.15.7:0/3664971820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ac152990 con 0x7f09ac15a2f0 2023-10-06T11:01:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.756+0000 7f09b11f8700 1 -- 172.21.15.7:0/3664971820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ac070480 con 0x7f09ac15a2f0 2023-10-06T11:01:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.757+0000 7f0992ffd700 1 -- 172.21.15.7:0/3664971820 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09a0025d40 con 0x7f09ac15a2f0 2023-10-06T11:01:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.757+0000 7f0992ffd700 1 --2- 172.21.15.7:0/3664971820 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0998066f30 0x7f09980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.758+0000 7f0992ffd700 1 -- 172.21.15.7:0/3664971820 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f09a0086780 con 0x7f09ac15a2f0 2023-10-06T11:01:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.758+0000 7f09aad9d700 1 --2- 172.21.15.7:0/3664971820 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0998066f30 0x7f09980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.758+0000 7f09aad9d700 1 --2- 172.21.15.7:0/3664971820 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0998066f30 0x7f09980693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f099c007d10 tx=0x7f099c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:03.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:03.762+0000 7f0992ffd700 1 -- 172.21.15.7:0/3664971820 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09a00537c0 con 0x7f09ac15a2f0 2023-10-06T11:01:04.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.008+0000 7f09b11f8700 1 -- 172.21.15.7:0/3664971820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f09ac0c7c60 con 0x7f09ac15a2f0 2023-10-06T11:01:04.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.590+0000 7f0992ffd700 1 -- 172.21.15.7:0/3664971820 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v24) v1 ==== 173+0+0 (secure 0 0 0) 0x7f09a0056de0 con 0x7f09ac15a2f0 2023-10-06T11:01:04.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.596+0000 7f09b11f8700 1 -- 172.21.15.7:0/3664971820 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0998066f30 msgr2=0x7f09980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:04.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.596+0000 7f09b11f8700 1 --2- 172.21.15.7:0/3664971820 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0998066f30 0x7f09980693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f099c007d10 tx=0x7f099c009040 comp rx=0 tx=0).stop 2023-10-06T11:01:04.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.596+0000 7f09b11f8700 1 -- 172.21.15.7:0/3664971820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09ac15a2f0 msgr2=0x7f09ac152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:04.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.596+0000 7f09b11f8700 1 --2- 172.21.15.7:0/3664971820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09ac15a2f0 0x7f09ac152450 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f09940046c0 tx=0x7f09a0019000 comp rx=0 tx=0).stop 2023-10-06T11:01:04.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.597+0000 7f09b11f8700 1 -- 172.21.15.7:0/3664971820 shutdown_connections 2023-10-06T11:01:04.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.597+0000 7f09b11f8700 1 --2- 172.21.15.7:0/3664971820 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0998066f30 0x7f09980693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:04.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.597+0000 7f09b11f8700 1 --2- 172.21.15.7:0/3664971820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09ac15c380 0x7f09ac15c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:04.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.597+0000 7f09b11f8700 1 --2- 172.21.15.7:0/3664971820 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0994004810 0x7f09ac15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:04.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.597+0000 7f09b11f8700 1 --2- 172.21.15.7:0/3664971820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09ac15a2f0 0x7f09ac152450 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:04.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.597+0000 7f09b11f8700 1 -- 172.21.15.7:0/3664971820 >> 172.21.15.7:0/3664971820 conn(0x7f09ac0afc90 msgr2=0x7f09ac06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:04.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.599+0000 7f09b11f8700 1 -- 172.21.15.7:0/3664971820 shutdown_connections 2023-10-06T11:01:04.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.599+0000 7f09b11f8700 1 -- 172.21.15.7:0/3664971820 wait complete. 2023-10-06T11:01:04.608 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 9 and data pool 10 2023-10-06T11:01:04.631 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:01:04.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.763+0000 7ff372d7e700 1 Processor -- start 2023-10-06T11:01:04.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.763+0000 7ff372d7e700 1 -- start start 2023-10-06T11:01:04.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.764+0000 7ff372d7e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff36c0c8af0 0x7ff36c0a7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:04.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.764+0000 7ff372d7e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36c0caa70 con 0x7ff36c0a6c60 2023-10-06T11:01:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.764+0000 7ff372d7e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36c0ca460 con 0x7ff36c0ae870 2023-10-06T11:01:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.764+0000 7ff372d7e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c0ad7f0 con 0x7ff36c0c8af0 2023-10-06T11:01:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.764+0000 7ff370b1a700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff36c0a6c60 0x7ff36c0ae160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42642/0 (socket says 172.21.15.7:42642) 2023-10-06T11:01:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.764+0000 7ff370b1a700 1 -- 172.21.15.7:0/44040234 learned_addr learned my addr 172.21.15.7:0/44040234 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.764+0000 7ff37131b700 1 --2- 172.21.15.7:0/44040234 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff36c0c8af0 0x7ff36c0a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905168649 0 0) 0x7ff36c0caa70 con 0x7ff36c0a6c60 2023-10-06T11:01:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff354003570 con 0x7ff36c0a6c60 2023-10-06T11:01:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536211270 0 0) 0x7ff36c0ca460 con 0x7ff36c0ae870 2023-10-06T11:01:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff36c0caa70 con 0x7ff36c0ae870 2023-10-06T11:01:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 561331215 0 0) 0x7ff354003570 con 0x7ff36c0a6c60 2023-10-06T11:01:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff36c0c8af0 msgr2=0x7ff36c0a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 --2- 172.21.15.7:0/44040234 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff36c0c8af0 0x7ff36c0a7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 >> v1:172.21.15.50:6789/0 conn(0x7ff36c0ae870 legacy=0x7ff36c0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c0ad9f0 con 0x7ff36c0a6c60 2023-10-06T11:01:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7ff35c001470 con 0x7ff36c0a6c60 2023-10-06T11:01:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff37131b700 1 --2- 172.21.15.7:0/44040234 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff36c0c8af0 0x7ff36c0a7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:01:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 >> v1:172.21.15.7:6789/0 conn(0x7ff36c0a6c60 legacy=0x7ff36c0ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 --2- 172.21.15.7:0/44040234 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff36c0c8af0 0x7ff354003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 --2- 172.21.15.7:0/44040234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff354004160 0x7ff354004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 --2- 172.21.15.7:0/44040234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff354004d50 0x7ff3540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c0ad7f0 con 0x7ff354004d50 2023-10-06T11:01:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35400bba0 con 0x7ff354004160 2023-10-06T11:01:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35400bd60 con 0x7ff36c0c8af0 2023-10-06T11:01:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff37131b700 1 --2- 172.21.15.7:0/44040234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff354004d50 0x7ff3540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff370b1a700 1 --2- 172.21.15.7:0/44040234 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff36c0c8af0 0x7ff354003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff36bfff700 1 --2- 172.21.15.7:0/44040234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff354004160 0x7ff354004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff37131b700 1 -- 172.21.15.7:0/44040234 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff36c0c8af0 msgr2=0x7ff354003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.765+0000 7ff37131b700 1 --2- 172.21.15.7:0/44040234 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff36c0c8af0 0x7ff354003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.766+0000 7ff37131b700 1 -- 172.21.15.7:0/44040234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff354004160 msgr2=0x7ff354004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.766+0000 7ff37131b700 1 --2- 172.21.15.7:0/44040234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff354004160 0x7ff354004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:04.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.766+0000 7ff37131b700 1 -- 172.21.15.7:0/44040234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff364009a20 con 0x7ff354004d50 2023-10-06T11:01:04.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.766+0000 7ff37131b700 1 --2- 172.21.15.7:0/44040234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff354004d50 0x7ff3540051c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0c8f30 tx=0x7ff36400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff55c17db0d14078 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:04.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.766+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364009c50 con 0x7ff354004d50 2023-10-06T11:01:04.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.766+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36400f040 con 0x7ff354004d50 2023-10-06T11:01:04.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.766+0000 7ff36b7fe700 1 -- 172.21.15.7:0/44040234 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36400ee90 con 0x7ff354004d50 2023-10-06T11:01:04.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.766+0000 7ff372d7e700 1 -- 172.21.15.7:0/44040234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff354004d50 msgr2=0x7ff3540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:04.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.766+0000 7ff372d7e700 1 --2- 172.21.15.7:0/44040234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff354004d50 0x7ff3540051c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0c8f30 tx=0x7ff36400b040 comp rx=0 tx=0).stop 2023-10-06T11:01:04.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.766+0000 7ff37131b700 1 -- 172.21.15.7:0/44040234 reap_dead start 2023-10-06T11:01:04.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.767+0000 7ff372d7e700 1 -- 172.21.15.7:0/44040234 shutdown_connections 2023-10-06T11:01:04.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.767+0000 7ff372d7e700 1 -- 172.21.15.7:0/44040234 >> 172.21.15.7:0/44040234 conn(0x7ff36c095a70 msgr2=0x7ff36c0af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:04.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.767+0000 7ff372d7e700 1 -- 172.21.15.7:0/44040234 shutdown_connections 2023-10-06T11:01:04.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.767+0000 7ff372d7e700 1 -- 172.21.15.7:0/44040234 wait complete. 2023-10-06T11:01:04.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.768+0000 7ff372d7e700 1 Processor -- start 2023-10-06T11:01:04.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.768+0000 7ff372d7e700 1 -- start start 2023-10-06T11:01:04.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff372d7e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff36c152d10 0x7ff36c0a8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:04.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff372d7e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff36c16b560 0x7ff36c1545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:04.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff372d7e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff36c098820 0x7ff36c098cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:04.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff372d7e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c099200 con 0x7ff36c152d10 2023-10-06T11:01:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff372d7e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c154ed0 con 0x7ff36c098820 2023-10-06T11:01:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff372d7e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c1551b0 con 0x7ff36c16b560 2023-10-06T11:01:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff370b1a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff36c152d10 0x7ff36c0a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff370b1a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff36c152d10 0x7ff36c0a8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60264/0 (socket says 172.21.15.7:60264) 2023-10-06T11:01:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff370b1a700 1 -- 172.21.15.7:0/3104207670 learned_addr learned my addr 172.21.15.7:0/3104207670 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff37131b700 1 --2- 172.21.15.7:0/3104207670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff36c098820 0x7ff36c098cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff36bfff700 1 --2- 172.21.15.7:0/3104207670 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff36c16b560 0x7ff36c1545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff370b1a700 1 -- 172.21.15.7:0/3104207670 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff36c16b560 msgr2=0x7ff36c1545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff370b1a700 1 --2- 172.21.15.7:0/3104207670 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff36c16b560 0x7ff36c1545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff370b1a700 1 -- 172.21.15.7:0/3104207670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff36c098820 msgr2=0x7ff36c098cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff370b1a700 1 --2- 172.21.15.7:0/3104207670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff36c098820 0x7ff36c098cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff370b1a700 1 -- 172.21.15.7:0/3104207670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c155490 con 0x7ff36c152d10 2023-10-06T11:01:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.769+0000 7ff370b1a700 1 --2- 172.21.15.7:0/3104207670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff36c152d10 0x7ff36c0a8760 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff35c007fd0 tx=0x7ff36c0c9870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.770+0000 7ff368ff9700 1 -- 172.21.15.7:0/3104207670 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c018030 con 0x7ff36c152d10 2023-10-06T11:01:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.770+0000 7ff368ff9700 1 -- 172.21.15.7:0/3104207670 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c00f6c0 con 0x7ff36c152d10 2023-10-06T11:01:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.770+0000 7ff372d7e700 1 -- 172.21.15.7:0/3104207670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36c0a7160 con 0x7ff36c152d10 2023-10-06T11:01:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.770+0000 7ff368ff9700 1 -- 172.21.15.7:0/3104207670 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c00fa80 con 0x7ff36c152d10 2023-10-06T11:01:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.770+0000 7ff372d7e700 1 -- 172.21.15.7:0/3104207670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36c154b10 con 0x7ff36c152d10 2023-10-06T11:01:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.771+0000 7ff372d7e700 1 -- 172.21.15.7:0/3104207670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36c0a7370 con 0x7ff36c152d10 2023-10-06T11:01:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.771+0000 7ff368ff9700 1 -- 172.21.15.7:0/3104207670 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff35c01b070 con 0x7ff36c152d10 2023-10-06T11:01:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.772+0000 7ff368ff9700 1 --2- 172.21.15.7:0/3104207670 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff358066f30 0x7ff3580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.772+0000 7ff368ff9700 1 -- 172.21.15.7:0/3104207670 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff35c019070 con 0x7ff36c152d10 2023-10-06T11:01:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.772+0000 7ff36bfff700 1 --2- 172.21.15.7:0/3104207670 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff358066f30 0x7ff3580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.772+0000 7ff36bfff700 1 --2- 172.21.15.7:0/3104207670 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff358066f30 0x7ff3580693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff360007e40 tx=0x7ff360009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.776+0000 7ff368ff9700 1 -- 172.21.15.7:0/3104207670 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff35c051630 con 0x7ff36c152d10 2023-10-06T11:01:04.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.979+0000 7ff372d7e700 1 -- 172.21.15.7:0/3104207670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff36c070480 con 0x7ff36c152d10 2023-10-06T11:01:04.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.979+0000 7ff368ff9700 1 -- 172.21.15.7:0/3104207670 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17086 (secure 0 0 0) 0x7ff35c054c50 con 0x7ff36c152d10 2023-10-06T11:01:04.982 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:04.982 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":56,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:01:04.009631+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:01:01.839698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T11:01:02.986831+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:01:04.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.982+0000 7ff372d7e700 1 -- 172.21.15.7:0/3104207670 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff358066f30 msgr2=0x7ff3580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:04.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.982+0000 7ff372d7e700 1 --2- 172.21.15.7:0/3104207670 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff358066f30 0x7ff3580693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff360007e40 tx=0x7ff360009040 comp rx=0 tx=0).stop 2023-10-06T11:01:04.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.982+0000 7ff372d7e700 1 -- 172.21.15.7:0/3104207670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff36c152d10 msgr2=0x7ff36c0a8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:04.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.982+0000 7ff372d7e700 1 --2- 172.21.15.7:0/3104207670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff36c152d10 0x7ff36c0a8760 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff35c007fd0 tx=0x7ff36c0c9870 comp rx=0 tx=0).stop 2023-10-06T11:01:04.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.982+0000 7ff372d7e700 1 -- 172.21.15.7:0/3104207670 shutdown_connections 2023-10-06T11:01:04.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.982+0000 7ff372d7e700 1 --2- 172.21.15.7:0/3104207670 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff358066f30 0x7ff3580693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:04.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.982+0000 7ff372d7e700 1 --2- 172.21.15.7:0/3104207670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff36c152d10 0x7ff36c0a8760 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:04.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.982+0000 7ff372d7e700 1 --2- 172.21.15.7:0/3104207670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff36c098820 0x7ff36c098cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:04.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.982+0000 7ff372d7e700 1 --2- 172.21.15.7:0/3104207670 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff36c16b560 0x7ff36c1545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.982+0000 7ff372d7e700 1 -- 172.21.15.7:0/3104207670 >> 172.21.15.7:0/3104207670 conn(0x7ff36c095a70 msgr2=0x7ff36c0998b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.982+0000 7ff372d7e700 1 -- 172.21.15.7:0/3104207670 shutdown_connections 2023-10-06T11:01:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:04.982+0000 7ff372d7e700 1 -- 172.21.15.7:0/3104207670 wait complete. 2023-10-06T11:01:04.998 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:01:05.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.129+0000 7fad0eb9e700 1 Processor -- start 2023-10-06T11:01:05.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.129+0000 7fad0eb9e700 1 -- start start 2023-10-06T11:01:05.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.130+0000 7fad0eb9e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad081590d0 0x7fad08069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:05.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.130+0000 7fad0eb9e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fad0815d520 0x7fad081594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:05.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.130+0000 7fad0eb9e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad080694d0 con 0x7fad0806a0f0 2023-10-06T11:01:05.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.130+0000 7fad0eb9e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad08068990 con 0x7fad0815d520 2023-10-06T11:01:05.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.130+0000 7fad0eb9e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad08068ba0 con 0x7fad081590d0 2023-10-06T11:01:05.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.130+0000 7fad0d13b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fad0815d520 0x7fad081594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:05.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.130+0000 7fad07fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fad0806a0f0 0x7fad0815ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42658/0 (socket says 172.21.15.7:42658) 2023-10-06T11:01:05.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.130+0000 7fad0d13b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fad0815d520 0x7fad081594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60266/0 (socket says 172.21.15.7:60266) 2023-10-06T11:01:05.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.130+0000 7fad07fff700 1 -- 172.21.15.7:0/3105514695 learned_addr learned my addr 172.21.15.7:0/3105514695 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:05.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.130+0000 7fad0c93a700 1 --2- 172.21.15.7:0/3105514695 >> v2:172.21.15.50:3300/0 conn(0x7fad081590d0 0x7fad08069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:05.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.130+0000 7fad0d13b700 1 -- 172.21.15.7:0/3105514695 >> v2:172.21.15.50:3300/0 conn(0x7fad081590d0 msgr2=0x7fad08069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:05.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.130+0000 7fad0d13b700 1 --2- 172.21.15.7:0/3105514695 >> v2:172.21.15.50:3300/0 conn(0x7fad081590d0 0x7fad08069bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.130+0000 7fad0d13b700 1 -- 172.21.15.7:0/3105514695 >> v1:172.21.15.7:6789/0 conn(0x7fad0806a0f0 legacy=0x7fad0815ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:05.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.130+0000 7fad0d13b700 1 -- 172.21.15.7:0/3105514695 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad08068e80 con 0x7fad0815d520 2023-10-06T11:01:05.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.131+0000 7fad0d13b700 1 --2- 172.21.15.7:0/3105514695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0815d520 0x7fad081594a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fad0806ec40 tx=0x7fad00009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c5838b9d6c370f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:05.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.131+0000 7fad077fe700 1 -- 172.21.15.7:0/3105514695 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0000e070 con 0x7fad0815d520 2023-10-06T11:01:05.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.131+0000 7fad077fe700 1 -- 172.21.15.7:0/3105514695 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0000bc30 con 0x7fad0815d520 2023-10-06T11:01:05.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.131+0000 7fad077fe700 1 -- 172.21.15.7:0/3105514695 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad00012430 con 0x7fad0815d520 2023-10-06T11:01:05.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.131+0000 7fad0eb9e700 1 -- 172.21.15.7:0/3105514695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0815d520 msgr2=0x7fad081594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:05.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.131+0000 7fad0eb9e700 1 --2- 172.21.15.7:0/3105514695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0815d520 0x7fad081594a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fad0806ec40 tx=0x7fad00009780 comp rx=0 tx=0).stop 2023-10-06T11:01:05.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.131+0000 7fad0eb9e700 1 -- 172.21.15.7:0/3105514695 shutdown_connections 2023-10-06T11:01:05.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.131+0000 7fad0eb9e700 1 --2- 172.21.15.7:0/3105514695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0815d520 0x7fad081594a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.131+0000 7fad0eb9e700 1 --2- 172.21.15.7:0/3105514695 >> v2:172.21.15.50:3300/0 conn(0x7fad081590d0 0x7fad08069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.131+0000 7fad0eb9e700 1 -- 172.21.15.7:0/3105514695 >> 172.21.15.7:0/3105514695 conn(0x7fad08096160 msgr2=0x7fad080afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:05.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.131+0000 7fad0eb9e700 1 -- 172.21.15.7:0/3105514695 shutdown_connections 2023-10-06T11:01:05.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.131+0000 7fad0eb9e700 1 -- 172.21.15.7:0/3105514695 wait complete. 2023-10-06T11:01:05.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.133+0000 7fad0eb9e700 1 Processor -- start 2023-10-06T11:01:05.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.133+0000 7fad0eb9e700 1 -- start start 2023-10-06T11:01:05.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0eb9e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0806a0f0 0x7fad08151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:05.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0eb9e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad081590d0 0x7fad0809a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:05.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0eb9e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0815d520 0x7fad08098720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:05.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0eb9e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad081578b0 con 0x7fad0815d520 2023-10-06T11:01:05.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0eb9e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad08099330 con 0x7fad0806a0f0 2023-10-06T11:01:05.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0eb9e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad08099610 con 0x7fad081590d0 2023-10-06T11:01:05.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0d13b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0815d520 0x7fad08098720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:05.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0d13b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0815d520 0x7fad08098720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60276/0 (socket says 172.21.15.7:60276) 2023-10-06T11:01:05.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0d13b700 1 -- 172.21.15.7:0/2449918327 learned_addr learned my addr 172.21.15.7:0/2449918327 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:05.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0c93a700 1 --2- 172.21.15.7:0/2449918327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0806a0f0 0x7fad08151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:05.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad07fff700 1 --2- 172.21.15.7:0/2449918327 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad081590d0 0x7fad0809a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:05.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0d13b700 1 -- 172.21.15.7:0/2449918327 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad081590d0 msgr2=0x7fad0809a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:05.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0d13b700 1 --2- 172.21.15.7:0/2449918327 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad081590d0 0x7fad0809a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0d13b700 1 -- 172.21.15.7:0/2449918327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0806a0f0 msgr2=0x7fad08151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:05.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0d13b700 1 --2- 172.21.15.7:0/2449918327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0806a0f0 0x7fad08151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0d13b700 1 -- 172.21.15.7:0/2449918327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad00009a20 con 0x7fad0815d520 2023-10-06T11:01:05.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.134+0000 7fad0d13b700 1 --2- 172.21.15.7:0/2449918327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0815d520 0x7fad08098720 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fad00013000 tx=0x7fad00019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:05.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.135+0000 7fad04ff9700 1 -- 172.21.15.7:0/2449918327 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad00027470 con 0x7fad0815d520 2023-10-06T11:01:05.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.135+0000 7fad04ff9700 1 -- 172.21.15.7:0/2449918327 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad00027630 con 0x7fad0815d520 2023-10-06T11:01:05.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.135+0000 7fad0eb9e700 1 -- 172.21.15.7:0/2449918327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad080998f0 con 0x7fad0815d520 2023-10-06T11:01:05.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.135+0000 7fad04ff9700 1 -- 172.21.15.7:0/2449918327 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000279f0 con 0x7fad0815d520 2023-10-06T11:01:05.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.135+0000 7fad0eb9e700 1 -- 172.21.15.7:0/2449918327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0809a910 con 0x7fad0815d520 2023-10-06T11:01:05.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.136+0000 7fad0eb9e700 1 -- 172.21.15.7:0/2449918327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0809ab00 con 0x7fad0815d520 2023-10-06T11:01:05.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.136+0000 7fad04ff9700 1 -- 172.21.15.7:0/2449918327 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad00024070 con 0x7fad0815d520 2023-10-06T11:01:05.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.137+0000 7fad04ff9700 1 --2- 172.21.15.7:0/2449918327 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7facec066f30 0x7facec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:05.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.137+0000 7fad04ff9700 1 -- 172.21.15.7:0/2449918327 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fad00086e90 con 0x7fad0815d520 2023-10-06T11:01:05.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.137+0000 7fad0c93a700 1 --2- 172.21.15.7:0/2449918327 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7facec066f30 0x7facec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:05.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.137+0000 7fad0c93a700 1 --2- 172.21.15.7:0/2449918327 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7facec066f30 0x7facec0693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7facfc006fd0 tx=0x7facfc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:05.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.141+0000 7fad04ff9700 1 -- 172.21.15.7:0/2449918327 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad00053e60 con 0x7fad0815d520 2023-10-06T11:01:05.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.345+0000 7fad0eb9e700 1 -- 172.21.15.7:0/2449918327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad08070480 con 0x7fad0815d520 2023-10-06T11:01:05.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.346+0000 7fad04ff9700 1 -- 172.21.15.7:0/2449918327 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17086 (secure 0 0 0) 0x7fad0002c090 con 0x7fad0815d520 2023-10-06T11:01:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:05.349 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":56,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:01:04.009631+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:01:01.839698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T11:01:02.986831+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:01:05.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.349+0000 7fad0eb9e700 1 -- 172.21.15.7:0/2449918327 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7facec066f30 msgr2=0x7facec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:05.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.349+0000 7fad0eb9e700 1 --2- 172.21.15.7:0/2449918327 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7facec066f30 0x7facec0693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7facfc006fd0 tx=0x7facfc008040 comp rx=0 tx=0).stop 2023-10-06T11:01:05.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.349+0000 7fad0eb9e700 1 -- 172.21.15.7:0/2449918327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0815d520 msgr2=0x7fad08098720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:05.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.349+0000 7fad0eb9e700 1 --2- 172.21.15.7:0/2449918327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0815d520 0x7fad08098720 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fad00013000 tx=0x7fad00019000 comp rx=0 tx=0).stop 2023-10-06T11:01:05.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.349+0000 7fad0eb9e700 1 -- 172.21.15.7:0/2449918327 shutdown_connections 2023-10-06T11:01:05.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.349+0000 7fad0eb9e700 1 --2- 172.21.15.7:0/2449918327 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7facec066f30 0x7facec0693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.349+0000 7fad0eb9e700 1 --2- 172.21.15.7:0/2449918327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0815d520 0x7fad08098720 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.349+0000 7fad0eb9e700 1 --2- 172.21.15.7:0/2449918327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0806a0f0 0x7fad08151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.349+0000 7fad0eb9e700 1 --2- 172.21.15.7:0/2449918327 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad081590d0 0x7fad0809a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.349+0000 7fad0eb9e700 1 -- 172.21.15.7:0/2449918327 >> 172.21.15.7:0/2449918327 conn(0x7fad08096160 msgr2=0x7fad081523c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:05.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.349+0000 7fad0eb9e700 1 -- 172.21.15.7:0/2449918327 shutdown_connections 2023-10-06T11:01:05.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.349+0000 7fad0eb9e700 1 -- 172.21.15.7:0/2449918327 wait complete. 2023-10-06T11:01:05.364 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:01:05.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.497+0000 7fbec9298700 1 Processor -- start 2023-10-06T11:01:05.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.497+0000 7fbec9298700 1 -- start start 2023-10-06T11:01:05.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.498+0000 7fbec9298700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbec406c850 0x7fbec4158d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:05.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.498+0000 7fbec9298700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbec41592b0 0x7fbec40690f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:05.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.498+0000 7fbec9298700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec40c8510 con 0x7fbec406c480 2023-10-06T11:01:05.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.498+0000 7fbec9298700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec40c96c0 con 0x7fbec406c850 2023-10-06T11:01:05.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.498+0000 7fbec9298700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec4069e20 con 0x7fbec41592b0 2023-10-06T11:01:05.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.499+0000 7fbec2ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbec406c480 0x7fbec40c8fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42672/0 (socket says 172.21.15.7:42672) 2023-10-06T11:01:05.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.499+0000 7fbec2ffd700 1 -- 172.21.15.7:0/3274940776 learned_addr learned my addr 172.21.15.7:0/3274940776 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:05.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.499+0000 7fbec27fc700 1 --2- 172.21.15.7:0/3274940776 >> v2:172.21.15.50:3300/0 conn(0x7fbec406c850 0x7fbec4158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:05.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.499+0000 7fbec37fe700 1 --2- 172.21.15.7:0/3274940776 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbec41592b0 0x7fbec40690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:05.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.499+0000 7fbec1ffb700 1 -- 172.21.15.7:0/3274940776 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516424819 0 0) 0x7fbec40c8510 con 0x7fbec406c480 2023-10-06T11:01:05.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.499+0000 7fbec1ffb700 1 -- 172.21.15.7:0/3274940776 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb0003570 con 0x7fbec406c480 2023-10-06T11:01:05.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.499+0000 7fbec27fc700 1 -- 172.21.15.7:0/3274940776 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbec41592b0 msgr2=0x7fbec40690f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:05.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.499+0000 7fbec27fc700 1 --2- 172.21.15.7:0/3274940776 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbec41592b0 0x7fbec40690f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.499+0000 7fbec27fc700 1 -- 172.21.15.7:0/3274940776 >> v1:172.21.15.7:6789/0 conn(0x7fbec406c480 legacy=0x7fbec40c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:05.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.499+0000 7fbec27fc700 1 -- 172.21.15.7:0/3274940776 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec40c87b0 con 0x7fbec406c850 2023-10-06T11:01:05.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.499+0000 7fbec27fc700 1 --2- 172.21.15.7:0/3274940776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec406c850 0x7fbec4158d70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0098e0 tx=0x7fbeac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39429d2623acdeaa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:05.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.500+0000 7fbec1ffb700 1 -- 172.21.15.7:0/3274940776 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac011630 con 0x7fbec406c850 2023-10-06T11:01:05.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.500+0000 7fbec1ffb700 1 -- 172.21.15.7:0/3274940776 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac011790 con 0x7fbec406c850 2023-10-06T11:01:05.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.500+0000 7fbec1ffb700 1 -- 172.21.15.7:0/3274940776 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac011b10 con 0x7fbec406c850 2023-10-06T11:01:05.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.500+0000 7fbec9298700 1 -- 172.21.15.7:0/3274940776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec406c850 msgr2=0x7fbec4158d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:05.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.500+0000 7fbec9298700 1 --2- 172.21.15.7:0/3274940776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec406c850 0x7fbec4158d70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0098e0 tx=0x7fbeac0091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.500+0000 7fbec9298700 1 -- 172.21.15.7:0/3274940776 shutdown_connections 2023-10-06T11:01:05.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.500+0000 7fbec9298700 1 --2- 172.21.15.7:0/3274940776 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbec41592b0 0x7fbec40690f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.500+0000 7fbec9298700 1 --2- 172.21.15.7:0/3274940776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec406c850 0x7fbec4158d70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.500+0000 7fbec9298700 1 -- 172.21.15.7:0/3274940776 >> 172.21.15.7:0/3274940776 conn(0x7fbec40cded0 msgr2=0x7fbec40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.500+0000 7fbec9298700 1 -- 172.21.15.7:0/3274940776 shutdown_connections 2023-10-06T11:01:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.500+0000 7fbec9298700 1 -- 172.21.15.7:0/3274940776 wait complete. 2023-10-06T11:01:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.502+0000 7fbec9298700 1 Processor -- start 2023-10-06T11:01:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.502+0000 7fbec9298700 1 -- start start 2023-10-06T11:01:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.502+0000 7fbec9298700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbec406c480 0x7fbec40b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.502+0000 7fbec9298700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec406c850 0x7fbec40c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.502+0000 7fbec9298700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec41592b0 0x7fbec414d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.502+0000 7fbec9298700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40c7970 con 0x7fbec41592b0 2023-10-06T11:01:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.502+0000 7fbec9298700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40b1750 con 0x7fbec406c850 2023-10-06T11:01:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.502+0000 7fbec9298700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40b0e20 con 0x7fbec406c480 2023-10-06T11:01:05.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbec37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec41592b0 0x7fbec414d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:05.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbec37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec41592b0 0x7fbec414d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60288/0 (socket says 172.21.15.7:60288) 2023-10-06T11:01:05.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbec37fe700 1 -- 172.21.15.7:0/326134640 learned_addr learned my addr 172.21.15.7:0/326134640 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:05.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbec27fc700 1 --2- 172.21.15.7:0/326134640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec406c850 0x7fbec40c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:05.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbec2ffd700 1 --2- 172.21.15.7:0/326134640 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbec406c480 0x7fbec40b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:05.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbec37fe700 1 -- 172.21.15.7:0/326134640 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbec406c480 msgr2=0x7fbec40b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:05.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbec37fe700 1 --2- 172.21.15.7:0/326134640 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbec406c480 0x7fbec40b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbec37fe700 1 -- 172.21.15.7:0/326134640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec406c850 msgr2=0x7fbec40c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:05.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbec37fe700 1 --2- 172.21.15.7:0/326134640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec406c850 0x7fbec40c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:05.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbec37fe700 1 -- 172.21.15.7:0/326134640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac009420 con 0x7fbec41592b0 2023-10-06T11:01:05.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbec37fe700 1 --2- 172.21.15.7:0/326134640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec41592b0 0x7fbec414d230 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009df0 tx=0x7fbebc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:05.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbebaffd700 1 -- 172.21.15.7:0/326134640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00caa0 con 0x7fbec41592b0 2023-10-06T11:01:05.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbebaffd700 1 -- 172.21.15.7:0/326134640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc00f040 con 0x7fbec41592b0 2023-10-06T11:01:05.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbec9298700 1 -- 172.21.15.7:0/326134640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec40b1100 con 0x7fbec41592b0 2023-10-06T11:01:05.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbebaffd700 1 -- 172.21.15.7:0/326134640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00ce70 con 0x7fbec41592b0 2023-10-06T11:01:05.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.503+0000 7fbec9298700 1 -- 172.21.15.7:0/326134640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec40c7650 con 0x7fbec41592b0 2023-10-06T11:01:05.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.504+0000 7fbec9298700 1 -- 172.21.15.7:0/326134640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec40b2120 con 0x7fbec41592b0 2023-10-06T11:01:05.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.505+0000 7fbebaffd700 1 -- 172.21.15.7:0/326134640 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbebc014690 con 0x7fbec41592b0 2023-10-06T11:01:05.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.505+0000 7fbebaffd700 1 --2- 172.21.15.7:0/326134640 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbea4066f30 0x7fbea40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:05.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.505+0000 7fbebaffd700 1 -- 172.21.15.7:0/326134640 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbebc085100 con 0x7fbec41592b0 2023-10-06T11:01:05.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.505+0000 7fbec2ffd700 1 --2- 172.21.15.7:0/326134640 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbea4066f30 0x7fbea40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:05.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.506+0000 7fbec2ffd700 1 --2- 172.21.15.7:0/326134640 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbea4066f30 0x7fbea40693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4007fd0 tx=0x7fbeb4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:05.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.510+0000 7fbebaffd700 1 -- 172.21.15.7:0/326134640 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbebc055ac0 con 0x7fbec41592b0 2023-10-06T11:01:05.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:05.760+0000 7fbec9298700 1 -- 172.21.15.7:0/326134640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbec4070480 con 0x7fbec41592b0 2023-10-06T11:01:06.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.613+0000 7fbebaffd700 1 -- 172.21.15.7:0/326134640 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbebc055650 con 0x7fbec41592b0 2023-10-06T11:01:06.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.616+0000 7fbec9298700 1 -- 172.21.15.7:0/326134640 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbea4066f30 msgr2=0x7fbea40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:06.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.616+0000 7fbec9298700 1 --2- 172.21.15.7:0/326134640 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbea4066f30 0x7fbea40693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4007fd0 tx=0x7fbeb4009040 comp rx=0 tx=0).stop 2023-10-06T11:01:06.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.616+0000 7fbec9298700 1 -- 172.21.15.7:0/326134640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec41592b0 msgr2=0x7fbec414d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.616+0000 7fbec9298700 1 --2- 172.21.15.7:0/326134640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec41592b0 0x7fbec414d230 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009df0 tx=0x7fbebc00b040 comp rx=0 tx=0).stop 2023-10-06T11:01:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.616+0000 7fbec9298700 1 -- 172.21.15.7:0/326134640 shutdown_connections 2023-10-06T11:01:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.616+0000 7fbec9298700 1 --2- 172.21.15.7:0/326134640 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbea4066f30 0x7fbea40693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.616+0000 7fbec9298700 1 --2- 172.21.15.7:0/326134640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec41592b0 0x7fbec414d230 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.616+0000 7fbec9298700 1 --2- 172.21.15.7:0/326134640 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbec406c480 0x7fbec40b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.616+0000 7fbec9298700 1 --2- 172.21.15.7:0/326134640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec406c850 0x7fbec40c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.616+0000 7fbec9298700 1 -- 172.21.15.7:0/326134640 >> 172.21.15.7:0/326134640 conn(0x7fbec40cded0 msgr2=0x7fbec40cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.616+0000 7fbec9298700 1 -- 172.21.15.7:0/326134640 shutdown_connections 2023-10-06T11:01:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.616+0000 7fbec9298700 1 -- 172.21.15.7:0/326134640 wait complete. 2023-10-06T11:01:06.634 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:01:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.771+0000 7f47e17af700 1 Processor -- start 2023-10-06T11:01:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.771+0000 7f47e17af700 1 -- start start 2023-10-06T11:01:06.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47e17af700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47dc0af440 0x7f47dc0caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:06.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47e17af700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f47dc159890 0x7f47dc0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:06.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47e17af700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47dc0cf870 con 0x7f47dc1594c0 2023-10-06T11:01:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47e17af700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47dc0cecf0 con 0x7f47dc159890 2023-10-06T11:01:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47e17af700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0cba70 con 0x7f47dc0af440 2023-10-06T11:01:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47db7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f47dc159890 0x7f47dc0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47daffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f47dc1594c0 0x7f47dc0aed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42682/0 (socket says 172.21.15.7:42682) 2023-10-06T11:01:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47daffd700 1 -- 172.21.15.7:0/2028483917 learned_addr learned my addr 172.21.15.7:0/2028483917 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47da7fc700 1 --2- 172.21.15.7:0/2028483917 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47dc0af440 0x7f47dc0caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47db7fe700 1 -- 172.21.15.7:0/2028483917 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47dc0af440 msgr2=0x7f47dc0caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47db7fe700 1 --2- 172.21.15.7:0/2028483917 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47dc0af440 0x7f47dc0caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47db7fe700 1 -- 172.21.15.7:0/2028483917 >> v1:172.21.15.7:6789/0 conn(0x7f47dc1594c0 legacy=0x7f47dc0aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47db7fe700 1 -- 172.21.15.7:0/2028483917 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc0b1030 con 0x7f47dc159890 2023-10-06T11:01:06.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47da7fc700 1 --2- 172.21.15.7:0/2028483917 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47dc0af440 0x7f47dc0caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:06.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.772+0000 7f47db7fe700 1 --2- 172.21.15.7:0/2028483917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47dc159890 0x7f47dc0cb530 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009e60 tx=0x7f47d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e716dfd5812e4a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:06.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.773+0000 7f47d9ffb700 1 -- 172.21.15.7:0/2028483917 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d400e070 con 0x7f47dc159890 2023-10-06T11:01:06.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.773+0000 7f47d9ffb700 1 -- 172.21.15.7:0/2028483917 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d400bc30 con 0x7f47dc159890 2023-10-06T11:01:06.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.773+0000 7f47d9ffb700 1 -- 172.21.15.7:0/2028483917 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4012430 con 0x7f47dc159890 2023-10-06T11:01:06.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.773+0000 7f47e17af700 1 -- 172.21.15.7:0/2028483917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47dc159890 msgr2=0x7f47dc0cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:06.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.773+0000 7f47e17af700 1 --2- 172.21.15.7:0/2028483917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47dc159890 0x7f47dc0cb530 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009e60 tx=0x7f47d4009780 comp rx=0 tx=0).stop 2023-10-06T11:01:06.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.773+0000 7f47e17af700 1 -- 172.21.15.7:0/2028483917 shutdown_connections 2023-10-06T11:01:06.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.773+0000 7f47e17af700 1 --2- 172.21.15.7:0/2028483917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47dc159890 0x7f47dc0cb530 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:06.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.773+0000 7f47e17af700 1 --2- 172.21.15.7:0/2028483917 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47dc0af440 0x7f47dc0caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:06.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.773+0000 7f47e17af700 1 -- 172.21.15.7:0/2028483917 >> 172.21.15.7:0/2028483917 conn(0x7f47dc067bc0 msgr2=0x7f47dc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:06.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.773+0000 7f47e17af700 1 -- 172.21.15.7:0/2028483917 shutdown_connections 2023-10-06T11:01:06.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.773+0000 7f47e17af700 1 -- 172.21.15.7:0/2028483917 wait complete. 2023-10-06T11:01:06.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.775+0000 7f47e17af700 1 Processor -- start 2023-10-06T11:01:06.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.775+0000 7f47e17af700 1 -- start start 2023-10-06T11:01:06.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.776+0000 7f47e17af700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47dc0af440 0x7f47dc0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:06.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.776+0000 7f47e17af700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47dc1594c0 0x7f47dc151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:06.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.776+0000 7f47e17af700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47dc159890 0x7f47dc154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.776+0000 7f47e17af700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0c71c0 con 0x7f47dc1594c0 2023-10-06T11:01:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.776+0000 7f47e17af700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0c7d40 con 0x7f47dc0af440 2023-10-06T11:01:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.776+0000 7f47e17af700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0c7410 con 0x7f47dc159890 2023-10-06T11:01:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.776+0000 7f47da7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47dc1594c0 0x7f47dc151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.776+0000 7f47da7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47dc1594c0 0x7f47dc151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60304/0 (socket says 172.21.15.7:60304) 2023-10-06T11:01:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.776+0000 7f47da7fc700 1 -- 172.21.15.7:0/3018099449 learned_addr learned my addr 172.21.15.7:0/3018099449 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.777+0000 7f47db7fe700 1 --2- 172.21.15.7:0/3018099449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47dc159890 0x7f47dc154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.777+0000 7f47daffd700 1 --2- 172.21.15.7:0/3018099449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47dc0af440 0x7f47dc0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.777+0000 7f47da7fc700 1 -- 172.21.15.7:0/3018099449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47dc159890 msgr2=0x7f47dc154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.777+0000 7f47da7fc700 1 --2- 172.21.15.7:0/3018099449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47dc159890 0x7f47dc154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.777+0000 7f47da7fc700 1 -- 172.21.15.7:0/3018099449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47dc0af440 msgr2=0x7f47dc0c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.777+0000 7f47da7fc700 1 --2- 172.21.15.7:0/3018099449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47dc0af440 0x7f47dc0c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.777+0000 7f47da7fc700 1 -- 172.21.15.7:0/3018099449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d4009a20 con 0x7f47dc1594c0 2023-10-06T11:01:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.777+0000 7f47da7fc700 1 --2- 172.21.15.7:0/3018099449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47dc1594c0 0x7f47dc151d30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f47d000c880 tx=0x7f47d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.777+0000 7f47c2ffd700 1 -- 172.21.15.7:0/3018099449 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0011600 con 0x7f47dc1594c0 2023-10-06T11:01:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.777+0000 7f47c2ffd700 1 -- 172.21.15.7:0/3018099449 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d0011760 con 0x7f47dc1594c0 2023-10-06T11:01:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.777+0000 7f47e17af700 1 -- 172.21.15.7:0/3018099449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47dc0c76f0 con 0x7f47dc1594c0 2023-10-06T11:01:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.777+0000 7f47c2ffd700 1 -- 172.21.15.7:0/3018099449 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0011b00 con 0x7f47dc1594c0 2023-10-06T11:01:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.777+0000 7f47e17af700 1 -- 172.21.15.7:0/3018099449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47dc155010 con 0x7f47dc1594c0 2023-10-06T11:01:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.778+0000 7f47e17af700 1 -- 172.21.15.7:0/3018099449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47dc0c7ed0 con 0x7f47dc1594c0 2023-10-06T11:01:06.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.779+0000 7f47c2ffd700 1 -- 172.21.15.7:0/3018099449 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47d0018350 con 0x7f47dc1594c0 2023-10-06T11:01:06.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.779+0000 7f47c2ffd700 1 --2- 172.21.15.7:0/3018099449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f47c8066f30 0x7f47c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:06.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.780+0000 7f47c2ffd700 1 -- 172.21.15.7:0/3018099449 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f47d00847e0 con 0x7f47dc1594c0 2023-10-06T11:01:06.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.780+0000 7f47daffd700 1 --2- 172.21.15.7:0/3018099449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f47c8066f30 0x7f47c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:06.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.780+0000 7f47daffd700 1 --2- 172.21.15.7:0/3018099449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f47c8066f30 0x7f47c80693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f47cc001780 tx=0x7f47cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:06.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:06.784+0000 7f47c2ffd700 1 -- 172.21.15.7:0/3018099449 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47d0055240 con 0x7f47dc1594c0 2023-10-06T11:01:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.032+0000 7f47e17af700 1 -- 172.21.15.7:0/3018099449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f47dc070480 con 0x7f47dc1594c0 2023-10-06T11:01:07.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.615+0000 7f47c2ffd700 1 -- 172.21.15.7:0/3018099449 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f47d0054dd0 con 0x7f47dc1594c0 2023-10-06T11:01:07.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.617+0000 7f47e17af700 1 -- 172.21.15.7:0/3018099449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f47c8066f30 msgr2=0x7f47c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:07.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.617+0000 7f47e17af700 1 --2- 172.21.15.7:0/3018099449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f47c8066f30 0x7f47c80693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f47cc001780 tx=0x7f47cc009040 comp rx=0 tx=0).stop 2023-10-06T11:01:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.617+0000 7f47e17af700 1 -- 172.21.15.7:0/3018099449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47dc1594c0 msgr2=0x7f47dc151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.617+0000 7f47e17af700 1 --2- 172.21.15.7:0/3018099449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47dc1594c0 0x7f47dc151d30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f47d000c880 tx=0x7f47d0008040 comp rx=0 tx=0).stop 2023-10-06T11:01:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.618+0000 7f47e17af700 1 -- 172.21.15.7:0/3018099449 shutdown_connections 2023-10-06T11:01:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.618+0000 7f47e17af700 1 --2- 172.21.15.7:0/3018099449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f47c8066f30 0x7f47c80693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.618+0000 7f47e17af700 1 --2- 172.21.15.7:0/3018099449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47dc159890 0x7f47dc154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.618+0000 7f47e17af700 1 --2- 172.21.15.7:0/3018099449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47dc0af440 0x7f47dc0c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.618+0000 7f47e17af700 1 --2- 172.21.15.7:0/3018099449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47dc1594c0 0x7f47dc151d30 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.618+0000 7f47e17af700 1 -- 172.21.15.7:0/3018099449 >> 172.21.15.7:0/3018099449 conn(0x7f47dc067bc0 msgr2=0x7f47dc0c4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.618+0000 7f47e17af700 1 -- 172.21.15.7:0/3018099449 shutdown_connections 2023-10-06T11:01:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.618+0000 7f47e17af700 1 -- 172.21.15.7:0/3018099449 wait complete. 2023-10-06T11:01:07.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:01:07.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.769+0000 7fdf36f53700 1 Processor -- start 2023-10-06T11:01:07.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.769+0000 7fdf36f53700 1 -- start start 2023-10-06T11:01:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.770+0000 7fdf36f53700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdf30159360 0x7fdf300afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.770+0000 7fdf36f53700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf30068100 0x7fdf30162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.770+0000 7fdf36f53700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf300aeba0 con 0x7fdf300ac7f0 2023-10-06T11:01:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.770+0000 7fdf36f53700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf30159730 con 0x7fdf30159360 2023-10-06T11:01:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.770+0000 7fdf36f53700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf300ae270 con 0x7fdf30068100 2023-10-06T11:01:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.770+0000 7fdf34cef700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdf30159360 0x7fdf300afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.770+0000 7fdf34cef700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdf30159360 0x7fdf300afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60318/0 (socket says 172.21.15.7:60318) 2023-10-06T11:01:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.770+0000 7fdf34cef700 1 -- 172.21.15.7:0/3398019751 learned_addr learned my addr 172.21.15.7:0/3398019751 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.770+0000 7fdf354f0700 1 --2- 172.21.15.7:0/3398019751 >> v2:172.21.15.50:3300/0 conn(0x7fdf30068100 0x7fdf30162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.770+0000 7fdf34cef700 1 -- 172.21.15.7:0/3398019751 >> v2:172.21.15.50:3300/0 conn(0x7fdf30068100 msgr2=0x7fdf30162ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.770+0000 7fdf34cef700 1 --2- 172.21.15.7:0/3398019751 >> v2:172.21.15.50:3300/0 conn(0x7fdf30068100 0x7fdf30162ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.770+0000 7fdf34cef700 1 -- 172.21.15.7:0/3398019751 >> v1:172.21.15.50:6789/0 conn(0x7fdf300ac7f0 legacy=0x7fdf300a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.770+0000 7fdf34cef700 1 -- 172.21.15.7:0/3398019751 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf300ae550 con 0x7fdf30159360 2023-10-06T11:01:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.770+0000 7fdf34cef700 1 --2- 172.21.15.7:0/3398019751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf30159360 0x7fdf300afb40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdf3006fc90 tx=0x7fdf20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dba4a100bf666b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.771+0000 7fdf2f7fe700 1 -- 172.21.15.7:0/3398019751 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20009e70 con 0x7fdf30159360 2023-10-06T11:01:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.771+0000 7fdf2f7fe700 1 -- 172.21.15.7:0/3398019751 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2000b860 con 0x7fdf30159360 2023-10-06T11:01:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.771+0000 7fdf2f7fe700 1 -- 172.21.15.7:0/3398019751 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2000bc00 con 0x7fdf30159360 2023-10-06T11:01:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.771+0000 7fdf36f53700 1 -- 172.21.15.7:0/3398019751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf30159360 msgr2=0x7fdf300afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.771+0000 7fdf36f53700 1 --2- 172.21.15.7:0/3398019751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf30159360 0x7fdf300afb40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdf3006fc90 tx=0x7fdf20009250 comp rx=0 tx=0).stop 2023-10-06T11:01:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.771+0000 7fdf36f53700 1 -- 172.21.15.7:0/3398019751 shutdown_connections 2023-10-06T11:01:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.771+0000 7fdf36f53700 1 --2- 172.21.15.7:0/3398019751 >> v2:172.21.15.50:3300/0 conn(0x7fdf30068100 0x7fdf30162ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.771+0000 7fdf36f53700 1 --2- 172.21.15.7:0/3398019751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf30159360 0x7fdf300afb40 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.771+0000 7fdf36f53700 1 -- 172.21.15.7:0/3398019751 >> 172.21.15.7:0/3398019751 conn(0x7fdf30095a70 msgr2=0x7fdf300af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.771+0000 7fdf36f53700 1 -- 172.21.15.7:0/3398019751 shutdown_connections 2023-10-06T11:01:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.771+0000 7fdf36f53700 1 -- 172.21.15.7:0/3398019751 wait complete. 2023-10-06T11:01:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.772+0000 7fdf36f53700 1 Processor -- start 2023-10-06T11:01:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.773+0000 7fdf36f53700 1 -- start start 2023-10-06T11:01:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.773+0000 7fdf36f53700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf30068100 0x7fdf301582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.773+0000 7fdf36f53700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf300ac7f0 0x7fdf30156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.773+0000 7fdf36f53700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf30159360 0x7fdf30151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.773+0000 7fdf36f53700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf30152140 con 0x7fdf30159360 2023-10-06T11:01:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.773+0000 7fdf36f53700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3014c7f0 con 0x7fdf300ac7f0 2023-10-06T11:01:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.773+0000 7fdf36f53700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf30150370 con 0x7fdf30068100 2023-10-06T11:01:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf354f0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf30159360 0x7fdf30151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf354f0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf30159360 0x7fdf30151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60330/0 (socket says 172.21.15.7:60330) 2023-10-06T11:01:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf354f0700 1 -- 172.21.15.7:0/3676873657 learned_addr learned my addr 172.21.15.7:0/3676873657 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:07.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf2ffff700 1 --2- 172.21.15.7:0/3676873657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf300ac7f0 0x7fdf30156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:07.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf34cef700 1 --2- 172.21.15.7:0/3676873657 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf30068100 0x7fdf301582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:07.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf354f0700 1 -- 172.21.15.7:0/3676873657 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf30068100 msgr2=0x7fdf301582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:07.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf354f0700 1 --2- 172.21.15.7:0/3676873657 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf30068100 0x7fdf301582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:07.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf354f0700 1 -- 172.21.15.7:0/3676873657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf300ac7f0 msgr2=0x7fdf30156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:07.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf354f0700 1 --2- 172.21.15.7:0/3676873657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf300ac7f0 0x7fdf30156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:07.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf354f0700 1 -- 172.21.15.7:0/3676873657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf200094f0 con 0x7fdf30159360 2023-10-06T11:01:07.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf354f0700 1 --2- 172.21.15.7:0/3676873657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf30159360 0x7fdf30151560 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009e90 tx=0x7fdf2800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:07.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf2cff9700 1 -- 172.21.15.7:0/3676873657 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800cb70 con 0x7fdf30159360 2023-10-06T11:01:07.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf2cff9700 1 -- 172.21.15.7:0/3676873657 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2800f040 con 0x7fdf30159360 2023-10-06T11:01:07.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf36f53700 1 -- 172.21.15.7:0/3676873657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3014ca00 con 0x7fdf30159360 2023-10-06T11:01:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf2cff9700 1 -- 172.21.15.7:0/3676873657 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28014480 con 0x7fdf30159360 2023-10-06T11:01:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.774+0000 7fdf36f53700 1 -- 172.21.15.7:0/3676873657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3014cfc0 con 0x7fdf30159360 2023-10-06T11:01:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.775+0000 7fdf36f53700 1 -- 172.21.15.7:0/3676873657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf30070480 con 0x7fdf30159360 2023-10-06T11:01:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.776+0000 7fdf2cff9700 1 -- 172.21.15.7:0/3676873657 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf28014830 con 0x7fdf30159360 2023-10-06T11:01:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.776+0000 7fdf2cff9700 1 --2- 172.21.15.7:0/3676873657 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdf1c066f30 0x7fdf1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.776+0000 7fdf34cef700 1 --2- 172.21.15.7:0/3676873657 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdf1c066f30 0x7fdf1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.776+0000 7fdf2cff9700 1 -- 172.21.15.7:0/3676873657 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdf28085480 con 0x7fdf30159360 2023-10-06T11:01:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.777+0000 7fdf34cef700 1 --2- 172.21.15.7:0/3676873657 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdf1c066f30 0x7fdf1c0693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdf3006fc90 tx=0x7fdf20017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:07.781+0000 7fdf2cff9700 1 -- 172.21.15.7:0/3676873657 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf28052450 con 0x7fdf30159360 2023-10-06T11:01:08.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.026+0000 7fdf36f53700 1 -- 172.21.15.7:0/3676873657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf300ae830 con 0x7fdf30159360 2023-10-06T11:01:08.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.026+0000 7fdf2cff9700 1 -- 172.21.15.7:0/3676873657 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4589 (secure 0 0 0) 0x7fdf28055a70 con 0x7fdf30159360 2023-10-06T11:01:08.028 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:08.028 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3539274987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3539274987},{"type":"v1","addr":"172.21.15.7:6836","nonce":3539274987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1716655212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1716655212},{"type":"v1","addr":"172.21.15.50:6834","nonce":1716655212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/186446686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":186446686},{"type":"v1","addr":"172.21.15.50:6835","nonce":186446686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:01:04.009956+0000","modified":"2023-10-06T11:01:07.613415+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5520":{"gid":5520,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/1121258860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1121258860},{"type":"v1","addr":"172.21.15.7:6837","nonce":1121258860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:01:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.028+0000 7fdf36f53700 1 -- 172.21.15.7:0/3676873657 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdf1c066f30 msgr2=0x7fdf1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.029+0000 7fdf36f53700 1 --2- 172.21.15.7:0/3676873657 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdf1c066f30 0x7fdf1c0693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdf3006fc90 tx=0x7fdf20017000 comp rx=0 tx=0).stop 2023-10-06T11:01:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.029+0000 7fdf36f53700 1 -- 172.21.15.7:0/3676873657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf30159360 msgr2=0x7fdf30151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.029+0000 7fdf36f53700 1 --2- 172.21.15.7:0/3676873657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf30159360 0x7fdf30151560 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009e90 tx=0x7fdf2800b040 comp rx=0 tx=0).stop 2023-10-06T11:01:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.029+0000 7fdf36f53700 1 -- 172.21.15.7:0/3676873657 shutdown_connections 2023-10-06T11:01:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.029+0000 7fdf36f53700 1 --2- 172.21.15.7:0/3676873657 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdf1c066f30 0x7fdf1c0693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.029+0000 7fdf36f53700 1 --2- 172.21.15.7:0/3676873657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf30159360 0x7fdf30151560 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.029+0000 7fdf36f53700 1 --2- 172.21.15.7:0/3676873657 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf30068100 0x7fdf301582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.029+0000 7fdf36f53700 1 --2- 172.21.15.7:0/3676873657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf300ac7f0 0x7fdf30156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.029+0000 7fdf36f53700 1 -- 172.21.15.7:0/3676873657 >> 172.21.15.7:0/3676873657 conn(0x7fdf30095a70 msgr2=0x7fdf300b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:08.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.029+0000 7fdf36f53700 1 -- 172.21.15.7:0/3676873657 shutdown_connections 2023-10-06T11:01:08.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.029+0000 7fdf36f53700 1 -- 172.21.15.7:0/3676873657 wait complete. 2023-10-06T11:01:08.032 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2023-10-06T11:01:08.044 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:01:08.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.173+0000 7fb9d7dcc700 1 Processor -- start 2023-10-06T11:01:08.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.174+0000 7fb9d7dcc700 1 -- start start 2023-10-06T11:01:08.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.174+0000 7fb9d7dcc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb9d0158120 0x7fb9d00c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.174+0000 7fb9d7dcc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9d00cae30 0x7fb9d00cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.175+0000 7fb9d7dcc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d00cbd10 con 0x7fb9d00c8ba0 2023-10-06T11:01:08.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.175+0000 7fb9d7dcc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d00cb9e0 con 0x7fb9d0158120 2023-10-06T11:01:08.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.175+0000 7fb9d7dcc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d00c9300 con 0x7fb9d00cae30 2023-10-06T11:01:08.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.175+0000 7fb9d6369700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9d00cae30 0x7fb9d00cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.175+0000 7fb9d5b68700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb9d0158120 0x7fb9d00c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.175+0000 7fb9d6369700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9d00cae30 0x7fb9d00cc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.7:58670/0 (socket says 172.21.15.7:58670) 2023-10-06T11:01:08.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.175+0000 7fb9d6369700 1 -- 172.21.15.7:0/2651089522 learned_addr learned my addr 172.21.15.7:0/2651089522 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:08.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.175+0000 7fb9d5b68700 1 -- 172.21.15.7:0/2651089522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9d00cae30 msgr2=0x7fb9d00cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:08.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.175+0000 7fb9d5b68700 1 --2- 172.21.15.7:0/2651089522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9d00cae30 0x7fb9d00cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.175+0000 7fb9d5b68700 1 -- 172.21.15.7:0/2651089522 >> v1:172.21.15.50:6789/0 conn(0x7fb9d00c8ba0 legacy=0x7fb9d00ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.175+0000 7fb9d5b68700 1 -- 172.21.15.7:0/2651089522 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d00c95e0 con 0x7fb9d0158120 2023-10-06T11:01:08.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.175+0000 7fb9d6369700 1 --2- 172.21.15.7:0/2651089522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9d00cae30 0x7fb9d00cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:01:08.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.175+0000 7fb9d5b68700 1 --2- 172.21.15.7:0/2651089522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d0158120 0x7fb9d00c8660 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0098d0 tx=0x7fb9cc009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5333c8258c646748 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:08.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.176+0000 7fb9d4b66700 1 -- 172.21.15.7:0/2651089522 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc005c10 con 0x7fb9d0158120 2023-10-06T11:01:08.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.176+0000 7fb9d4b66700 1 -- 172.21.15.7:0/2651089522 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc005d70 con 0x7fb9d0158120 2023-10-06T11:01:08.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.176+0000 7fb9d4b66700 1 -- 172.21.15.7:0/2651089522 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc006280 con 0x7fb9d0158120 2023-10-06T11:01:08.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.176+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2651089522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d0158120 msgr2=0x7fb9d00c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.176+0000 7fb9d7dcc700 1 --2- 172.21.15.7:0/2651089522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d0158120 0x7fb9d00c8660 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0098d0 tx=0x7fb9cc009120 comp rx=0 tx=0).stop 2023-10-06T11:01:08.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.176+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2651089522 shutdown_connections 2023-10-06T11:01:08.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.176+0000 7fb9d7dcc700 1 --2- 172.21.15.7:0/2651089522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9d00cae30 0x7fb9d00cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.176+0000 7fb9d7dcc700 1 --2- 172.21.15.7:0/2651089522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d0158120 0x7fb9d00c8660 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.176+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2651089522 >> 172.21.15.7:0/2651089522 conn(0x7fb9d0087920 msgr2=0x7fb9d0097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:08.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.176+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2651089522 shutdown_connections 2023-10-06T11:01:08.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.176+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2651089522 wait complete. 2023-10-06T11:01:08.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.178+0000 7fb9d7dcc700 1 Processor -- start 2023-10-06T11:01:08.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.178+0000 7fb9d7dcc700 1 -- start start 2023-10-06T11:01:08.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.179+0000 7fb9d7dcc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9d00c8ba0 0x7fb9d0166ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.179+0000 7fb9d7dcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d00cae30 0x7fb9d00c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.179+0000 7fb9d7dcc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d0158120 0x7fb9d00b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.179+0000 7fb9d7dcc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d00c3ec0 con 0x7fb9d0158120 2023-10-06T11:01:08.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.179+0000 7fb9d7dcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d00c41a0 con 0x7fb9d00cae30 2023-10-06T11:01:08.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.179+0000 7fb9d7dcc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d00c4480 con 0x7fb9d00c8ba0 2023-10-06T11:01:08.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.179+0000 7fb9d6369700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d0158120 0x7fb9d00b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.179+0000 7fb9d6369700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d0158120 0x7fb9d00b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60346/0 (socket says 172.21.15.7:60346) 2023-10-06T11:01:08.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.179+0000 7fb9d6369700 1 -- 172.21.15.7:0/2468423735 learned_addr learned my addr 172.21.15.7:0/2468423735 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:08.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.179+0000 7fb9d5367700 1 --2- 172.21.15.7:0/2468423735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d00cae30 0x7fb9d00c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.179+0000 7fb9d5b68700 1 --2- 172.21.15.7:0/2468423735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9d00c8ba0 0x7fb9d0166ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.180+0000 7fb9d6369700 1 -- 172.21.15.7:0/2468423735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9d00c8ba0 msgr2=0x7fb9d0166ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.180+0000 7fb9d6369700 1 --2- 172.21.15.7:0/2468423735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9d00c8ba0 0x7fb9d0166ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.180+0000 7fb9d6369700 1 -- 172.21.15.7:0/2468423735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d00cae30 msgr2=0x7fb9d00c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.180+0000 7fb9d6369700 1 --2- 172.21.15.7:0/2468423735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d00cae30 0x7fb9d00c16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.180+0000 7fb9d6369700 1 -- 172.21.15.7:0/2468423735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c8009ae0 con 0x7fb9d0158120 2023-10-06T11:01:08.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.180+0000 7fb9d6369700 1 --2- 172.21.15.7:0/2468423735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d0158120 0x7fb9d00b2690 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009fd0 tx=0x7fb9c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:08.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.180+0000 7fb9c5ffb700 1 -- 172.21.15.7:0/2468423735 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8018070 con 0x7fb9d0158120 2023-10-06T11:01:08.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.180+0000 7fb9c5ffb700 1 -- 172.21.15.7:0/2468423735 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c800f040 con 0x7fb9d0158120 2023-10-06T11:01:08.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.180+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2468423735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9cc0093c0 con 0x7fb9d0158120 2023-10-06T11:01:08.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.180+0000 7fb9c5ffb700 1 -- 172.21.15.7:0/2468423735 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800cbd0 con 0x7fb9d0158120 2023-10-06T11:01:08.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.180+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2468423735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d0146500 con 0x7fb9d0158120 2023-10-06T11:01:08.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.181+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2468423735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d0146080 con 0x7fb9d0158120 2023-10-06T11:01:08.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.182+0000 7fb9c5ffb700 1 -- 172.21.15.7:0/2468423735 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9c8003020 con 0x7fb9d0158120 2023-10-06T11:01:08.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.182+0000 7fb9c5ffb700 1 --2- 172.21.15.7:0/2468423735 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb9b4066f30 0x7fb9b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.182+0000 7fb9c5ffb700 1 -- 172.21.15.7:0/2468423735 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb9c8084c20 con 0x7fb9d0158120 2023-10-06T11:01:08.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.182+0000 7fb9d5b68700 1 --2- 172.21.15.7:0/2468423735 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb9b4066f30 0x7fb9b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.183+0000 7fb9d5b68700 1 --2- 172.21.15.7:0/2468423735 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb9b4066f30 0x7fb9b40693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009160 tx=0x7fb9cc016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:08.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.186+0000 7fb9c5ffb700 1 -- 172.21.15.7:0/2468423735 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9d0146080 con 0x7fb9d0158120 2023-10-06T11:01:08.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.394+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2468423735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9d0146080 con 0x7fb9d0158120 2023-10-06T11:01:08.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.395+0000 7fb9c5ffb700 1 -- 172.21.15.7:0/2468423735 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+17073 (secure 0 0 0) 0x7fb9d0146080 con 0x7fb9d0158120 2023-10-06T11:01:08.397 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:08.398 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":57,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:01:05.587241+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:01:01.839698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T11:01:02.986831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:01:08.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.398+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2468423735 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb9b4066f30 msgr2=0x7fb9b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.398+0000 7fb9d7dcc700 1 --2- 172.21.15.7:0/2468423735 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb9b4066f30 0x7fb9b40693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009160 tx=0x7fb9cc016000 comp rx=0 tx=0).stop 2023-10-06T11:01:08.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.398+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2468423735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d0158120 msgr2=0x7fb9d00b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.398+0000 7fb9d7dcc700 1 --2- 172.21.15.7:0/2468423735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d0158120 0x7fb9d00b2690 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009fd0 tx=0x7fb9c800b040 comp rx=0 tx=0).stop 2023-10-06T11:01:08.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.398+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2468423735 shutdown_connections 2023-10-06T11:01:08.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.398+0000 7fb9d7dcc700 1 --2- 172.21.15.7:0/2468423735 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb9b4066f30 0x7fb9b40693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.398+0000 7fb9d7dcc700 1 --2- 172.21.15.7:0/2468423735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d0158120 0x7fb9d00b2690 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.398+0000 7fb9d7dcc700 1 --2- 172.21.15.7:0/2468423735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9d00c8ba0 0x7fb9d0166ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.398+0000 7fb9d7dcc700 1 --2- 172.21.15.7:0/2468423735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d00cae30 0x7fb9d00c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.398+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2468423735 >> 172.21.15.7:0/2468423735 conn(0x7fb9d0087920 msgr2=0x7fb9d006c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:08.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.398+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2468423735 shutdown_connections 2023-10-06T11:01:08.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.398+0000 7fb9d7dcc700 1 -- 172.21.15.7:0/2468423735 wait complete. 2023-10-06T11:01:08.413 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:01:08.413 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:01:08.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.544+0000 7f1b546b0700 1 Processor -- start 2023-10-06T11:01:08.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.544+0000 7f1b546b0700 1 -- start start 2023-10-06T11:01:08.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.545+0000 7f1b546b0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b4c1590d0 0x7f1b4c069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.545+0000 7f1b546b0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1b4c06a0f0 0x7f1b4c15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.545+0000 7f1b546b0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c0694d0 con 0x7f1b4c15d350 2023-10-06T11:01:08.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.545+0000 7f1b546b0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4c15d770 con 0x7f1b4c06a0f0 2023-10-06T11:01:08.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.545+0000 7f1b546b0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4c068ba0 con 0x7f1b4c1590d0 2023-10-06T11:01:08.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.545+0000 7f1b51c4b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1b4c06a0f0 0x7f1b4c15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.545+0000 7f1b52c4d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1b4c15d350 0x7f1b4c067980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42694/0 (socket says 172.21.15.7:42694) 2023-10-06T11:01:08.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.545+0000 7f1b52c4d700 1 -- 172.21.15.7:0/866217000 learned_addr learned my addr 172.21.15.7:0/866217000 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:08.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.545+0000 7f1b5244c700 1 --2- 172.21.15.7:0/866217000 >> v2:172.21.15.50:3300/0 conn(0x7f1b4c1590d0 0x7f1b4c069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.545+0000 7f1b51c4b700 1 -- 172.21.15.7:0/866217000 >> v2:172.21.15.50:3300/0 conn(0x7f1b4c1590d0 msgr2=0x7f1b4c069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:08.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.545+0000 7f1b51c4b700 1 --2- 172.21.15.7:0/866217000 >> v2:172.21.15.50:3300/0 conn(0x7f1b4c1590d0 0x7f1b4c069bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.545+0000 7f1b51c4b700 1 -- 172.21.15.7:0/866217000 >> v1:172.21.15.7:6789/0 conn(0x7f1b4c15d350 legacy=0x7f1b4c067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.545+0000 7f1b51c4b700 1 -- 172.21.15.7:0/866217000 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c068e80 con 0x7f1b4c06a0f0 2023-10-06T11:01:08.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.545+0000 7f1b5144a700 1 -- 172.21.15.7:0/866217000 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705856529 0 0) 0x7f1b4c0694d0 con 0x7f1b4c15d350 2023-10-06T11:01:08.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.546+0000 7f1b51c4b700 1 --2- 172.21.15.7:0/866217000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06a0f0 0x7f1b4c15ce10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c06ec40 tx=0x7f1b3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9991ffc79a19b0e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:08.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.546+0000 7f1b5144a700 1 -- 172.21.15.7:0/866217000 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c011630 con 0x7f1b4c06a0f0 2023-10-06T11:01:08.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.546+0000 7f1b5144a700 1 -- 172.21.15.7:0/866217000 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c011790 con 0x7f1b4c06a0f0 2023-10-06T11:01:08.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.546+0000 7f1b5144a700 1 -- 172.21.15.7:0/866217000 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c011b30 con 0x7f1b4c06a0f0 2023-10-06T11:01:08.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.546+0000 7f1b546b0700 1 -- 172.21.15.7:0/866217000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06a0f0 msgr2=0x7f1b4c15ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.546+0000 7f1b546b0700 1 --2- 172.21.15.7:0/866217000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06a0f0 0x7f1b4c15ce10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c06ec40 tx=0x7f1b3c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.546+0000 7f1b546b0700 1 -- 172.21.15.7:0/866217000 shutdown_connections 2023-10-06T11:01:08.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.546+0000 7f1b546b0700 1 --2- 172.21.15.7:0/866217000 >> v2:172.21.15.50:3300/0 conn(0x7f1b4c1590d0 0x7f1b4c069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.546+0000 7f1b546b0700 1 --2- 172.21.15.7:0/866217000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06a0f0 0x7f1b4c15ce10 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.546+0000 7f1b546b0700 1 -- 172.21.15.7:0/866217000 >> 172.21.15.7:0/866217000 conn(0x7f1b4c096160 msgr2=0x7f1b4c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:08.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.546+0000 7f1b546b0700 1 -- 172.21.15.7:0/866217000 shutdown_connections 2023-10-06T11:01:08.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.546+0000 7f1b546b0700 1 -- 172.21.15.7:0/866217000 wait complete. 2023-10-06T11:01:08.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.548+0000 7f1b546b0700 1 Processor -- start 2023-10-06T11:01:08.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.548+0000 7f1b546b0700 1 -- start start 2023-10-06T11:01:08.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.548+0000 7f1b546b0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b4c06a0f0 0x7f1b4c1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b546b0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b4c1590d0 0x7f1b4c155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b546b0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c15d350 0x7f1b4c06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b546b0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c156670 con 0x7f1b4c15d350 2023-10-06T11:01:08.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b546b0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c1567e0 con 0x7f1b4c1590d0 2023-10-06T11:01:08.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b546b0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0989e0 con 0x7f1b4c06a0f0 2023-10-06T11:01:08.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b52c4d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c15d350 0x7f1b4c06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b52c4d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c15d350 0x7f1b4c06c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60362/0 (socket says 172.21.15.7:60362) 2023-10-06T11:01:08.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b52c4d700 1 -- 172.21.15.7:0/3907908875 learned_addr learned my addr 172.21.15.7:0/3907908875 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:08.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b51c4b700 1 --2- 172.21.15.7:0/3907908875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b4c1590d0 0x7f1b4c155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b5244c700 1 --2- 172.21.15.7:0/3907908875 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b4c06a0f0 0x7f1b4c1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b52c4d700 1 -- 172.21.15.7:0/3907908875 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b4c06a0f0 msgr2=0x7f1b4c1581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b52c4d700 1 --2- 172.21.15.7:0/3907908875 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b4c06a0f0 0x7f1b4c1581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b52c4d700 1 -- 172.21.15.7:0/3907908875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b4c1590d0 msgr2=0x7f1b4c155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b52c4d700 1 --2- 172.21.15.7:0/3907908875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b4c1590d0 0x7f1b4c155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b52c4d700 1 -- 172.21.15.7:0/3907908875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c009420 con 0x7f1b4c15d350 2023-10-06T11:01:08.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b52c4d700 1 --2- 172.21.15.7:0/3907908875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c15d350 0x7f1b4c06c3b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400cbf0 tx=0x7f1b440019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:08.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b427fc700 1 -- 172.21.15.7:0/3907908875 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4400a8b0 con 0x7f1b4c15d350 2023-10-06T11:01:08.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b427fc700 1 -- 172.21.15.7:0/3907908875 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4400aa10 con 0x7f1b4c15d350 2023-10-06T11:01:08.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b546b0700 1 -- 172.21.15.7:0/3907908875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c158770 con 0x7f1b4c15d350 2023-10-06T11:01:08.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.549+0000 7f1b427fc700 1 -- 172.21.15.7:0/3907908875 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4400add0 con 0x7f1b4c15d350 2023-10-06T11:01:08.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.550+0000 7f1b546b0700 1 -- 172.21.15.7:0/3907908875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c156390 con 0x7f1b4c15d350 2023-10-06T11:01:08.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.550+0000 7f1b546b0700 1 -- 172.21.15.7:0/3907908875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c070480 con 0x7f1b4c15d350 2023-10-06T11:01:08.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.551+0000 7f1b427fc700 1 -- 172.21.15.7:0/3907908875 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b44007300 con 0x7f1b4c15d350 2023-10-06T11:01:08.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.551+0000 7f1b427fc700 1 --2- 172.21.15.7:0/3907908875 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1b30066f30 0x7f1b300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.551+0000 7f1b427fc700 1 -- 172.21.15.7:0/3907908875 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1b44084ae0 con 0x7f1b4c15d350 2023-10-06T11:01:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.552+0000 7f1b5244c700 1 --2- 172.21.15.7:0/3907908875 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1b30066f30 0x7f1b300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.552+0000 7f1b5244c700 1 --2- 172.21.15.7:0/3907908875 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1b30066f30 0x7f1b300693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009db0 tx=0x7f1b480091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:08.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.556+0000 7f1b427fc700 1 -- 172.21.15.7:0/3907908875 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b44051a90 con 0x7f1b4c15d350 2023-10-06T11:01:08.567 INFO:tasks.ceph.mds.c.smithi007.stderr:2023-10-06T11:01:08.565+0000 7f632e17b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:01:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.757+0000 7f1b546b0700 1 -- 172.21.15.7:0/3907908875 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b4c069160 con 0x7f1b30066f30 2023-10-06T11:01:08.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.767+0000 7f1b427fc700 1 -- 172.21.15.7:0/3907908875 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311515 (secure 0 0 0) 0x7f1b4c069160 con 0x7f1b30066f30 2023-10-06T11:01:08.772 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:08.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.771+0000 7f1b546b0700 1 -- 172.21.15.7:0/3907908875 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1b30066f30 msgr2=0x7f1b300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.771+0000 7f1b546b0700 1 --2- 172.21.15.7:0/3907908875 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1b30066f30 0x7f1b300693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009db0 tx=0x7f1b480091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.771+0000 7f1b546b0700 1 -- 172.21.15.7:0/3907908875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c15d350 msgr2=0x7f1b4c06c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.771+0000 7f1b546b0700 1 --2- 172.21.15.7:0/3907908875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c15d350 0x7f1b4c06c3b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400cbf0 tx=0x7f1b440019b0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.771+0000 7f1b546b0700 1 -- 172.21.15.7:0/3907908875 shutdown_connections 2023-10-06T11:01:08.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.771+0000 7f1b546b0700 1 --2- 172.21.15.7:0/3907908875 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1b30066f30 0x7f1b300693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.771+0000 7f1b546b0700 1 --2- 172.21.15.7:0/3907908875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c15d350 0x7f1b4c06c3b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.771+0000 7f1b546b0700 1 --2- 172.21.15.7:0/3907908875 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b4c06a0f0 0x7f1b4c1581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.771+0000 7f1b546b0700 1 --2- 172.21.15.7:0/3907908875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b4c1590d0 0x7f1b4c155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.771+0000 7f1b546b0700 1 -- 172.21.15.7:0/3907908875 >> 172.21.15.7:0/3907908875 conn(0x7f1b4c096160 msgr2=0x7f1b4c1539f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:08.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.771+0000 7f1b546b0700 1 -- 172.21.15.7:0/3907908875 shutdown_connections 2023-10-06T11:01:08.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.771+0000 7f1b546b0700 1 -- 172.21.15.7:0/3907908875 wait complete. 2023-10-06T11:01:08.776 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-06T11:01:08.786 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-10-06T11:01:08.000460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384652,"kb_used_data":6348,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590068,"statfs":{"total":773094113280,"available":770652229632,"internally_reserved":0,"allocated":6500352,"data_stored":3647888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.428676"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.616555+0000","last_change":"2023-10-06T11:01:04.616555+0000","last_active":"2023-10-06T11:01:04.616555+0000","last_peered":"2023-10-06T11:01:04.616555+0000","last_clean":"2023-10-06T11:01:04.616555+0000","last_became_active":"2023-10-06T11:01:04.615274+0000","last_became_peered":"2023-10-06T11:01:04.615274+0000","last_unstale":"2023-10-06T11:01:04.616555+0000","last_undegraded":"2023-10-06T11:01:04.616555+0000","last_fullsized":"2023-10-06T11:01:04.616555+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:29.136846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.621536+0000","last_change":"2023-10-06T11:01:04.621536+0000","last_active":"2023-10-06T11:01:04.621536+0000","last_peered":"2023-10-06T11:01:04.621536+0000","last_clean":"2023-10-06T11:01:04.621536+0000","last_became_active":"2023-10-06T11:01:04.621226+0000","last_became_peered":"2023-10-06T11:01:04.621226+0000","last_unstale":"2023-10-06T11:01:04.621536+0000","last_undegraded":"2023-10-06T11:01:04.621536+0000","last_fullsized":"2023-10-06T11:01:04.621536+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:12.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.621468+0000","last_change":"2023-10-06T11:01:04.621468+0000","last_active":"2023-10-06T11:01:04.621468+0000","last_peered":"2023-10-06T11:01:04.621468+0000","last_clean":"2023-10-06T11:01:04.621468+0000","last_became_active":"2023-10-06T11:01:04.621221+0000","last_became_peered":"2023-10-06T11:01:04.621221+0000","last_unstale":"2023-10-06T11:01:04.621468+0000","last_undegraded":"2023-10-06T11:01:04.621468+0000","last_fullsized":"2023-10-06T11:01:04.621468+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:18:38.158140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.621190+0000","last_change":"2023-10-06T11:01:04.621190+0000","last_active":"2023-10-06T11:01:04.621190+0000","last_peered":"2023-10-06T11:01:04.621190+0000","last_clean":"2023-10-06T11:01:04.621190+0000","last_became_active":"2023-10-06T11:01:04.620799+0000","last_became_peered":"2023-10-06T11:01:04.620799+0000","last_unstale":"2023-10-06T11:01:04.621190+0000","last_undegraded":"2023-10-06T11:01:04.621190+0000","last_fullsized":"2023-10-06T11:01:04.621190+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:18.231015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.598053+0000","last_change":"2023-10-06T11:01:04.598053+0000","last_active":"2023-10-06T11:01:04.598053+0000","last_peered":"2023-10-06T11:01:04.598053+0000","last_clean":"2023-10-06T11:01:04.598053+0000","last_became_active":"2023-10-06T11:01:04.597673+0000","last_became_peered":"2023-10-06T11:01:04.597673+0000","last_unstale":"2023-10-06T11:01:04.598053+0000","last_undegraded":"2023-10-06T11:01:04.598053+0000","last_fullsized":"2023-10-06T11:01:04.598053+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:51:24.968480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.624819+0000","last_change":"2023-10-06T11:01:04.624819+0000","last_active":"2023-10-06T11:01:04.624819+0000","last_peered":"2023-10-06T11:01:04.624819+0000","last_clean":"2023-10-06T11:01:04.624819+0000","last_became_active":"2023-10-06T11:01:04.624419+0000","last_became_peered":"2023-10-06T11:01:04.624419+0000","last_unstale":"2023-10-06T11:01:04.624819+0000","last_undegraded":"2023-10-06T11:01:04.624819+0000","last_fullsized":"2023-10-06T11:01:04.624819+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:15.432056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.614608+0000","last_change":"2023-10-06T11:01:04.614608+0000","last_active":"2023-10-06T11:01:04.614608+0000","last_peered":"2023-10-06T11:01:04.614608+0000","last_clean":"2023-10-06T11:01:04.614608+0000","last_became_active":"2023-10-06T11:01:04.614319+0000","last_became_peered":"2023-10-06T11:01:04.614319+0000","last_unstale":"2023-10-06T11:01:04.614608+0000","last_undegraded":"2023-10-06T11:01:04.614608+0000","last_fullsized":"2023-10-06T11:01:04.614608+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:55.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.616407+0000","last_change":"2023-10-06T11:01:04.616407+0000","last_active":"2023-10-06T11:01:04.616407+0000","last_peered":"2023-10-06T11:01:04.616407+0000","last_clean":"2023-10-06T11:01:04.616407+0000","last_became_active":"2023-10-06T11:01:04.615290+0000","last_became_peered":"2023-10-06T11:01:04.615290+0000","last_unstale":"2023-10-06T11:01:04.616407+0000","last_undegraded":"2023-10-06T11:01:04.616407+0000","last_fullsized":"2023-10-06T11:01:04.616407+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:40.567842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.615084+0000","last_change":"2023-10-06T11:01:04.615084+0000","last_active":"2023-10-06T11:01:04.615084+0000","last_peered":"2023-10-06T11:01:04.615084+0000","last_clean":"2023-10-06T11:01:04.615084+0000","last_became_active":"2023-10-06T11:01:04.614809+0000","last_became_peered":"2023-10-06T11:01:04.614809+0000","last_unstale":"2023-10-06T11:01:04.615084+0000","last_undegraded":"2023-10-06T11:01:04.615084+0000","last_fullsized":"2023-10-06T11:01:04.615084+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:46.225998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625602+0000","last_change":"2023-10-06T11:01:04.625602+0000","last_active":"2023-10-06T11:01:04.625602+0000","last_peered":"2023-10-06T11:01:04.625602+0000","last_clean":"2023-10-06T11:01:04.625602+0000","last_became_active":"2023-10-06T11:01:04.625173+0000","last_became_peered":"2023-10-06T11:01:04.625173+0000","last_unstale":"2023-10-06T11:01:04.625602+0000","last_undegraded":"2023-10-06T11:01:04.625602+0000","last_fullsized":"2023-10-06T11:01:04.625602+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:20:15.098690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.603109+0000","last_change":"2023-10-06T11:01:04.603109+0000","last_active":"2023-10-06T11:01:04.603109+0000","last_peered":"2023-10-06T11:01:04.603109+0000","last_clean":"2023-10-06T11:01:04.603109+0000","last_became_active":"2023-10-06T11:01:04.602837+0000","last_became_peered":"2023-10-06T11:01:04.602837+0000","last_unstale":"2023-10-06T11:01:04.603109+0000","last_undegraded":"2023-10-06T11:01:04.603109+0000","last_fullsized":"2023-10-06T11:01:04.603109+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:04.741719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.611348+0000","last_change":"2023-10-06T11:01:04.611348+0000","last_active":"2023-10-06T11:01:04.611348+0000","last_peered":"2023-10-06T11:01:04.611348+0000","last_clean":"2023-10-06T11:01:04.611348+0000","last_became_active":"2023-10-06T11:01:04.611054+0000","last_became_peered":"2023-10-06T11:01:04.611054+0000","last_unstale":"2023-10-06T11:01:04.611348+0000","last_undegraded":"2023-10-06T11:01:04.611348+0000","last_fullsized":"2023-10-06T11:01:04.611348+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:12:05.467380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.615081+0000","last_change":"2023-10-06T11:01:04.615081+0000","last_active":"2023-10-06T11:01:04.615081+0000","last_peered":"2023-10-06T11:01:04.615081+0000","last_clean":"2023-10-06T11:01:04.615081+0000","last_became_active":"2023-10-06T11:01:04.614779+0000","last_became_peered":"2023-10-06T11:01:04.614779+0000","last_unstale":"2023-10-06T11:01:04.615081+0000","last_undegraded":"2023-10-06T11:01:04.615081+0000","last_fullsized":"2023-10-06T11:01:04.615081+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:53.358655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625412+0000","last_change":"2023-10-06T11:01:04.625412+0000","last_active":"2023-10-06T11:01:04.625412+0000","last_peered":"2023-10-06T11:01:04.625412+0000","last_clean":"2023-10-06T11:01:04.625412+0000","last_became_active":"2023-10-06T11:01:04.625052+0000","last_became_peered":"2023-10-06T11:01:04.625052+0000","last_unstale":"2023-10-06T11:01:04.625412+0000","last_undegraded":"2023-10-06T11:01:04.625412+0000","last_fullsized":"2023-10-06T11:01:04.625412+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:10.261073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625735+0000","last_change":"2023-10-06T11:01:04.625735+0000","last_active":"2023-10-06T11:01:04.625735+0000","last_peered":"2023-10-06T11:01:04.625735+0000","last_clean":"2023-10-06T11:01:04.625735+0000","last_became_active":"2023-10-06T11:01:04.625446+0000","last_became_peered":"2023-10-06T11:01:04.625446+0000","last_unstale":"2023-10-06T11:01:04.625735+0000","last_undegraded":"2023-10-06T11:01:04.625735+0000","last_fullsized":"2023-10-06T11:01:04.625735+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:40.764334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.607429+0000","last_change":"2023-10-06T11:01:04.607429+0000","last_active":"2023-10-06T11:01:04.607429+0000","last_peered":"2023-10-06T11:01:04.607429+0000","last_clean":"2023-10-06T11:01:04.607429+0000","last_became_active":"2023-10-06T11:01:04.607077+0000","last_became_peered":"2023-10-06T11:01:04.607077+0000","last_unstale":"2023-10-06T11:01:04.607429+0000","last_undegraded":"2023-10-06T11:01:04.607429+0000","last_fullsized":"2023-10-06T11:01:04.607429+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:13.225100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.601752+0000","last_change":"2023-10-06T11:01:04.601752+0000","last_active":"2023-10-06T11:01:04.601752+0000","last_peered":"2023-10-06T11:01:04.601752+0000","last_clean":"2023-10-06T11:01:04.601752+0000","last_became_active":"2023-10-06T11:01:04.601432+0000","last_became_peered":"2023-10-06T11:01:04.601432+0000","last_unstale":"2023-10-06T11:01:04.601752+0000","last_undegraded":"2023-10-06T11:01:04.601752+0000","last_fullsized":"2023-10-06T11:01:04.601752+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:19.125745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.619947+0000","last_change":"2023-10-06T11:01:04.619947+0000","last_active":"2023-10-06T11:01:04.619947+0000","last_peered":"2023-10-06T11:01:04.619947+0000","last_clean":"2023-10-06T11:01:04.619947+0000","last_became_active":"2023-10-06T11:01:04.619674+0000","last_became_peered":"2023-10-06T11:01:04.619674+0000","last_unstale":"2023-10-06T11:01:04.619947+0000","last_undegraded":"2023-10-06T11:01:04.619947+0000","last_fullsized":"2023-10-06T11:01:04.619947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:47:02.600368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.605300+0000","last_change":"2023-10-06T11:01:04.605300+0000","last_active":"2023-10-06T11:01:04.605300+0000","last_peered":"2023-10-06T11:01:04.605300+0000","last_clean":"2023-10-06T11:01:04.605300+0000","last_became_active":"2023-10-06T11:01:04.604968+0000","last_became_peered":"2023-10-06T11:01:04.604968+0000","last_unstale":"2023-10-06T11:01:04.605300+0000","last_undegraded":"2023-10-06T11:01:04.605300+0000","last_fullsized":"2023-10-06T11:01:04.605300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:29.136846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.606579+0000","last_change":"2023-10-06T11:01:04.606579+0000","last_active":"2023-10-06T11:01:04.606579+0000","last_peered":"2023-10-06T11:01:04.606579+0000","last_clean":"2023-10-06T11:01:04.606579+0000","last_became_active":"2023-10-06T11:01:04.605414+0000","last_became_peered":"2023-10-06T11:01:04.605414+0000","last_unstale":"2023-10-06T11:01:04.606579+0000","last_undegraded":"2023-10-06T11:01:04.606579+0000","last_fullsized":"2023-10-06T11:01:04.606579+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:19.919031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.626072+0000","last_change":"2023-10-06T11:01:04.626072+0000","last_active":"2023-10-06T11:01:04.626072+0000","last_peered":"2023-10-06T11:01:04.626072+0000","last_clean":"2023-10-06T11:01:04.626072+0000","last_became_active":"2023-10-06T11:01:04.625599+0000","last_became_peered":"2023-10-06T11:01:04.625599+0000","last_unstale":"2023-10-06T11:01:04.626072+0000","last_undegraded":"2023-10-06T11:01:04.626072+0000","last_fullsized":"2023-10-06T11:01:04.626072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:39.644026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.614625+0000","last_change":"2023-10-06T11:01:04.614625+0000","last_active":"2023-10-06T11:01:04.614625+0000","last_peered":"2023-10-06T11:01:04.614625+0000","last_clean":"2023-10-06T11:01:04.614625+0000","last_became_active":"2023-10-06T11:01:04.614367+0000","last_became_peered":"2023-10-06T11:01:04.614367+0000","last_unstale":"2023-10-06T11:01:04.614625+0000","last_undegraded":"2023-10-06T11:01:04.614625+0000","last_fullsized":"2023-10-06T11:01:04.614625+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:52.998339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.614012+0000","last_change":"2023-10-06T11:01:04.614012+0000","last_active":"2023-10-06T11:01:04.614012+0000","last_peered":"2023-10-06T11:01:04.614012+0000","last_clean":"2023-10-06T11:01:04.614012+0000","last_became_active":"2023-10-06T11:01:04.613715+0000","last_became_peered":"2023-10-06T11:01:04.613715+0000","last_unstale":"2023-10-06T11:01:04.614012+0000","last_undegraded":"2023-10-06T11:01:04.614012+0000","last_fullsized":"2023-10-06T11:01:04.614012+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:04.741719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.619978+0000","last_change":"2023-10-06T11:01:04.619978+0000","last_active":"2023-10-06T11:01:04.619978+0000","last_peered":"2023-10-06T11:01:04.619978+0000","last_clean":"2023-10-06T11:01:04.619978+0000","last_became_active":"2023-10-06T11:01:04.619648+0000","last_became_peered":"2023-10-06T11:01:04.619648+0000","last_unstale":"2023-10-06T11:01:04.619978+0000","last_undegraded":"2023-10-06T11:01:04.619978+0000","last_fullsized":"2023-10-06T11:01:04.619978+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:02:27.135567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.609040+0000","last_change":"2023-10-06T11:01:04.609040+0000","last_active":"2023-10-06T11:01:04.609040+0000","last_peered":"2023-10-06T11:01:04.609040+0000","last_clean":"2023-10-06T11:01:04.609040+0000","last_became_active":"2023-10-06T11:01:04.608533+0000","last_became_peered":"2023-10-06T11:01:04.608533+0000","last_unstale":"2023-10-06T11:01:04.609040+0000","last_undegraded":"2023-10-06T11:01:04.609040+0000","last_fullsized":"2023-10-06T11:01:04.609040+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:52.079098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.606485+0000","last_change":"2023-10-06T11:01:04.606485+0000","last_active":"2023-10-06T11:01:04.606485+0000","last_peered":"2023-10-06T11:01:04.606485+0000","last_clean":"2023-10-06T11:01:04.606485+0000","last_became_active":"2023-10-06T11:01:04.606206+0000","last_became_peered":"2023-10-06T11:01:04.606206+0000","last_unstale":"2023-10-06T11:01:04.606485+0000","last_undegraded":"2023-10-06T11:01:04.606485+0000","last_fullsized":"2023-10-06T11:01:04.606485+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:54.059762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.605087+0000","last_change":"2023-10-06T11:01:04.605087+0000","last_active":"2023-10-06T11:01:04.605087+0000","last_peered":"2023-10-06T11:01:04.605087+0000","last_clean":"2023-10-06T11:01:04.605087+0000","last_became_active":"2023-10-06T11:01:04.604755+0000","last_became_peered":"2023-10-06T11:01:04.604755+0000","last_unstale":"2023-10-06T11:01:04.605087+0000","last_undegraded":"2023-10-06T11:01:04.605087+0000","last_fullsized":"2023-10-06T11:01:04.605087+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:52.998339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.616829+0000","last_change":"2023-10-06T11:01:04.616829+0000","last_active":"2023-10-06T11:01:04.616829+0000","last_peered":"2023-10-06T11:01:04.616829+0000","last_clean":"2023-10-06T11:01:04.616829+0000","last_became_active":"2023-10-06T11:01:04.616293+0000","last_became_peered":"2023-10-06T11:01:04.616293+0000","last_unstale":"2023-10-06T11:01:04.616829+0000","last_undegraded":"2023-10-06T11:01:04.616829+0000","last_fullsized":"2023-10-06T11:01:04.616829+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:38.338726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.615030+0000","last_change":"2023-10-06T11:01:04.615030+0000","last_active":"2023-10-06T11:01:04.615030+0000","last_peered":"2023-10-06T11:01:04.615030+0000","last_clean":"2023-10-06T11:01:04.615030+0000","last_became_active":"2023-10-06T11:01:04.614746+0000","last_became_peered":"2023-10-06T11:01:04.614746+0000","last_unstale":"2023-10-06T11:01:04.615030+0000","last_undegraded":"2023-10-06T11:01:04.615030+0000","last_fullsized":"2023-10-06T11:01:04.615030+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:07.890468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.611374+0000","last_change":"2023-10-06T11:01:04.611374+0000","last_active":"2023-10-06T11:01:04.611374+0000","last_peered":"2023-10-06T11:01:04.611374+0000","last_clean":"2023-10-06T11:01:04.611374+0000","last_became_active":"2023-10-06T11:01:04.611087+0000","last_became_peered":"2023-10-06T11:01:04.611087+0000","last_unstale":"2023-10-06T11:01:04.611374+0000","last_undegraded":"2023-10-06T11:01:04.611374+0000","last_fullsized":"2023-10-06T11:01:04.611374+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:02.676672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.605850+0000","last_change":"2023-10-06T11:01:04.605850+0000","last_active":"2023-10-06T11:01:04.605850+0000","last_peered":"2023-10-06T11:01:04.605850+0000","last_clean":"2023-10-06T11:01:04.605850+0000","last_became_active":"2023-10-06T11:01:04.605571+0000","last_became_peered":"2023-10-06T11:01:04.605571+0000","last_unstale":"2023-10-06T11:01:04.605850+0000","last_undegraded":"2023-10-06T11:01:04.605850+0000","last_fullsized":"2023-10-06T11:01:04.605850+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:41:37.034924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.608536+0000","last_change":"2023-10-06T11:01:04.608536+0000","last_active":"2023-10-06T11:01:04.608536+0000","last_peered":"2023-10-06T11:01:04.608536+0000","last_clean":"2023-10-06T11:01:04.608536+0000","last_became_active":"2023-10-06T11:01:04.608237+0000","last_became_peered":"2023-10-06T11:01:04.608237+0000","last_unstale":"2023-10-06T11:01:04.608536+0000","last_undegraded":"2023-10-06T11:01:04.608536+0000","last_fullsized":"2023-10-06T11:01:04.608536+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:18.231015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.605806+0000","last_change":"2023-10-06T11:01:04.605806+0000","last_active":"2023-10-06T11:01:04.605806+0000","last_peered":"2023-10-06T11:01:04.605806+0000","last_clean":"2023-10-06T11:01:04.605806+0000","last_became_active":"2023-10-06T11:01:04.605533+0000","last_became_peered":"2023-10-06T11:01:04.605533+0000","last_unstale":"2023-10-06T11:01:04.605806+0000","last_undegraded":"2023-10-06T11:01:04.605806+0000","last_fullsized":"2023-10-06T11:01:04.605806+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:12.232627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"56'4","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.627441+0000","last_change":"2023-10-06T11:01:03.595107+0000","last_active":"2023-10-06T11:01:04.627441+0000","last_peered":"2023-10-06T11:01:04.627441+0000","last_clean":"2023-10-06T11:01:04.627441+0000","last_became_active":"2023-10-06T11:01:03.591790+0000","last_became_peered":"2023-10-06T11:01:03.591790+0000","last_unstale":"2023-10-06T11:01:04.627441+0000","last_undegraded":"2023-10-06T11:01:04.627441+0000","last_fullsized":"2023-10-06T11:01:04.627441+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:50:30.877453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.598904+0000","last_change":"2023-10-06T11:01:04.598904+0000","last_active":"2023-10-06T11:01:04.598904+0000","last_peered":"2023-10-06T11:01:04.598904+0000","last_clean":"2023-10-06T11:01:04.598904+0000","last_became_active":"2023-10-06T11:01:04.598639+0000","last_became_peered":"2023-10-06T11:01:04.598639+0000","last_unstale":"2023-10-06T11:01:04.598904+0000","last_undegraded":"2023-10-06T11:01:04.598904+0000","last_fullsized":"2023-10-06T11:01:04.598904+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:52.079098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"56'1","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.599059+0000","last_change":"2023-10-06T11:01:03.589846+0000","last_active":"2023-10-06T11:01:04.599059+0000","last_peered":"2023-10-06T11:01:04.599059+0000","last_clean":"2023-10-06T11:01:04.599059+0000","last_became_active":"2023-10-06T11:01:03.589564+0000","last_became_peered":"2023-10-06T11:01:03.589564+0000","last_unstale":"2023-10-06T11:01:04.599059+0000","last_undegraded":"2023-10-06T11:01:04.599059+0000","last_fullsized":"2023-10-06T11:01:04.599059+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:02:26.130564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.619252+0000","last_change":"2023-10-06T11:01:04.619252+0000","last_active":"2023-10-06T11:01:04.619252+0000","last_peered":"2023-10-06T11:01:04.619252+0000","last_clean":"2023-10-06T11:01:04.619252+0000","last_became_active":"2023-10-06T11:01:04.618833+0000","last_became_peered":"2023-10-06T11:01:04.618833+0000","last_unstale":"2023-10-06T11:01:04.619252+0000","last_undegraded":"2023-10-06T11:01:04.619252+0000","last_fullsized":"2023-10-06T11:01:04.619252+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:12:05.467380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"56'2","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.620675+0000","last_change":"2023-10-06T11:01:03.595699+0000","last_active":"2023-10-06T11:01:04.620675+0000","last_peered":"2023-10-06T11:01:04.620675+0000","last_clean":"2023-10-06T11:01:04.620675+0000","last_became_active":"2023-10-06T11:01:03.595395+0000","last_became_peered":"2023-10-06T11:01:03.595395+0000","last_unstale":"2023-10-06T11:01:04.620675+0000","last_undegraded":"2023-10-06T11:01:04.620675+0000","last_fullsized":"2023-10-06T11:01:04.620675+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:06.885465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625770+0000","last_change":"2023-10-06T11:01:04.625770+0000","last_active":"2023-10-06T11:01:04.625770+0000","last_peered":"2023-10-06T11:01:04.625770+0000","last_clean":"2023-10-06T11:01:04.625770+0000","last_became_active":"2023-10-06T11:01:04.625354+0000","last_became_peered":"2023-10-06T11:01:04.625354+0000","last_unstale":"2023-10-06T11:01:04.625770+0000","last_undegraded":"2023-10-06T11:01:04.625770+0000","last_fullsized":"2023-10-06T11:01:04.625770+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:03:28.313489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"56'2","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.619661+0000","last_change":"2023-10-06T11:01:03.589480+0000","last_active":"2023-10-06T11:01:04.619661+0000","last_peered":"2023-10-06T11:01:04.619661+0000","last_clean":"2023-10-06T11:01:04.619661+0000","last_became_active":"2023-10-06T11:01:03.588938+0000","last_became_peered":"2023-10-06T11:01:03.588938+0000","last_unstale":"2023-10-06T11:01:04.619661+0000","last_undegraded":"2023-10-06T11:01:04.619661+0000","last_fullsized":"2023-10-06T11:01:04.619661+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:20:14.093687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.621965+0000","last_change":"2023-10-06T11:01:04.621965+0000","last_active":"2023-10-06T11:01:04.621965+0000","last_peered":"2023-10-06T11:01:04.621965+0000","last_clean":"2023-10-06T11:01:04.621965+0000","last_became_active":"2023-10-06T11:01:04.621480+0000","last_became_peered":"2023-10-06T11:01:04.621480+0000","last_unstale":"2023-10-06T11:01:04.621965+0000","last_undegraded":"2023-10-06T11:01:04.621965+0000","last_fullsized":"2023-10-06T11:01:04.621965+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:40.547479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"56'1","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.600385+0000","last_change":"2023-10-06T11:01:03.588422+0000","last_active":"2023-10-06T11:01:04.600385+0000","last_peered":"2023-10-06T11:01:04.600385+0000","last_clean":"2023-10-06T11:01:04.600385+0000","last_became_active":"2023-10-06T11:01:03.588112+0000","last_became_peered":"2023-10-06T11:01:03.588112+0000","last_unstale":"2023-10-06T11:01:04.600385+0000","last_undegraded":"2023-10-06T11:01:04.600385+0000","last_fullsized":"2023-10-06T11:01:04.600385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:01.671669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.600801+0000","last_change":"2023-10-06T11:01:04.600801+0000","last_active":"2023-10-06T11:01:04.600801+0000","last_peered":"2023-10-06T11:01:04.600801+0000","last_clean":"2023-10-06T11:01:04.600801+0000","last_became_active":"2023-10-06T11:01:04.600538+0000","last_became_peered":"2023-10-06T11:01:04.600538+0000","last_unstale":"2023-10-06T11:01:04.600801+0000","last_undegraded":"2023-10-06T11:01:04.600801+0000","last_fullsized":"2023-10-06T11:01:04.600801+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:35.138926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"56'1","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.600994+0000","last_change":"2023-10-06T11:01:03.586584+0000","last_active":"2023-10-06T11:01:04.600994+0000","last_peered":"2023-10-06T11:01:04.600994+0000","last_clean":"2023-10-06T11:01:04.600994+0000","last_became_active":"2023-10-06T11:01:03.586013+0000","last_became_peered":"2023-10-06T11:01:03.586013+0000","last_unstale":"2023-10-06T11:01:04.600994+0000","last_undegraded":"2023-10-06T11:01:04.600994+0000","last_fullsized":"2023-10-06T11:01:04.600994+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:39.562839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625789+0000","last_change":"2023-10-06T11:01:04.625789+0000","last_active":"2023-10-06T11:01:04.625789+0000","last_peered":"2023-10-06T11:01:04.625789+0000","last_clean":"2023-10-06T11:01:04.625789+0000","last_became_active":"2023-10-06T11:01:04.625168+0000","last_became_peered":"2023-10-06T11:01:04.625168+0000","last_unstale":"2023-10-06T11:01:04.625789+0000","last_undegraded":"2023-10-06T11:01:04.625789+0000","last_fullsized":"2023-10-06T11:01:04.625789+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:53:01.328898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.593116+0000","last_change":"2023-10-06T11:01:03.592023+0000","last_active":"2023-10-06T11:01:03.593116+0000","last_peered":"2023-10-06T11:01:03.593116+0000","last_clean":"2023-10-06T11:01:03.593116+0000","last_became_active":"2023-10-06T11:01:03.591585+0000","last_became_peered":"2023-10-06T11:01:03.591585+0000","last_unstale":"2023-10-06T11:01:03.593116+0000","last_undegraded":"2023-10-06T11:01:03.593116+0000","last_fullsized":"2023-10-06T11:01:03.593116+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:53.054759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.613798+0000","last_change":"2023-10-06T11:01:04.613798+0000","last_active":"2023-10-06T11:01:04.613798+0000","last_peered":"2023-10-06T11:01:04.613798+0000","last_clean":"2023-10-06T11:01:04.613798+0000","last_became_active":"2023-10-06T11:01:04.613513+0000","last_became_peered":"2023-10-06T11:01:04.613513+0000","last_unstale":"2023-10-06T11:01:04.613798+0000","last_undegraded":"2023-10-06T11:01:04.613798+0000","last_fullsized":"2023-10-06T11:01:04.613798+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:31.345664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.593715+0000","last_change":"2023-10-06T11:01:03.590501+0000","last_active":"2023-10-06T11:01:03.593715+0000","last_peered":"2023-10-06T11:01:03.593715+0000","last_clean":"2023-10-06T11:01:03.593715+0000","last_became_active":"2023-10-06T11:01:03.590205+0000","last_became_peered":"2023-10-06T11:01:03.590205+0000","last_unstale":"2023-10-06T11:01:03.593715+0000","last_undegraded":"2023-10-06T11:01:03.593715+0000","last_fullsized":"2023-10-06T11:01:03.593715+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:49:07.404016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.612829+0000","last_change":"2023-10-06T11:01:04.612829+0000","last_active":"2023-10-06T11:01:04.612829+0000","last_peered":"2023-10-06T11:01:04.612829+0000","last_clean":"2023-10-06T11:01:04.612829+0000","last_became_active":"2023-10-06T11:01:04.612526+0000","last_became_peered":"2023-10-06T11:01:04.612526+0000","last_unstale":"2023-10-06T11:01:04.612829+0000","last_undegraded":"2023-10-06T11:01:04.612829+0000","last_fullsized":"2023-10-06T11:01:04.612829+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:16.006475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.599714+0000","last_change":"2023-10-06T11:01:03.598202+0000","last_active":"2023-10-06T11:01:03.599714+0000","last_peered":"2023-10-06T11:01:03.599714+0000","last_clean":"2023-10-06T11:01:03.599714+0000","last_became_active":"2023-10-06T11:01:03.597917+0000","last_became_peered":"2023-10-06T11:01:03.597917+0000","last_unstale":"2023-10-06T11:01:03.599714+0000","last_undegraded":"2023-10-06T11:01:03.599714+0000","last_fullsized":"2023-10-06T11:01:03.599714+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:15.001472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.606414+0000","last_change":"2023-10-06T11:01:04.606414+0000","last_active":"2023-10-06T11:01:04.606414+0000","last_peered":"2023-10-06T11:01:04.606414+0000","last_clean":"2023-10-06T11:01:04.606414+0000","last_became_active":"2023-10-06T11:01:04.606077+0000","last_became_peered":"2023-10-06T11:01:04.606077+0000","last_unstale":"2023-10-06T11:01:04.606414+0000","last_undegraded":"2023-10-06T11:01:04.606414+0000","last_fullsized":"2023-10-06T11:01:04.606414+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:40.006889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.598778+0000","last_change":"2023-10-06T11:01:03.595649+0000","last_active":"2023-10-06T11:01:03.598778+0000","last_peered":"2023-10-06T11:01:03.598778+0000","last_clean":"2023-10-06T11:01:03.598778+0000","last_became_active":"2023-10-06T11:01:03.595288+0000","last_became_peered":"2023-10-06T11:01:03.595288+0000","last_unstale":"2023-10-06T11:01:03.598778+0000","last_undegraded":"2023-10-06T11:01:03.598778+0000","last_fullsized":"2023-10-06T11:01:03.598778+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:03:27.308486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.607435+0000","last_change":"2023-10-06T11:01:04.607435+0000","last_active":"2023-10-06T11:01:04.607435+0000","last_peered":"2023-10-06T11:01:04.607435+0000","last_clean":"2023-10-06T11:01:04.607435+0000","last_became_active":"2023-10-06T11:01:04.606805+0000","last_became_peered":"2023-10-06T11:01:04.606805+0000","last_unstale":"2023-10-06T11:01:04.607435+0000","last_undegraded":"2023-10-06T11:01:04.607435+0000","last_fullsized":"2023-10-06T11:01:04.607435+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:15:53.490409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"56'3","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625114+0000","last_change":"2023-10-06T11:01:03.592359+0000","last_active":"2023-10-06T11:01:04.625114+0000","last_peered":"2023-10-06T11:01:04.625114+0000","last_clean":"2023-10-06T11:01:04.625114+0000","last_became_active":"2023-10-06T11:01:03.592086+0000","last_became_peered":"2023-10-06T11:01:03.592086+0000","last_unstale":"2023-10-06T11:01:04.625114+0000","last_undegraded":"2023-10-06T11:01:04.625114+0000","last_fullsized":"2023-10-06T11:01:04.625114+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:34.133924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.612881+0000","last_change":"2023-10-06T11:01:04.612881+0000","last_active":"2023-10-06T11:01:04.612881+0000","last_peered":"2023-10-06T11:01:04.612881+0000","last_clean":"2023-10-06T11:01:04.612881+0000","last_became_active":"2023-10-06T11:01:04.608693+0000","last_became_peered":"2023-10-06T11:01:04.608693+0000","last_unstale":"2023-10-06T11:01:04.612881+0000","last_undegraded":"2023-10-06T11:01:04.612881+0000","last_fullsized":"2023-10-06T11:01:04.612881+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:31.345664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"56'6","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625543+0000","last_change":"2023-10-06T11:01:03.595201+0000","last_active":"2023-10-06T11:01:04.625543+0000","last_peered":"2023-10-06T11:01:04.625543+0000","last_clean":"2023-10-06T11:01:04.625543+0000","last_became_active":"2023-10-06T11:01:03.594541+0000","last_became_peered":"2023-10-06T11:01:03.594541+0000","last_unstale":"2023-10-06T11:01:04.625543+0000","last_undegraded":"2023-10-06T11:01:04.625543+0000","last_fullsized":"2023-10-06T11:01:04.625543+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:08.802332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.615236+0000","last_change":"2023-10-06T11:01:04.615236+0000","last_active":"2023-10-06T11:01:04.615236+0000","last_peered":"2023-10-06T11:01:04.615236+0000","last_clean":"2023-10-06T11:01:04.615236+0000","last_became_active":"2023-10-06T11:01:04.614964+0000","last_became_peered":"2023-10-06T11:01:04.614964+0000","last_unstale":"2023-10-06T11:01:04.615236+0000","last_undegraded":"2023-10-06T11:01:04.615236+0000","last_fullsized":"2023-10-06T11:01:04.615236+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:19.919031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"56'2","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.615628+0000","last_change":"2023-10-06T11:01:03.591470+0000","last_active":"2023-10-06T11:01:04.615628+0000","last_peered":"2023-10-06T11:01:04.615628+0000","last_clean":"2023-10-06T11:01:04.615628+0000","last_became_active":"2023-10-06T11:01:03.591185+0000","last_became_peered":"2023-10-06T11:01:03.591185+0000","last_unstale":"2023-10-06T11:01:04.615628+0000","last_undegraded":"2023-10-06T11:01:04.615628+0000","last_fullsized":"2023-10-06T11:01:04.615628+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:25.919357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.620458+0000","last_change":"2023-10-06T11:01:04.620458+0000","last_active":"2023-10-06T11:01:04.620458+0000","last_peered":"2023-10-06T11:01:04.620458+0000","last_clean":"2023-10-06T11:01:04.620458+0000","last_became_active":"2023-10-06T11:01:04.620154+0000","last_became_peered":"2023-10-06T11:01:04.620154+0000","last_unstale":"2023-10-06T11:01:04.620458+0000","last_undegraded":"2023-10-06T11:01:04.620458+0000","last_fullsized":"2023-10-06T11:01:04.620458+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:46.225998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.599206+0000","last_change":"2023-10-06T11:01:03.598176+0000","last_active":"2023-10-06T11:01:03.599206+0000","last_peered":"2023-10-06T11:01:03.599206+0000","last_clean":"2023-10-06T11:01:03.599206+0000","last_became_active":"2023-10-06T11:01:03.597314+0000","last_became_peered":"2023-10-06T11:01:03.597314+0000","last_unstale":"2023-10-06T11:01:03.599206+0000","last_undegraded":"2023-10-06T11:01:03.599206+0000","last_fullsized":"2023-10-06T11:01:03.599206+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:11.227624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.605439+0000","last_change":"2023-10-06T11:01:04.605439+0000","last_active":"2023-10-06T11:01:04.605439+0000","last_peered":"2023-10-06T11:01:04.605439+0000","last_clean":"2023-10-06T11:01:04.605439+0000","last_became_active":"2023-10-06T11:01:04.605008+0000","last_became_peered":"2023-10-06T11:01:04.605008+0000","last_unstale":"2023-10-06T11:01:04.605439+0000","last_undegraded":"2023-10-06T11:01:04.605439+0000","last_fullsized":"2023-10-06T11:01:04.605439+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:53:19.485010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.599019+0000","last_change":"2023-10-06T11:01:03.591078+0000","last_active":"2023-10-06T11:01:03.599019+0000","last_peered":"2023-10-06T11:01:03.599019+0000","last_clean":"2023-10-06T11:01:03.599019+0000","last_became_active":"2023-10-06T11:01:03.590777+0000","last_became_peered":"2023-10-06T11:01:03.590777+0000","last_unstale":"2023-10-06T11:01:03.599019+0000","last_undegraded":"2023-10-06T11:01:03.599019+0000","last_fullsized":"2023-10-06T11:01:03.599019+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:11.183330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.614774+0000","last_change":"2023-10-06T11:01:04.614774+0000","last_active":"2023-10-06T11:01:04.614774+0000","last_peered":"2023-10-06T11:01:04.614774+0000","last_clean":"2023-10-06T11:01:04.614774+0000","last_became_active":"2023-10-06T11:01:04.614452+0000","last_became_peered":"2023-10-06T11:01:04.614452+0000","last_unstale":"2023-10-06T11:01:04.614774+0000","last_undegraded":"2023-10-06T11:01:04.614774+0000","last_fullsized":"2023-10-06T11:01:04.614774+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:28.470960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"56'8","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.619156+0000","last_change":"2023-10-06T11:01:03.592439+0000","last_active":"2023-10-06T11:01:04.619156+0000","last_peered":"2023-10-06T11:01:04.619156+0000","last_clean":"2023-10-06T11:01:04.619156+0000","last_became_active":"2023-10-06T11:01:03.591891+0000","last_became_peered":"2023-10-06T11:01:03.591891+0000","last_unstale":"2023-10-06T11:01:04.619156+0000","last_undegraded":"2023-10-06T11:01:04.619156+0000","last_fullsized":"2023-10-06T11:01:04.619156+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:18:37.153138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.620358+0000","last_change":"2023-10-06T11:01:04.620358+0000","last_active":"2023-10-06T11:01:04.620358+0000","last_peered":"2023-10-06T11:01:04.620358+0000","last_clean":"2023-10-06T11:01:04.620358+0000","last_became_active":"2023-10-06T11:01:04.619972+0000","last_became_peered":"2023-10-06T11:01:04.619972+0000","last_unstale":"2023-10-06T11:01:04.620358+0000","last_undegraded":"2023-10-06T11:01:04.620358+0000","last_fullsized":"2023-10-06T11:01:04.620358+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:41:37.034924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"56'2","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.615632+0000","last_change":"2023-10-06T11:01:03.599836+0000","last_active":"2023-10-06T11:01:04.615632+0000","last_peered":"2023-10-06T11:01:04.615632+0000","last_clean":"2023-10-06T11:01:04.615632+0000","last_became_active":"2023-10-06T11:01:03.599563+0000","last_became_peered":"2023-10-06T11:01:03.599563+0000","last_unstale":"2023-10-06T11:01:04.615632+0000","last_undegraded":"2023-10-06T11:01:04.615632+0000","last_fullsized":"2023-10-06T11:01:04.615632+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:53:18.480008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.622081+0000","last_change":"2023-10-06T11:01:04.622081+0000","last_active":"2023-10-06T11:01:04.622081+0000","last_peered":"2023-10-06T11:01:04.622081+0000","last_clean":"2023-10-06T11:01:04.622081+0000","last_became_active":"2023-10-06T11:01:04.621795+0000","last_became_peered":"2023-10-06T11:01:04.621795+0000","last_unstale":"2023-10-06T11:01:04.622081+0000","last_undegraded":"2023-10-06T11:01:04.622081+0000","last_fullsized":"2023-10-06T11:01:04.622081+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:28:56.319019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.597640+0000","last_change":"2023-10-06T11:01:03.595601+0000","last_active":"2023-10-06T11:01:03.597640+0000","last_peered":"2023-10-06T11:01:03.597640+0000","last_clean":"2023-10-06T11:01:03.597640+0000","last_became_active":"2023-10-06T11:01:03.595311+0000","last_became_peered":"2023-10-06T11:01:03.595311+0000","last_unstale":"2023-10-06T11:01:03.597640+0000","last_undegraded":"2023-10-06T11:01:03.597640+0000","last_fullsized":"2023-10-06T11:01:03.597640+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:02:19.885083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.619737+0000","last_change":"2023-10-06T11:01:04.619737+0000","last_active":"2023-10-06T11:01:04.619737+0000","last_peered":"2023-10-06T11:01:04.619737+0000","last_clean":"2023-10-06T11:01:04.619737+0000","last_became_active":"2023-10-06T11:01:04.619415+0000","last_became_peered":"2023-10-06T11:01:04.619415+0000","last_unstale":"2023-10-06T11:01:04.619737+0000","last_undegraded":"2023-10-06T11:01:04.619737+0000","last_fullsized":"2023-10-06T11:01:04.619737+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:34.800619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.596574+0000","last_change":"2023-10-06T11:01:03.595643+0000","last_active":"2023-10-06T11:01:03.596574+0000","last_peered":"2023-10-06T11:01:03.596574+0000","last_clean":"2023-10-06T11:01:03.596574+0000","last_became_active":"2023-10-06T11:01:03.595352+0000","last_became_peered":"2023-10-06T11:01:03.595352+0000","last_unstale":"2023-10-06T11:01:03.596574+0000","last_undegraded":"2023-10-06T11:01:03.596574+0000","last_fullsized":"2023-10-06T11:01:03.596574+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:39.759331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.604698+0000","last_change":"2023-10-06T11:01:04.604698+0000","last_active":"2023-10-06T11:01:04.604698+0000","last_peered":"2023-10-06T11:01:04.604698+0000","last_clean":"2023-10-06T11:01:04.604698+0000","last_became_active":"2023-10-06T11:01:04.604400+0000","last_became_peered":"2023-10-06T11:01:04.604400+0000","last_unstale":"2023-10-06T11:01:04.604698+0000","last_undegraded":"2023-10-06T11:01:04.604698+0000","last_fullsized":"2023-10-06T11:01:04.604698+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:59:30.481573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.595986+0000","last_change":"2023-10-06T11:01:03.594938+0000","last_active":"2023-10-06T11:01:03.595986+0000","last_peered":"2023-10-06T11:01:03.595986+0000","last_clean":"2023-10-06T11:01:03.595986+0000","last_became_active":"2023-10-06T11:01:03.591588+0000","last_became_peered":"2023-10-06T11:01:03.591588+0000","last_unstale":"2023-10-06T11:01:03.595986+0000","last_undegraded":"2023-10-06T11:01:03.595986+0000","last_fullsized":"2023-10-06T11:01:03.595986+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:19.337064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.608070+0000","last_change":"2023-10-06T11:01:04.608070+0000","last_active":"2023-10-06T11:01:04.608070+0000","last_peered":"2023-10-06T11:01:04.608070+0000","last_clean":"2023-10-06T11:01:04.608070+0000","last_became_active":"2023-10-06T11:01:04.607788+0000","last_became_peered":"2023-10-06T11:01:04.607788+0000","last_unstale":"2023-10-06T11:01:04.608070+0000","last_undegraded":"2023-10-06T11:01:04.608070+0000","last_fullsized":"2023-10-06T11:01:04.608070+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:38.338726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.599191+0000","last_change":"2023-10-06T11:01:03.597015+0000","last_active":"2023-10-06T11:01:03.599191+0000","last_peered":"2023-10-06T11:01:03.599191+0000","last_clean":"2023-10-06T11:01:03.599191+0000","last_became_active":"2023-10-06T11:01:03.596701+0000","last_became_peered":"2023-10-06T11:01:03.596701+0000","last_unstale":"2023-10-06T11:01:03.599191+0000","last_undegraded":"2023-10-06T11:01:03.599191+0000","last_fullsized":"2023-10-06T11:01:03.599191+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:27.465958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.617030+0000","last_change":"2023-10-06T11:01:04.617030+0000","last_active":"2023-10-06T11:01:04.617030+0000","last_peered":"2023-10-06T11:01:04.617030+0000","last_clean":"2023-10-06T11:01:04.617030+0000","last_became_active":"2023-10-06T11:01:04.616756+0000","last_became_peered":"2023-10-06T11:01:04.616756+0000","last_unstale":"2023-10-06T11:01:04.617030+0000","last_undegraded":"2023-10-06T11:01:04.617030+0000","last_fullsized":"2023-10-06T11:01:04.617030+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:40.006889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.593678+0000","last_change":"2023-10-06T11:01:03.592759+0000","last_active":"2023-10-06T11:01:03.593678+0000","last_peered":"2023-10-06T11:01:03.593678+0000","last_clean":"2023-10-06T11:01:03.593678+0000","last_became_active":"2023-10-06T11:01:03.592470+0000","last_became_peered":"2023-10-06T11:01:03.592470+0000","last_unstale":"2023-10-06T11:01:03.593678+0000","last_undegraded":"2023-10-06T11:01:03.593678+0000","last_fullsized":"2023-10-06T11:01:03.593678+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:33.795616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.595613+0000","last_change":"2023-10-06T11:01:04.595613+0000","last_active":"2023-10-06T11:01:04.595613+0000","last_peered":"2023-10-06T11:01:04.595613+0000","last_clean":"2023-10-06T11:01:04.595613+0000","last_became_active":"2023-10-06T11:01:04.595337+0000","last_became_peered":"2023-10-06T11:01:04.595337+0000","last_unstale":"2023-10-06T11:01:04.595613+0000","last_undegraded":"2023-10-06T11:01:04.595613+0000","last_fullsized":"2023-10-06T11:01:04.595613+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:26.924360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.593104+0000","last_change":"2023-10-06T11:01:03.591848+0000","last_active":"2023-10-06T11:01:03.593104+0000","last_peered":"2023-10-06T11:01:03.593104+0000","last_clean":"2023-10-06T11:01:03.593104+0000","last_became_active":"2023-10-06T11:01:03.591149+0000","last_became_peered":"2023-10-06T11:01:03.591149+0000","last_unstale":"2023-10-06T11:01:03.593104+0000","last_undegraded":"2023-10-06T11:01:03.593104+0000","last_fullsized":"2023-10-06T11:01:03.593104+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:52.353652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.607416+0000","last_change":"2023-10-06T11:01:04.607416+0000","last_active":"2023-10-06T11:01:04.607416+0000","last_peered":"2023-10-06T11:01:04.607416+0000","last_clean":"2023-10-06T11:01:04.607416+0000","last_became_active":"2023-10-06T11:01:04.607019+0000","last_became_peered":"2023-10-06T11:01:04.607019+0000","last_unstale":"2023-10-06T11:01:04.607416+0000","last_undegraded":"2023-10-06T11:01:04.607416+0000","last_fullsized":"2023-10-06T11:01:04.607416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:46.292511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.594802+0000","last_change":"2023-10-06T11:01:03.590215+0000","last_active":"2023-10-06T11:01:03.594802+0000","last_peered":"2023-10-06T11:01:03.594802+0000","last_clean":"2023-10-06T11:01:03.594802+0000","last_became_active":"2023-10-06T11:01:03.589923+0000","last_became_peered":"2023-10-06T11:01:03.589923+0000","last_unstale":"2023-10-06T11:01:03.594802+0000","last_undegraded":"2023-10-06T11:01:03.594802+0000","last_fullsized":"2023-10-06T11:01:03.594802+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:28.373069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.600845+0000","last_change":"2023-10-06T11:01:04.600845+0000","last_active":"2023-10-06T11:01:04.600845+0000","last_peered":"2023-10-06T11:01:04.600845+0000","last_clean":"2023-10-06T11:01:04.600845+0000","last_became_active":"2023-10-06T11:01:04.600537+0000","last_became_peered":"2023-10-06T11:01:04.600537+0000","last_unstale":"2023-10-06T11:01:04.600845+0000","last_undegraded":"2023-10-06T11:01:04.600845+0000","last_fullsized":"2023-10-06T11:01:04.600845+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:15.432056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"56'1","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.602633+0000","last_change":"2023-10-06T11:01:03.598094+0000","last_active":"2023-10-06T11:01:04.602633+0000","last_peered":"2023-10-06T11:01:04.602633+0000","last_clean":"2023-10-06T11:01:04.602633+0000","last_became_active":"2023-10-06T11:01:03.597803+0000","last_became_peered":"2023-10-06T11:01:03.597803+0000","last_unstale":"2023-10-06T11:01:04.602633+0000","last_undegraded":"2023-10-06T11:01:04.602633+0000","last_fullsized":"2023-10-06T11:01:04.602633+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:18.120743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.588299+0000","last_change":"2023-10-06T10:58:56.328381+0000","last_active":"2023-10-06T11:01:03.588299+0000","last_peered":"2023-10-06T11:01:03.588299+0000","last_clean":"2023-10-06T11:01:03.588299+0000","last_became_active":"2023-10-06T10:58:56.328054+0000","last_became_peered":"2023-10-06T10:58:56.328054+0000","last_unstale":"2023-10-06T11:01:03.588299+0000","last_undegraded":"2023-10-06T11:01:03.588299+0000","last_fullsized":"2023-10-06T11:01:03.588299+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.605710+0000","last_change":"2023-10-06T11:01:04.605710+0000","last_active":"2023-10-06T11:01:04.605710+0000","last_peered":"2023-10-06T11:01:04.605710+0000","last_clean":"2023-10-06T11:01:04.605710+0000","last_became_active":"2023-10-06T11:01:04.604654+0000","last_became_peered":"2023-10-06T11:01:04.604654+0000","last_unstale":"2023-10-06T11:01:04.605710+0000","last_undegraded":"2023-10-06T11:01:04.605710+0000","last_fullsized":"2023-10-06T11:01:04.605710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:02:20.890085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.598561+0000","last_change":"2023-10-06T11:01:03.597262+0000","last_active":"2023-10-06T11:01:03.598561+0000","last_peered":"2023-10-06T11:01:03.598561+0000","last_clean":"2023-10-06T11:01:03.598561+0000","last_became_active":"2023-10-06T11:01:03.596997+0000","last_became_peered":"2023-10-06T11:01:03.596997+0000","last_unstale":"2023-10-06T11:01:03.598561+0000","last_undegraded":"2023-10-06T11:01:03.598561+0000","last_fullsized":"2023-10-06T11:01:03.598561+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:02.153328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.579113+0000","last_change":"2023-10-06T10:58:56.326189+0000","last_active":"2023-10-06T11:01:03.579113+0000","last_peered":"2023-10-06T11:01:03.579113+0000","last_clean":"2023-10-06T11:01:03.579113+0000","last_became_active":"2023-10-06T10:58:56.325852+0000","last_became_peered":"2023-10-06T10:58:56.325852+0000","last_unstale":"2023-10-06T11:01:03.579113+0000","last_undegraded":"2023-10-06T11:01:03.579113+0000","last_fullsized":"2023-10-06T11:01:03.579113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:28.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.609574+0000","last_change":"2023-10-06T11:01:04.609574+0000","last_active":"2023-10-06T11:01:04.609574+0000","last_peered":"2023-10-06T11:01:04.609574+0000","last_clean":"2023-10-06T11:01:04.609574+0000","last_became_active":"2023-10-06T11:01:04.608829+0000","last_became_peered":"2023-10-06T11:01:04.608829+0000","last_unstale":"2023-10-06T11:01:04.609574+0000","last_undegraded":"2023-10-06T11:01:04.609574+0000","last_fullsized":"2023-10-06T11:01:04.609574+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:52.079098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"56'2","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.618772+0000","last_change":"2023-10-06T11:01:03.591332+0000","last_active":"2023-10-06T11:01:04.618772+0000","last_peered":"2023-10-06T11:01:04.618772+0000","last_clean":"2023-10-06T11:01:04.618772+0000","last_became_active":"2023-10-06T11:01:03.590912+0000","last_became_peered":"2023-10-06T11:01:03.590912+0000","last_unstale":"2023-10-06T11:01:04.618772+0000","last_undegraded":"2023-10-06T11:01:04.618772+0000","last_fullsized":"2023-10-06T11:01:04.618772+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:03:27.308486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":49,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.579783+0000","last_change":"2023-10-06T10:58:56.325363+0000","last_active":"2023-10-06T11:01:03.579783+0000","last_peered":"2023-10-06T11:01:03.579783+0000","last_clean":"2023-10-06T11:01:03.579783+0000","last_became_active":"2023-10-06T10:58:56.325095+0000","last_became_peered":"2023-10-06T10:58:56.325095+0000","last_unstale":"2023-10-06T11:01:03.579783+0000","last_undegraded":"2023-10-06T11:01:03.579783+0000","last_fullsized":"2023-10-06T11:01:03.579783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":192,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.579737+0000","last_change":"2023-10-06T10:58:57.328525+0000","last_active":"2023-10-06T11:01:03.579737+0000","last_peered":"2023-10-06T11:01:03.579737+0000","last_clean":"2023-10-06T11:01:03.579737+0000","last_became_active":"2023-10-06T10:58:57.327509+0000","last_became_peered":"2023-10-06T10:58:57.327509+0000","last_unstale":"2023-10-06T11:01:03.579737+0000","last_undegraded":"2023-10-06T11:01:03.579737+0000","last_fullsized":"2023-10-06T11:01:03.579737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_clean_scrub_stamp":"2023-10-06T10:58:56.314996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:45.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.609696+0000","last_change":"2023-10-06T11:01:04.609696+0000","last_active":"2023-10-06T11:01:04.609696+0000","last_peered":"2023-10-06T11:01:04.609696+0000","last_clean":"2023-10-06T11:01:04.609696+0000","last_became_active":"2023-10-06T11:01:04.609443+0000","last_became_peered":"2023-10-06T11:01:04.609443+0000","last_unstale":"2023-10-06T11:01:04.609696+0000","last_undegraded":"2023-10-06T11:01:04.609696+0000","last_fullsized":"2023-10-06T11:01:04.609696+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:03.158331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.599187+0000","last_change":"2023-10-06T11:01:03.597996+0000","last_active":"2023-10-06T11:01:03.599187+0000","last_peered":"2023-10-06T11:01:03.599187+0000","last_clean":"2023-10-06T11:01:03.599187+0000","last_became_active":"2023-10-06T11:01:03.595736+0000","last_became_peered":"2023-10-06T11:01:03.595736+0000","last_unstale":"2023-10-06T11:01:03.599187+0000","last_undegraded":"2023-10-06T11:01:03.599187+0000","last_fullsized":"2023-10-06T11:01:03.599187+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:14.309780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.579660+0000","last_change":"2023-10-06T10:58:56.331567+0000","last_active":"2023-10-06T11:01:03.579660+0000","last_peered":"2023-10-06T11:01:03.579660+0000","last_clean":"2023-10-06T11:01:03.579660+0000","last_became_active":"2023-10-06T10:58:56.331244+0000","last_became_peered":"2023-10-06T10:58:56.331244+0000","last_unstale":"2023-10-06T11:01:03.579660+0000","last_undegraded":"2023-10-06T11:01:03.579660+0000","last_fullsized":"2023-10-06T11:01:03.579660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.607177+0000","last_change":"2023-10-06T11:01:04.607177+0000","last_active":"2023-10-06T11:01:04.607177+0000","last_peered":"2023-10-06T11:01:04.607177+0000","last_clean":"2023-10-06T11:01:04.607177+0000","last_became_active":"2023-10-06T11:01:04.606858+0000","last_became_peered":"2023-10-06T11:01:04.606858+0000","last_unstale":"2023-10-06T11:01:04.607177+0000","last_undegraded":"2023-10-06T11:01:04.607177+0000","last_fullsized":"2023-10-06T11:01:04.607177+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:15.314783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.590591+0000","last_change":"2023-10-06T11:01:03.588613+0000","last_active":"2023-10-06T11:01:03.590591+0000","last_peered":"2023-10-06T11:01:03.590591+0000","last_clean":"2023-10-06T11:01:03.590591+0000","last_became_active":"2023-10-06T11:01:03.588087+0000","last_became_peered":"2023-10-06T11:01:03.588087+0000","last_unstale":"2023-10-06T11:01:03.590591+0000","last_undegraded":"2023-10-06T11:01:03.590591+0000","last_fullsized":"2023-10-06T11:01:03.590591+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:38.639023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.579634+0000","last_change":"2023-10-06T10:58:56.332184+0000","last_active":"2023-10-06T11:01:03.579634+0000","last_peered":"2023-10-06T11:01:03.579634+0000","last_clean":"2023-10-06T11:01:03.579634+0000","last_became_active":"2023-10-06T10:58:56.331830+0000","last_became_peered":"2023-10-06T10:58:56.331830+0000","last_unstale":"2023-10-06T11:01:03.579634+0000","last_undegraded":"2023-10-06T11:01:03.579634+0000","last_fullsized":"2023-10-06T11:01:03.579634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:54:02.320834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625973+0000","last_change":"2023-10-06T11:01:04.625973+0000","last_active":"2023-10-06T11:01:04.625973+0000","last_peered":"2023-10-06T11:01:04.625973+0000","last_clean":"2023-10-06T11:01:04.625973+0000","last_became_active":"2023-10-06T11:01:04.625529+0000","last_became_peered":"2023-10-06T11:01:04.625529+0000","last_unstale":"2023-10-06T11:01:04.625973+0000","last_undegraded":"2023-10-06T11:01:04.625973+0000","last_fullsized":"2023-10-06T11:01:04.625973+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:51:10.704038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.592168+0000","last_change":"2023-10-06T11:01:03.589832+0000","last_active":"2023-10-06T11:01:03.592168+0000","last_peered":"2023-10-06T11:01:03.592168+0000","last_clean":"2023-10-06T11:01:03.592168+0000","last_became_active":"2023-10-06T11:01:03.589484+0000","last_became_peered":"2023-10-06T11:01:03.589484+0000","last_unstale":"2023-10-06T11:01:03.592168+0000","last_undegraded":"2023-10-06T11:01:03.592168+0000","last_fullsized":"2023-10-06T11:01:03.592168+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.256071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":42,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.593939+0000","last_change":"2023-10-06T10:58:56.331654+0000","last_active":"2023-10-06T11:01:03.593939+0000","last_peered":"2023-10-06T11:01:03.593939+0000","last_clean":"2023-10-06T11:01:03.593939+0000","last_became_active":"2023-10-06T10:58:56.331345+0000","last_became_peered":"2023-10-06T10:58:56.331345+0000","last_unstale":"2023-10-06T11:01:03.593939+0000","last_undegraded":"2023-10-06T11:01:03.593939+0000","last_fullsized":"2023-10-06T11:01:03.593939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.600937+0000","last_change":"2023-10-06T11:01:04.600937+0000","last_active":"2023-10-06T11:01:04.600937+0000","last_peered":"2023-10-06T11:01:04.600937+0000","last_clean":"2023-10-06T11:01:04.600937+0000","last_became_active":"2023-10-06T11:01:04.600319+0000","last_became_peered":"2023-10-06T11:01:04.600319+0000","last_unstale":"2023-10-06T11:01:04.600937+0000","last_undegraded":"2023-10-06T11:01:04.600937+0000","last_fullsized":"2023-10-06T11:01:04.600937+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:52:03.611174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"56'2","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.615688+0000","last_change":"2023-10-06T11:01:03.599075+0000","last_active":"2023-10-06T11:01:04.615688+0000","last_peered":"2023-10-06T11:01:04.615688+0000","last_clean":"2023-10-06T11:01:04.615688+0000","last_became_active":"2023-10-06T11:01:03.598779+0000","last_became_peered":"2023-10-06T11:01:03.598779+0000","last_unstale":"2023-10-06T11:01:04.615688+0000","last_undegraded":"2023-10-06T11:01:04.615688+0000","last_fullsized":"2023-10-06T11:01:04.615688+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:37.333723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":42,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.578923+0000","last_change":"2023-10-06T10:58:56.331650+0000","last_active":"2023-10-06T11:01:03.578923+0000","last_peered":"2023-10-06T11:01:03.578923+0000","last_clean":"2023-10-06T11:01:03.578923+0000","last_became_active":"2023-10-06T10:58:56.331344+0000","last_became_peered":"2023-10-06T10:58:56.331344+0000","last_unstale":"2023-10-06T11:01:03.578923+0000","last_undegraded":"2023-10-06T11:01:03.578923+0000","last_fullsized":"2023-10-06T11:01:03.578923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:45.584545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.614659+0000","last_change":"2023-10-06T11:01:04.614659+0000","last_active":"2023-10-06T11:01:04.614659+0000","last_peered":"2023-10-06T11:01:04.614659+0000","last_clean":"2023-10-06T11:01:04.614659+0000","last_became_active":"2023-10-06T11:01:04.614345+0000","last_became_peered":"2023-10-06T11:01:04.614345+0000","last_unstale":"2023-10-06T11:01:04.614659+0000","last_undegraded":"2023-10-06T11:01:04.614659+0000","last_fullsized":"2023-10-06T11:01:04.614659+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:03.158331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"56'1","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.601780+0000","last_change":"2023-10-06T11:01:03.596491+0000","last_active":"2023-10-06T11:01:04.601780+0000","last_peered":"2023-10-06T11:01:04.601780+0000","last_clean":"2023-10-06T11:01:04.601780+0000","last_became_active":"2023-10-06T11:01:03.596150+0000","last_became_peered":"2023-10-06T11:01:03.596150+0000","last_unstale":"2023-10-06T11:01:04.601780+0000","last_undegraded":"2023-10-06T11:01:04.601780+0000","last_fullsized":"2023-10-06T11:01:04.601780+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:51:23.963477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":42,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.578955+0000","last_change":"2023-10-06T10:58:56.326315+0000","last_active":"2023-10-06T11:01:03.578955+0000","last_peered":"2023-10-06T11:01:03.578955+0000","last_clean":"2023-10-06T11:01:03.578955+0000","last_became_active":"2023-10-06T10:58:56.325897+0000","last_became_peered":"2023-10-06T10:58:56.325897+0000","last_unstale":"2023-10-06T11:01:03.578955+0000","last_undegraded":"2023-10-06T11:01:03.578955+0000","last_fullsized":"2023-10-06T11:01:03.578955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":897108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.62},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.46000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.374},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77800000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66900000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.47999999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.47199999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.60099999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.69199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":305762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79200000000000004,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.621,"15min":0.61599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.435}]},{"osd":1,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.40999999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":1.036,"15min":1.036},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.72299999999999998,"5min":1.274,"15min":1.274},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.40500000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77700000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86799999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.249,"15min":0.249},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.36399999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84799999999999998,"5min":0.873,"15min":0.873},"last":0.64200000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82299999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.49099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83299999999999996,"5min":1.006,"15min":1.006},"last":0.65400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298552,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073288,"statfs":{"total":96636764160,"available":96331046912,"internally_reserved":0,"allocated":1294336,"data_stored":906816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.379,"15min":0.38100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56000000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.34300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44,"15min":0.441},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.436},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64700000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.438,"15min":0.438},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.32400000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93100000000000005,"5min":1.123,"15min":1.123},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69599999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70599999999999996,"15min":0.70999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":305762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.40699999999999997,"15min":0.41499999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.66600000000000004,"5min":0.746,"15min":0.746},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44,"15min":0.438},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46000000000000002,"15min":0.45300000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.378},{"interface":"front","average":{"1min":0.5,"5min":0.61899999999999999,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.746,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79200000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89500000000000002,"5min":1.002,"15min":1.002},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68400000000000005,"15min":0.68899999999999995},"min":{"1min":0.51400000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.85499999999999998,"5min":1.022,"15min":1.022},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0069999999999999,"5min":1.238,"15min":1.238},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0549999999999999,"5min":2.9540000000000002,"15min":2.9540000000000002},"last":0.623},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71899999999999997,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83299999999999996,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92400000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94799999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.85599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297944,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073896,"statfs":{"total":96636764160,"available":96331669504,"internally_reserved":0,"allocated":671744,"data_stored":314176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.379},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63800000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.432,"15min":0.435},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46000000000000002,"15min":0.46100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.438}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40400000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.66600000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.374,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.036},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0780000000000001,"5min":1.107,"15min":1.107},"last":0.751},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.623}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.47399999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.498,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86599999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.52100000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.65500000000000003,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.2130000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98299999999999998,"5min":1.232,"15min":1.232},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.57699999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.78000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":305762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52600000000000002,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.54700000000000004,"15min":0.57399999999999995},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57199999999999995,"5min":4.617,"15min":4.617},"last":0.33900000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52700000000000002,"15min":0.54700000000000004},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70699999999999996,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.51800000000000002,"15min":0.53100000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.59799999999999998,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.441}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.68899999999999995,"15min":0.72499999999999998},"min":{"1min":0.36499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.61299999999999999,"5min":6.4400000000000004,"15min":6.4400000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.72199999999999998,"15min":0.75800000000000001},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66900000000000004,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.74299999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.83699999999999997,"15min":0.86799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92500000000000004,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90900000000000003,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.65400000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.81499999999999995,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.016,"5min":4.4470000000000001,"15min":4.4470000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73499999999999999,"15min":0.748},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85899999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.55200000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.70599999999999996,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88400000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.87,"15min":0.89400000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95899999999999996,"5min":4.4130000000000003,"15min":4.4130000000000003},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":306740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88200000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.60899999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.748,"5min":5.476,"15min":5.476},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.44900000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.58099999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88100000000000001,"5min":1.978,"15min":1.978},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.36399999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.46200000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.58499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.495}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":305762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.77100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.42799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76700000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.75600000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78200000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.745}]},{"osd":3,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78300000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.81999999999999995}]},{"osd":4,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77100000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.438},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.629,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48099999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63300000000000001,"15min":0.64000000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67000000000000004,"15min":0.68000000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.73899999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:01:08.792 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:01:08.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.958+0000 7f83a45b3700 1 Processor -- start 2023-10-06T11:01:08.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.958+0000 7f83a45b3700 1 -- start start 2023-10-06T11:01:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a45b3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f839c068100 0x7f839c0a6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a45b3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f839c0ac7f0 0x7f839c0a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a45b3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839c0b0250 con 0x7f839c159360 2023-10-06T11:01:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a45b3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839c0aeba0 con 0x7f839c068100 2023-10-06T11:01:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a45b3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839c159730 con 0x7f839c0ac7f0 2023-10-06T11:01:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a1b4e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f839c068100 0x7f839c0a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a234f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f839c159360 0x7f839c0afb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42700/0 (socket says 172.21.15.7:42700) 2023-10-06T11:01:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a234f700 1 -- 172.21.15.7:0/1222112826 learned_addr learned my addr 172.21.15.7:0/1222112826 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a2b50700 1 --2- 172.21.15.7:0/1222112826 >> v2:172.21.15.50:3300/0 conn(0x7f839c0ac7f0 0x7f839c0a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a1b4e700 1 -- 172.21.15.7:0/1222112826 >> v2:172.21.15.50:3300/0 conn(0x7f839c0ac7f0 msgr2=0x7f839c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:08.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a1b4e700 1 --2- 172.21.15.7:0/1222112826 >> v2:172.21.15.50:3300/0 conn(0x7f839c0ac7f0 0x7f839c0a6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a1b4e700 1 -- 172.21.15.7:0/1222112826 >> v1:172.21.15.7:6789/0 conn(0x7f839c159360 legacy=0x7f839c0afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a1b4e700 1 -- 172.21.15.7:0/1222112826 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c0ae270 con 0x7f839c068100 2023-10-06T11:01:08.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a134d700 1 -- 172.21.15.7:0/1222112826 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127913355 0 0) 0x7f8398001110 con 0x7f839c159360 2023-10-06T11:01:08.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.959+0000 7f83a1b4e700 1 --2- 172.21.15.7:0/1222112826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f839c068100 0x7f839c0a6980 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f839c06fc90 tx=0x7f838c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2cb5a951e35088 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:08.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.960+0000 7f83a134d700 1 -- 172.21.15.7:0/1222112826 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c00b6b0 con 0x7f839c068100 2023-10-06T11:01:08.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.960+0000 7f83a134d700 1 -- 172.21.15.7:0/1222112826 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c00b810 con 0x7f839c068100 2023-10-06T11:01:08.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.960+0000 7f83a134d700 1 -- 172.21.15.7:0/1222112826 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c00bbb0 con 0x7f839c068100 2023-10-06T11:01:08.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.960+0000 7f83a45b3700 1 -- 172.21.15.7:0/1222112826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f839c068100 msgr2=0x7f839c0a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.960+0000 7f83a45b3700 1 --2- 172.21.15.7:0/1222112826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f839c068100 0x7f839c0a6980 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f839c06fc90 tx=0x7f838c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.960+0000 7f83a45b3700 1 -- 172.21.15.7:0/1222112826 shutdown_connections 2023-10-06T11:01:08.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.960+0000 7f83a45b3700 1 --2- 172.21.15.7:0/1222112826 >> v2:172.21.15.50:3300/0 conn(0x7f839c0ac7f0 0x7f839c0a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.960+0000 7f83a45b3700 1 --2- 172.21.15.7:0/1222112826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f839c068100 0x7f839c0a6980 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.960+0000 7f83a45b3700 1 -- 172.21.15.7:0/1222112826 >> 172.21.15.7:0/1222112826 conn(0x7f839c095a70 msgr2=0x7f839c0af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:08.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.960+0000 7f83a45b3700 1 -- 172.21.15.7:0/1222112826 shutdown_connections 2023-10-06T11:01:08.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.960+0000 7f83a45b3700 1 -- 172.21.15.7:0/1222112826 wait complete. 2023-10-06T11:01:08.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.961+0000 7f83a45b3700 1 Processor -- start 2023-10-06T11:01:08.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.961+0000 7f83a45b3700 1 -- start start 2023-10-06T11:01:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.962+0000 7f83a45b3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f839c068100 0x7f839c099b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.962+0000 7f83a45b3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f839c0ac7f0 0x7f839c16a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.962+0000 7f83a45b3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f839c159360 0x7f839c15b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.962+0000 7f83a45b3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c09a0c0 con 0x7f839c0ac7f0 2023-10-06T11:01:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.962+0000 7f83a45b3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c151ab0 con 0x7f839c068100 2023-10-06T11:01:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.962+0000 7f83a45b3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839c16d2f0 con 0x7f839c159360 2023-10-06T11:01:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.962+0000 7f83a1b4e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f839c0ac7f0 0x7f839c16a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.962+0000 7f83a1b4e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f839c0ac7f0 0x7f839c16a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60388/0 (socket says 172.21.15.7:60388) 2023-10-06T11:01:08.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.962+0000 7f83a1b4e700 1 -- 172.21.15.7:0/1262083366 learned_addr learned my addr 172.21.15.7:0/1262083366 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:08.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.963+0000 7f83a234f700 1 --2- 172.21.15.7:0/1262083366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f839c068100 0x7f839c099b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.963+0000 7f83a2b50700 1 --2- 172.21.15.7:0/1262083366 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f839c159360 0x7f839c15b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.963+0000 7f83a1b4e700 1 -- 172.21.15.7:0/1262083366 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f839c159360 msgr2=0x7f839c15b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.963+0000 7f83a1b4e700 1 --2- 172.21.15.7:0/1262083366 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f839c159360 0x7f839c15b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.963+0000 7f83a1b4e700 1 -- 172.21.15.7:0/1262083366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f839c068100 msgr2=0x7f839c099b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:08.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.963+0000 7f83a1b4e700 1 --2- 172.21.15.7:0/1262083366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f839c068100 0x7f839c099b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:08.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.963+0000 7f83a1b4e700 1 -- 172.21.15.7:0/1262083366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c009420 con 0x7f839c0ac7f0 2023-10-06T11:01:08.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.963+0000 7f83a1b4e700 1 --2- 172.21.15.7:0/1262083366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f839c0ac7f0 0x7f839c16a390 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f838c0097b0 tx=0x7f838c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:08.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.963+0000 7f83927fc700 1 -- 172.21.15.7:0/1262083366 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c00bb90 con 0x7f839c0ac7f0 2023-10-06T11:01:08.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.963+0000 7f83927fc700 1 -- 172.21.15.7:0/1262083366 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c011420 con 0x7f839c0ac7f0 2023-10-06T11:01:08.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.963+0000 7f83a45b3700 1 -- 172.21.15.7:0/1262083366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839c16d5d0 con 0x7f839c0ac7f0 2023-10-06T11:01:08.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.963+0000 7f83927fc700 1 -- 172.21.15.7:0/1262083366 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c0117e0 con 0x7f839c0ac7f0 2023-10-06T11:01:08.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.963+0000 7f83a45b3700 1 -- 172.21.15.7:0/1262083366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839c16db90 con 0x7f839c0ac7f0 2023-10-06T11:01:08.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.964+0000 7f83a45b3700 1 -- 172.21.15.7:0/1262083366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839c070480 con 0x7f839c0ac7f0 2023-10-06T11:01:08.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.964+0000 7f83927fc700 1 -- 172.21.15.7:0/1262083366 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f838c011bd0 con 0x7f839c0ac7f0 2023-10-06T11:01:08.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.965+0000 7f83927fc700 1 --2- 172.21.15.7:0/1262083366 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8380066f30 0x7f83800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:08.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.965+0000 7f83927fc700 1 -- 172.21.15.7:0/1262083366 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f838c086130 con 0x7f839c0ac7f0 2023-10-06T11:01:08.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.965+0000 7f83a234f700 1 --2- 172.21.15.7:0/1262083366 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8380066f30 0x7f83800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:08.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.965+0000 7f83a234f700 1 --2- 172.21.15.7:0/1262083366 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8380066f30 0x7f83800693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f839800c8f0 tx=0x7f8398009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:08.969+0000 7f83927fc700 1 -- 172.21.15.7:0/1262083366 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f838c053100 con 0x7f839c0ac7f0 2023-10-06T11:01:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.167+0000 7f83a45b3700 1 -- 172.21.15.7:0/1262083366 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f839c0ae550 con 0x7f8380066f30 2023-10-06T11:01:09.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.176+0000 7f83927fc700 1 -- 172.21.15.7:0/1262083366 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311515 (secure 0 0 0) 0x7f839c0ae550 con 0x7f8380066f30 2023-10-06T11:01:09.181 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.180+0000 7f83a45b3700 1 -- 172.21.15.7:0/1262083366 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8380066f30 msgr2=0x7f83800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.180+0000 7f83a45b3700 1 --2- 172.21.15.7:0/1262083366 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8380066f30 0x7f83800693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f839800c8f0 tx=0x7f8398009040 comp rx=0 tx=0).stop 2023-10-06T11:01:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.180+0000 7f83a45b3700 1 -- 172.21.15.7:0/1262083366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f839c0ac7f0 msgr2=0x7f839c16a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.180+0000 7f83a45b3700 1 --2- 172.21.15.7:0/1262083366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f839c0ac7f0 0x7f839c16a390 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f838c0097b0 tx=0x7f838c017000 comp rx=0 tx=0).stop 2023-10-06T11:01:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.180+0000 7f83a45b3700 1 -- 172.21.15.7:0/1262083366 shutdown_connections 2023-10-06T11:01:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.180+0000 7f83a45b3700 1 --2- 172.21.15.7:0/1262083366 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8380066f30 0x7f83800693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.180+0000 7f83a45b3700 1 --2- 172.21.15.7:0/1262083366 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f839c159360 0x7f839c15b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.180+0000 7f83a45b3700 1 --2- 172.21.15.7:0/1262083366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f839c068100 0x7f839c099b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.180+0000 7f83a45b3700 1 --2- 172.21.15.7:0/1262083366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f839c0ac7f0 0x7f839c16a390 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.180+0000 7f83a45b3700 1 -- 172.21.15.7:0/1262083366 >> 172.21.15.7:0/1262083366 conn(0x7f839c095a70 msgr2=0x7f839c0b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:09.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.180+0000 7f83a45b3700 1 -- 172.21.15.7:0/1262083366 shutdown_connections 2023-10-06T11:01:09.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.180+0000 7f83a45b3700 1 -- 172.21.15.7:0/1262083366 wait complete. 2023-10-06T11:01:09.185 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-06T11:01:09.195 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-10-06T11:01:08.000460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384652,"kb_used_data":6348,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590068,"statfs":{"total":773094113280,"available":770652229632,"internally_reserved":0,"allocated":6500352,"data_stored":3647888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.428676"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.616555+0000","last_change":"2023-10-06T11:01:04.616555+0000","last_active":"2023-10-06T11:01:04.616555+0000","last_peered":"2023-10-06T11:01:04.616555+0000","last_clean":"2023-10-06T11:01:04.616555+0000","last_became_active":"2023-10-06T11:01:04.615274+0000","last_became_peered":"2023-10-06T11:01:04.615274+0000","last_unstale":"2023-10-06T11:01:04.616555+0000","last_undegraded":"2023-10-06T11:01:04.616555+0000","last_fullsized":"2023-10-06T11:01:04.616555+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:29.136846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.621536+0000","last_change":"2023-10-06T11:01:04.621536+0000","last_active":"2023-10-06T11:01:04.621536+0000","last_peered":"2023-10-06T11:01:04.621536+0000","last_clean":"2023-10-06T11:01:04.621536+0000","last_became_active":"2023-10-06T11:01:04.621226+0000","last_became_peered":"2023-10-06T11:01:04.621226+0000","last_unstale":"2023-10-06T11:01:04.621536+0000","last_undegraded":"2023-10-06T11:01:04.621536+0000","last_fullsized":"2023-10-06T11:01:04.621536+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:12.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.621468+0000","last_change":"2023-10-06T11:01:04.621468+0000","last_active":"2023-10-06T11:01:04.621468+0000","last_peered":"2023-10-06T11:01:04.621468+0000","last_clean":"2023-10-06T11:01:04.621468+0000","last_became_active":"2023-10-06T11:01:04.621221+0000","last_became_peered":"2023-10-06T11:01:04.621221+0000","last_unstale":"2023-10-06T11:01:04.621468+0000","last_undegraded":"2023-10-06T11:01:04.621468+0000","last_fullsized":"2023-10-06T11:01:04.621468+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:18:38.158140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.621190+0000","last_change":"2023-10-06T11:01:04.621190+0000","last_active":"2023-10-06T11:01:04.621190+0000","last_peered":"2023-10-06T11:01:04.621190+0000","last_clean":"2023-10-06T11:01:04.621190+0000","last_became_active":"2023-10-06T11:01:04.620799+0000","last_became_peered":"2023-10-06T11:01:04.620799+0000","last_unstale":"2023-10-06T11:01:04.621190+0000","last_undegraded":"2023-10-06T11:01:04.621190+0000","last_fullsized":"2023-10-06T11:01:04.621190+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:18.231015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.598053+0000","last_change":"2023-10-06T11:01:04.598053+0000","last_active":"2023-10-06T11:01:04.598053+0000","last_peered":"2023-10-06T11:01:04.598053+0000","last_clean":"2023-10-06T11:01:04.598053+0000","last_became_active":"2023-10-06T11:01:04.597673+0000","last_became_peered":"2023-10-06T11:01:04.597673+0000","last_unstale":"2023-10-06T11:01:04.598053+0000","last_undegraded":"2023-10-06T11:01:04.598053+0000","last_fullsized":"2023-10-06T11:01:04.598053+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:51:24.968480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.624819+0000","last_change":"2023-10-06T11:01:04.624819+0000","last_active":"2023-10-06T11:01:04.624819+0000","last_peered":"2023-10-06T11:01:04.624819+0000","last_clean":"2023-10-06T11:01:04.624819+0000","last_became_active":"2023-10-06T11:01:04.624419+0000","last_became_peered":"2023-10-06T11:01:04.624419+0000","last_unstale":"2023-10-06T11:01:04.624819+0000","last_undegraded":"2023-10-06T11:01:04.624819+0000","last_fullsized":"2023-10-06T11:01:04.624819+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:15.432056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.614608+0000","last_change":"2023-10-06T11:01:04.614608+0000","last_active":"2023-10-06T11:01:04.614608+0000","last_peered":"2023-10-06T11:01:04.614608+0000","last_clean":"2023-10-06T11:01:04.614608+0000","last_became_active":"2023-10-06T11:01:04.614319+0000","last_became_peered":"2023-10-06T11:01:04.614319+0000","last_unstale":"2023-10-06T11:01:04.614608+0000","last_undegraded":"2023-10-06T11:01:04.614608+0000","last_fullsized":"2023-10-06T11:01:04.614608+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:55.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.616407+0000","last_change":"2023-10-06T11:01:04.616407+0000","last_active":"2023-10-06T11:01:04.616407+0000","last_peered":"2023-10-06T11:01:04.616407+0000","last_clean":"2023-10-06T11:01:04.616407+0000","last_became_active":"2023-10-06T11:01:04.615290+0000","last_became_peered":"2023-10-06T11:01:04.615290+0000","last_unstale":"2023-10-06T11:01:04.616407+0000","last_undegraded":"2023-10-06T11:01:04.616407+0000","last_fullsized":"2023-10-06T11:01:04.616407+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:40.567842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.615084+0000","last_change":"2023-10-06T11:01:04.615084+0000","last_active":"2023-10-06T11:01:04.615084+0000","last_peered":"2023-10-06T11:01:04.615084+0000","last_clean":"2023-10-06T11:01:04.615084+0000","last_became_active":"2023-10-06T11:01:04.614809+0000","last_became_peered":"2023-10-06T11:01:04.614809+0000","last_unstale":"2023-10-06T11:01:04.615084+0000","last_undegraded":"2023-10-06T11:01:04.615084+0000","last_fullsized":"2023-10-06T11:01:04.615084+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:46.225998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625602+0000","last_change":"2023-10-06T11:01:04.625602+0000","last_active":"2023-10-06T11:01:04.625602+0000","last_peered":"2023-10-06T11:01:04.625602+0000","last_clean":"2023-10-06T11:01:04.625602+0000","last_became_active":"2023-10-06T11:01:04.625173+0000","last_became_peered":"2023-10-06T11:01:04.625173+0000","last_unstale":"2023-10-06T11:01:04.625602+0000","last_undegraded":"2023-10-06T11:01:04.625602+0000","last_fullsized":"2023-10-06T11:01:04.625602+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:20:15.098690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.603109+0000","last_change":"2023-10-06T11:01:04.603109+0000","last_active":"2023-10-06T11:01:04.603109+0000","last_peered":"2023-10-06T11:01:04.603109+0000","last_clean":"2023-10-06T11:01:04.603109+0000","last_became_active":"2023-10-06T11:01:04.602837+0000","last_became_peered":"2023-10-06T11:01:04.602837+0000","last_unstale":"2023-10-06T11:01:04.603109+0000","last_undegraded":"2023-10-06T11:01:04.603109+0000","last_fullsized":"2023-10-06T11:01:04.603109+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:04.741719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.611348+0000","last_change":"2023-10-06T11:01:04.611348+0000","last_active":"2023-10-06T11:01:04.611348+0000","last_peered":"2023-10-06T11:01:04.611348+0000","last_clean":"2023-10-06T11:01:04.611348+0000","last_became_active":"2023-10-06T11:01:04.611054+0000","last_became_peered":"2023-10-06T11:01:04.611054+0000","last_unstale":"2023-10-06T11:01:04.611348+0000","last_undegraded":"2023-10-06T11:01:04.611348+0000","last_fullsized":"2023-10-06T11:01:04.611348+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:12:05.467380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.615081+0000","last_change":"2023-10-06T11:01:04.615081+0000","last_active":"2023-10-06T11:01:04.615081+0000","last_peered":"2023-10-06T11:01:04.615081+0000","last_clean":"2023-10-06T11:01:04.615081+0000","last_became_active":"2023-10-06T11:01:04.614779+0000","last_became_peered":"2023-10-06T11:01:04.614779+0000","last_unstale":"2023-10-06T11:01:04.615081+0000","last_undegraded":"2023-10-06T11:01:04.615081+0000","last_fullsized":"2023-10-06T11:01:04.615081+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:53.358655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625412+0000","last_change":"2023-10-06T11:01:04.625412+0000","last_active":"2023-10-06T11:01:04.625412+0000","last_peered":"2023-10-06T11:01:04.625412+0000","last_clean":"2023-10-06T11:01:04.625412+0000","last_became_active":"2023-10-06T11:01:04.625052+0000","last_became_peered":"2023-10-06T11:01:04.625052+0000","last_unstale":"2023-10-06T11:01:04.625412+0000","last_undegraded":"2023-10-06T11:01:04.625412+0000","last_fullsized":"2023-10-06T11:01:04.625412+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:10.261073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625735+0000","last_change":"2023-10-06T11:01:04.625735+0000","last_active":"2023-10-06T11:01:04.625735+0000","last_peered":"2023-10-06T11:01:04.625735+0000","last_clean":"2023-10-06T11:01:04.625735+0000","last_became_active":"2023-10-06T11:01:04.625446+0000","last_became_peered":"2023-10-06T11:01:04.625446+0000","last_unstale":"2023-10-06T11:01:04.625735+0000","last_undegraded":"2023-10-06T11:01:04.625735+0000","last_fullsized":"2023-10-06T11:01:04.625735+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:40.764334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.607429+0000","last_change":"2023-10-06T11:01:04.607429+0000","last_active":"2023-10-06T11:01:04.607429+0000","last_peered":"2023-10-06T11:01:04.607429+0000","last_clean":"2023-10-06T11:01:04.607429+0000","last_became_active":"2023-10-06T11:01:04.607077+0000","last_became_peered":"2023-10-06T11:01:04.607077+0000","last_unstale":"2023-10-06T11:01:04.607429+0000","last_undegraded":"2023-10-06T11:01:04.607429+0000","last_fullsized":"2023-10-06T11:01:04.607429+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:13.225100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.601752+0000","last_change":"2023-10-06T11:01:04.601752+0000","last_active":"2023-10-06T11:01:04.601752+0000","last_peered":"2023-10-06T11:01:04.601752+0000","last_clean":"2023-10-06T11:01:04.601752+0000","last_became_active":"2023-10-06T11:01:04.601432+0000","last_became_peered":"2023-10-06T11:01:04.601432+0000","last_unstale":"2023-10-06T11:01:04.601752+0000","last_undegraded":"2023-10-06T11:01:04.601752+0000","last_fullsized":"2023-10-06T11:01:04.601752+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:19.125745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.619947+0000","last_change":"2023-10-06T11:01:04.619947+0000","last_active":"2023-10-06T11:01:04.619947+0000","last_peered":"2023-10-06T11:01:04.619947+0000","last_clean":"2023-10-06T11:01:04.619947+0000","last_became_active":"2023-10-06T11:01:04.619674+0000","last_became_peered":"2023-10-06T11:01:04.619674+0000","last_unstale":"2023-10-06T11:01:04.619947+0000","last_undegraded":"2023-10-06T11:01:04.619947+0000","last_fullsized":"2023-10-06T11:01:04.619947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:47:02.600368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.605300+0000","last_change":"2023-10-06T11:01:04.605300+0000","last_active":"2023-10-06T11:01:04.605300+0000","last_peered":"2023-10-06T11:01:04.605300+0000","last_clean":"2023-10-06T11:01:04.605300+0000","last_became_active":"2023-10-06T11:01:04.604968+0000","last_became_peered":"2023-10-06T11:01:04.604968+0000","last_unstale":"2023-10-06T11:01:04.605300+0000","last_undegraded":"2023-10-06T11:01:04.605300+0000","last_fullsized":"2023-10-06T11:01:04.605300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:29.136846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.606579+0000","last_change":"2023-10-06T11:01:04.606579+0000","last_active":"2023-10-06T11:01:04.606579+0000","last_peered":"2023-10-06T11:01:04.606579+0000","last_clean":"2023-10-06T11:01:04.606579+0000","last_became_active":"2023-10-06T11:01:04.605414+0000","last_became_peered":"2023-10-06T11:01:04.605414+0000","last_unstale":"2023-10-06T11:01:04.606579+0000","last_undegraded":"2023-10-06T11:01:04.606579+0000","last_fullsized":"2023-10-06T11:01:04.606579+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:19.919031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.626072+0000","last_change":"2023-10-06T11:01:04.626072+0000","last_active":"2023-10-06T11:01:04.626072+0000","last_peered":"2023-10-06T11:01:04.626072+0000","last_clean":"2023-10-06T11:01:04.626072+0000","last_became_active":"2023-10-06T11:01:04.625599+0000","last_became_peered":"2023-10-06T11:01:04.625599+0000","last_unstale":"2023-10-06T11:01:04.626072+0000","last_undegraded":"2023-10-06T11:01:04.626072+0000","last_fullsized":"2023-10-06T11:01:04.626072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:39.644026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.614625+0000","last_change":"2023-10-06T11:01:04.614625+0000","last_active":"2023-10-06T11:01:04.614625+0000","last_peered":"2023-10-06T11:01:04.614625+0000","last_clean":"2023-10-06T11:01:04.614625+0000","last_became_active":"2023-10-06T11:01:04.614367+0000","last_became_peered":"2023-10-06T11:01:04.614367+0000","last_unstale":"2023-10-06T11:01:04.614625+0000","last_undegraded":"2023-10-06T11:01:04.614625+0000","last_fullsized":"2023-10-06T11:01:04.614625+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:52.998339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.614012+0000","last_change":"2023-10-06T11:01:04.614012+0000","last_active":"2023-10-06T11:01:04.614012+0000","last_peered":"2023-10-06T11:01:04.614012+0000","last_clean":"2023-10-06T11:01:04.614012+0000","last_became_active":"2023-10-06T11:01:04.613715+0000","last_became_peered":"2023-10-06T11:01:04.613715+0000","last_unstale":"2023-10-06T11:01:04.614012+0000","last_undegraded":"2023-10-06T11:01:04.614012+0000","last_fullsized":"2023-10-06T11:01:04.614012+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:04.741719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.619978+0000","last_change":"2023-10-06T11:01:04.619978+0000","last_active":"2023-10-06T11:01:04.619978+0000","last_peered":"2023-10-06T11:01:04.619978+0000","last_clean":"2023-10-06T11:01:04.619978+0000","last_became_active":"2023-10-06T11:01:04.619648+0000","last_became_peered":"2023-10-06T11:01:04.619648+0000","last_unstale":"2023-10-06T11:01:04.619978+0000","last_undegraded":"2023-10-06T11:01:04.619978+0000","last_fullsized":"2023-10-06T11:01:04.619978+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:02:27.135567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.609040+0000","last_change":"2023-10-06T11:01:04.609040+0000","last_active":"2023-10-06T11:01:04.609040+0000","last_peered":"2023-10-06T11:01:04.609040+0000","last_clean":"2023-10-06T11:01:04.609040+0000","last_became_active":"2023-10-06T11:01:04.608533+0000","last_became_peered":"2023-10-06T11:01:04.608533+0000","last_unstale":"2023-10-06T11:01:04.609040+0000","last_undegraded":"2023-10-06T11:01:04.609040+0000","last_fullsized":"2023-10-06T11:01:04.609040+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:52.079098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.606485+0000","last_change":"2023-10-06T11:01:04.606485+0000","last_active":"2023-10-06T11:01:04.606485+0000","last_peered":"2023-10-06T11:01:04.606485+0000","last_clean":"2023-10-06T11:01:04.606485+0000","last_became_active":"2023-10-06T11:01:04.606206+0000","last_became_peered":"2023-10-06T11:01:04.606206+0000","last_unstale":"2023-10-06T11:01:04.606485+0000","last_undegraded":"2023-10-06T11:01:04.606485+0000","last_fullsized":"2023-10-06T11:01:04.606485+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:54.059762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.605087+0000","last_change":"2023-10-06T11:01:04.605087+0000","last_active":"2023-10-06T11:01:04.605087+0000","last_peered":"2023-10-06T11:01:04.605087+0000","last_clean":"2023-10-06T11:01:04.605087+0000","last_became_active":"2023-10-06T11:01:04.604755+0000","last_became_peered":"2023-10-06T11:01:04.604755+0000","last_unstale":"2023-10-06T11:01:04.605087+0000","last_undegraded":"2023-10-06T11:01:04.605087+0000","last_fullsized":"2023-10-06T11:01:04.605087+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:52.998339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.616829+0000","last_change":"2023-10-06T11:01:04.616829+0000","last_active":"2023-10-06T11:01:04.616829+0000","last_peered":"2023-10-06T11:01:04.616829+0000","last_clean":"2023-10-06T11:01:04.616829+0000","last_became_active":"2023-10-06T11:01:04.616293+0000","last_became_peered":"2023-10-06T11:01:04.616293+0000","last_unstale":"2023-10-06T11:01:04.616829+0000","last_undegraded":"2023-10-06T11:01:04.616829+0000","last_fullsized":"2023-10-06T11:01:04.616829+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:38.338726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.615030+0000","last_change":"2023-10-06T11:01:04.615030+0000","last_active":"2023-10-06T11:01:04.615030+0000","last_peered":"2023-10-06T11:01:04.615030+0000","last_clean":"2023-10-06T11:01:04.615030+0000","last_became_active":"2023-10-06T11:01:04.614746+0000","last_became_peered":"2023-10-06T11:01:04.614746+0000","last_unstale":"2023-10-06T11:01:04.615030+0000","last_undegraded":"2023-10-06T11:01:04.615030+0000","last_fullsized":"2023-10-06T11:01:04.615030+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:07.890468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.611374+0000","last_change":"2023-10-06T11:01:04.611374+0000","last_active":"2023-10-06T11:01:04.611374+0000","last_peered":"2023-10-06T11:01:04.611374+0000","last_clean":"2023-10-06T11:01:04.611374+0000","last_became_active":"2023-10-06T11:01:04.611087+0000","last_became_peered":"2023-10-06T11:01:04.611087+0000","last_unstale":"2023-10-06T11:01:04.611374+0000","last_undegraded":"2023-10-06T11:01:04.611374+0000","last_fullsized":"2023-10-06T11:01:04.611374+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:02.676672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.605850+0000","last_change":"2023-10-06T11:01:04.605850+0000","last_active":"2023-10-06T11:01:04.605850+0000","last_peered":"2023-10-06T11:01:04.605850+0000","last_clean":"2023-10-06T11:01:04.605850+0000","last_became_active":"2023-10-06T11:01:04.605571+0000","last_became_peered":"2023-10-06T11:01:04.605571+0000","last_unstale":"2023-10-06T11:01:04.605850+0000","last_undegraded":"2023-10-06T11:01:04.605850+0000","last_fullsized":"2023-10-06T11:01:04.605850+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:41:37.034924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.608536+0000","last_change":"2023-10-06T11:01:04.608536+0000","last_active":"2023-10-06T11:01:04.608536+0000","last_peered":"2023-10-06T11:01:04.608536+0000","last_clean":"2023-10-06T11:01:04.608536+0000","last_became_active":"2023-10-06T11:01:04.608237+0000","last_became_peered":"2023-10-06T11:01:04.608237+0000","last_unstale":"2023-10-06T11:01:04.608536+0000","last_undegraded":"2023-10-06T11:01:04.608536+0000","last_fullsized":"2023-10-06T11:01:04.608536+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:18.231015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.605806+0000","last_change":"2023-10-06T11:01:04.605806+0000","last_active":"2023-10-06T11:01:04.605806+0000","last_peered":"2023-10-06T11:01:04.605806+0000","last_clean":"2023-10-06T11:01:04.605806+0000","last_became_active":"2023-10-06T11:01:04.605533+0000","last_became_peered":"2023-10-06T11:01:04.605533+0000","last_unstale":"2023-10-06T11:01:04.605806+0000","last_undegraded":"2023-10-06T11:01:04.605806+0000","last_fullsized":"2023-10-06T11:01:04.605806+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:12.232627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"56'4","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.627441+0000","last_change":"2023-10-06T11:01:03.595107+0000","last_active":"2023-10-06T11:01:04.627441+0000","last_peered":"2023-10-06T11:01:04.627441+0000","last_clean":"2023-10-06T11:01:04.627441+0000","last_became_active":"2023-10-06T11:01:03.591790+0000","last_became_peered":"2023-10-06T11:01:03.591790+0000","last_unstale":"2023-10-06T11:01:04.627441+0000","last_undegraded":"2023-10-06T11:01:04.627441+0000","last_fullsized":"2023-10-06T11:01:04.627441+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:50:30.877453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.598904+0000","last_change":"2023-10-06T11:01:04.598904+0000","last_active":"2023-10-06T11:01:04.598904+0000","last_peered":"2023-10-06T11:01:04.598904+0000","last_clean":"2023-10-06T11:01:04.598904+0000","last_became_active":"2023-10-06T11:01:04.598639+0000","last_became_peered":"2023-10-06T11:01:04.598639+0000","last_unstale":"2023-10-06T11:01:04.598904+0000","last_undegraded":"2023-10-06T11:01:04.598904+0000","last_fullsized":"2023-10-06T11:01:04.598904+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:52.079098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"56'1","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.599059+0000","last_change":"2023-10-06T11:01:03.589846+0000","last_active":"2023-10-06T11:01:04.599059+0000","last_peered":"2023-10-06T11:01:04.599059+0000","last_clean":"2023-10-06T11:01:04.599059+0000","last_became_active":"2023-10-06T11:01:03.589564+0000","last_became_peered":"2023-10-06T11:01:03.589564+0000","last_unstale":"2023-10-06T11:01:04.599059+0000","last_undegraded":"2023-10-06T11:01:04.599059+0000","last_fullsized":"2023-10-06T11:01:04.599059+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:02:26.130564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.619252+0000","last_change":"2023-10-06T11:01:04.619252+0000","last_active":"2023-10-06T11:01:04.619252+0000","last_peered":"2023-10-06T11:01:04.619252+0000","last_clean":"2023-10-06T11:01:04.619252+0000","last_became_active":"2023-10-06T11:01:04.618833+0000","last_became_peered":"2023-10-06T11:01:04.618833+0000","last_unstale":"2023-10-06T11:01:04.619252+0000","last_undegraded":"2023-10-06T11:01:04.619252+0000","last_fullsized":"2023-10-06T11:01:04.619252+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:12:05.467380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"56'2","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.620675+0000","last_change":"2023-10-06T11:01:03.595699+0000","last_active":"2023-10-06T11:01:04.620675+0000","last_peered":"2023-10-06T11:01:04.620675+0000","last_clean":"2023-10-06T11:01:04.620675+0000","last_became_active":"2023-10-06T11:01:03.595395+0000","last_became_peered":"2023-10-06T11:01:03.595395+0000","last_unstale":"2023-10-06T11:01:04.620675+0000","last_undegraded":"2023-10-06T11:01:04.620675+0000","last_fullsized":"2023-10-06T11:01:04.620675+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:06.885465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625770+0000","last_change":"2023-10-06T11:01:04.625770+0000","last_active":"2023-10-06T11:01:04.625770+0000","last_peered":"2023-10-06T11:01:04.625770+0000","last_clean":"2023-10-06T11:01:04.625770+0000","last_became_active":"2023-10-06T11:01:04.625354+0000","last_became_peered":"2023-10-06T11:01:04.625354+0000","last_unstale":"2023-10-06T11:01:04.625770+0000","last_undegraded":"2023-10-06T11:01:04.625770+0000","last_fullsized":"2023-10-06T11:01:04.625770+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:03:28.313489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"56'2","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.619661+0000","last_change":"2023-10-06T11:01:03.589480+0000","last_active":"2023-10-06T11:01:04.619661+0000","last_peered":"2023-10-06T11:01:04.619661+0000","last_clean":"2023-10-06T11:01:04.619661+0000","last_became_active":"2023-10-06T11:01:03.588938+0000","last_became_peered":"2023-10-06T11:01:03.588938+0000","last_unstale":"2023-10-06T11:01:04.619661+0000","last_undegraded":"2023-10-06T11:01:04.619661+0000","last_fullsized":"2023-10-06T11:01:04.619661+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:20:14.093687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.621965+0000","last_change":"2023-10-06T11:01:04.621965+0000","last_active":"2023-10-06T11:01:04.621965+0000","last_peered":"2023-10-06T11:01:04.621965+0000","last_clean":"2023-10-06T11:01:04.621965+0000","last_became_active":"2023-10-06T11:01:04.621480+0000","last_became_peered":"2023-10-06T11:01:04.621480+0000","last_unstale":"2023-10-06T11:01:04.621965+0000","last_undegraded":"2023-10-06T11:01:04.621965+0000","last_fullsized":"2023-10-06T11:01:04.621965+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:40.547479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"56'1","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.600385+0000","last_change":"2023-10-06T11:01:03.588422+0000","last_active":"2023-10-06T11:01:04.600385+0000","last_peered":"2023-10-06T11:01:04.600385+0000","last_clean":"2023-10-06T11:01:04.600385+0000","last_became_active":"2023-10-06T11:01:03.588112+0000","last_became_peered":"2023-10-06T11:01:03.588112+0000","last_unstale":"2023-10-06T11:01:04.600385+0000","last_undegraded":"2023-10-06T11:01:04.600385+0000","last_fullsized":"2023-10-06T11:01:04.600385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:01.671669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.600801+0000","last_change":"2023-10-06T11:01:04.600801+0000","last_active":"2023-10-06T11:01:04.600801+0000","last_peered":"2023-10-06T11:01:04.600801+0000","last_clean":"2023-10-06T11:01:04.600801+0000","last_became_active":"2023-10-06T11:01:04.600538+0000","last_became_peered":"2023-10-06T11:01:04.600538+0000","last_unstale":"2023-10-06T11:01:04.600801+0000","last_undegraded":"2023-10-06T11:01:04.600801+0000","last_fullsized":"2023-10-06T11:01:04.600801+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:35.138926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"56'1","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.600994+0000","last_change":"2023-10-06T11:01:03.586584+0000","last_active":"2023-10-06T11:01:04.600994+0000","last_peered":"2023-10-06T11:01:04.600994+0000","last_clean":"2023-10-06T11:01:04.600994+0000","last_became_active":"2023-10-06T11:01:03.586013+0000","last_became_peered":"2023-10-06T11:01:03.586013+0000","last_unstale":"2023-10-06T11:01:04.600994+0000","last_undegraded":"2023-10-06T11:01:04.600994+0000","last_fullsized":"2023-10-06T11:01:04.600994+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:39.562839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625789+0000","last_change":"2023-10-06T11:01:04.625789+0000","last_active":"2023-10-06T11:01:04.625789+0000","last_peered":"2023-10-06T11:01:04.625789+0000","last_clean":"2023-10-06T11:01:04.625789+0000","last_became_active":"2023-10-06T11:01:04.625168+0000","last_became_peered":"2023-10-06T11:01:04.625168+0000","last_unstale":"2023-10-06T11:01:04.625789+0000","last_undegraded":"2023-10-06T11:01:04.625789+0000","last_fullsized":"2023-10-06T11:01:04.625789+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:53:01.328898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.593116+0000","last_change":"2023-10-06T11:01:03.592023+0000","last_active":"2023-10-06T11:01:03.593116+0000","last_peered":"2023-10-06T11:01:03.593116+0000","last_clean":"2023-10-06T11:01:03.593116+0000","last_became_active":"2023-10-06T11:01:03.591585+0000","last_became_peered":"2023-10-06T11:01:03.591585+0000","last_unstale":"2023-10-06T11:01:03.593116+0000","last_undegraded":"2023-10-06T11:01:03.593116+0000","last_fullsized":"2023-10-06T11:01:03.593116+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:53.054759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.613798+0000","last_change":"2023-10-06T11:01:04.613798+0000","last_active":"2023-10-06T11:01:04.613798+0000","last_peered":"2023-10-06T11:01:04.613798+0000","last_clean":"2023-10-06T11:01:04.613798+0000","last_became_active":"2023-10-06T11:01:04.613513+0000","last_became_peered":"2023-10-06T11:01:04.613513+0000","last_unstale":"2023-10-06T11:01:04.613798+0000","last_undegraded":"2023-10-06T11:01:04.613798+0000","last_fullsized":"2023-10-06T11:01:04.613798+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:31.345664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.593715+0000","last_change":"2023-10-06T11:01:03.590501+0000","last_active":"2023-10-06T11:01:03.593715+0000","last_peered":"2023-10-06T11:01:03.593715+0000","last_clean":"2023-10-06T11:01:03.593715+0000","last_became_active":"2023-10-06T11:01:03.590205+0000","last_became_peered":"2023-10-06T11:01:03.590205+0000","last_unstale":"2023-10-06T11:01:03.593715+0000","last_undegraded":"2023-10-06T11:01:03.593715+0000","last_fullsized":"2023-10-06T11:01:03.593715+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:49:07.404016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.612829+0000","last_change":"2023-10-06T11:01:04.612829+0000","last_active":"2023-10-06T11:01:04.612829+0000","last_peered":"2023-10-06T11:01:04.612829+0000","last_clean":"2023-10-06T11:01:04.612829+0000","last_became_active":"2023-10-06T11:01:04.612526+0000","last_became_peered":"2023-10-06T11:01:04.612526+0000","last_unstale":"2023-10-06T11:01:04.612829+0000","last_undegraded":"2023-10-06T11:01:04.612829+0000","last_fullsized":"2023-10-06T11:01:04.612829+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:16.006475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.599714+0000","last_change":"2023-10-06T11:01:03.598202+0000","last_active":"2023-10-06T11:01:03.599714+0000","last_peered":"2023-10-06T11:01:03.599714+0000","last_clean":"2023-10-06T11:01:03.599714+0000","last_became_active":"2023-10-06T11:01:03.597917+0000","last_became_peered":"2023-10-06T11:01:03.597917+0000","last_unstale":"2023-10-06T11:01:03.599714+0000","last_undegraded":"2023-10-06T11:01:03.599714+0000","last_fullsized":"2023-10-06T11:01:03.599714+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:15.001472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.606414+0000","last_change":"2023-10-06T11:01:04.606414+0000","last_active":"2023-10-06T11:01:04.606414+0000","last_peered":"2023-10-06T11:01:04.606414+0000","last_clean":"2023-10-06T11:01:04.606414+0000","last_became_active":"2023-10-06T11:01:04.606077+0000","last_became_peered":"2023-10-06T11:01:04.606077+0000","last_unstale":"2023-10-06T11:01:04.606414+0000","last_undegraded":"2023-10-06T11:01:04.606414+0000","last_fullsized":"2023-10-06T11:01:04.606414+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:40.006889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.598778+0000","last_change":"2023-10-06T11:01:03.595649+0000","last_active":"2023-10-06T11:01:03.598778+0000","last_peered":"2023-10-06T11:01:03.598778+0000","last_clean":"2023-10-06T11:01:03.598778+0000","last_became_active":"2023-10-06T11:01:03.595288+0000","last_became_peered":"2023-10-06T11:01:03.595288+0000","last_unstale":"2023-10-06T11:01:03.598778+0000","last_undegraded":"2023-10-06T11:01:03.598778+0000","last_fullsized":"2023-10-06T11:01:03.598778+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:03:27.308486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.607435+0000","last_change":"2023-10-06T11:01:04.607435+0000","last_active":"2023-10-06T11:01:04.607435+0000","last_peered":"2023-10-06T11:01:04.607435+0000","last_clean":"2023-10-06T11:01:04.607435+0000","last_became_active":"2023-10-06T11:01:04.606805+0000","last_became_peered":"2023-10-06T11:01:04.606805+0000","last_unstale":"2023-10-06T11:01:04.607435+0000","last_undegraded":"2023-10-06T11:01:04.607435+0000","last_fullsized":"2023-10-06T11:01:04.607435+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:15:53.490409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"56'3","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625114+0000","last_change":"2023-10-06T11:01:03.592359+0000","last_active":"2023-10-06T11:01:04.625114+0000","last_peered":"2023-10-06T11:01:04.625114+0000","last_clean":"2023-10-06T11:01:04.625114+0000","last_became_active":"2023-10-06T11:01:03.592086+0000","last_became_peered":"2023-10-06T11:01:03.592086+0000","last_unstale":"2023-10-06T11:01:04.625114+0000","last_undegraded":"2023-10-06T11:01:04.625114+0000","last_fullsized":"2023-10-06T11:01:04.625114+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:34.133924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.612881+0000","last_change":"2023-10-06T11:01:04.612881+0000","last_active":"2023-10-06T11:01:04.612881+0000","last_peered":"2023-10-06T11:01:04.612881+0000","last_clean":"2023-10-06T11:01:04.612881+0000","last_became_active":"2023-10-06T11:01:04.608693+0000","last_became_peered":"2023-10-06T11:01:04.608693+0000","last_unstale":"2023-10-06T11:01:04.612881+0000","last_undegraded":"2023-10-06T11:01:04.612881+0000","last_fullsized":"2023-10-06T11:01:04.612881+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:31.345664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"56'6","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625543+0000","last_change":"2023-10-06T11:01:03.595201+0000","last_active":"2023-10-06T11:01:04.625543+0000","last_peered":"2023-10-06T11:01:04.625543+0000","last_clean":"2023-10-06T11:01:04.625543+0000","last_became_active":"2023-10-06T11:01:03.594541+0000","last_became_peered":"2023-10-06T11:01:03.594541+0000","last_unstale":"2023-10-06T11:01:04.625543+0000","last_undegraded":"2023-10-06T11:01:04.625543+0000","last_fullsized":"2023-10-06T11:01:04.625543+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:08.802332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.615236+0000","last_change":"2023-10-06T11:01:04.615236+0000","last_active":"2023-10-06T11:01:04.615236+0000","last_peered":"2023-10-06T11:01:04.615236+0000","last_clean":"2023-10-06T11:01:04.615236+0000","last_became_active":"2023-10-06T11:01:04.614964+0000","last_became_peered":"2023-10-06T11:01:04.614964+0000","last_unstale":"2023-10-06T11:01:04.615236+0000","last_undegraded":"2023-10-06T11:01:04.615236+0000","last_fullsized":"2023-10-06T11:01:04.615236+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:19.919031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"56'2","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.615628+0000","last_change":"2023-10-06T11:01:03.591470+0000","last_active":"2023-10-06T11:01:04.615628+0000","last_peered":"2023-10-06T11:01:04.615628+0000","last_clean":"2023-10-06T11:01:04.615628+0000","last_became_active":"2023-10-06T11:01:03.591185+0000","last_became_peered":"2023-10-06T11:01:03.591185+0000","last_unstale":"2023-10-06T11:01:04.615628+0000","last_undegraded":"2023-10-06T11:01:04.615628+0000","last_fullsized":"2023-10-06T11:01:04.615628+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:25.919357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.620458+0000","last_change":"2023-10-06T11:01:04.620458+0000","last_active":"2023-10-06T11:01:04.620458+0000","last_peered":"2023-10-06T11:01:04.620458+0000","last_clean":"2023-10-06T11:01:04.620458+0000","last_became_active":"2023-10-06T11:01:04.620154+0000","last_became_peered":"2023-10-06T11:01:04.620154+0000","last_unstale":"2023-10-06T11:01:04.620458+0000","last_undegraded":"2023-10-06T11:01:04.620458+0000","last_fullsized":"2023-10-06T11:01:04.620458+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:46.225998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.599206+0000","last_change":"2023-10-06T11:01:03.598176+0000","last_active":"2023-10-06T11:01:03.599206+0000","last_peered":"2023-10-06T11:01:03.599206+0000","last_clean":"2023-10-06T11:01:03.599206+0000","last_became_active":"2023-10-06T11:01:03.597314+0000","last_became_peered":"2023-10-06T11:01:03.597314+0000","last_unstale":"2023-10-06T11:01:03.599206+0000","last_undegraded":"2023-10-06T11:01:03.599206+0000","last_fullsized":"2023-10-06T11:01:03.599206+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:11.227624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.605439+0000","last_change":"2023-10-06T11:01:04.605439+0000","last_active":"2023-10-06T11:01:04.605439+0000","last_peered":"2023-10-06T11:01:04.605439+0000","last_clean":"2023-10-06T11:01:04.605439+0000","last_became_active":"2023-10-06T11:01:04.605008+0000","last_became_peered":"2023-10-06T11:01:04.605008+0000","last_unstale":"2023-10-06T11:01:04.605439+0000","last_undegraded":"2023-10-06T11:01:04.605439+0000","last_fullsized":"2023-10-06T11:01:04.605439+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:53:19.485010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.599019+0000","last_change":"2023-10-06T11:01:03.591078+0000","last_active":"2023-10-06T11:01:03.599019+0000","last_peered":"2023-10-06T11:01:03.599019+0000","last_clean":"2023-10-06T11:01:03.599019+0000","last_became_active":"2023-10-06T11:01:03.590777+0000","last_became_peered":"2023-10-06T11:01:03.590777+0000","last_unstale":"2023-10-06T11:01:03.599019+0000","last_undegraded":"2023-10-06T11:01:03.599019+0000","last_fullsized":"2023-10-06T11:01:03.599019+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:11.183330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.614774+0000","last_change":"2023-10-06T11:01:04.614774+0000","last_active":"2023-10-06T11:01:04.614774+0000","last_peered":"2023-10-06T11:01:04.614774+0000","last_clean":"2023-10-06T11:01:04.614774+0000","last_became_active":"2023-10-06T11:01:04.614452+0000","last_became_peered":"2023-10-06T11:01:04.614452+0000","last_unstale":"2023-10-06T11:01:04.614774+0000","last_undegraded":"2023-10-06T11:01:04.614774+0000","last_fullsized":"2023-10-06T11:01:04.614774+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:28.470960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"56'8","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.619156+0000","last_change":"2023-10-06T11:01:03.592439+0000","last_active":"2023-10-06T11:01:04.619156+0000","last_peered":"2023-10-06T11:01:04.619156+0000","last_clean":"2023-10-06T11:01:04.619156+0000","last_became_active":"2023-10-06T11:01:03.591891+0000","last_became_peered":"2023-10-06T11:01:03.591891+0000","last_unstale":"2023-10-06T11:01:04.619156+0000","last_undegraded":"2023-10-06T11:01:04.619156+0000","last_fullsized":"2023-10-06T11:01:04.619156+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:18:37.153138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.620358+0000","last_change":"2023-10-06T11:01:04.620358+0000","last_active":"2023-10-06T11:01:04.620358+0000","last_peered":"2023-10-06T11:01:04.620358+0000","last_clean":"2023-10-06T11:01:04.620358+0000","last_became_active":"2023-10-06T11:01:04.619972+0000","last_became_peered":"2023-10-06T11:01:04.619972+0000","last_unstale":"2023-10-06T11:01:04.620358+0000","last_undegraded":"2023-10-06T11:01:04.620358+0000","last_fullsized":"2023-10-06T11:01:04.620358+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:41:37.034924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"56'2","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.615632+0000","last_change":"2023-10-06T11:01:03.599836+0000","last_active":"2023-10-06T11:01:04.615632+0000","last_peered":"2023-10-06T11:01:04.615632+0000","last_clean":"2023-10-06T11:01:04.615632+0000","last_became_active":"2023-10-06T11:01:03.599563+0000","last_became_peered":"2023-10-06T11:01:03.599563+0000","last_unstale":"2023-10-06T11:01:04.615632+0000","last_undegraded":"2023-10-06T11:01:04.615632+0000","last_fullsized":"2023-10-06T11:01:04.615632+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:53:18.480008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.622081+0000","last_change":"2023-10-06T11:01:04.622081+0000","last_active":"2023-10-06T11:01:04.622081+0000","last_peered":"2023-10-06T11:01:04.622081+0000","last_clean":"2023-10-06T11:01:04.622081+0000","last_became_active":"2023-10-06T11:01:04.621795+0000","last_became_peered":"2023-10-06T11:01:04.621795+0000","last_unstale":"2023-10-06T11:01:04.622081+0000","last_undegraded":"2023-10-06T11:01:04.622081+0000","last_fullsized":"2023-10-06T11:01:04.622081+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:28:56.319019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.597640+0000","last_change":"2023-10-06T11:01:03.595601+0000","last_active":"2023-10-06T11:01:03.597640+0000","last_peered":"2023-10-06T11:01:03.597640+0000","last_clean":"2023-10-06T11:01:03.597640+0000","last_became_active":"2023-10-06T11:01:03.595311+0000","last_became_peered":"2023-10-06T11:01:03.595311+0000","last_unstale":"2023-10-06T11:01:03.597640+0000","last_undegraded":"2023-10-06T11:01:03.597640+0000","last_fullsized":"2023-10-06T11:01:03.597640+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:02:19.885083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.619737+0000","last_change":"2023-10-06T11:01:04.619737+0000","last_active":"2023-10-06T11:01:04.619737+0000","last_peered":"2023-10-06T11:01:04.619737+0000","last_clean":"2023-10-06T11:01:04.619737+0000","last_became_active":"2023-10-06T11:01:04.619415+0000","last_became_peered":"2023-10-06T11:01:04.619415+0000","last_unstale":"2023-10-06T11:01:04.619737+0000","last_undegraded":"2023-10-06T11:01:04.619737+0000","last_fullsized":"2023-10-06T11:01:04.619737+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:34.800619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.596574+0000","last_change":"2023-10-06T11:01:03.595643+0000","last_active":"2023-10-06T11:01:03.596574+0000","last_peered":"2023-10-06T11:01:03.596574+0000","last_clean":"2023-10-06T11:01:03.596574+0000","last_became_active":"2023-10-06T11:01:03.595352+0000","last_became_peered":"2023-10-06T11:01:03.595352+0000","last_unstale":"2023-10-06T11:01:03.596574+0000","last_undegraded":"2023-10-06T11:01:03.596574+0000","last_fullsized":"2023-10-06T11:01:03.596574+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:39.759331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.604698+0000","last_change":"2023-10-06T11:01:04.604698+0000","last_active":"2023-10-06T11:01:04.604698+0000","last_peered":"2023-10-06T11:01:04.604698+0000","last_clean":"2023-10-06T11:01:04.604698+0000","last_became_active":"2023-10-06T11:01:04.604400+0000","last_became_peered":"2023-10-06T11:01:04.604400+0000","last_unstale":"2023-10-06T11:01:04.604698+0000","last_undegraded":"2023-10-06T11:01:04.604698+0000","last_fullsized":"2023-10-06T11:01:04.604698+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:59:30.481573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.595986+0000","last_change":"2023-10-06T11:01:03.594938+0000","last_active":"2023-10-06T11:01:03.595986+0000","last_peered":"2023-10-06T11:01:03.595986+0000","last_clean":"2023-10-06T11:01:03.595986+0000","last_became_active":"2023-10-06T11:01:03.591588+0000","last_became_peered":"2023-10-06T11:01:03.591588+0000","last_unstale":"2023-10-06T11:01:03.595986+0000","last_undegraded":"2023-10-06T11:01:03.595986+0000","last_fullsized":"2023-10-06T11:01:03.595986+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:19.337064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.608070+0000","last_change":"2023-10-06T11:01:04.608070+0000","last_active":"2023-10-06T11:01:04.608070+0000","last_peered":"2023-10-06T11:01:04.608070+0000","last_clean":"2023-10-06T11:01:04.608070+0000","last_became_active":"2023-10-06T11:01:04.607788+0000","last_became_peered":"2023-10-06T11:01:04.607788+0000","last_unstale":"2023-10-06T11:01:04.608070+0000","last_undegraded":"2023-10-06T11:01:04.608070+0000","last_fullsized":"2023-10-06T11:01:04.608070+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:38.338726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.599191+0000","last_change":"2023-10-06T11:01:03.597015+0000","last_active":"2023-10-06T11:01:03.599191+0000","last_peered":"2023-10-06T11:01:03.599191+0000","last_clean":"2023-10-06T11:01:03.599191+0000","last_became_active":"2023-10-06T11:01:03.596701+0000","last_became_peered":"2023-10-06T11:01:03.596701+0000","last_unstale":"2023-10-06T11:01:03.599191+0000","last_undegraded":"2023-10-06T11:01:03.599191+0000","last_fullsized":"2023-10-06T11:01:03.599191+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:27.465958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.617030+0000","last_change":"2023-10-06T11:01:04.617030+0000","last_active":"2023-10-06T11:01:04.617030+0000","last_peered":"2023-10-06T11:01:04.617030+0000","last_clean":"2023-10-06T11:01:04.617030+0000","last_became_active":"2023-10-06T11:01:04.616756+0000","last_became_peered":"2023-10-06T11:01:04.616756+0000","last_unstale":"2023-10-06T11:01:04.617030+0000","last_undegraded":"2023-10-06T11:01:04.617030+0000","last_fullsized":"2023-10-06T11:01:04.617030+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:40.006889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.593678+0000","last_change":"2023-10-06T11:01:03.592759+0000","last_active":"2023-10-06T11:01:03.593678+0000","last_peered":"2023-10-06T11:01:03.593678+0000","last_clean":"2023-10-06T11:01:03.593678+0000","last_became_active":"2023-10-06T11:01:03.592470+0000","last_became_peered":"2023-10-06T11:01:03.592470+0000","last_unstale":"2023-10-06T11:01:03.593678+0000","last_undegraded":"2023-10-06T11:01:03.593678+0000","last_fullsized":"2023-10-06T11:01:03.593678+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:33.795616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.595613+0000","last_change":"2023-10-06T11:01:04.595613+0000","last_active":"2023-10-06T11:01:04.595613+0000","last_peered":"2023-10-06T11:01:04.595613+0000","last_clean":"2023-10-06T11:01:04.595613+0000","last_became_active":"2023-10-06T11:01:04.595337+0000","last_became_peered":"2023-10-06T11:01:04.595337+0000","last_unstale":"2023-10-06T11:01:04.595613+0000","last_undegraded":"2023-10-06T11:01:04.595613+0000","last_fullsized":"2023-10-06T11:01:04.595613+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:26.924360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.593104+0000","last_change":"2023-10-06T11:01:03.591848+0000","last_active":"2023-10-06T11:01:03.593104+0000","last_peered":"2023-10-06T11:01:03.593104+0000","last_clean":"2023-10-06T11:01:03.593104+0000","last_became_active":"2023-10-06T11:01:03.591149+0000","last_became_peered":"2023-10-06T11:01:03.591149+0000","last_unstale":"2023-10-06T11:01:03.593104+0000","last_undegraded":"2023-10-06T11:01:03.593104+0000","last_fullsized":"2023-10-06T11:01:03.593104+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:52.353652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.607416+0000","last_change":"2023-10-06T11:01:04.607416+0000","last_active":"2023-10-06T11:01:04.607416+0000","last_peered":"2023-10-06T11:01:04.607416+0000","last_clean":"2023-10-06T11:01:04.607416+0000","last_became_active":"2023-10-06T11:01:04.607019+0000","last_became_peered":"2023-10-06T11:01:04.607019+0000","last_unstale":"2023-10-06T11:01:04.607416+0000","last_undegraded":"2023-10-06T11:01:04.607416+0000","last_fullsized":"2023-10-06T11:01:04.607416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:46.292511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.594802+0000","last_change":"2023-10-06T11:01:03.590215+0000","last_active":"2023-10-06T11:01:03.594802+0000","last_peered":"2023-10-06T11:01:03.594802+0000","last_clean":"2023-10-06T11:01:03.594802+0000","last_became_active":"2023-10-06T11:01:03.589923+0000","last_became_peered":"2023-10-06T11:01:03.589923+0000","last_unstale":"2023-10-06T11:01:03.594802+0000","last_undegraded":"2023-10-06T11:01:03.594802+0000","last_fullsized":"2023-10-06T11:01:03.594802+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:28.373069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.600845+0000","last_change":"2023-10-06T11:01:04.600845+0000","last_active":"2023-10-06T11:01:04.600845+0000","last_peered":"2023-10-06T11:01:04.600845+0000","last_clean":"2023-10-06T11:01:04.600845+0000","last_became_active":"2023-10-06T11:01:04.600537+0000","last_became_peered":"2023-10-06T11:01:04.600537+0000","last_unstale":"2023-10-06T11:01:04.600845+0000","last_undegraded":"2023-10-06T11:01:04.600845+0000","last_fullsized":"2023-10-06T11:01:04.600845+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:15.432056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"56'1","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.602633+0000","last_change":"2023-10-06T11:01:03.598094+0000","last_active":"2023-10-06T11:01:04.602633+0000","last_peered":"2023-10-06T11:01:04.602633+0000","last_clean":"2023-10-06T11:01:04.602633+0000","last_became_active":"2023-10-06T11:01:03.597803+0000","last_became_peered":"2023-10-06T11:01:03.597803+0000","last_unstale":"2023-10-06T11:01:04.602633+0000","last_undegraded":"2023-10-06T11:01:04.602633+0000","last_fullsized":"2023-10-06T11:01:04.602633+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:18.120743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.588299+0000","last_change":"2023-10-06T10:58:56.328381+0000","last_active":"2023-10-06T11:01:03.588299+0000","last_peered":"2023-10-06T11:01:03.588299+0000","last_clean":"2023-10-06T11:01:03.588299+0000","last_became_active":"2023-10-06T10:58:56.328054+0000","last_became_peered":"2023-10-06T10:58:56.328054+0000","last_unstale":"2023-10-06T11:01:03.588299+0000","last_undegraded":"2023-10-06T11:01:03.588299+0000","last_fullsized":"2023-10-06T11:01:03.588299+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.605710+0000","last_change":"2023-10-06T11:01:04.605710+0000","last_active":"2023-10-06T11:01:04.605710+0000","last_peered":"2023-10-06T11:01:04.605710+0000","last_clean":"2023-10-06T11:01:04.605710+0000","last_became_active":"2023-10-06T11:01:04.604654+0000","last_became_peered":"2023-10-06T11:01:04.604654+0000","last_unstale":"2023-10-06T11:01:04.605710+0000","last_undegraded":"2023-10-06T11:01:04.605710+0000","last_fullsized":"2023-10-06T11:01:04.605710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:02:20.890085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.598561+0000","last_change":"2023-10-06T11:01:03.597262+0000","last_active":"2023-10-06T11:01:03.598561+0000","last_peered":"2023-10-06T11:01:03.598561+0000","last_clean":"2023-10-06T11:01:03.598561+0000","last_became_active":"2023-10-06T11:01:03.596997+0000","last_became_peered":"2023-10-06T11:01:03.596997+0000","last_unstale":"2023-10-06T11:01:03.598561+0000","last_undegraded":"2023-10-06T11:01:03.598561+0000","last_fullsized":"2023-10-06T11:01:03.598561+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:02.153328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.579113+0000","last_change":"2023-10-06T10:58:56.326189+0000","last_active":"2023-10-06T11:01:03.579113+0000","last_peered":"2023-10-06T11:01:03.579113+0000","last_clean":"2023-10-06T11:01:03.579113+0000","last_became_active":"2023-10-06T10:58:56.325852+0000","last_became_peered":"2023-10-06T10:58:56.325852+0000","last_unstale":"2023-10-06T11:01:03.579113+0000","last_undegraded":"2023-10-06T11:01:03.579113+0000","last_fullsized":"2023-10-06T11:01:03.579113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:28.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.609574+0000","last_change":"2023-10-06T11:01:04.609574+0000","last_active":"2023-10-06T11:01:04.609574+0000","last_peered":"2023-10-06T11:01:04.609574+0000","last_clean":"2023-10-06T11:01:04.609574+0000","last_became_active":"2023-10-06T11:01:04.608829+0000","last_became_peered":"2023-10-06T11:01:04.608829+0000","last_unstale":"2023-10-06T11:01:04.609574+0000","last_undegraded":"2023-10-06T11:01:04.609574+0000","last_fullsized":"2023-10-06T11:01:04.609574+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:52.079098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"56'2","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.618772+0000","last_change":"2023-10-06T11:01:03.591332+0000","last_active":"2023-10-06T11:01:04.618772+0000","last_peered":"2023-10-06T11:01:04.618772+0000","last_clean":"2023-10-06T11:01:04.618772+0000","last_became_active":"2023-10-06T11:01:03.590912+0000","last_became_peered":"2023-10-06T11:01:03.590912+0000","last_unstale":"2023-10-06T11:01:04.618772+0000","last_undegraded":"2023-10-06T11:01:04.618772+0000","last_fullsized":"2023-10-06T11:01:04.618772+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:03:27.308486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":49,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.579783+0000","last_change":"2023-10-06T10:58:56.325363+0000","last_active":"2023-10-06T11:01:03.579783+0000","last_peered":"2023-10-06T11:01:03.579783+0000","last_clean":"2023-10-06T11:01:03.579783+0000","last_became_active":"2023-10-06T10:58:56.325095+0000","last_became_peered":"2023-10-06T10:58:56.325095+0000","last_unstale":"2023-10-06T11:01:03.579783+0000","last_undegraded":"2023-10-06T11:01:03.579783+0000","last_fullsized":"2023-10-06T11:01:03.579783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":192,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.579737+0000","last_change":"2023-10-06T10:58:57.328525+0000","last_active":"2023-10-06T11:01:03.579737+0000","last_peered":"2023-10-06T11:01:03.579737+0000","last_clean":"2023-10-06T11:01:03.579737+0000","last_became_active":"2023-10-06T10:58:57.327509+0000","last_became_peered":"2023-10-06T10:58:57.327509+0000","last_unstale":"2023-10-06T11:01:03.579737+0000","last_undegraded":"2023-10-06T11:01:03.579737+0000","last_fullsized":"2023-10-06T11:01:03.579737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_clean_scrub_stamp":"2023-10-06T10:58:56.314996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:45.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.609696+0000","last_change":"2023-10-06T11:01:04.609696+0000","last_active":"2023-10-06T11:01:04.609696+0000","last_peered":"2023-10-06T11:01:04.609696+0000","last_clean":"2023-10-06T11:01:04.609696+0000","last_became_active":"2023-10-06T11:01:04.609443+0000","last_became_peered":"2023-10-06T11:01:04.609443+0000","last_unstale":"2023-10-06T11:01:04.609696+0000","last_undegraded":"2023-10-06T11:01:04.609696+0000","last_fullsized":"2023-10-06T11:01:04.609696+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:03.158331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.599187+0000","last_change":"2023-10-06T11:01:03.597996+0000","last_active":"2023-10-06T11:01:03.599187+0000","last_peered":"2023-10-06T11:01:03.599187+0000","last_clean":"2023-10-06T11:01:03.599187+0000","last_became_active":"2023-10-06T11:01:03.595736+0000","last_became_peered":"2023-10-06T11:01:03.595736+0000","last_unstale":"2023-10-06T11:01:03.599187+0000","last_undegraded":"2023-10-06T11:01:03.599187+0000","last_fullsized":"2023-10-06T11:01:03.599187+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:14.309780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.579660+0000","last_change":"2023-10-06T10:58:56.331567+0000","last_active":"2023-10-06T11:01:03.579660+0000","last_peered":"2023-10-06T11:01:03.579660+0000","last_clean":"2023-10-06T11:01:03.579660+0000","last_became_active":"2023-10-06T10:58:56.331244+0000","last_became_peered":"2023-10-06T10:58:56.331244+0000","last_unstale":"2023-10-06T11:01:03.579660+0000","last_undegraded":"2023-10-06T11:01:03.579660+0000","last_fullsized":"2023-10-06T11:01:03.579660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.607177+0000","last_change":"2023-10-06T11:01:04.607177+0000","last_active":"2023-10-06T11:01:04.607177+0000","last_peered":"2023-10-06T11:01:04.607177+0000","last_clean":"2023-10-06T11:01:04.607177+0000","last_became_active":"2023-10-06T11:01:04.606858+0000","last_became_peered":"2023-10-06T11:01:04.606858+0000","last_unstale":"2023-10-06T11:01:04.607177+0000","last_undegraded":"2023-10-06T11:01:04.607177+0000","last_fullsized":"2023-10-06T11:01:04.607177+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:15.314783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.590591+0000","last_change":"2023-10-06T11:01:03.588613+0000","last_active":"2023-10-06T11:01:03.590591+0000","last_peered":"2023-10-06T11:01:03.590591+0000","last_clean":"2023-10-06T11:01:03.590591+0000","last_became_active":"2023-10-06T11:01:03.588087+0000","last_became_peered":"2023-10-06T11:01:03.588087+0000","last_unstale":"2023-10-06T11:01:03.590591+0000","last_undegraded":"2023-10-06T11:01:03.590591+0000","last_fullsized":"2023-10-06T11:01:03.590591+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:38.639023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.579634+0000","last_change":"2023-10-06T10:58:56.332184+0000","last_active":"2023-10-06T11:01:03.579634+0000","last_peered":"2023-10-06T11:01:03.579634+0000","last_clean":"2023-10-06T11:01:03.579634+0000","last_became_active":"2023-10-06T10:58:56.331830+0000","last_became_peered":"2023-10-06T10:58:56.331830+0000","last_unstale":"2023-10-06T11:01:03.579634+0000","last_undegraded":"2023-10-06T11:01:03.579634+0000","last_fullsized":"2023-10-06T11:01:03.579634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:54:02.320834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.625973+0000","last_change":"2023-10-06T11:01:04.625973+0000","last_active":"2023-10-06T11:01:04.625973+0000","last_peered":"2023-10-06T11:01:04.625973+0000","last_clean":"2023-10-06T11:01:04.625973+0000","last_became_active":"2023-10-06T11:01:04.625529+0000","last_became_peered":"2023-10-06T11:01:04.625529+0000","last_unstale":"2023-10-06T11:01:04.625973+0000","last_undegraded":"2023-10-06T11:01:04.625973+0000","last_fullsized":"2023-10-06T11:01:04.625973+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:51:10.704038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.592168+0000","last_change":"2023-10-06T11:01:03.589832+0000","last_active":"2023-10-06T11:01:03.592168+0000","last_peered":"2023-10-06T11:01:03.592168+0000","last_clean":"2023-10-06T11:01:03.592168+0000","last_became_active":"2023-10-06T11:01:03.589484+0000","last_became_peered":"2023-10-06T11:01:03.589484+0000","last_unstale":"2023-10-06T11:01:03.592168+0000","last_undegraded":"2023-10-06T11:01:03.592168+0000","last_fullsized":"2023-10-06T11:01:03.592168+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.256071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":42,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.593939+0000","last_change":"2023-10-06T10:58:56.331654+0000","last_active":"2023-10-06T11:01:03.593939+0000","last_peered":"2023-10-06T11:01:03.593939+0000","last_clean":"2023-10-06T11:01:03.593939+0000","last_became_active":"2023-10-06T10:58:56.331345+0000","last_became_peered":"2023-10-06T10:58:56.331345+0000","last_unstale":"2023-10-06T11:01:03.593939+0000","last_undegraded":"2023-10-06T11:01:03.593939+0000","last_fullsized":"2023-10-06T11:01:03.593939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.600937+0000","last_change":"2023-10-06T11:01:04.600937+0000","last_active":"2023-10-06T11:01:04.600937+0000","last_peered":"2023-10-06T11:01:04.600937+0000","last_clean":"2023-10-06T11:01:04.600937+0000","last_became_active":"2023-10-06T11:01:04.600319+0000","last_became_peered":"2023-10-06T11:01:04.600319+0000","last_unstale":"2023-10-06T11:01:04.600937+0000","last_undegraded":"2023-10-06T11:01:04.600937+0000","last_fullsized":"2023-10-06T11:01:04.600937+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:52:03.611174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"56'2","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.615688+0000","last_change":"2023-10-06T11:01:03.599075+0000","last_active":"2023-10-06T11:01:04.615688+0000","last_peered":"2023-10-06T11:01:04.615688+0000","last_clean":"2023-10-06T11:01:04.615688+0000","last_became_active":"2023-10-06T11:01:03.598779+0000","last_became_peered":"2023-10-06T11:01:03.598779+0000","last_unstale":"2023-10-06T11:01:04.615688+0000","last_undegraded":"2023-10-06T11:01:04.615688+0000","last_fullsized":"2023-10-06T11:01:04.615688+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:37.333723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":42,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.578923+0000","last_change":"2023-10-06T10:58:56.331650+0000","last_active":"2023-10-06T11:01:03.578923+0000","last_peered":"2023-10-06T11:01:03.578923+0000","last_clean":"2023-10-06T11:01:03.578923+0000","last_became_active":"2023-10-06T10:58:56.331344+0000","last_became_peered":"2023-10-06T10:58:56.331344+0000","last_unstale":"2023-10-06T11:01:03.578923+0000","last_undegraded":"2023-10-06T11:01:03.578923+0000","last_fullsized":"2023-10-06T11:01:03.578923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:45.584545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.614659+0000","last_change":"2023-10-06T11:01:04.614659+0000","last_active":"2023-10-06T11:01:04.614659+0000","last_peered":"2023-10-06T11:01:04.614659+0000","last_clean":"2023-10-06T11:01:04.614659+0000","last_became_active":"2023-10-06T11:01:04.614345+0000","last_became_peered":"2023-10-06T11:01:04.614345+0000","last_unstale":"2023-10-06T11:01:04.614659+0000","last_undegraded":"2023-10-06T11:01:04.614659+0000","last_fullsized":"2023-10-06T11:01:04.614659+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:03.571402+0000","last_clean_scrub_stamp":"2023-10-06T11:01:03.571402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:03.158331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"56'1","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.601780+0000","last_change":"2023-10-06T11:01:03.596491+0000","last_active":"2023-10-06T11:01:04.601780+0000","last_peered":"2023-10-06T11:01:04.601780+0000","last_clean":"2023-10-06T11:01:04.601780+0000","last_became_active":"2023-10-06T11:01:03.596150+0000","last_became_peered":"2023-10-06T11:01:03.596150+0000","last_unstale":"2023-10-06T11:01:04.601780+0000","last_undegraded":"2023-10-06T11:01:04.601780+0000","last_fullsized":"2023-10-06T11:01:04.601780+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:02.566400+0000","last_clean_scrub_stamp":"2023-10-06T11:01:02.566400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:51:23.963477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":42,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T11:01:03.578955+0000","last_change":"2023-10-06T10:58:56.326315+0000","last_active":"2023-10-06T11:01:03.578955+0000","last_peered":"2023-10-06T11:01:03.578955+0000","last_clean":"2023-10-06T11:01:03.578955+0000","last_became_active":"2023-10-06T10:58:56.325897+0000","last_became_peered":"2023-10-06T10:58:56.325897+0000","last_unstale":"2023-10-06T11:01:03.578955+0000","last_undegraded":"2023-10-06T11:01:03.578955+0000","last_fullsized":"2023-10-06T11:01:03.578955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":897108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.62},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.46000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.374},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77800000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66900000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.47999999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.47199999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.60099999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.69199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":305762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79200000000000004,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.621,"15min":0.61599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.435}]},{"osd":1,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.40999999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":1.036,"15min":1.036},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.72299999999999998,"5min":1.274,"15min":1.274},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.40500000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77700000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86799999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.249,"15min":0.249},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.36399999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84799999999999998,"5min":0.873,"15min":0.873},"last":0.64200000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82299999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.49099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83299999999999996,"5min":1.006,"15min":1.006},"last":0.65400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298552,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073288,"statfs":{"total":96636764160,"available":96331046912,"internally_reserved":0,"allocated":1294336,"data_stored":906816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.379,"15min":0.38100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56000000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.34300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44,"15min":0.441},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.436},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64700000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.438,"15min":0.438},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.32400000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93100000000000005,"5min":1.123,"15min":1.123},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69599999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70599999999999996,"15min":0.70999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":305762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.40699999999999997,"15min":0.41499999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.66600000000000004,"5min":0.746,"15min":0.746},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44,"15min":0.438},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46000000000000002,"15min":0.45300000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.378},{"interface":"front","average":{"1min":0.5,"5min":0.61899999999999999,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.746,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79200000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89500000000000002,"5min":1.002,"15min":1.002},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68400000000000005,"15min":0.68899999999999995},"min":{"1min":0.51400000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.85499999999999998,"5min":1.022,"15min":1.022},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0069999999999999,"5min":1.238,"15min":1.238},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0549999999999999,"5min":2.9540000000000002,"15min":2.9540000000000002},"last":0.623},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71899999999999997,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83299999999999996,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92400000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94799999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.85599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297944,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073896,"statfs":{"total":96636764160,"available":96331669504,"internally_reserved":0,"allocated":671744,"data_stored":314176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.379},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63800000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.432,"15min":0.435},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46000000000000002,"15min":0.46100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.438}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40400000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.66600000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.374,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.036},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0780000000000001,"5min":1.107,"15min":1.107},"last":0.751},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.623}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.47399999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.498,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86599999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.52100000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.65500000000000003,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.2130000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98299999999999998,"5min":1.232,"15min":1.232},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.57699999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.78000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":305762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52600000000000002,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.54700000000000004,"15min":0.57399999999999995},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57199999999999995,"5min":4.617,"15min":4.617},"last":0.33900000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52700000000000002,"15min":0.54700000000000004},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70699999999999996,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.51800000000000002,"15min":0.53100000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.59799999999999998,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.441}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.68899999999999995,"15min":0.72499999999999998},"min":{"1min":0.36499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.61299999999999999,"5min":6.4400000000000004,"15min":6.4400000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.72199999999999998,"15min":0.75800000000000001},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66900000000000004,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.74299999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.83699999999999997,"15min":0.86799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92500000000000004,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90900000000000003,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.65400000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.81499999999999995,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.016,"5min":4.4470000000000001,"15min":4.4470000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73499999999999999,"15min":0.748},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85899999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.55200000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.70599999999999996,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88400000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.87,"15min":0.89400000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95899999999999996,"5min":4.4130000000000003,"15min":4.4130000000000003},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":306740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88200000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.60899999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.748,"5min":5.476,"15min":5.476},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.44900000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.58099999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88100000000000001,"5min":1.978,"15min":1.978},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.36399999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.46200000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.58499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.495}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":305762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.77100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.42799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76700000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.75600000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78200000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.745}]},{"osd":3,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78300000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.81999999999999995}]},{"osd":4,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77100000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.438},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.629,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48099999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63300000000000001,"15min":0.64000000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67000000000000004,"15min":0.68000000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.73899999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:01:09.202 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:01:09.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:01:09.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.376+0000 7f1bec1a3700 1 Processor -- start 2023-10-06T11:01:09.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.376+0000 7f1bec1a3700 1 -- start start 2023-10-06T11:01:09.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.377+0000 7f1bec1a3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1be40cbdd0 0x7f1be40c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.377+0000 7f1bec1a3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1be406b8e0 0x7f1be406bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.377+0000 7f1bec1a3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be4068070 con 0x7f1be40acab0 2023-10-06T11:01:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.377+0000 7f1bec1a3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be406c2a0 con 0x7f1be406b8e0 2023-10-06T11:01:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.377+0000 7f1bec1a3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be40adb60 con 0x7f1be40cbdd0 2023-10-06T11:01:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.377+0000 7f1bea740700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1be406b8e0 0x7f1be406bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.377+0000 7f1bea740700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1be406b8e0 0x7f1be406bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60394/0 (socket says 172.21.15.7:60394) 2023-10-06T11:01:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.377+0000 7f1bea740700 1 -- 172.21.15.7:0/360377452 learned_addr learned my addr 172.21.15.7:0/360377452 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:09.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.377+0000 7f1be9f3f700 1 --2- 172.21.15.7:0/360377452 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1be40cbdd0 0x7f1be40c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:09.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.377+0000 7f1bea740700 1 -- 172.21.15.7:0/360377452 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1be40cbdd0 msgr2=0x7f1be40c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:09.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.377+0000 7f1bea740700 1 --2- 172.21.15.7:0/360377452 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1be40cbdd0 0x7f1be40c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.377+0000 7f1bea740700 1 -- 172.21.15.7:0/360377452 >> v1:172.21.15.50:6789/0 conn(0x7f1be40acab0 legacy=0x7f1be40acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:09.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.377+0000 7f1bea740700 1 -- 172.21.15.7:0/360377452 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be40ad880 con 0x7f1be406b8e0 2023-10-06T11:01:09.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.377+0000 7f1be9f3f700 1 --2- 172.21.15.7:0/360377452 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1be40cbdd0 0x7f1be40c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:09.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.378+0000 7f1bea740700 1 --2- 172.21.15.7:0/360377452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be406b8e0 0x7f1be406bd60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009f20 tx=0x7f1bdc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1141f24e3c0e898c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:09.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.378+0000 7f1be8f3d700 1 -- 172.21.15.7:0/360377452 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00e070 con 0x7f1be406b8e0 2023-10-06T11:01:09.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.378+0000 7f1be8f3d700 1 -- 172.21.15.7:0/360377452 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc00bad0 con 0x7f1be406b8e0 2023-10-06T11:01:09.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.378+0000 7f1be8f3d700 1 -- 172.21.15.7:0/360377452 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc0092e0 con 0x7f1be406b8e0 2023-10-06T11:01:09.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.378+0000 7f1bec1a3700 1 -- 172.21.15.7:0/360377452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be406b8e0 msgr2=0x7f1be406bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:09.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.378+0000 7f1bec1a3700 1 --2- 172.21.15.7:0/360377452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be406b8e0 0x7f1be406bd60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009f20 tx=0x7f1bdc009840 comp rx=0 tx=0).stop 2023-10-06T11:01:09.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.378+0000 7f1bec1a3700 1 -- 172.21.15.7:0/360377452 shutdown_connections 2023-10-06T11:01:09.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.378+0000 7f1bec1a3700 1 --2- 172.21.15.7:0/360377452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be406b8e0 0x7f1be406bd60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.378+0000 7f1bec1a3700 1 --2- 172.21.15.7:0/360377452 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1be40cbdd0 0x7f1be40c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.378+0000 7f1bec1a3700 1 -- 172.21.15.7:0/360377452 >> 172.21.15.7:0/360377452 conn(0x7f1be40cc560 msgr2=0x7f1be40cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:09.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.379+0000 7f1bec1a3700 1 -- 172.21.15.7:0/360377452 shutdown_connections 2023-10-06T11:01:09.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.379+0000 7f1bec1a3700 1 -- 172.21.15.7:0/360377452 wait complete. 2023-10-06T11:01:09.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.380+0000 7f1bec1a3700 1 Processor -- start 2023-10-06T11:01:09.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.380+0000 7f1bec1a3700 1 -- start start 2023-10-06T11:01:09.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bec1a3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be406b8e0 0x7f1be4149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:09.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bec1a3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1be40acab0 0x7f1be4095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:09.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bec1a3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be40cbdd0 0x7f1be40aaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:09.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bec1a3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be4096a80 con 0x7f1be40cbdd0 2023-10-06T11:01:09.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bec1a3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be414a0b0 con 0x7f1be406b8e0 2023-10-06T11:01:09.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bec1a3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be4167390 con 0x7f1be40acab0 2023-10-06T11:01:09.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bea740700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be40cbdd0 0x7f1be40aaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:09.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bea740700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be40cbdd0 0x7f1be40aaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60410/0 (socket says 172.21.15.7:60410) 2023-10-06T11:01:09.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bea740700 1 -- 172.21.15.7:0/2473494461 learned_addr learned my addr 172.21.15.7:0/2473494461 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:09.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1be9f3f700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be406b8e0 0x7f1be4149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:09.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1be973e700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1be40acab0 0x7f1be4095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:09.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bea740700 1 -- 172.21.15.7:0/2473494461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1be40acab0 msgr2=0x7f1be4095a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:09.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bea740700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1be40acab0 0x7f1be4095a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bea740700 1 -- 172.21.15.7:0/2473494461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be406b8e0 msgr2=0x7f1be4149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:09.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bea740700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be406b8e0 0x7f1be4149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bea740700 1 -- 172.21.15.7:0/2473494461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc009ae0 con 0x7f1be40cbdd0 2023-10-06T11:01:09.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1be973e700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1be40acab0 0x7f1be4095a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:09.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1be9f3f700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be406b8e0 0x7f1be4149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:09.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bea740700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be40cbdd0 0x7f1be40aaad0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1be406fc00 tx=0x7f1bdc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:09.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bd9ffb700 1 -- 172.21.15.7:0/2473494461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc012e60 con 0x7f1be40cbdd0 2023-10-06T11:01:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bd9ffb700 1 -- 172.21.15.7:0/2473494461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc01e430 con 0x7f1be40cbdd0 2023-10-06T11:01:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bd9ffb700 1 -- 172.21.15.7:0/2473494461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc01e7d0 con 0x7f1be40cbdd0 2023-10-06T11:01:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.381+0000 7f1bec1a3700 1 -- 172.21.15.7:0/2473494461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be40964c0 con 0x7f1be40cbdd0 2023-10-06T11:01:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.382+0000 7f1bec1a3700 1 -- 172.21.15.7:0/2473494461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be4167020 con 0x7f1be40cbdd0 2023-10-06T11:01:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.383+0000 7f1bec1a3700 1 -- 172.21.15.7:0/2473494461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be4070480 con 0x7f1be40cbdd0 2023-10-06T11:01:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.383+0000 7f1bd9ffb700 1 -- 172.21.15.7:0/2473494461 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1bdc01eb80 con 0x7f1be40cbdd0 2023-10-06T11:01:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.384+0000 7f1bd9ffb700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1bc8066f30 0x7f1bc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:09.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.384+0000 7f1bd9ffb700 1 -- 172.21.15.7:0/2473494461 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1bdc086570 con 0x7f1be40cbdd0 2023-10-06T11:01:09.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.384+0000 7f1be9f3f700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1bc8066f30 0x7f1bc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:09.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.384+0000 7f1be9f3f700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1bc8066f30 0x7f1bc80693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1be0006fd0 tx=0x7f1be0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:09.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.388+0000 7f1bd9ffb700 1 -- 172.21.15.7:0/2473494461 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bdc053540 con 0x7f1be40cbdd0 2023-10-06T11:01:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.675+0000 7f1bec1a3700 1 -- 172.21.15.7:0/2473494461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1be406af60 con 0x7f1be40cbdd0 2023-10-06T11:01:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.679+0000 7f1bd9ffb700 1 -- 172.21.15.7:0/2473494461 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1bdc056b60 con 0x7f1be40cbdd0 2023-10-06T11:01:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.681+0000 7f1bec1a3700 1 -- 172.21.15.7:0/2473494461 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1bc8066f30 msgr2=0x7f1bc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.681+0000 7f1bec1a3700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1bc8066f30 0x7f1bc80693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1be0006fd0 tx=0x7f1be0008040 comp rx=0 tx=0).stop 2023-10-06T11:01:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.681+0000 7f1bec1a3700 1 -- 172.21.15.7:0/2473494461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be40cbdd0 msgr2=0x7f1be40aaad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.681+0000 7f1bec1a3700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be40cbdd0 0x7f1be40aaad0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1be406fc00 tx=0x7f1bdc017000 comp rx=0 tx=0).stop 2023-10-06T11:01:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.681+0000 7f1bec1a3700 1 -- 172.21.15.7:0/2473494461 shutdown_connections 2023-10-06T11:01:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.681+0000 7f1bec1a3700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1bc8066f30 0x7f1bc80693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.681+0000 7f1bec1a3700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be40cbdd0 0x7f1be40aaad0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.681+0000 7f1bec1a3700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be406b8e0 0x7f1be4149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.681+0000 7f1bec1a3700 1 --2- 172.21.15.7:0/2473494461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1be40acab0 0x7f1be4095a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.681+0000 7f1bec1a3700 1 -- 172.21.15.7:0/2473494461 >> 172.21.15.7:0/2473494461 conn(0x7f1be40cc560 msgr2=0x7f1be40cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.682+0000 7f1bec1a3700 1 -- 172.21.15.7:0/2473494461 shutdown_connections 2023-10-06T11:01:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.682+0000 7f1bec1a3700 1 -- 172.21.15.7:0/2473494461 wait complete. 2023-10-06T11:01:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-06T11:01:09.697 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:01:09.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.827+0000 7f612a073700 1 Processor -- start 2023-10-06T11:01:09.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.827+0000 7f612a073700 1 -- start start 2023-10-06T11:01:09.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.828+0000 7f612a073700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61240cb610 0x7f6124159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.828+0000 7f612a073700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61240cb180 con 0x7f61240c8f70 2023-10-06T11:01:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.828+0000 7f612a073700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61240c9340 con 0x7f612406ce80 2023-10-06T11:01:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.828+0000 7f612a073700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61240cb9e0 con 0x7f61240cb610 2023-10-06T11:01:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.829+0000 7f61237fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f61240c8f70 0x7f612406c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42714/0 (socket says 172.21.15.7:42714) 2023-10-06T11:01:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.829+0000 7f61237fe700 1 -- 172.21.15.7:0/2098927069 learned_addr learned my addr 172.21.15.7:0/2098927069 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.829+0000 7f6123fff700 1 --2- 172.21.15.7:0/2098927069 >> v2:172.21.15.50:3300/0 conn(0x7f61240cb610 0x7f6124159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.829+0000 7f61227fc700 1 -- 172.21.15.7:0/2098927069 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663868758 0 0) 0x7f61240cb180 con 0x7f61240c8f70 2023-10-06T11:01:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.829+0000 7f61227fc700 1 -- 172.21.15.7:0/2098927069 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f610c003570 con 0x7f61240c8f70 2023-10-06T11:01:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.829+0000 7f6123fff700 1 -- 172.21.15.7:0/2098927069 >> v1:172.21.15.50:6789/0 conn(0x7f612406ce80 legacy=0x7f61241597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.829+0000 7f61227fc700 1 -- 172.21.15.7:0/2098927069 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4043194665 0 0) 0x7f610c003570 con 0x7f61240c8f70 2023-10-06T11:01:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.829+0000 7f6123fff700 1 -- 172.21.15.7:0/2098927069 >> v1:172.21.15.7:6789/0 conn(0x7f61240c8f70 legacy=0x7f612406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.829+0000 7f6123fff700 1 -- 172.21.15.7:0/2098927069 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612415a570 con 0x7f61240cb610 2023-10-06T11:01:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.829+0000 7f6123fff700 1 --2- 172.21.15.7:0/2098927069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61240cb610 0x7f6124159ee0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f611c009e60 tx=0x7f611c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1896891823d6172 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.830+0000 7f61227fc700 1 -- 172.21.15.7:0/2098927069 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c00e070 con 0x7f61240cb610 2023-10-06T11:01:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.830+0000 7f61227fc700 1 -- 172.21.15.7:0/2098927069 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c00b850 con 0x7f61240cb610 2023-10-06T11:01:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.830+0000 7f61227fc700 1 -- 172.21.15.7:0/2098927069 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114001470 con 0x7f61240cb610 2023-10-06T11:01:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.830+0000 7f612a073700 1 -- 172.21.15.7:0/2098927069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61240cb610 msgr2=0x7f6124159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.830+0000 7f612a073700 1 --2- 172.21.15.7:0/2098927069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61240cb610 0x7f6124159ee0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f611c009e60 tx=0x7f611c009780 comp rx=0 tx=0).stop 2023-10-06T11:01:09.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.830+0000 7f612a073700 1 -- 172.21.15.7:0/2098927069 shutdown_connections 2023-10-06T11:01:09.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.830+0000 7f612a073700 1 --2- 172.21.15.7:0/2098927069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61240cb610 0x7f6124159ee0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.830+0000 7f612a073700 1 -- 172.21.15.7:0/2098927069 >> 172.21.15.7:0/2098927069 conn(0x7f612406bbe0 msgr2=0x7f61240ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:09.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.830+0000 7f612a073700 1 -- 172.21.15.7:0/2098927069 shutdown_connections 2023-10-06T11:01:09.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.830+0000 7f612a073700 1 -- 172.21.15.7:0/2098927069 wait complete. 2023-10-06T11:01:09.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.832+0000 7f612a073700 1 Processor -- start 2023-10-06T11:01:09.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.832+0000 7f612a073700 1 -- start start 2023-10-06T11:01:09.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.832+0000 7f612a073700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f612406ce80 0x7f612416c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:09.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.832+0000 7f612a073700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61240c8f70 0x7f61240c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:09.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.832+0000 7f612a073700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61240cb610 0x7f61240c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:09.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.832+0000 7f612a073700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61240b1bc0 con 0x7f61240cb610 2023-10-06T11:01:09.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.832+0000 7f612a073700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61240b1ea0 con 0x7f61240c8f70 2023-10-06T11:01:09.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.832+0000 7f612a073700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61240b2180 con 0x7f612406ce80 2023-10-06T11:01:09.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.832+0000 7f6123fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61240cb610 0x7f61240c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:09.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.832+0000 7f6123fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61240cb610 0x7f61240c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60424/0 (socket says 172.21.15.7:60424) 2023-10-06T11:01:09.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.832+0000 7f6123fff700 1 -- 172.21.15.7:0/2032345210 learned_addr learned my addr 172.21.15.7:0/2032345210 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:09.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.833+0000 7f61237fe700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f612406ce80 0x7f612416c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:09.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.833+0000 7f6122ffd700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61240c8f70 0x7f61240c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:09.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.833+0000 7f6123fff700 1 -- 172.21.15.7:0/2032345210 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f612406ce80 msgr2=0x7f612416c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:09.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.833+0000 7f6123fff700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f612406ce80 0x7f612416c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.833+0000 7f6123fff700 1 -- 172.21.15.7:0/2032345210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61240c8f70 msgr2=0x7f61240c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:09.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.833+0000 7f6123fff700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61240c8f70 0x7f61240c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:09.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.833+0000 7f6123fff700 1 -- 172.21.15.7:0/2032345210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c009a20 con 0x7f61240cb610 2023-10-06T11:01:09.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.833+0000 7f6122ffd700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61240c8f70 0x7f61240c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:09.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.833+0000 7f6123fff700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61240cb610 0x7f61240c4630 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f611c0097c0 tx=0x7f611c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:09.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.833+0000 7f610b7fe700 1 -- 172.21.15.7:0/2032345210 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c012da0 con 0x7f61240cb610 2023-10-06T11:01:09.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.833+0000 7f610b7fe700 1 -- 172.21.15.7:0/2032345210 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c01e450 con 0x7f61240cb610 2023-10-06T11:01:09.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.833+0000 7f610b7fe700 1 -- 172.21.15.7:0/2032345210 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c01e7d0 con 0x7f61240cb610 2023-10-06T11:01:09.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.833+0000 7f612a073700 1 -- 172.21.15.7:0/2032345210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61240b2460 con 0x7f61240cb610 2023-10-06T11:01:09.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.833+0000 7f612a073700 1 -- 172.21.15.7:0/2032345210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612416c550 con 0x7f61240cb610 2023-10-06T11:01:09.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.834+0000 7f612a073700 1 -- 172.21.15.7:0/2032345210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612416c6e0 con 0x7f61240cb610 2023-10-06T11:01:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.835+0000 7f610b7fe700 1 -- 172.21.15.7:0/2032345210 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f611c01eb40 con 0x7f61240cb610 2023-10-06T11:01:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.836+0000 7f610b7fe700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6110066f30 0x7f61100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.836+0000 7f610b7fe700 1 -- 172.21.15.7:0/2032345210 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f611c086d30 con 0x7f61240cb610 2023-10-06T11:01:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.836+0000 7f61237fe700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6110066f30 0x7f61100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.836+0000 7f61237fe700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6110066f30 0x7f61100693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f61140011e0 tx=0x7f6114000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:09.840+0000 7f610b7fe700 1 -- 172.21.15.7:0/2032345210 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f611c053d80 con 0x7f61240cb610 2023-10-06T11:01:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.085+0000 7f612a073700 1 -- 172.21.15.7:0/2032345210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6124070480 con 0x7f61240cb610 2023-10-06T11:01:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.086+0000 7f610b7fe700 1 -- 172.21.15.7:0/2032345210 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4589 (secure 0 0 0) 0x7f611c016090 con 0x7f61240cb610 2023-10-06T11:01:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:10.088 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3539274987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3539274987},{"type":"v1","addr":"172.21.15.7:6836","nonce":3539274987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1716655212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1716655212},{"type":"v1","addr":"172.21.15.50:6834","nonce":1716655212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/186446686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":186446686},{"type":"v1","addr":"172.21.15.50:6835","nonce":186446686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:01:04.009956+0000","modified":"2023-10-06T11:01:07.613415+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5520":{"gid":5520,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/1121258860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1121258860},{"type":"v1","addr":"172.21.15.7:6837","nonce":1121258860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:01:10.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.088+0000 7f612a073700 1 -- 172.21.15.7:0/2032345210 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6110066f30 msgr2=0x7f61100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.088+0000 7f612a073700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6110066f30 0x7f61100693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f61140011e0 tx=0x7f6114000bc0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.088+0000 7f612a073700 1 -- 172.21.15.7:0/2032345210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61240cb610 msgr2=0x7f61240c4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.088+0000 7f612a073700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61240cb610 0x7f61240c4630 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f611c0097c0 tx=0x7f611c017000 comp rx=0 tx=0).stop 2023-10-06T11:01:10.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.088+0000 7f612a073700 1 -- 172.21.15.7:0/2032345210 shutdown_connections 2023-10-06T11:01:10.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.088+0000 7f612a073700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6110066f30 0x7f61100693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.088+0000 7f612a073700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61240cb610 0x7f61240c4630 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.088+0000 7f612a073700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f612406ce80 0x7f612416c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.088+0000 7f612a073700 1 --2- 172.21.15.7:0/2032345210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61240c8f70 0x7f61240c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.088+0000 7f612a073700 1 -- 172.21.15.7:0/2032345210 >> 172.21.15.7:0/2032345210 conn(0x7f612406bbe0 msgr2=0x7f61240c31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:10.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.088+0000 7f612a073700 1 -- 172.21.15.7:0/2032345210 shutdown_connections 2023-10-06T11:01:10.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.088+0000 7f612a073700 1 -- 172.21.15.7:0/2032345210 wait complete. 2023-10-06T11:01:10.091 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2023-10-06T11:01:10.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:01:04.009956+0000', 'modified': '2023-10-06T11:01:07.613415+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5520}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5520': {'gid': 5520, 'name': 'c', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6837/1121258860', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 1121258860}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 1121258860}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:01:10.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:01:10.506 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T11:01:10.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.647+0000 7ff8336be700 1 Processor -- start 2023-10-06T11:01:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.647+0000 7ff8336be700 1 -- start start 2023-10-06T11:01:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.648+0000 7ff8336be700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff82c068a90 0x7ff82c0c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.648+0000 7ff8336be700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff82c15d900 0x7ff82c0c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.648+0000 7ff8336be700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c069f50 con 0x7ff82c0cbe40 2023-10-06T11:01:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.648+0000 7ff8336be700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82c06ab60 con 0x7ff82c068a90 2023-10-06T11:01:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.648+0000 7ff8336be700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c06a230 con 0x7ff82c15d900 2023-10-06T11:01:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.648+0000 7ff83145a700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff82c0cbe40 0x7ff82c15d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48456/0 (socket says 172.21.15.7:48456) 2023-10-06T11:01:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.648+0000 7ff83145a700 1 -- 172.21.15.7:0/775701345 learned_addr learned my addr 172.21.15.7:0/775701345 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.648+0000 7ff830c59700 1 --2- 172.21.15.7:0/775701345 >> v2:172.21.15.50:3300/0 conn(0x7ff82c068a90 0x7ff82c0c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.648+0000 7ff831c5b700 1 --2- 172.21.15.7:0/775701345 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff82c15d900 0x7ff82c0c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.648+0000 7ff823fff700 1 -- 172.21.15.7:0/775701345 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313785431 0 0) 0x7ff82c069f50 con 0x7ff82c0cbe40 2023-10-06T11:01:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.648+0000 7ff823fff700 1 -- 172.21.15.7:0/775701345 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff818003570 con 0x7ff82c0cbe40 2023-10-06T11:01:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.649+0000 7ff823fff700 1 -- 172.21.15.7:0/775701345 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 675385319 0 0) 0x7ff818003570 con 0x7ff82c0cbe40 2023-10-06T11:01:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.649+0000 7ff830c59700 1 -- 172.21.15.7:0/775701345 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff82c15d900 msgr2=0x7ff82c0c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.649+0000 7ff830c59700 1 --2- 172.21.15.7:0/775701345 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff82c15d900 0x7ff82c0c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.649+0000 7ff830c59700 1 -- 172.21.15.7:0/775701345 >> v1:172.21.15.7:6789/0 conn(0x7ff82c0cbe40 legacy=0x7ff82c15d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.649+0000 7ff830c59700 1 -- 172.21.15.7:0/775701345 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c06a510 con 0x7ff82c068a90 2023-10-06T11:01:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.649+0000 7ff831c5b700 1 --2- 172.21.15.7:0/775701345 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff82c15d900 0x7ff82c0c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:01:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.649+0000 7ff830c59700 1 --2- 172.21.15.7:0/775701345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff82c068a90 0x7ff82c0c87a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0098e0 tx=0x7ff81c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31da916bc19903a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.649+0000 7ff823fff700 1 -- 172.21.15.7:0/775701345 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8280015f0 con 0x7ff82c068a90 2023-10-06T11:01:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.649+0000 7ff823fff700 1 -- 172.21.15.7:0/775701345 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c011420 con 0x7ff82c068a90 2023-10-06T11:01:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.649+0000 7ff823fff700 1 -- 172.21.15.7:0/775701345 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c0117c0 con 0x7ff82c068a90 2023-10-06T11:01:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.650+0000 7ff8336be700 1 -- 172.21.15.7:0/775701345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff82c068a90 msgr2=0x7ff82c0c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.650+0000 7ff8336be700 1 --2- 172.21.15.7:0/775701345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff82c068a90 0x7ff82c0c87a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0098e0 tx=0x7ff81c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.650+0000 7ff8336be700 1 -- 172.21.15.7:0/775701345 shutdown_connections 2023-10-06T11:01:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.650+0000 7ff8336be700 1 --2- 172.21.15.7:0/775701345 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff82c15d900 0x7ff82c0c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.650+0000 7ff8336be700 1 --2- 172.21.15.7:0/775701345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff82c068a90 0x7ff82c0c87a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.650+0000 7ff8336be700 1 -- 172.21.15.7:0/775701345 >> 172.21.15.7:0/775701345 conn(0x7ff82c087920 msgr2=0x7ff82c097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.650+0000 7ff8336be700 1 -- 172.21.15.7:0/775701345 shutdown_connections 2023-10-06T11:01:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.650+0000 7ff8336be700 1 -- 172.21.15.7:0/775701345 wait complete. 2023-10-06T11:01:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.651+0000 7ff8336be700 1 Processor -- start 2023-10-06T11:01:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.651+0000 7ff8336be700 1 -- start start 2023-10-06T11:01:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.652+0000 7ff8336be700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff82c068a90 0x7ff82c0c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.652+0000 7ff8336be700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff82c0cbe40 0x7ff82c1601d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.652+0000 7ff8336be700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff82c15d900 0x7ff82c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.652+0000 7ff8336be700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c161570 con 0x7ff82c0cbe40 2023-10-06T11:01:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.652+0000 7ff8336be700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c160710 con 0x7ff82c068a90 2023-10-06T11:01:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.652+0000 7ff8336be700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c160960 con 0x7ff82c15d900 2023-10-06T11:01:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.652+0000 7ff830c59700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff82c0cbe40 0x7ff82c1601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.652+0000 7ff830c59700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff82c0cbe40 0x7ff82c1601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38198/0 (socket says 172.21.15.7:38198) 2023-10-06T11:01:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.652+0000 7ff830c59700 1 -- 172.21.15.7:0/2442485887 learned_addr learned my addr 172.21.15.7:0/2442485887 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.652+0000 7ff831c5b700 1 --2- 172.21.15.7:0/2442485887 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff82c15d900 0x7ff82c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.652+0000 7ff83145a700 1 --2- 172.21.15.7:0/2442485887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff82c068a90 0x7ff82c0c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.652+0000 7ff830c59700 1 -- 172.21.15.7:0/2442485887 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff82c15d900 msgr2=0x7ff82c15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.652+0000 7ff830c59700 1 --2- 172.21.15.7:0/2442485887 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff82c15d900 0x7ff82c15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.652+0000 7ff830c59700 1 -- 172.21.15.7:0/2442485887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff82c068a90 msgr2=0x7ff82c0c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.653+0000 7ff830c59700 1 --2- 172.21.15.7:0/2442485887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff82c068a90 0x7ff82c0c1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.653+0000 7ff830c59700 1 -- 172.21.15.7:0/2442485887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff824009a20 con 0x7ff82c0cbe40 2023-10-06T11:01:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.653+0000 7ff830c59700 1 --2- 172.21.15.7:0/2442485887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff82c0cbe40 0x7ff82c1601d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0030c0 tx=0x7ff81c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.653+0000 7ff8217fa700 1 -- 172.21.15.7:0/2442485887 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c01cc90 con 0x7ff82c0cbe40 2023-10-06T11:01:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.653+0000 7ff8217fa700 1 -- 172.21.15.7:0/2442485887 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c01cdf0 con 0x7ff82c0cbe40 2023-10-06T11:01:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.653+0000 7ff8336be700 1 -- 172.21.15.7:0/2442485887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff81c009420 con 0x7ff82c0cbe40 2023-10-06T11:01:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.653+0000 7ff8217fa700 1 -- 172.21.15.7:0/2442485887 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c01a6a0 con 0x7ff82c0cbe40 2023-10-06T11:01:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.653+0000 7ff8336be700 1 -- 172.21.15.7:0/2442485887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c160f20 con 0x7ff82c0cbe40 2023-10-06T11:01:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.654+0000 7ff8217fa700 1 -- 172.21.15.7:0/2442485887 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff81c01aad0 con 0x7ff82c0cbe40 2023-10-06T11:01:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.655+0000 7ff8217fa700 1 --2- 172.21.15.7:0/2442485887 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff810066f30 0x7ff8100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.655+0000 7ff8217fa700 1 -- 172.21.15.7:0/2442485887 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff81c086270 con 0x7ff82c0cbe40 2023-10-06T11:01:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.655+0000 7ff83145a700 1 --2- 172.21.15.7:0/2442485887 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff810066f30 0x7ff8100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.655+0000 7ff83145a700 1 --2- 172.21.15.7:0/2442485887 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff810066f30 0x7ff8100693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff828002ee0 tx=0x7ff828009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.657+0000 7ff83c9d2b80 1 Processor -- start 2023-10-06T11:01:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.657+0000 7ff83c9d2b80 1 -- start start 2023-10-06T11:01:10.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff83c9d2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444ba450 0x5567444ba820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff83c9d2b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 0x5567444c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff83c9d2b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444c34d0 0x5567444c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff83c9d2b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674438d310 con 0x5567444c34d0 2023-10-06T11:01:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff83c9d2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567443ca130 con 0x5567444ba450 2023-10-06T11:01:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff83c9d2b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567443c7af0 con 0x55674449ff40 2023-10-06T11:01:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff831c5b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444c34d0 0x5567444c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff831c5b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444c34d0 0x5567444c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38214/0 (socket says 172.21.15.7:38214) 2023-10-06T11:01:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff831c5b700 1 -- 172.21.15.7:0/706369869 learned_addr learned my addr 172.21.15.7:0/706369869 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff83145a700 1 --2- 172.21.15.7:0/706369869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444ba450 0x5567444ba820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff830c59700 1 --2- 172.21.15.7:0/706369869 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 0x5567444c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff831c5b700 1 -- 172.21.15.7:0/706369869 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 msgr2=0x5567444c2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff831c5b700 1 --2- 172.21.15.7:0/706369869 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 0x5567444c2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff831c5b700 1 -- 172.21.15.7:0/706369869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444ba450 msgr2=0x5567444ba820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff831c5b700 1 --2- 172.21.15.7:0/706369869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444ba450 0x5567444ba820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff831c5b700 1 -- 172.21.15.7:0/706369869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567441c9790 con 0x5567444c34d0 2023-10-06T11:01:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.658+0000 7ff831c5b700 1 --2- 172.21.15.7:0/706369869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444c34d0 0x5567444c3940 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff8240076c0 tx=0x7ff82400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170e091bd8b84f65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.659+0000 7ff8167fc700 1 -- 172.21.15.7:0/706369869 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82400e070 con 0x5567444c34d0 2023-10-06T11:01:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.659+0000 7ff8167fc700 1 -- 172.21.15.7:0/706369869 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82400f040 con 0x5567444c34d0 2023-10-06T11:01:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.659+0000 7ff8167fc700 1 -- 172.21.15.7:0/706369869 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824015880 con 0x5567444c34d0 2023-10-06T11:01:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.659+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/706369869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444c34d0 msgr2=0x5567444c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.659+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/706369869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444c34d0 0x5567444c3940 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff8240076c0 tx=0x7ff82400b040 comp rx=0 tx=0).stop 2023-10-06T11:01:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.659+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/706369869 shutdown_connections 2023-10-06T11:01:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.659+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/706369869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444c34d0 0x5567444c3940 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.659+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/706369869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444ba450 0x5567444ba820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.659+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/706369869 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 0x5567444c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.659+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/706369869 >> 172.21.15.7:0/706369869 conn(0x5567444bd880 msgr2=0x5567444bdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.659+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/706369869 shutdown_connections 2023-10-06T11:01:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.659+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/706369869 wait complete. 2023-10-06T11:01:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.660+0000 7ff83c9d2b80 1 -- start start 2023-10-06T11:01:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.660+0000 7ff83c9d2b80 1 Processor -- start 2023-10-06T11:01:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.661+0000 7ff83c9d2b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 0x556744493cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.661+0000 7ff83c9d2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444ba450 0x556744497b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.661+0000 7ff83c9d2b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444c34d0 0x556744498710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.661+0000 7ff83c9d2b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567443c38e0 con 0x5567444c34d0 2023-10-06T11:01:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.661+0000 7ff83c9d2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674436f980 con 0x5567444ba450 2023-10-06T11:01:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.661+0000 7ff83c9d2b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x55674436f620 con 0x55674449ff40 2023-10-06T11:01:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.661+0000 7ff83c9d2b80 10 client.0 _ll_register_callbacks cb 0x5567441d2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:01:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.661+0000 7ff831c5b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444c34d0 0x556744498710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.661+0000 7ff831c5b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444c34d0 0x556744498710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38228/0 (socket says 172.21.15.7:38228) 2023-10-06T11:01:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.661+0000 7ff831c5b700 1 -- 172.21.15.7:0/2661987555 learned_addr learned my addr 172.21.15.7:0/2661987555 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.661+0000 7ff83145a700 1 --2- 172.21.15.7:0/2661987555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 0x556744493cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.661+0000 7ff830c59700 1 --2- 172.21.15.7:0/2661987555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444ba450 0x556744497b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff831c5b700 1 -- 172.21.15.7:0/2661987555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 msgr2=0x556744493cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff831c5b700 1 --2- 172.21.15.7:0/2661987555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 0x556744493cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff831c5b700 1 -- 172.21.15.7:0/2661987555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444ba450 msgr2=0x556744497b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff831c5b700 1 --2- 172.21.15.7:0/2661987555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444ba450 0x556744497b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff831c5b700 1 -- 172.21.15.7:0/2661987555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff824007420 con 0x5567444c34d0 2023-10-06T11:01:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff830c59700 1 --2- 172.21.15.7:0/2661987555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444ba450 0x556744497b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff831c5b700 1 --2- 172.21.15.7:0/2661987555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444c34d0 0x556744498710 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff8240099c0 tx=0x7ff82401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9070b14deb508a40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff80b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-06T11:01:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff80b7fe700 1 -- 172.21.15.7:0/2661987555 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82401f860 con 0x5567444c34d0 2023-10-06T11:01:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff80b7fe700 1 -- 172.21.15.7:0/2661987555 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff82401f9c0 con 0x5567444c34d0 2023-10-06T11:01:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/2661987555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556744467d60 con 0x5567444c34d0 2023-10-06T11:01:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff80b7fe700 1 -- 172.21.15.7:0/2661987555 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff82401fd90 con 0x5567444c34d0 2023-10-06T11:01:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff83c9d2b80 10 client.5667 fetch_fsmap learned FSMap version 28 2023-10-06T11:01:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/2661987555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x5567442b60a0 con 0x5567444c34d0 2023-10-06T11:01:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff80b7fe700 1 -- 172.21.15.7:0/2661987555 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556744467d60 con 0x5567444c34d0 2023-10-06T11:01:10.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff80b7fe700 1 -- 172.21.15.7:0/2661987555 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff8240273f0 con 0x5567444c34d0 2023-10-06T11:01:10.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff83c9d2b80 10 client.5667 fetch_fsmap finished waiting for FSMap version 28 2023-10-06T11:01:10.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff83c9d2b80 10 client.5667 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:01:10.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff83c9d2b80 20 client.5667 populate_metadata read hostname 'smithi007' 2023-10-06T11:01:10.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/2661987555 >> [v2:172.21.15.7:6835/1121258860,v1:172.21.15.7:6837/1121258860] conn(0x5567444bbfa0 0x5567444bc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff83c9d2b80 4 client.5667 mds_command: new command op to 5520 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:01:10.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.662+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/2661987555 --> [v2:172.21.15.7:6835/1121258860,v1:172.21.15.7:6837/1121258860] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556744444b30 con 0x5567444bbfa0 2023-10-06T11:01:10.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.663+0000 7ff83145a700 1 --2- 172.21.15.7:0/2661987555 >> [v2:172.21.15.7:6835/1121258860,v1:172.21.15.7:6837/1121258860] conn(0x5567444bbfa0 0x5567444bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.663+0000 7ff80b7fe700 10 client.5667 ms_handle_connect on v2:172.21.15.7:6835/1121258860 2023-10-06T11:01:10.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.663+0000 7ff83145a700 1 --2- 172.21.15.7:0/2661987555 >> [v2:172.21.15.7:6835/1121258860,v1:172.21.15.7:6837/1121258860] conn(0x5567444bbfa0 0x5567444bc370 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=429852903248d888 server_cookie=26d1375247c99ed1 in_seq=0 out_seq=0 2023-10-06T11:01:10.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff80b7fe700 1 -- 172.21.15.7:0/2661987555 <== mds.0 v2:172.21.15.7:6835/1121258860 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x556744444b30 con 0x5567444bbfa0 2023-10-06T11:01:10.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff80b7fe700 10 client.5667 handle_command_reply: tid=0 2023-10-06T11:01:10.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff83c9d2b80 1 client.5667 shutdown 2023-10-06T11:01:10.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/2661987555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444c34d0 msgr2=0x556744498710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/2661987555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444c34d0 0x556744498710 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff8240099c0 tx=0x7ff82401b000 comp rx=0 tx=0).stop 2023-10-06T11:01:10.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/2661987555 shutdown_connections 2023-10-06T11:01:10.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/2661987555 >> [v2:172.21.15.7:6835/1121258860,v1:172.21.15.7:6837/1121258860] conn(0x5567444bbfa0 0x5567444bc370 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/2661987555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444c34d0 0x556744498710 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/2661987555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 0x556744493cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff80b7fe700 0 client.5667 ms_handle_reset on v2:172.21.15.7:6835/1121258860 2023-10-06T11:01:10.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/2661987555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444ba450 0x556744497b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/2661987555 >> 172.21.15.7:0/2661987555 conn(0x5567444bd880 msgr2=0x55674446fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:10.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/2661987555 shutdown_connections 2023-10-06T11:01:10.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/2661987555 wait complete. 2023-10-06T11:01:10.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.664+0000 7ff83c9d2b80 20 client.5667 trim_cache size 0 max 16384 2023-10-06T11:01:10.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.682+0000 7ff83c9d2b80 1 Processor -- start 2023-10-06T11:01:10.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.682+0000 7ff83c9d2b80 1 -- start start 2023-10-06T11:01:10.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.683+0000 7ff83c9d2b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674449ff40 0x55674446eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.683+0000 7ff83c9d2b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x5567444ba450 0x55674446f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.683+0000 7ff83c9d2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444c34d0 0x5567444cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.683+0000 7ff83c9d2b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674425b1e0 con 0x55674449ff40 2023-10-06T11:01:10.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.683+0000 7ff83c9d2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674449ad90 con 0x5567444c34d0 2023-10-06T11:01:10.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.683+0000 7ff83c9d2b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x55674449c950 con 0x5567444ba450 2023-10-06T11:01:10.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.683+0000 7ff83145a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674449ff40 0x55674446eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.683+0000 7ff83145a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674449ff40 0x55674446eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38242/0 (socket says 172.21.15.7:38242) 2023-10-06T11:01:10.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.683+0000 7ff83145a700 1 -- 172.21.15.7:0/3476540907 learned_addr learned my addr 172.21.15.7:0/3476540907 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:10.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.683+0000 7ff831c5b700 1 --2- 172.21.15.7:0/3476540907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444c34d0 0x5567444cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.683+0000 7ff830c59700 1 --2- 172.21.15.7:0/3476540907 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x5567444ba450 0x55674446f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.684+0000 7ff83145a700 1 -- 172.21.15.7:0/3476540907 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x5567444ba450 msgr2=0x55674446f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:10.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.684+0000 7ff83145a700 1 --2- 172.21.15.7:0/3476540907 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x5567444ba450 0x55674446f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.684+0000 7ff83145a700 1 -- 172.21.15.7:0/3476540907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444c34d0 msgr2=0x5567444cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:10.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.684+0000 7ff83145a700 1 --2- 172.21.15.7:0/3476540907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444c34d0 0x5567444cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.684+0000 7ff83145a700 1 -- 172.21.15.7:0/3476540907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567443923c0 con 0x55674449ff40 2023-10-06T11:01:10.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.684+0000 7ff83145a700 1 --2- 172.21.15.7:0/3476540907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674449ff40 0x55674446eef0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff828000ef0 tx=0x7ff828013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f351b91027567a58 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:10.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.684+0000 7ff816ffd700 1 -- 172.21.15.7:0/3476540907 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8280071d0 con 0x55674449ff40 2023-10-06T11:01:10.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.684+0000 7ff816ffd700 1 -- 172.21.15.7:0/3476540907 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff828007330 con 0x55674449ff40 2023-10-06T11:01:10.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.684+0000 7ff816ffd700 1 -- 172.21.15.7:0/3476540907 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8280057f0 con 0x55674449ff40 2023-10-06T11:01:10.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.685+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/3476540907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674449ff40 msgr2=0x55674446eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.685+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/3476540907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674449ff40 0x55674446eef0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff828000ef0 tx=0x7ff828013000 comp rx=0 tx=0).stop 2023-10-06T11:01:10.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.685+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/3476540907 shutdown_connections 2023-10-06T11:01:10.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.685+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/3476540907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674449ff40 0x55674446eef0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.685+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/3476540907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444c34d0 0x5567444cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.685+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/3476540907 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x5567444ba450 0x55674446f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.685+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/3476540907 >> 172.21.15.7:0/3476540907 conn(0x5567444bd880 msgr2=0x5567444c2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:10.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.685+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/3476540907 shutdown_connections 2023-10-06T11:01:10.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.685+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/3476540907 wait complete. 2023-10-06T11:01:10.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.685+0000 7ff83c9d2b80 1 -- start start 2023-10-06T11:01:10.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.686+0000 7ff83c9d2b80 1 Processor -- start 2023-10-06T11:01:10.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.686+0000 7ff83c9d2b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 0x556744509280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.686+0000 7ff83c9d2b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444ba450 0x55674446eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.686+0000 7ff83c9d2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444c34d0 0x55674446f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.686+0000 7ff83c9d2b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x556744495b50 con 0x5567444ba450 2023-10-06T11:01:10.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.686+0000 7ff83c9d2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556744494ab0 con 0x5567444c34d0 2023-10-06T11:01:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.686+0000 7ff83c9d2b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x556744498820 con 0x55674449ff40 2023-10-06T11:01:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff83c9d2b80 10 client.0 _ll_register_callbacks cb 0x5567441d2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:01:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff830c59700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444ba450 0x55674446eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff830c59700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444ba450 0x55674446eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38244/0 (socket says 172.21.15.7:38244) 2023-10-06T11:01:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff830c59700 1 -- 172.21.15.7:0/1865542220 learned_addr learned my addr 172.21.15.7:0/1865542220 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff83145a700 1 --2- 172.21.15.7:0/1865542220 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 0x556744509280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff831c5b700 1 --2- 172.21.15.7:0/1865542220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444c34d0 0x55674446f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff830c59700 1 -- 172.21.15.7:0/1865542220 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 msgr2=0x556744509280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff830c59700 1 --2- 172.21.15.7:0/1865542220 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 0x556744509280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff830c59700 1 -- 172.21.15.7:0/1865542220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444c34d0 msgr2=0x55674446f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff830c59700 1 --2- 172.21.15.7:0/1865542220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444c34d0 0x55674446f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff830c59700 1 -- 172.21.15.7:0/1865542220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82800f040 con 0x5567444ba450 2023-10-06T11:01:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff830c59700 1 --2- 172.21.15.7:0/1865542220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444ba450 0x55674446eef0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0091e0 tx=0x7ff81c05c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361e94e14b07287f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff80b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-06T11:01:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff80b7fe700 1 -- 172.21.15.7:0/1865542220 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c056f00 con 0x5567444ba450 2023-10-06T11:01:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff80b7fe700 1 -- 172.21.15.7:0/1865542220 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff81c05a150 con 0x5567444ba450 2023-10-06T11:01:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/1865542220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556744471660 con 0x5567444ba450 2023-10-06T11:01:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff80b7fe700 1 -- 172.21.15.7:0/1865542220 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff81c05dea0 con 0x5567444ba450 2023-10-06T11:01:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff83c9d2b80 10 client.5673 fetch_fsmap learned FSMap version 28 2023-10-06T11:01:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.687+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/1865542220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55674422a1d0 con 0x5567444ba450 2023-10-06T11:01:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.688+0000 7ff80b7fe700 1 -- 172.21.15.7:0/1865542220 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556744471660 con 0x5567444ba450 2023-10-06T11:01:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.688+0000 7ff80b7fe700 1 -- 172.21.15.7:0/1865542220 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff81c05c0b0 con 0x5567444ba450 2023-10-06T11:01:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.688+0000 7ff83c9d2b80 10 client.5673 fetch_fsmap finished waiting for FSMap version 28 2023-10-06T11:01:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.688+0000 7ff83c9d2b80 10 client.5673 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:01:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.688+0000 7ff83c9d2b80 20 client.5673 populate_metadata read hostname 'smithi007' 2023-10-06T11:01:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.688+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/1865542220 >> [v2:172.21.15.7:6835/1121258860,v1:172.21.15.7:6837/1121258860] conn(0x556744523720 0x556744523af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.688+0000 7ff83c9d2b80 4 client.5673 mds_command: new command op to 5520 tid=0[{"prefix": "status"}] 2023-10-06T11:01:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.688+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/1865542220 --> [v2:172.21.15.7:6835/1121258860,v1:172.21.15.7:6837/1121258860] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7ff82400f040 con 0x556744523720 2023-10-06T11:01:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.688+0000 7ff83145a700 1 --2- 172.21.15.7:0/1865542220 >> [v2:172.21.15.7:6835/1121258860,v1:172.21.15.7:6837/1121258860] conn(0x556744523720 0x556744523af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.688+0000 7ff80b7fe700 10 client.5673 ms_handle_connect on v2:172.21.15.7:6835/1121258860 2023-10-06T11:01:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.688+0000 7ff83145a700 1 --2- 172.21.15.7:0/1865542220 >> [v2:172.21.15.7:6835/1121258860,v1:172.21.15.7:6837/1121258860] conn(0x556744523720 0x556744523af0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=953ccffc4204b91d server_cookie=822d465d4c1a3ef4 in_seq=0 out_seq=0 2023-10-06T11:01:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.688+0000 7ff80b7fe700 1 -- 172.21.15.7:0/1865542220 <== mds.0 v2:172.21.15.7:6835/1121258860 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7ff82400f040 con 0x556744523720 2023-10-06T11:01:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.688+0000 7ff80b7fe700 10 client.5673 handle_command_reply: tid=0 2023-10-06T11:01:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.688+0000 7ff83c9d2b80 1 client.5673 shutdown 2023-10-06T11:01:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/1865542220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444ba450 msgr2=0x55674446eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/1865542220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444ba450 0x55674446eef0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0091e0 tx=0x7ff81c05c040 comp rx=0 tx=0).stop 2023-10-06T11:01:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/1865542220 shutdown_connections 2023-10-06T11:01:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/1865542220 >> [v2:172.21.15.7:6835/1121258860,v1:172.21.15.7:6837/1121258860] conn(0x556744523720 0x556744523af0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/1865542220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567444c34d0 0x55674446f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/1865542220 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55674449ff40 0x556744509280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff80b7fe700 0 client.5673 ms_handle_reset on v2:172.21.15.7:6835/1121258860 2023-10-06T11:01:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff83c9d2b80 1 --2- 172.21.15.7:0/1865542220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567444ba450 0x55674446eef0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/1865542220 >> 172.21.15.7:0/1865542220 conn(0x5567444bd880 msgr2=0x556744469870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/1865542220 shutdown_connections 2023-10-06T11:01:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff83c9d2b80 1 -- 172.21.15.7:0/1865542220 wait complete. 2023-10-06T11:01:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff83c9d2b80 20 client.5673 trim_cache size 0 max 16384 2023-10-06T11:01:10.698 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:01:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "ff7fc17b-4d49-4596-ba3b-1d865cad8f21", 2023-10-06T11:01:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-06T11:01:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5520, 2023-10-06T11:01:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-06T11:01:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-06T11:01:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-06T11:01:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 6.1021906609999998, 2023-10-06T11:01:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 28, 2023-10-06T11:01:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 57, 2023-10-06T11:01:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 57, 2023-10-06T11:01:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 13.079645699 2023-10-06T11:01:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:01:10.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff8336be700 1 -- 172.21.15.7:0/2442485887 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff810066f30 msgr2=0x7ff8100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff8336be700 1 --2- 172.21.15.7:0/2442485887 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff810066f30 0x7ff8100693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff828002ee0 tx=0x7ff828009040 comp rx=0 tx=0).stop 2023-10-06T11:01:10.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff8336be700 1 -- 172.21.15.7:0/2442485887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff82c0cbe40 msgr2=0x7ff82c1601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.689+0000 7ff8336be700 1 --2- 172.21.15.7:0/2442485887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff82c0cbe40 0x7ff82c1601d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0030c0 tx=0x7ff81c016000 comp rx=0 tx=0).stop 2023-10-06T11:01:10.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.690+0000 7ff8336be700 1 -- 172.21.15.7:0/2442485887 shutdown_connections 2023-10-06T11:01:10.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.690+0000 7ff8336be700 1 --2- 172.21.15.7:0/2442485887 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff810066f30 0x7ff8100693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.690+0000 7ff8336be700 1 --2- 172.21.15.7:0/2442485887 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff82c15d900 0x7ff82c15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.690+0000 7ff8336be700 1 --2- 172.21.15.7:0/2442485887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff82c068a90 0x7ff82c0c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.690+0000 7ff8336be700 1 --2- 172.21.15.7:0/2442485887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff82c0cbe40 0x7ff82c1601d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.690+0000 7ff8336be700 1 -- 172.21.15.7:0/2442485887 >> 172.21.15.7:0/2442485887 conn(0x7ff82c087920 msgr2=0x7ff82c06d880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:10.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.690+0000 7ff8336be700 1 -- 172.21.15.7:0/2442485887 shutdown_connections 2023-10-06T11:01:10.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.690+0000 7ff8336be700 1 -- 172.21.15.7:0/2442485887 wait complete. 2023-10-06T11:01:10.704 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:01:10.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.836+0000 7fb9614ad700 1 Processor -- start 2023-10-06T11:01:10.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.836+0000 7fb9614ad700 1 -- start start 2023-10-06T11:01:10.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.836+0000 7fb9614ad700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb95c0af320 0x7fb95c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.837+0000 7fb9614ad700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb95c0cf6c0 con 0x7fb95c0695f0 2023-10-06T11:01:10.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.837+0000 7fb9614ad700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb95c0ceab0 con 0x7fb95c0cb580 2023-10-06T11:01:10.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.837+0000 7fb9614ad700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95c159c00 con 0x7fb95c0af320 2023-10-06T11:01:10.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.837+0000 7fb95b7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb95c0695f0 0x7fb95c0afc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48470/0 (socket says 172.21.15.7:48470) 2023-10-06T11:01:10.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.837+0000 7fb95b7fe700 1 -- 172.21.15.7:0/2870711245 learned_addr learned my addr 172.21.15.7:0/2870711245 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:10.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.837+0000 7fb95affd700 1 --2- 172.21.15.7:0/2870711245 >> v2:172.21.15.50:3300/0 conn(0x7fb95c0af320 0x7fb95c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.837+0000 7fb959ffb700 1 -- 172.21.15.7:0/2870711245 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887918539 0 0) 0x7fb95c0cf6c0 con 0x7fb95c0695f0 2023-10-06T11:01:10.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.837+0000 7fb959ffb700 1 -- 172.21.15.7:0/2870711245 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb944003570 con 0x7fb95c0695f0 2023-10-06T11:01:10.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.837+0000 7fb959ffb700 1 -- 172.21.15.7:0/2870711245 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3624638812 0 0) 0x7fb95c0ceab0 con 0x7fb95c0cb580 2023-10-06T11:01:10.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.837+0000 7fb959ffb700 1 -- 172.21.15.7:0/2870711245 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb95c0cf6c0 con 0x7fb95c0cb580 2023-10-06T11:01:10.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.837+0000 7fb95affd700 1 -- 172.21.15.7:0/2870711245 >> v1:172.21.15.50:6789/0 conn(0x7fb95c0cb580 legacy=0x7fb95c068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.837+0000 7fb95affd700 1 -- 172.21.15.7:0/2870711245 >> v1:172.21.15.7:6789/0 conn(0x7fb95c0695f0 legacy=0x7fb95c0afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.837+0000 7fb95affd700 1 -- 172.21.15.7:0/2870711245 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c0ced90 con 0x7fb95c0af320 2023-10-06T11:01:10.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.838+0000 7fb95affd700 1 --2- 172.21.15.7:0/2870711245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb95c0af320 0x7fb95c0cb040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0098e0 tx=0x7fb94c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7e37e3d715eafae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:10.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.838+0000 7fb959ffb700 1 -- 172.21.15.7:0/2870711245 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c011630 con 0x7fb95c0af320 2023-10-06T11:01:10.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.838+0000 7fb959ffb700 1 -- 172.21.15.7:0/2870711245 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c011790 con 0x7fb95c0af320 2023-10-06T11:01:10.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.838+0000 7fb959ffb700 1 -- 172.21.15.7:0/2870711245 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c011b30 con 0x7fb95c0af320 2023-10-06T11:01:10.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.838+0000 7fb9614ad700 1 -- 172.21.15.7:0/2870711245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb95c0af320 msgr2=0x7fb95c0cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.838+0000 7fb9614ad700 1 --2- 172.21.15.7:0/2870711245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb95c0af320 0x7fb95c0cb040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0098e0 tx=0x7fb94c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.838+0000 7fb9614ad700 1 -- 172.21.15.7:0/2870711245 shutdown_connections 2023-10-06T11:01:10.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.838+0000 7fb9614ad700 1 --2- 172.21.15.7:0/2870711245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb95c0af320 0x7fb95c0cb040 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.838+0000 7fb9614ad700 1 -- 172.21.15.7:0/2870711245 >> 172.21.15.7:0/2870711245 conn(0x7fb95c067b80 msgr2=0x7fb95c0d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:10.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.838+0000 7fb9614ad700 1 -- 172.21.15.7:0/2870711245 shutdown_connections 2023-10-06T11:01:10.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.838+0000 7fb9614ad700 1 -- 172.21.15.7:0/2870711245 wait complete. 2023-10-06T11:01:10.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.840+0000 7fb9614ad700 1 Processor -- start 2023-10-06T11:01:10.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.840+0000 7fb9614ad700 1 -- start start 2023-10-06T11:01:10.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.840+0000 7fb9614ad700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb95c0695f0 0x7fb95c1545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb9614ad700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb95c0af320 0x7fb95c158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb9614ad700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c0cb580 0x7fb95c158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb9614ad700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c0b17f0 con 0x7fb95c0cb580 2023-10-06T11:01:10.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb9614ad700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c0b3e20 con 0x7fb95c0af320 2023-10-06T11:01:10.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb9614ad700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c0b3b40 con 0x7fb95c0695f0 2023-10-06T11:01:10.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb95b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c0cb580 0x7fb95c158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb95b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c0cb580 0x7fb95c158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38250/0 (socket says 172.21.15.7:38250) 2023-10-06T11:01:10.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb95b7fe700 1 -- 172.21.15.7:0/3527243634 learned_addr learned my addr 172.21.15.7:0/3527243634 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:10.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb95affd700 1 --2- 172.21.15.7:0/3527243634 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb95c0695f0 0x7fb95c1545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb95a7fc700 1 --2- 172.21.15.7:0/3527243634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb95c0af320 0x7fb95c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb95b7fe700 1 -- 172.21.15.7:0/3527243634 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb95c0695f0 msgr2=0x7fb95c1545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb95b7fe700 1 --2- 172.21.15.7:0/3527243634 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb95c0695f0 0x7fb95c1545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb95b7fe700 1 -- 172.21.15.7:0/3527243634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb95c0af320 msgr2=0x7fb95c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:10.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb95b7fe700 1 --2- 172.21.15.7:0/3527243634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb95c0af320 0x7fb95c158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:10.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb95b7fe700 1 -- 172.21.15.7:0/3527243634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c009420 con 0x7fb95c0cb580 2023-10-06T11:01:10.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb95b7fe700 1 --2- 172.21.15.7:0/3527243634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c0cb580 0x7fb95c158580 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb954001460 tx=0x7fb954001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:10.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb942ffd700 1 -- 172.21.15.7:0/3527243634 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95400a8b0 con 0x7fb95c0cb580 2023-10-06T11:01:10.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb942ffd700 1 -- 172.21.15.7:0/3527243634 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95400aa10 con 0x7fb95c0cb580 2023-10-06T11:01:10.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb9614ad700 1 -- 172.21.15.7:0/3527243634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95c0b11a0 con 0x7fb95c0cb580 2023-10-06T11:01:10.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.841+0000 7fb942ffd700 1 -- 172.21.15.7:0/3527243634 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95400adb0 con 0x7fb95c0cb580 2023-10-06T11:01:10.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.842+0000 7fb9614ad700 1 -- 172.21.15.7:0/3527243634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95c0b37d0 con 0x7fb95c0cb580 2023-10-06T11:01:10.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.843+0000 7fb9614ad700 1 -- 172.21.15.7:0/3527243634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95c070480 con 0x7fb95c0cb580 2023-10-06T11:01:10.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.843+0000 7fb942ffd700 1 -- 172.21.15.7:0/3527243634 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb954007300 con 0x7fb95c0cb580 2023-10-06T11:01:10.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.843+0000 7fb942ffd700 1 --2- 172.21.15.7:0/3527243634 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb948066f30 0x7fb9480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:10.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.844+0000 7fb942ffd700 1 -- 172.21.15.7:0/3527243634 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb954084af0 con 0x7fb95c0cb580 2023-10-06T11:01:10.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.844+0000 7fb95affd700 1 --2- 172.21.15.7:0/3527243634 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb948066f30 0x7fb9480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:10.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.844+0000 7fb95affd700 1 --2- 172.21.15.7:0/3527243634 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb948066f30 0x7fb9480693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0093f0 tx=0x7fb94c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:10.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:10.848+0000 7fb942ffd700 1 -- 172.21.15.7:0/3527243634 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb954051b40 con 0x7fb95c0cb580 2023-10-06T11:01:10.939 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:01:10.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:01:11.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:11.102+0000 7fb9614ad700 1 -- 172.21.15.7:0/3527243634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb95c0b1930 con 0x7fb95c0cb580 2023-10-06T11:01:11.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:11.103+0000 7fb942ffd700 1 -- 172.21.15.7:0/3527243634 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb954055160 con 0x7fb95c0cb580 2023-10-06T11:01:11.105 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:01:11.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:11.105+0000 7fb9614ad700 1 -- 172.21.15.7:0/3527243634 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb948066f30 msgr2=0x7fb9480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:11.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:11.105+0000 7fb9614ad700 1 --2- 172.21.15.7:0/3527243634 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb948066f30 0x7fb9480693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0093f0 tx=0x7fb94c017000 comp rx=0 tx=0).stop 2023-10-06T11:01:11.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:11.105+0000 7fb9614ad700 1 -- 172.21.15.7:0/3527243634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c0cb580 msgr2=0x7fb95c158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:11.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:11.105+0000 7fb9614ad700 1 --2- 172.21.15.7:0/3527243634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c0cb580 0x7fb95c158580 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb954001460 tx=0x7fb954001ac0 comp rx=0 tx=0).stop 2023-10-06T11:01:11.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:11.105+0000 7fb9614ad700 1 -- 172.21.15.7:0/3527243634 shutdown_connections 2023-10-06T11:01:11.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:11.105+0000 7fb9614ad700 1 --2- 172.21.15.7:0/3527243634 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb948066f30 0x7fb9480693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:11.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:11.105+0000 7fb9614ad700 1 --2- 172.21.15.7:0/3527243634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c0cb580 0x7fb95c158580 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:11.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:11.105+0000 7fb9614ad700 1 --2- 172.21.15.7:0/3527243634 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb95c0695f0 0x7fb95c1545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:11.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:11.105+0000 7fb9614ad700 1 --2- 172.21.15.7:0/3527243634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb95c0af320 0x7fb95c158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:11.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:11.105+0000 7fb9614ad700 1 -- 172.21.15.7:0/3527243634 >> 172.21.15.7:0/3527243634 conn(0x7fb95c067b80 msgr2=0x7fb95c0cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:11.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:11.105+0000 7fb9614ad700 1 -- 172.21.15.7:0/3527243634 shutdown_connections 2023-10-06T11:01:11.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:11.105+0000 7fb9614ad700 1 -- 172.21.15.7:0/3527243634 wait complete. 2023-10-06T11:01:11.120 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:01:11.120 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:01:11.121 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-06T11:01:11.121 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:01:11.121 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:11.121 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:01:11.121 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:01:11.121 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:01:11.121 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:01:11.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:11.121 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-06T11:01:11.142 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:01:11.142 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:01:11.142 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:01:11.142 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:11.142 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-06T11:01:11.142 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:11.143 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:01:11.143 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:11.143 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-06T11:01:11.143 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:01:11.143 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:11.143 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-06T11:01:11.143 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:01:11.143 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:11.143 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-06T11:01:11.143 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:01:11.143 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42294sec preferred_lft 42294sec 2023-10-06T11:01:11.144 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-06T11:01:11.144 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:11.144 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:01:11.144 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:11.144 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-06T11:01:11.144 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:01:11.144 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 4e:b6:a2:96:c6:8a brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:11.144 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:01:11.144 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:11.144 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::10ea:76ff:fedd:887a/64 scope link 2023-10-06T11:01:11.145 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:11.145 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:01:11.145 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether b6:89:e7:77:c6:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:01:11.145 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::b489:e7ff:fe77:c63a/64 scope link 2023-10-06T11:01:11.145 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:11.145 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:01:11.145 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 4e:b6:a2:96:c6:8a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:01:11.145 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::4cb6:a2ff:fe96:c68a/64 scope link 2023-10-06T11:01:11.145 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:11.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:11.146 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:01:11.213 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-06T11:01:11.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:11.215 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-06T11:01:11.280 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-06T11:01:11.280 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:01:11.281 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:01:11.281 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:01:11.281 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:01:11.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:11.281 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T11:01:11.281 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T11:01:11.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:01:11.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:01:11.282 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:01:11.282 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T11:01:11.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:11.404 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-06T11:01:11.425 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:01:11.425 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:01:11.425 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:01:11.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:11.425 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-06T11:01:11.500 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:01:11.501 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:01:11.501 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:11.564 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:01:11.564 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:01:11.564 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:11.627 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T11:01:11.703 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:01:11.704 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:01:11.778 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:01:11.780 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:01:11.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:11.780 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T11:01:11.843 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:01:11.843 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:01:11.886 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T11:01:11.921 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:01:11.921 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:01:11.986 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2023-10-06T11:01:11.984+0000 7f878bcd2540 -1 init, newargv = 0x559f755396b0 newargc=15 2023-10-06T11:01:11.986 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[140454]: starting ceph client 2023-10-06T11:01:11.991 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[140454]: starting fuse 2023-10-06T11:01:11.994 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:01:11.996 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:01:11.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:11.996 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T11:01:12.057 INFO:teuthology.orchestra.run.smithi007.stdout:47 2023-10-06T11:01:12.057 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T11:01:12.057 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:01:12.057 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2023-10-06T11:01:12.057 DEBUG:teuthology.orchestra.run.smithi007:> import re 2023-10-06T11:01:12.057 DEBUG:teuthology.orchestra.run.smithi007:> import os 2023-10-06T11:01:12.058 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2023-10-06T11:01:12.058 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:01:12.058 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2023-10-06T11:01:12.058 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:01:12.058 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2023-10-06T11:01:12.058 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:01:12.058 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:01:12.058 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2023-10-06T11:01:12.058 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2023-10-06T11:01:12.058 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2023-10-06T11:01:12.058 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2023-10-06T11:01:12.059 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:01:12.059 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2023-10-06T11:01:12.059 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:01:12.059 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:01:12.059 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:01:12.059 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2023-10-06T11:01:12.059 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2023-10-06T11:01:12.059 DEBUG:teuthology.orchestra.run.smithi007:> return f 2023-10-06T11:01:12.059 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:01:12.059 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:01:12.059 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.0")) 2023-10-06T11:01:12.059 DEBUG:teuthology.orchestra.run.smithi007:> ' 2023-10-06T11:01:12.197 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.140454.asok 2023-10-06T11:01:12.379 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.140454.asok 2023-10-06T11:01:12.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:12.379 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.140454.asok status 2023-10-06T11:01:12.555 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:01:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2023-10-06T11:01:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:01:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:01:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2023-10-06T11:01:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2023-10-06T11:01:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:01:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "140454", 2023-10-06T11:01:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2023-10-06T11:01:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:01:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2023-10-06T11:01:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2023-10-06T11:01:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5685, 2023-10-06T11:01:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2023-10-06T11:01:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2023-10-06T11:01:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2023-10-06T11:01:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 5685 2023-10-06T11:01:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:01:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T11:01:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T11:01:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:01:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1831367974 2023-10-06T11:01:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:01:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:01:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T11:01:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T11:01:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:01:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1831367974 2023-10-06T11:01:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:01:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.5685 192.168.0.1:0/1831367974", 2023-10-06T11:01:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.1:0/1831367974", 2023-10-06T11:01:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2023-10-06T11:01:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 28, 2023-10-06T11:01:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 57, 2023-10-06T11:01:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:01:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2023-10-06T11:01:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2023-10-06T11:01:12.559 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:01:12.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:12.566 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2023-10-06T11:01:12.566 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:12.587 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2023-10-06T11:01:12.587 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:12.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:12.587 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:12.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:12.661 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2023-10-06T11:01:12.733 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2023-10-06T11:01:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.919+0000 7fa0828ba700 1 Processor -- start 2023-10-06T11:01:12.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.920+0000 7fa0828ba700 1 -- start start 2023-10-06T11:01:12.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.920+0000 7fa0828ba700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa07c0ae430 0x7fa07c0b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:12.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.920+0000 7fa0828ba700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa07c0b0540 0x7fa07c06c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:12.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.920+0000 7fa0828ba700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa07c06c770 0x7fa07c06db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:12.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.920+0000 7fa0828ba700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07c0af590 con 0x7fa07c0ae430 2023-10-06T11:01:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.920+0000 7fa0828ba700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07c15bc60 con 0x7fa07c06c770 2023-10-06T11:01:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.920+0000 7fa0828ba700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c06cb90 con 0x7fa07c0b0540 2023-10-06T11:01:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.921+0000 7fa07bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa07c0ae430 0x7fa07c0b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.921+0000 7fa07bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa07c0ae430 0x7fa07c0b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38260/0 (socket says 172.21.15.7:38260) 2023-10-06T11:01:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.921+0000 7fa07bfff700 1 -- 172.21.15.7:0/3637276288 learned_addr learned my addr 172.21.15.7:0/3637276288 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.921+0000 7fa07b7fe700 1 --2- 172.21.15.7:0/3637276288 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa07c0b0540 0x7fa07c06c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.921+0000 7fa080e57700 1 --2- 172.21.15.7:0/3637276288 >> v2:172.21.15.50:3300/0 conn(0x7fa07c06c770 0x7fa07c06db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.921+0000 7fa07bfff700 1 -- 172.21.15.7:0/3637276288 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa07c0b0540 msgr2=0x7fa07c06c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.921+0000 7fa07bfff700 1 --2- 172.21.15.7:0/3637276288 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa07c0b0540 0x7fa07c06c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.921+0000 7fa07bfff700 1 -- 172.21.15.7:0/3637276288 >> v2:172.21.15.50:3300/0 conn(0x7fa07c06c770 msgr2=0x7fa07c06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.921+0000 7fa07bfff700 1 --2- 172.21.15.7:0/3637276288 >> v2:172.21.15.50:3300/0 conn(0x7fa07c06c770 0x7fa07c06db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:12.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.921+0000 7fa07bfff700 1 -- 172.21.15.7:0/3637276288 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c15b050 con 0x7fa07c0ae430 2023-10-06T11:01:12.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.921+0000 7fa07bfff700 1 --2- 172.21.15.7:0/3637276288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa07c0ae430 0x7fa07c0b0000 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0ad810 tx=0x7fa06c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1f8f301b690c53 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:12.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.921+0000 7fa07affd700 1 -- 172.21.15.7:0/3637276288 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00b820 con 0x7fa07c0ae430 2023-10-06T11:01:12.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.921+0000 7fa07affd700 1 -- 172.21.15.7:0/3637276288 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c00b980 con 0x7fa07c0ae430 2023-10-06T11:01:12.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.921+0000 7fa07affd700 1 -- 172.21.15.7:0/3637276288 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00bd20 con 0x7fa07c0ae430 2023-10-06T11:01:12.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.922+0000 7fa0828ba700 1 -- 172.21.15.7:0/3637276288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa07c0ae430 msgr2=0x7fa07c0b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:12.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.922+0000 7fa0828ba700 1 --2- 172.21.15.7:0/3637276288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa07c0ae430 0x7fa07c0b0000 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0ad810 tx=0x7fa06c009250 comp rx=0 tx=0).stop 2023-10-06T11:01:12.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.922+0000 7fa0828ba700 1 -- 172.21.15.7:0/3637276288 shutdown_connections 2023-10-06T11:01:12.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.922+0000 7fa0828ba700 1 --2- 172.21.15.7:0/3637276288 >> v2:172.21.15.50:3300/0 conn(0x7fa07c06c770 0x7fa07c06db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:12.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.922+0000 7fa0828ba700 1 --2- 172.21.15.7:0/3637276288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa07c0ae430 0x7fa07c0b0000 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:12.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.922+0000 7fa0828ba700 1 --2- 172.21.15.7:0/3637276288 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa07c0b0540 0x7fa07c06c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:12.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.922+0000 7fa0828ba700 1 -- 172.21.15.7:0/3637276288 >> 172.21.15.7:0/3637276288 conn(0x7fa07c0cded0 msgr2=0x7fa07c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:12.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.922+0000 7fa0828ba700 1 -- 172.21.15.7:0/3637276288 shutdown_connections 2023-10-06T11:01:12.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.922+0000 7fa0828ba700 1 -- 172.21.15.7:0/3637276288 wait complete. 2023-10-06T11:01:12.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.924+0000 7fa0828ba700 1 Processor -- start 2023-10-06T11:01:12.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.924+0000 7fa0828ba700 1 -- start start 2023-10-06T11:01:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.925+0000 7fa0828ba700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa07c06c770 0x7fa07c0c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.925+0000 7fa0828ba700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa07c0ae430 0x7fa07c157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.925+0000 7fa0828ba700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07c0b0540 0x7fa07c157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.925+0000 7fa0828ba700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0c45d0 con 0x7fa07c06c770 2023-10-06T11:01:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.925+0000 7fa0828ba700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0c7ca0 con 0x7fa07c0b0540 2023-10-06T11:01:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.925+0000 7fa0828ba700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0c7f80 con 0x7fa07c0ae430 2023-10-06T11:01:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.925+0000 7fa07bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa07c06c770 0x7fa07c0c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.925+0000 7fa07bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa07c06c770 0x7fa07c0c4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38274/0 (socket says 172.21.15.7:38274) 2023-10-06T11:01:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.925+0000 7fa07bfff700 1 -- 172.21.15.7:0/2662404070 learned_addr learned my addr 172.21.15.7:0/2662404070 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.925+0000 7fa07b7fe700 1 --2- 172.21.15.7:0/2662404070 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa07c0ae430 0x7fa07c157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.925+0000 7fa080e57700 1 --2- 172.21.15.7:0/2662404070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07c0b0540 0x7fa07c157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.926+0000 7fa07bfff700 1 -- 172.21.15.7:0/2662404070 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa07c0ae430 msgr2=0x7fa07c157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.926+0000 7fa07bfff700 1 --2- 172.21.15.7:0/2662404070 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa07c0ae430 0x7fa07c157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.926+0000 7fa07bfff700 1 -- 172.21.15.7:0/2662404070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07c0b0540 msgr2=0x7fa07c157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.926+0000 7fa07bfff700 1 --2- 172.21.15.7:0/2662404070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07c0b0540 0x7fa07c157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.926+0000 7fa07bfff700 1 -- 172.21.15.7:0/2662404070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c0094f0 con 0x7fa07c06c770 2023-10-06T11:01:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.926+0000 7fa07bfff700 1 --2- 172.21.15.7:0/2662404070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa07c06c770 0x7fa07c0c4090 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0094c0 tx=0x7fa06c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.926+0000 7fa063fff700 1 -- 172.21.15.7:0/2662404070 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c011e20 con 0x7fa07c06c770 2023-10-06T11:01:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.926+0000 7fa063fff700 1 -- 172.21.15.7:0/2662404070 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c024440 con 0x7fa07c06c770 2023-10-06T11:01:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.926+0000 7fa0828ba700 1 -- 172.21.15.7:0/2662404070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07c0c18e0 con 0x7fa07c06c770 2023-10-06T11:01:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.926+0000 7fa063fff700 1 -- 172.21.15.7:0/2662404070 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c024800 con 0x7fa07c06c770 2023-10-06T11:01:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.926+0000 7fa0828ba700 1 -- 172.21.15.7:0/2662404070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07c0c6d20 con 0x7fa07c06c770 2023-10-06T11:01:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.927+0000 7fa0828ba700 1 -- 172.21.15.7:0/2662404070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07c0c1e00 con 0x7fa07c06c770 2023-10-06T11:01:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.927+0000 7fa063fff700 1 -- 172.21.15.7:0/2662404070 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa06c01a420 con 0x7fa07c06c770 2023-10-06T11:01:12.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.928+0000 7fa063fff700 1 --2- 172.21.15.7:0/2662404070 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa068066f30 0x7fa0680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:12.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.928+0000 7fa063fff700 1 -- 172.21.15.7:0/2662404070 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa06c086690 con 0x7fa07c06c770 2023-10-06T11:01:12.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.928+0000 7fa07b7fe700 1 --2- 172.21.15.7:0/2662404070 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa068066f30 0x7fa0680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:12.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.928+0000 7fa07b7fe700 1 --2- 172.21.15.7:0/2662404070 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa068066f30 0x7fa0680693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa070006fd0 tx=0x7fa070008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:12.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:12.932+0000 7fa063fff700 1 -- 172.21.15.7:0/2662404070 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa06c053660 con 0x7fa07c06c770 2023-10-06T11:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.219+0000 7fa0828ba700 1 -- 172.21.15.7:0/2662404070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) v1 -- 0x7fa07c0c1700 con 0x7fa07c06c770 2023-10-06T11:01:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.223+0000 7fa063fff700 1 -- 172.21.15.7:0/2662404070 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 183+0+0 (secure 0 0 0) 0x7fa06c056c80 con 0x7fa07c06c770 2023-10-06T11:01:13.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.225+0000 7fa0828ba700 1 -- 172.21.15.7:0/2662404070 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa068066f30 msgr2=0x7fa0680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:13.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.225+0000 7fa0828ba700 1 --2- 172.21.15.7:0/2662404070 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa068066f30 0x7fa0680693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa070006fd0 tx=0x7fa070008040 comp rx=0 tx=0).stop 2023-10-06T11:01:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.225+0000 7fa0828ba700 1 -- 172.21.15.7:0/2662404070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa07c06c770 msgr2=0x7fa07c0c4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.225+0000 7fa0828ba700 1 --2- 172.21.15.7:0/2662404070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa07c06c770 0x7fa07c0c4090 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0094c0 tx=0x7fa06c017000 comp rx=0 tx=0).stop 2023-10-06T11:01:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.225+0000 7fa0828ba700 1 -- 172.21.15.7:0/2662404070 shutdown_connections 2023-10-06T11:01:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.225+0000 7fa0828ba700 1 --2- 172.21.15.7:0/2662404070 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa068066f30 0x7fa0680693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.225+0000 7fa0828ba700 1 --2- 172.21.15.7:0/2662404070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa07c06c770 0x7fa07c0c4090 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.225+0000 7fa0828ba700 1 --2- 172.21.15.7:0/2662404070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07c0b0540 0x7fa07c157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.225+0000 7fa0828ba700 1 --2- 172.21.15.7:0/2662404070 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa07c0ae430 0x7fa07c157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.225+0000 7fa0828ba700 1 -- 172.21.15.7:0/2662404070 >> 172.21.15.7:0/2662404070 conn(0x7fa07c0cded0 msgr2=0x7fa07c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.226+0000 7fa0828ba700 1 -- 172.21.15.7:0/2662404070 shutdown_connections 2023-10-06T11:01:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.226+0000 7fa0828ba700 1 -- 172.21.15.7:0/2662404070 wait complete. 2023-10-06T11:01:13.229 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-06T11:01:13.240 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2023-10-06T11:01:13.240 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:01:13.240 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:13.279 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[140454]: fuse finished with error 0 and tester_r 0 2023-10-06T11:01:13.281 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T11:01:13.380 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T11:01:13.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:13.381 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:01:13.403 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:01:13.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.582+0000 7fd746f97700 1 Processor -- start 2023-10-06T11:01:13.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.582+0000 7fd746f97700 1 -- start start 2023-10-06T11:01:13.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.583+0000 7fd746f97700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd740159360 0x7fd7400afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:13.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.583+0000 7fd746f97700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7400ac7f0 0x7fd7400a6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:13.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.583+0000 7fd746f97700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7400aeba0 con 0x7fd7400a6ec0 2023-10-06T11:01:13.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.583+0000 7fd746f97700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7400a7310 con 0x7fd740159360 2023-10-06T11:01:13.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.583+0000 7fd746f97700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd740159730 con 0x7fd7400ac7f0 2023-10-06T11:01:13.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.583+0000 7fd744d33700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd740159360 0x7fd7400afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:13.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.583+0000 7fd745534700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd7400a6ec0 0x7fd7400670f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48482/0 (socket says 172.21.15.7:48482) 2023-10-06T11:01:13.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.583+0000 7fd745534700 1 -- 172.21.15.7:0/64650413 learned_addr learned my addr 172.21.15.7:0/64650413 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:13.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.584+0000 7fd73ffff700 1 --2- 172.21.15.7:0/64650413 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7400ac7f0 0x7fd7400a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:13.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.584+0000 7fd744d33700 1 -- 172.21.15.7:0/64650413 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7400ac7f0 msgr2=0x7fd7400a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:13.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.584+0000 7fd744d33700 1 --2- 172.21.15.7:0/64650413 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7400ac7f0 0x7fd7400a6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:13.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.584+0000 7fd744d33700 1 -- 172.21.15.7:0/64650413 >> v1:172.21.15.7:6789/0 conn(0x7fd7400a6ec0 legacy=0x7fd7400670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.584+0000 7fd73f7fe700 1 -- 172.21.15.7:0/64650413 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140655219 0 0) 0x7fd7400aeba0 con 0x7fd7400a6ec0 2023-10-06T11:01:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.584+0000 7fd744d33700 1 -- 172.21.15.7:0/64650413 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7400ae270 con 0x7fd740159360 2023-10-06T11:01:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.584+0000 7fd744d33700 1 --2- 172.21.15.7:0/64650413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd740159360 0x7fd7400afb40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd7340098e0 tx=0x7fd7340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91762fe586d520e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.584+0000 7fd73f7fe700 1 -- 172.21.15.7:0/64650413 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734009e80 con 0x7fd740159360 2023-10-06T11:01:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.584+0000 7fd73f7fe700 1 -- 172.21.15.7:0/64650413 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73400b860 con 0x7fd740159360 2023-10-06T11:01:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.584+0000 7fd73f7fe700 1 -- 172.21.15.7:0/64650413 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400bbe0 con 0x7fd740159360 2023-10-06T11:01:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.585+0000 7fd746f97700 1 -- 172.21.15.7:0/64650413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd740159360 msgr2=0x7fd7400afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.585+0000 7fd746f97700 1 --2- 172.21.15.7:0/64650413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd740159360 0x7fd7400afb40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd7340098e0 tx=0x7fd7340091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.585+0000 7fd746f97700 1 -- 172.21.15.7:0/64650413 shutdown_connections 2023-10-06T11:01:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.585+0000 7fd746f97700 1 --2- 172.21.15.7:0/64650413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd740159360 0x7fd7400afb40 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.585+0000 7fd746f97700 1 --2- 172.21.15.7:0/64650413 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7400ac7f0 0x7fd7400a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.585+0000 7fd746f97700 1 -- 172.21.15.7:0/64650413 >> 172.21.15.7:0/64650413 conn(0x7fd740095a70 msgr2=0x7fd7400af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:13.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.585+0000 7fd746f97700 1 -- 172.21.15.7:0/64650413 shutdown_connections 2023-10-06T11:01:13.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.585+0000 7fd746f97700 1 -- 172.21.15.7:0/64650413 wait complete. 2023-10-06T11:01:13.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.586+0000 7fd746f97700 1 Processor -- start 2023-10-06T11:01:13.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.586+0000 7fd746f97700 1 -- start start 2023-10-06T11:01:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.587+0000 7fd746f97700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7400a6ec0 0x7fd74015e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.587+0000 7fd746f97700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7400ac7f0 0x7fd7400990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.587+0000 7fd746f97700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd740159360 0x7fd740157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.587+0000 7fd746f97700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd740155950 con 0x7fd7400a6ec0 2023-10-06T11:01:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.587+0000 7fd746f97700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd740155600 con 0x7fd7400ac7f0 2023-10-06T11:01:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.587+0000 7fd746f97700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd740099b30 con 0x7fd740159360 2023-10-06T11:01:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.587+0000 7fd744d33700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7400a6ec0 0x7fd74015e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.587+0000 7fd744d33700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7400a6ec0 0x7fd74015e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38284/0 (socket says 172.21.15.7:38284) 2023-10-06T11:01:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.587+0000 7fd744d33700 1 -- 172.21.15.7:0/739720223 learned_addr learned my addr 172.21.15.7:0/739720223 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.587+0000 7fd745534700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd740159360 0x7fd740157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:13.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.587+0000 7fd744d33700 1 -- 172.21.15.7:0/739720223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd740159360 msgr2=0x7fd740157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:13.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.587+0000 7fd73ffff700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7400ac7f0 0x7fd7400990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:13.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.587+0000 7fd744d33700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd740159360 0x7fd740157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:13.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.587+0000 7fd744d33700 1 -- 172.21.15.7:0/739720223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7400ac7f0 msgr2=0x7fd7400990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:13.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.588+0000 7fd744d33700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7400ac7f0 0x7fd7400990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:13.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.588+0000 7fd744d33700 1 -- 172.21.15.7:0/739720223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd734009420 con 0x7fd7400a6ec0 2023-10-06T11:01:13.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.588+0000 7fd745534700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd740159360 0x7fd740157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:13.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.588+0000 7fd73ffff700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7400ac7f0 0x7fd7400990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:13.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.588+0000 7fd744d33700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7400a6ec0 0x7fd74015e110 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd74006d380 tx=0x7fd734017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:13.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.588+0000 7fd73cff9700 1 -- 172.21.15.7:0/739720223 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400bbe0 con 0x7fd7400a6ec0 2023-10-06T11:01:13.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.588+0000 7fd73cff9700 1 -- 172.21.15.7:0/739720223 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd734011420 con 0x7fd7400a6ec0 2023-10-06T11:01:13.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.588+0000 7fd746f97700 1 -- 172.21.15.7:0/739720223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd740099e10 con 0x7fd7400a6ec0 2023-10-06T11:01:13.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.588+0000 7fd73cff9700 1 -- 172.21.15.7:0/739720223 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7340117c0 con 0x7fd7400a6ec0 2023-10-06T11:01:13.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.588+0000 7fd746f97700 1 -- 172.21.15.7:0/739720223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd740157430 con 0x7fd7400a6ec0 2023-10-06T11:01:13.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.589+0000 7fd746f97700 1 -- 172.21.15.7:0/739720223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd740070480 con 0x7fd7400a6ec0 2023-10-06T11:01:13.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.589+0000 7fd73cff9700 1 -- 172.21.15.7:0/739720223 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd734011bb0 con 0x7fd7400a6ec0 2023-10-06T11:01:13.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.590+0000 7fd73cff9700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd724066f30 0x7fd7240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:13.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.590+0000 7fd73cff9700 1 -- 172.21.15.7:0/739720223 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd7340860c0 con 0x7fd7400a6ec0 2023-10-06T11:01:13.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.590+0000 7fd73ffff700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd724066f30 0x7fd7240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:13.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.590+0000 7fd73ffff700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd724066f30 0x7fd7240693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd740096ac0 tx=0x7fd72c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:13.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.594+0000 7fd73cff9700 1 -- 172.21.15.7:0/739720223 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd734053090 con 0x7fd7400a6ec0 2023-10-06T11:01:13.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.851+0000 7fd746f97700 1 -- 172.21.15.7:0/739720223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd7400ae550 con 0x7fd7400a6ec0 2023-10-06T11:01:13.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.852+0000 7fd73cff9700 1 -- 172.21.15.7:0/739720223 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd734011e60 con 0x7fd7400a6ec0 2023-10-06T11:01:13.854 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:01:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.854+0000 7fd746f97700 1 -- 172.21.15.7:0/739720223 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd724066f30 msgr2=0x7fd7240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.854+0000 7fd746f97700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd724066f30 0x7fd7240693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd740096ac0 tx=0x7fd72c008040 comp rx=0 tx=0).stop 2023-10-06T11:01:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.854+0000 7fd746f97700 1 -- 172.21.15.7:0/739720223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7400a6ec0 msgr2=0x7fd74015e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:13.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.854+0000 7fd746f97700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7400a6ec0 0x7fd74015e110 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd74006d380 tx=0x7fd734017000 comp rx=0 tx=0).stop 2023-10-06T11:01:13.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.854+0000 7fd746f97700 1 -- 172.21.15.7:0/739720223 shutdown_connections 2023-10-06T11:01:13.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.854+0000 7fd746f97700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd724066f30 0x7fd7240693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:13.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.854+0000 7fd746f97700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7400a6ec0 0x7fd74015e110 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:13.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.854+0000 7fd746f97700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd740159360 0x7fd740157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:13.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.854+0000 7fd746f97700 1 --2- 172.21.15.7:0/739720223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7400ac7f0 0x7fd7400990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:13.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.854+0000 7fd746f97700 1 -- 172.21.15.7:0/739720223 >> 172.21.15.7:0/739720223 conn(0x7fd740095a70 msgr2=0x7fd7401544c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:13.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.854+0000 7fd746f97700 1 -- 172.21.15.7:0/739720223 shutdown_connections 2023-10-06T11:01:13.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:13.854+0000 7fd746f97700 1 -- 172.21.15.7:0/739720223 wait complete. 2023-10-06T11:01:13.869 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:01:13.869 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:01:13.870 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-06T11:01:13.870 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:01:13.870 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:13.870 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:01:13.870 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:01:13.870 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:01:13.870 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:01:13.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:13.870 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-06T11:01:13.891 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:01:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:01:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:01:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-06T11:01:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:13.891 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:01:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-06T11:01:13.891 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:01:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-06T11:01:13.892 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:01:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-06T11:01:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:01:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42292sec preferred_lft 42292sec 2023-10-06T11:01:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-06T11:01:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:13.892 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:01:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-06T11:01:13.893 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:01:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 4e:b6:a2:96:c6:8a brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:01:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::10ea:76ff:fedd:887a/64 scope link 2023-10-06T11:01:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:13.893 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:01:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether b6:89:e7:77:c6:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:01:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::b489:e7ff:fe77:c63a/64 scope link 2023-10-06T11:01:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:13.893 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:01:13.894 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 4e:b6:a2:96:c6:8a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:01:13.894 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::4cb6:a2ff:fe96:c68a/64 scope link 2023-10-06T11:01:13.894 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:13.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:13.894 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:01:13.961 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-06T11:01:13.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:13.963 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-06T11:01:14.029 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-06T11:01:14.029 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:01:14.029 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:01:14.029 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:01:14.029 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:01:14.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:14.030 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T11:01:14.030 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T11:01:14.030 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:01:14.030 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:01:14.030 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:01:14.030 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T11:01:14.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:14.152 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-06T11:01:14.173 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:01:14.173 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:01:14.173 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:01:14.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:14.174 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-06T11:01:14.249 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:01:14.249 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:01:14.249 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:14.314 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:01:14.314 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:01:14.314 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:14.378 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T11:01:14.454 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:01:14.455 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:01:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:01:14.530 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:01:14.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:14.531 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T11:01:14.594 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:01:14.594 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:01:14.637 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T11:01:14.671 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:01:14.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:01:14.738 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2023-10-06T11:01:14.736+0000 7f2373284540 -1 init, newargv = 0x5589bf68e7c0 newargc=15 2023-10-06T11:01:14.738 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[141134]: starting ceph client 2023-10-06T11:01:14.744 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:01:14.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[141134]: starting fuse 2023-10-06T11:01:14.745 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:01:14.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:14.746 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T11:01:14.806 INFO:teuthology.orchestra.run.smithi007.stdout:47 2023-10-06T11:01:14.806 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T11:01:14.806 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:01:14.806 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2023-10-06T11:01:14.806 DEBUG:teuthology.orchestra.run.smithi007:> import re 2023-10-06T11:01:14.806 DEBUG:teuthology.orchestra.run.smithi007:> import os 2023-10-06T11:01:14.806 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2023-10-06T11:01:14.806 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:01:14.807 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2023-10-06T11:01:14.807 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:01:14.807 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2023-10-06T11:01:14.807 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:01:14.807 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:01:14.807 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2023-10-06T11:01:14.807 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2023-10-06T11:01:14.807 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2023-10-06T11:01:14.807 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2023-10-06T11:01:14.807 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:01:14.807 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2023-10-06T11:01:14.807 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:01:14.807 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:01:14.808 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:01:14.808 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2023-10-06T11:01:14.808 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2023-10-06T11:01:14.808 DEBUG:teuthology.orchestra.run.smithi007:> return f 2023-10-06T11:01:14.808 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:01:14.808 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:01:14.808 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.0")) 2023-10-06T11:01:14.808 DEBUG:teuthology.orchestra.run.smithi007:> ' 2023-10-06T11:01:14.944 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.141134.asok 2023-10-06T11:01:15.126 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.141134.asok 2023-10-06T11:01:15.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:15.126 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.141134.asok status 2023-10-06T11:01:15.301 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:01:15.301 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2023-10-06T11:01:15.301 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:01:15.301 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:01:15.301 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2023-10-06T11:01:15.301 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2023-10-06T11:01:15.301 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:01:15.301 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "141134", 2023-10-06T11:01:15.301 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2023-10-06T11:01:15.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:01:15.302 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2023-10-06T11:01:15.302 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2023-10-06T11:01:15.302 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5706, 2023-10-06T11:01:15.302 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2023-10-06T11:01:15.302 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2023-10-06T11:01:15.302 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2023-10-06T11:01:15.302 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 5706 2023-10-06T11:01:15.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:01:15.302 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T11:01:15.302 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T11:01:15.303 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:01:15.303 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1580309752 2023-10-06T11:01:15.303 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:01:15.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:01:15.303 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T11:01:15.303 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T11:01:15.303 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:01:15.303 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1580309752 2023-10-06T11:01:15.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:01:15.303 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.5706 192.168.0.1:0/1580309752", 2023-10-06T11:01:15.303 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.1:0/1580309752", 2023-10-06T11:01:15.304 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2023-10-06T11:01:15.304 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 28, 2023-10-06T11:01:15.304 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 57, 2023-10-06T11:01:15.304 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:01:15.304 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2023-10-06T11:01:15.304 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2023-10-06T11:01:15.304 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:01:15.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:15.312 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2023-10-06T11:01:15.312 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:15.332 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2023-10-06T11:01:15.332 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:15.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:15.332 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:15.405 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:01:15.405 DEBUG:teuthology.orchestra.run.smithi007:> import os 2023-10-06T11:01:15.405 DEBUG:teuthology.orchestra.run.smithi007:> import errno 2023-10-06T11:01:15.406 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:01:15.406 DEBUG:teuthology.orchestra.run.smithi007:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-10-06T11:01:15.406 DEBUG:teuthology.orchestra.run.smithi007:> try: 2023-10-06T11:01:15.406 DEBUG:teuthology.orchestra.run.smithi007:> if False: 2023-10-06T11:01:15.406 DEBUG:teuthology.orchestra.run.smithi007:> ret = os.read(fd, 1024) 2023-10-06T11:01:15.406 DEBUG:teuthology.orchestra.run.smithi007:> else: 2023-10-06T11:01:15.406 DEBUG:teuthology.orchestra.run.smithi007:> os.write(fd, b'"'"'content'"'"') 2023-10-06T11:01:15.406 DEBUG:teuthology.orchestra.run.smithi007:> except OSError as e: 2023-10-06T11:01:15.406 DEBUG:teuthology.orchestra.run.smithi007:> if e.errno != errno.EPERM: 2023-10-06T11:01:15.406 DEBUG:teuthology.orchestra.run.smithi007:> raise 2023-10-06T11:01:15.406 DEBUG:teuthology.orchestra.run.smithi007:> else: 2023-10-06T11:01:15.406 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("client does not check permission of data pool") 2023-10-06T11:01:15.407 DEBUG:teuthology.orchestra.run.smithi007:> ' 2023-10-06T11:01:15.717 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2023-10-06T11:01:15.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.903+0000 7f826adcf700 1 Processor -- start 2023-10-06T11:01:15.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.903+0000 7f826adcf700 1 -- start start 2023-10-06T11:01:15.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.904+0000 7f826adcf700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82640b01c0 0x7f82640cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:15.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.904+0000 7f826adcf700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82640cedc0 con 0x7f82640b0590 2023-10-06T11:01:15.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.904+0000 7f826adcf700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82640c9720 con 0x7f82640c91c0 2023-10-06T11:01:15.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.904+0000 7f826adcf700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82640c9a00 con 0x7f82640b01c0 2023-10-06T11:01:15.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.904+0000 7f8263fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f82640b0590 0x7f82640c8ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48490/0 (socket says 172.21.15.7:48490) 2023-10-06T11:01:15.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.904+0000 7f8263fff700 1 -- 172.21.15.7:0/2312244912 learned_addr learned my addr 172.21.15.7:0/2312244912 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:15.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.904+0000 7f8268b6b700 1 --2- 172.21.15.7:0/2312244912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82640b01c0 0x7f82640cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:15.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.904+0000 7f82637fe700 1 -- 172.21.15.7:0/2312244912 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476378677 0 0) 0x7f82640cedc0 con 0x7f82640b0590 2023-10-06T11:01:15.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.904+0000 7f82637fe700 1 -- 172.21.15.7:0/2312244912 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8254003570 con 0x7f82640b0590 2023-10-06T11:01:15.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f82637fe700 1 -- 172.21.15.7:0/2312244912 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1681485193 0 0) 0x7f8254003570 con 0x7f82640b0590 2023-10-06T11:01:15.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f82637fe700 1 -- 172.21.15.7:0/2312244912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82640b01c0 msgr2=0x7f82640cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:15.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f82637fe700 1 --2- 172.21.15.7:0/2312244912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82640b01c0 0x7f82640cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:15.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f82637fe700 1 -- 172.21.15.7:0/2312244912 >> v1:172.21.15.50:6789/0 conn(0x7f82640c91c0 legacy=0x7f8264068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:15.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f82637fe700 1 -- 172.21.15.7:0/2312244912 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82640c9ce0 con 0x7f82640b0590 2023-10-06T11:01:15.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f82637fe700 1 -- 172.21.15.7:0/2312244912 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f8250001470 con 0x7f82640b0590 2023-10-06T11:01:15.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f82637fe700 1 -- 172.21.15.7:0/2312244912 >> v1:172.21.15.7:6789/0 conn(0x7f82640b0590 legacy=0x7f82640c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:15.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f82637fe700 1 --2- 172.21.15.7:0/2312244912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82640b01c0 0x7f8254003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:15.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f82637fe700 1 --2- 172.21.15.7:0/2312244912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254004010 0x7f8254004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:15.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f82637fe700 1 --2- 172.21.15.7:0/2312244912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8254004d50 0x7f82540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f82637fe700 1 -- 172.21.15.7:0/2312244912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82640c9a00 con 0x7f8254004010 2023-10-06T11:01:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f82637fe700 1 -- 172.21.15.7:0/2312244912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825400bc70 con 0x7f8254004d50 2023-10-06T11:01:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f82637fe700 1 -- 172.21.15.7:0/2312244912 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825400be30 con 0x7f82640b01c0 2023-10-06T11:01:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f8263fff700 1 --2- 172.21.15.7:0/2312244912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254004010 0x7f8254004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f8268b6b700 1 --2- 172.21.15.7:0/2312244912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82640b01c0 0x7f8254003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f826936c700 1 --2- 172.21.15.7:0/2312244912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8254004d50 0x7f82540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f8263fff700 1 -- 172.21.15.7:0/2312244912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82640b01c0 msgr2=0x7f8254003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f8263fff700 1 --2- 172.21.15.7:0/2312244912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82640b01c0 0x7f8254003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f8263fff700 1 -- 172.21.15.7:0/2312244912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8254004d50 msgr2=0x7f82540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f8263fff700 1 --2- 172.21.15.7:0/2312244912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8254004d50 0x7f82540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f8263fff700 1 -- 172.21.15.7:0/2312244912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8254003570 con 0x7f8254004010 2023-10-06T11:01:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.905+0000 7f8263fff700 1 --2- 172.21.15.7:0/2312244912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254004010 0x7f8254004810 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f825000c390 tx=0x7f8250001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20828eceb4d197d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.906+0000 7f82637fe700 1 -- 172.21.15.7:0/2312244912 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825000cc60 con 0x7f8254004010 2023-10-06T11:01:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.906+0000 7f82637fe700 1 -- 172.21.15.7:0/2312244912 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825000cdc0 con 0x7f8254004010 2023-10-06T11:01:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.906+0000 7f82637fe700 1 -- 172.21.15.7:0/2312244912 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250005b50 con 0x7f8254004010 2023-10-06T11:01:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.906+0000 7f826adcf700 1 -- 172.21.15.7:0/2312244912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254004010 msgr2=0x7f8254004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.906+0000 7f826adcf700 1 --2- 172.21.15.7:0/2312244912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254004010 0x7f8254004810 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f825000c390 tx=0x7f8250001e50 comp rx=0 tx=0).stop 2023-10-06T11:01:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.906+0000 7f826936c700 1 -- 172.21.15.7:0/2312244912 reap_dead start 2023-10-06T11:01:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.906+0000 7f826adcf700 1 -- 172.21.15.7:0/2312244912 shutdown_connections 2023-10-06T11:01:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.906+0000 7f826adcf700 1 -- 172.21.15.7:0/2312244912 >> 172.21.15.7:0/2312244912 conn(0x7f826406cd00 msgr2=0x7f82640cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.906+0000 7f826adcf700 1 -- 172.21.15.7:0/2312244912 shutdown_connections 2023-10-06T11:01:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.906+0000 7f826adcf700 1 -- 172.21.15.7:0/2312244912 wait complete. 2023-10-06T11:01:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.907+0000 7f826adcf700 1 Processor -- start 2023-10-06T11:01:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.908+0000 7f826adcf700 1 -- start start 2023-10-06T11:01:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.908+0000 7f826adcf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8254004010 0x7f82640c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.908+0000 7f826adcf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826414c030 0x7f82640b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f826adcf700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f826414c4a0 0x7f82640b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f826adcf700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82640c7160 con 0x7f826414c030 2023-10-06T11:01:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f826adcf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82640c6030 con 0x7f8254004010 2023-10-06T11:01:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f826adcf700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82640c6830 con 0x7f826414c4a0 2023-10-06T11:01:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f8263fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826414c030 0x7f82640b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f8263fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826414c030 0x7f82640b1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38306/0 (socket says 172.21.15.7:38306) 2023-10-06T11:01:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f8263fff700 1 -- 172.21.15.7:0/315920067 learned_addr learned my addr 172.21.15.7:0/315920067 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f8268b6b700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8254004010 0x7f82640c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f826936c700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f826414c4a0 0x7f82640b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f8263fff700 1 -- 172.21.15.7:0/315920067 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f826414c4a0 msgr2=0x7f82640b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f8263fff700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f826414c4a0 0x7f82640b21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f8263fff700 1 -- 172.21.15.7:0/315920067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8254004010 msgr2=0x7f82640c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f8263fff700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8254004010 0x7f82640c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f8263fff700 1 -- 172.21.15.7:0/315920067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82640c6b10 con 0x7f826414c030 2023-10-06T11:01:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f8268b6b700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8254004010 0x7f82640c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f826936c700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f826414c4a0 0x7f82640b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f8263fff700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826414c030 0x7f82640b1c90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8250001ed0 tx=0x7f8250015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f8260ff9700 1 -- 172.21.15.7:0/315920067 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825000cc60 con 0x7f826414c030 2023-10-06T11:01:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f8260ff9700 1 -- 172.21.15.7:0/315920067 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82500072e0 con 0x7f826414c030 2023-10-06T11:01:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f826adcf700 1 -- 172.21.15.7:0/315920067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82640c7160 con 0x7f826414c030 2023-10-06T11:01:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f8260ff9700 1 -- 172.21.15.7:0/315920067 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82500076a0 con 0x7f826414c030 2023-10-06T11:01:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.909+0000 7f826adcf700 1 -- 172.21.15.7:0/315920067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82640c52e0 con 0x7f826414c030 2023-10-06T11:01:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.910+0000 7f826adcf700 1 -- 172.21.15.7:0/315920067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82640c7b30 con 0x7f826414c030 2023-10-06T11:01:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.911+0000 7f8260ff9700 1 -- 172.21.15.7:0/315920067 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8250019030 con 0x7f826414c030 2023-10-06T11:01:15.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.912+0000 7f8260ff9700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8248066f30 0x7f82480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:15.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.912+0000 7f8260ff9700 1 -- 172.21.15.7:0/315920067 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f82500860d0 con 0x7f826414c030 2023-10-06T11:01:15.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.912+0000 7f8268b6b700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8248066f30 0x7f82480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:15.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.912+0000 7f8268b6b700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8248066f30 0x7f82480693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8258006f00 tx=0x7f8258008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:15.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:15.916+0000 7f8260ff9700 1 -- 172.21.15.7:0/315920067 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8250053080 con 0x7f826414c030 2023-10-06T11:01:16.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.202+0000 7f826adcf700 1 -- 172.21.15.7:0/315920067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) v1 -- 0x7f82640c72f0 con 0x7f826414c030 2023-10-06T11:01:16.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.206+0000 7f8260ff9700 1 -- 172.21.15.7:0/315920067 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v21) v1 ==== 183+0+0 (secure 0 0 0) 0x7f82500566a0 con 0x7f826414c030 2023-10-06T11:01:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.208+0000 7f826adcf700 1 -- 172.21.15.7:0/315920067 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8248066f30 msgr2=0x7f82480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.208+0000 7f826adcf700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8248066f30 0x7f82480693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8258006f00 tx=0x7f8258008040 comp rx=0 tx=0).stop 2023-10-06T11:01:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.208+0000 7f826adcf700 1 -- 172.21.15.7:0/315920067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826414c030 msgr2=0x7f82640b1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.208+0000 7f826adcf700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826414c030 0x7f82640b1c90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8250001ed0 tx=0x7f8250015000 comp rx=0 tx=0).stop 2023-10-06T11:01:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.208+0000 7f826adcf700 1 -- 172.21.15.7:0/315920067 shutdown_connections 2023-10-06T11:01:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.208+0000 7f826adcf700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8248066f30 0x7f82480693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.208+0000 7f826adcf700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f826414c4a0 0x7f82640b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.208+0000 7f826adcf700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8254004010 0x7f82640c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.208+0000 7f826adcf700 1 --2- 172.21.15.7:0/315920067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826414c030 0x7f82640b1c90 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:16.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.208+0000 7f826adcf700 1 -- 172.21.15.7:0/315920067 >> 172.21.15.7:0/315920067 conn(0x7f826406cd00 msgr2=0x7f82641576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:16.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.209+0000 7f826adcf700 1 -- 172.21.15.7:0/315920067 shutdown_connections 2023-10-06T11:01:16.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.209+0000 7f826adcf700 1 -- 172.21.15.7:0/315920067 wait complete. 2023-10-06T11:01:16.212 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-06T11:01:16.224 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2023-10-06T11:01:16.224 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:01:16.224 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:16.258 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[141134]: fuse finished with error 0 and tester_r 0 2023-10-06T11:01:16.260 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T11:01:16.332 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T11:01:16.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:16.332 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:01:16.354 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:01:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.533+0000 7ff1286b3700 1 Processor -- start 2023-10-06T11:01:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.533+0000 7ff1286b3700 1 -- start start 2023-10-06T11:01:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.534+0000 7ff1286b3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff120068100 0x7ff1200a6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.534+0000 7ff1286b3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff1200ac7f0 0x7ff1200a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.534+0000 7ff1286b3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1200b0250 con 0x7ff120159360 2023-10-06T11:01:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.534+0000 7ff1286b3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1200aeba0 con 0x7ff120068100 2023-10-06T11:01:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.534+0000 7ff1286b3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff120159730 con 0x7ff1200ac7f0 2023-10-06T11:01:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.534+0000 7ff125c4e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff120068100 0x7ff1200a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.534+0000 7ff12644f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff120159360 0x7ff1200afb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48504/0 (socket says 172.21.15.7:48504) 2023-10-06T11:01:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.534+0000 7ff12644f700 1 -- 172.21.15.7:0/773682912 learned_addr learned my addr 172.21.15.7:0/773682912 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.535+0000 7ff126c50700 1 --2- 172.21.15.7:0/773682912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff1200ac7f0 0x7ff1200a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.535+0000 7ff125c4e700 1 -- 172.21.15.7:0/773682912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff1200ac7f0 msgr2=0x7ff1200a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.535+0000 7ff125c4e700 1 --2- 172.21.15.7:0/773682912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff1200ac7f0 0x7ff1200a6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.535+0000 7ff125c4e700 1 -- 172.21.15.7:0/773682912 >> v1:172.21.15.7:6789/0 conn(0x7ff120159360 legacy=0x7ff1200afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.535+0000 7ff125c4e700 1 -- 172.21.15.7:0/773682912 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1200ae270 con 0x7ff120068100 2023-10-06T11:01:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.535+0000 7ff12544d700 1 -- 172.21.15.7:0/773682912 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336556897 0 0) 0x7ff11c001110 con 0x7ff120159360 2023-10-06T11:01:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.535+0000 7ff126c50700 1 --2- 172.21.15.7:0/773682912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff1200ac7f0 0x7ff1200a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.535+0000 7ff125c4e700 1 --2- 172.21.15.7:0/773682912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff120068100 0x7ff1200a6980 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff1140098e0 tx=0x7ff1140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629b3573ed393b46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.535+0000 7ff12544d700 1 -- 172.21.15.7:0/773682912 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff114009e80 con 0x7ff120068100 2023-10-06T11:01:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.535+0000 7ff12544d700 1 -- 172.21.15.7:0/773682912 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11400b860 con 0x7ff120068100 2023-10-06T11:01:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.535+0000 7ff12544d700 1 -- 172.21.15.7:0/773682912 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11400bbe0 con 0x7ff120068100 2023-10-06T11:01:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.536+0000 7ff1286b3700 1 -- 172.21.15.7:0/773682912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff120068100 msgr2=0x7ff1200a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.536+0000 7ff1286b3700 1 --2- 172.21.15.7:0/773682912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff120068100 0x7ff1200a6980 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff1140098e0 tx=0x7ff1140091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.536+0000 7ff1286b3700 1 -- 172.21.15.7:0/773682912 shutdown_connections 2023-10-06T11:01:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.536+0000 7ff1286b3700 1 --2- 172.21.15.7:0/773682912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff1200ac7f0 0x7ff1200a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.536+0000 7ff1286b3700 1 --2- 172.21.15.7:0/773682912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff120068100 0x7ff1200a6980 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.536+0000 7ff1286b3700 1 -- 172.21.15.7:0/773682912 >> 172.21.15.7:0/773682912 conn(0x7ff120095a70 msgr2=0x7ff1200af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.536+0000 7ff1286b3700 1 -- 172.21.15.7:0/773682912 shutdown_connections 2023-10-06T11:01:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.536+0000 7ff1286b3700 1 -- 172.21.15.7:0/773682912 wait complete. 2023-10-06T11:01:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.537+0000 7ff1286b3700 1 Processor -- start 2023-10-06T11:01:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.537+0000 7ff1286b3700 1 -- start start 2023-10-06T11:01:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.538+0000 7ff1286b3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff120068100 0x7ff120147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.538+0000 7ff1286b3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1200ac7f0 0x7ff120096cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.538+0000 7ff1286b3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff120159360 0x7ff120157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.538+0000 7ff1286b3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff120097200 con 0x7ff1200ac7f0 2023-10-06T11:01:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.538+0000 7ff1286b3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1201578c0 con 0x7ff120159360 2023-10-06T11:01:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.538+0000 7ff1286b3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff120098000 con 0x7ff120068100 2023-10-06T11:01:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.538+0000 7ff125c4e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1200ac7f0 0x7ff120096cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.538+0000 7ff125c4e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1200ac7f0 0x7ff120096cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38312/0 (socket says 172.21.15.7:38312) 2023-10-06T11:01:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.538+0000 7ff125c4e700 1 -- 172.21.15.7:0/3140993346 learned_addr learned my addr 172.21.15.7:0/3140993346 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.539+0000 7ff126c50700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff120159360 0x7ff120157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.539+0000 7ff12644f700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff120068100 0x7ff120147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.539+0000 7ff125c4e700 1 -- 172.21.15.7:0/3140993346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff120068100 msgr2=0x7ff120147f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.539+0000 7ff125c4e700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff120068100 0x7ff120147f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.539+0000 7ff125c4e700 1 -- 172.21.15.7:0/3140993346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff120159360 msgr2=0x7ff120157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.539+0000 7ff125c4e700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff120159360 0x7ff120157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.539+0000 7ff125c4e700 1 -- 172.21.15.7:0/3140993346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff114009420 con 0x7ff1200ac7f0 2023-10-06T11:01:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.539+0000 7ff126c50700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff120159360 0x7ff120157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.539+0000 7ff125c4e700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1200ac7f0 0x7ff120096cc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff114013000 tx=0x7ff114017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:16.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.539+0000 7ff1127fc700 1 -- 172.21.15.7:0/3140993346 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11400bbe0 con 0x7ff1200ac7f0 2023-10-06T11:01:16.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.539+0000 7ff1127fc700 1 -- 172.21.15.7:0/3140993346 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff114011420 con 0x7ff1200ac7f0 2023-10-06T11:01:16.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.539+0000 7ff1286b3700 1 -- 172.21.15.7:0/3140993346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1200973f0 con 0x7ff1200ac7f0 2023-10-06T11:01:16.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.539+0000 7ff1127fc700 1 -- 172.21.15.7:0/3140993346 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1140117a0 con 0x7ff1200ac7f0 2023-10-06T11:01:16.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.539+0000 7ff1286b3700 1 -- 172.21.15.7:0/3140993346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1200979b0 con 0x7ff1200ac7f0 2023-10-06T11:01:16.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.540+0000 7ff1286b3700 1 -- 172.21.15.7:0/3140993346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff120070480 con 0x7ff1200ac7f0 2023-10-06T11:01:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.541+0000 7ff1127fc700 1 -- 172.21.15.7:0/3140993346 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff114011bd0 con 0x7ff1200ac7f0 2023-10-06T11:01:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.541+0000 7ff1127fc700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff104066f30 0x7ff1040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.541+0000 7ff1127fc700 1 -- 172.21.15.7:0/3140993346 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff114086100 con 0x7ff1200ac7f0 2023-10-06T11:01:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.541+0000 7ff12644f700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff104066f30 0x7ff1040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.542+0000 7ff12644f700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff104066f30 0x7ff1040693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff11c001750 tx=0x7ff11c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.546+0000 7ff1127fc700 1 -- 172.21.15.7:0/3140993346 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1140530d0 con 0x7ff1200ac7f0 2023-10-06T11:01:16.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.798+0000 7ff1286b3700 1 -- 172.21.15.7:0/3140993346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff120098140 con 0x7ff1200ac7f0 2023-10-06T11:01:16.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.798+0000 7ff1127fc700 1 -- 172.21.15.7:0/3140993346 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff1140566f0 con 0x7ff1200ac7f0 2023-10-06T11:01:16.800 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:01:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.801+0000 7ff1286b3700 1 -- 172.21.15.7:0/3140993346 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff104066f30 msgr2=0x7ff1040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.801+0000 7ff1286b3700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff104066f30 0x7ff1040693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff11c001750 tx=0x7ff11c009040 comp rx=0 tx=0).stop 2023-10-06T11:01:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.801+0000 7ff1286b3700 1 -- 172.21.15.7:0/3140993346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1200ac7f0 msgr2=0x7ff120096cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.801+0000 7ff1286b3700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1200ac7f0 0x7ff120096cc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff114013000 tx=0x7ff114017000 comp rx=0 tx=0).stop 2023-10-06T11:01:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.801+0000 7ff1286b3700 1 -- 172.21.15.7:0/3140993346 shutdown_connections 2023-10-06T11:01:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.801+0000 7ff1286b3700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff104066f30 0x7ff1040693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.801+0000 7ff1286b3700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff120159360 0x7ff120157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.801+0000 7ff1286b3700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff120068100 0x7ff120147f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.801+0000 7ff1286b3700 1 --2- 172.21.15.7:0/3140993346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1200ac7f0 0x7ff120096cc0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.801+0000 7ff1286b3700 1 -- 172.21.15.7:0/3140993346 >> 172.21.15.7:0/3140993346 conn(0x7ff120095a70 msgr2=0x7ff120159e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.801+0000 7ff1286b3700 1 -- 172.21.15.7:0/3140993346 shutdown_connections 2023-10-06T11:01:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:16.801+0000 7ff1286b3700 1 -- 172.21.15.7:0/3140993346 wait complete. 2023-10-06T11:01:16.816 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:01:16.816 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:01:16.816 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-06T11:01:16.816 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:01:16.816 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:16.816 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:01:16.816 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:01:16.816 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:01:16.816 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:01:16.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:16.817 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-06T11:01:16.837 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:01:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:01:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:01:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-06T11:01:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:16.837 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:01:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-06T11:01:16.838 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:01:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-06T11:01:16.838 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:01:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-06T11:01:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:01:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42289sec preferred_lft 42289sec 2023-10-06T11:01:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-06T11:01:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:16.839 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:01:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-06T11:01:16.839 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:01:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 4e:b6:a2:96:c6:8a brd ff:ff:ff:ff:ff:ff 2023-10-06T11:01:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:01:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::10ea:76ff:fedd:887a/64 scope link 2023-10-06T11:01:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:16.839 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:01:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether b6:89:e7:77:c6:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:01:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::b489:e7ff:fe77:c63a/64 scope link 2023-10-06T11:01:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:16.840 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:01:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 4e:b6:a2:96:c6:8a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:01:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::4cb6:a2ff:fe96:c68a/64 scope link 2023-10-06T11:01:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:01:16.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:16.840 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:01:16.909 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-06T11:01:16.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:16.911 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-06T11:01:16.977 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-06T11:01:16.977 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:01:16.977 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:01:16.977 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:01:16.977 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:01:16.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:16.978 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-06T11:01:16.978 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-06T11:01:16.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:01:16.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:01:16.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:01:16.978 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-06T11:01:17.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:17.101 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-06T11:01:17.122 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:01:17.122 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:01:17.123 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:01:17.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:17.123 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-06T11:01:17.197 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:01:17.198 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:01:17.198 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:17.261 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:01:17.261 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:01:17.261 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:17.325 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T11:01:17.400 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:01:17.400 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:01:17.475 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:01:17.476 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:01:17.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:17.477 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T11:01:17.540 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:01:17.540 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:01:17.583 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-10-06T11:01:17.619 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:01:17.619 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:01:17.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2023-10-06T11:01:17.683+0000 7f3dc47b6540 -1 init, newargv = 0x559f2c2d7850 newargc=15 2023-10-06T11:01:17.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[141813]: starting ceph client 2023-10-06T11:01:17.690 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[141813]: starting fuse 2023-10-06T11:01:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:01:17.693 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:01:17.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:17.693 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-10-06T11:01:17.754 INFO:teuthology.orchestra.run.smithi007.stdout:47 2023-10-06T11:01:17.754 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T11:01:17.755 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:01:17.755 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2023-10-06T11:01:17.755 DEBUG:teuthology.orchestra.run.smithi007:> import re 2023-10-06T11:01:17.755 DEBUG:teuthology.orchestra.run.smithi007:> import os 2023-10-06T11:01:17.755 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2023-10-06T11:01:17.755 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:01:17.755 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2023-10-06T11:01:17.755 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:01:17.755 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2023-10-06T11:01:17.755 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:01:17.756 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:01:17.756 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2023-10-06T11:01:17.756 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2023-10-06T11:01:17.756 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2023-10-06T11:01:17.756 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2023-10-06T11:01:17.756 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:01:17.756 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2023-10-06T11:01:17.756 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:01:17.756 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:01:17.756 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:01:17.756 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2023-10-06T11:01:17.756 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2023-10-06T11:01:17.756 DEBUG:teuthology.orchestra.run.smithi007:> return f 2023-10-06T11:01:17.757 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:01:17.757 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:01:17.757 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.0")) 2023-10-06T11:01:17.757 DEBUG:teuthology.orchestra.run.smithi007:> ' 2023-10-06T11:01:17.892 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.141813.asok 2023-10-06T11:01:18.075 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.141813.asok 2023-10-06T11:01:18.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:18.075 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.141813.asok status 2023-10-06T11:01:18.251 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:01:18.251 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2023-10-06T11:01:18.251 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:01:18.252 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:01:18.252 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2023-10-06T11:01:18.252 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2023-10-06T11:01:18.252 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:01:18.252 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "141813", 2023-10-06T11:01:18.252 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2023-10-06T11:01:18.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:01:18.252 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2023-10-06T11:01:18.252 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2023-10-06T11:01:18.252 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5730, 2023-10-06T11:01:18.252 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2023-10-06T11:01:18.253 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2023-10-06T11:01:18.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2023-10-06T11:01:18.253 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 5730 2023-10-06T11:01:18.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:01:18.253 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T11:01:18.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T11:01:18.253 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:01:18.253 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 4059492421 2023-10-06T11:01:18.253 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-06T11:01:18.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:01:18.253 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-10-06T11:01:18.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-10-06T11:01:18.253 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:01:18.254 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 4059492421 2023-10-06T11:01:18.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-06T11:01:18.254 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.5730 192.168.0.1:0/4059492421", 2023-10-06T11:01:18.254 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.1:0/4059492421", 2023-10-06T11:01:18.254 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2023-10-06T11:01:18.254 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 28, 2023-10-06T11:01:18.254 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 57, 2023-10-06T11:01:18.254 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:01:18.254 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2023-10-06T11:01:18.254 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2023-10-06T11:01:18.254 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:01:18.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:18.262 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2023-10-06T11:01:18.262 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:18.283 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2023-10-06T11:01:18.283 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:18.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:01:18.283 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:18.356 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:01:18.356 DEBUG:teuthology.orchestra.run.smithi007:> import os 2023-10-06T11:01:18.356 DEBUG:teuthology.orchestra.run.smithi007:> import errno 2023-10-06T11:01:18.356 DEBUG:teuthology.orchestra.run.smithi007:> 2023-10-06T11:01:18.356 DEBUG:teuthology.orchestra.run.smithi007:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-10-06T11:01:18.357 DEBUG:teuthology.orchestra.run.smithi007:> try: 2023-10-06T11:01:18.357 DEBUG:teuthology.orchestra.run.smithi007:> if True: 2023-10-06T11:01:18.357 DEBUG:teuthology.orchestra.run.smithi007:> ret = os.read(fd, 1024) 2023-10-06T11:01:18.357 DEBUG:teuthology.orchestra.run.smithi007:> else: 2023-10-06T11:01:18.357 DEBUG:teuthology.orchestra.run.smithi007:> os.write(fd, b'"'"'content'"'"') 2023-10-06T11:01:18.357 DEBUG:teuthology.orchestra.run.smithi007:> except OSError as e: 2023-10-06T11:01:18.357 DEBUG:teuthology.orchestra.run.smithi007:> if e.errno != errno.EPERM: 2023-10-06T11:01:18.357 DEBUG:teuthology.orchestra.run.smithi007:> raise 2023-10-06T11:01:18.357 DEBUG:teuthology.orchestra.run.smithi007:> else: 2023-10-06T11:01:18.357 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("client does not check permission of data pool") 2023-10-06T11:01:18.357 DEBUG:teuthology.orchestra.run.smithi007:> ' 2023-10-06T11:01:18.666 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2023-10-06T11:01:18.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.851+0000 7f9c15166700 1 Processor -- start 2023-10-06T11:01:18.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.851+0000 7f9c15166700 1 -- start start 2023-10-06T11:01:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.852+0000 7f9c15166700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c100b2610 0x7f9c100cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.852+0000 7f9c15166700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c10067dc0 con 0x7f9c10140b60 2023-10-06T11:01:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.852+0000 7f9c15166700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c100cc500 con 0x7f9c10140790 2023-10-06T11:01:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.852+0000 7f9c15166700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100cc7e0 con 0x7f9c100b2610 2023-10-06T11:01:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0f59e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9c10140b60 0x7f9c100cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48516/0 (socket says 172.21.15.7:48516) 2023-10-06T11:01:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0f59e700 1 -- 172.21.15.7:0/1960627106 learned_addr learned my addr 172.21.15.7:0/1960627106 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0e59c700 1 --2- 172.21.15.7:0/1960627106 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c100b2610 0x7f9c100cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 -- 172.21.15.7:0/1960627106 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080320050 0 0) 0x7f9c10067dc0 con 0x7f9c10140b60 2023-10-06T11:01:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 -- 172.21.15.7:0/1960627106 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bf8003570 con 0x7f9c10140b60 2023-10-06T11:01:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 -- 172.21.15.7:0/1960627106 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3560016366 0 0) 0x7f9bf8003570 con 0x7f9c10140b60 2023-10-06T11:01:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 -- 172.21.15.7:0/1960627106 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c100b2610 msgr2=0x7f9c100cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 --2- 172.21.15.7:0/1960627106 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c100b2610 0x7f9c100cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 -- 172.21.15.7:0/1960627106 >> v1:172.21.15.50:6789/0 conn(0x7f9c10140790 legacy=0x7f9c100b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 -- 172.21.15.7:0/1960627106 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c10068010 con 0x7f9c10140b60 2023-10-06T11:01:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 -- 172.21.15.7:0/1960627106 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f9c080017f0 con 0x7f9c10140b60 2023-10-06T11:01:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 -- 172.21.15.7:0/1960627106 >> v1:172.21.15.7:6789/0 conn(0x7f9c10140b60 legacy=0x7f9c100cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 --2- 172.21.15.7:0/1960627106 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c100b2610 0x7f9bf8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 --2- 172.21.15.7:0/1960627106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf8004010 0x7f9bf8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 --2- 172.21.15.7:0/1960627106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bf8004d50 0x7f9bf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 -- 172.21.15.7:0/1960627106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100cc7e0 con 0x7f9bf8004d50 2023-10-06T11:01:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 -- 172.21.15.7:0/1960627106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf800bc70 con 0x7f9bf8004010 2023-10-06T11:01:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0dd9b700 1 -- 172.21.15.7:0/1960627106 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf800be30 con 0x7f9c100b2610 2023-10-06T11:01:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0f59e700 1 --2- 172.21.15.7:0/1960627106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bf8004d50 0x7f9bf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.853+0000 7f9c0ed9d700 1 --2- 172.21.15.7:0/1960627106 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c100b2610 0x7f9bf8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.854+0000 7f9c0e59c700 1 --2- 172.21.15.7:0/1960627106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf8004010 0x7f9bf8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.854+0000 7f9c0f59e700 1 -- 172.21.15.7:0/1960627106 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c100b2610 msgr2=0x7f9bf8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.854+0000 7f9c0f59e700 1 --2- 172.21.15.7:0/1960627106 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c100b2610 0x7f9bf8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.854+0000 7f9c0f59e700 1 -- 172.21.15.7:0/1960627106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf8004010 msgr2=0x7f9bf8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.854+0000 7f9c0f59e700 1 --2- 172.21.15.7:0/1960627106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf8004010 0x7f9bf8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.854+0000 7f9c0f59e700 1 -- 172.21.15.7:0/1960627106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf8003570 con 0x7f9bf8004d50 2023-10-06T11:01:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.854+0000 7f9c0f59e700 1 --2- 172.21.15.7:0/1960627106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bf8004d50 0x7f9bf80051c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800a900 tx=0x7f9c080021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2fd2485e71b746 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.854+0000 7f9c0dd9b700 1 -- 172.21.15.7:0/1960627106 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c080070d0 con 0x7f9bf8004d50 2023-10-06T11:01:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.854+0000 7f9c0dd9b700 1 -- 172.21.15.7:0/1960627106 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c08007230 con 0x7f9bf8004d50 2023-10-06T11:01:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.854+0000 7f9c0dd9b700 1 -- 172.21.15.7:0/1960627106 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c080075f0 con 0x7f9bf8004d50 2023-10-06T11:01:18.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.855+0000 7f9c15166700 1 -- 172.21.15.7:0/1960627106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bf8004d50 msgr2=0x7f9bf80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:18.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.855+0000 7f9c15166700 1 --2- 172.21.15.7:0/1960627106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bf8004d50 0x7f9bf80051c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800a900 tx=0x7f9c080021d0 comp rx=0 tx=0).stop 2023-10-06T11:01:18.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.855+0000 7f9c0f59e700 1 -- 172.21.15.7:0/1960627106 reap_dead start 2023-10-06T11:01:18.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.855+0000 7f9c15166700 1 -- 172.21.15.7:0/1960627106 shutdown_connections 2023-10-06T11:01:18.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.855+0000 7f9c15166700 1 -- 172.21.15.7:0/1960627106 >> 172.21.15.7:0/1960627106 conn(0x7f9c100cce30 msgr2=0x7f9c100cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:18.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.855+0000 7f9c15166700 1 -- 172.21.15.7:0/1960627106 shutdown_connections 2023-10-06T11:01:18.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.855+0000 7f9c15166700 1 -- 172.21.15.7:0/1960627106 wait complete. 2023-10-06T11:01:18.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.856+0000 7f9c15166700 1 Processor -- start 2023-10-06T11:01:18.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.856+0000 7f9c15166700 1 -- start start 2023-10-06T11:01:18.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c15166700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf8004d50 0x7f9c1015a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:18.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c15166700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c100a8f00 0x7f9c100a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:18.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c15166700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c100c1bd0 0x7f9c100c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:18.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c15166700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100c25b0 con 0x7f9c100c1bd0 2023-10-06T11:01:18.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c15166700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100aa9f0 con 0x7f9bf8004d50 2023-10-06T11:01:18.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c15166700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100a9950 con 0x7f9c100a8f00 2023-10-06T11:01:18.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c0f59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c100c1bd0 0x7f9c100c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:18.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c0f59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c100c1bd0 0x7f9c100c2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38332/0 (socket says 172.21.15.7:38332) 2023-10-06T11:01:18.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c0f59e700 1 -- 172.21.15.7:0/3483722965 learned_addr learned my addr 172.21.15.7:0/3483722965 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:18.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c0ed9d700 1 --2- 172.21.15.7:0/3483722965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf8004d50 0x7f9c1015a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:18.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c0e59c700 1 --2- 172.21.15.7:0/3483722965 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c100a8f00 0x7f9c100a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:18.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c0f59e700 1 -- 172.21.15.7:0/3483722965 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c100a8f00 msgr2=0x7f9c100a9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:18.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c0f59e700 1 --2- 172.21.15.7:0/3483722965 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c100a8f00 0x7f9c100a9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:18.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c0f59e700 1 -- 172.21.15.7:0/3483722965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf8004d50 msgr2=0x7f9c1015a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:18.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c0f59e700 1 --2- 172.21.15.7:0/3483722965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf8004d50 0x7f9c1015a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:18.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.857+0000 7f9c0f59e700 1 -- 172.21.15.7:0/3483722965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c100a9c30 con 0x7f9c100c1bd0 2023-10-06T11:01:18.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.858+0000 7f9c0f59e700 1 --2- 172.21.15.7:0/3483722965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c100c1bd0 0x7f9c100c2070 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800bc40 tx=0x7f9c08016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:18.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.858+0000 7f9bf6ffd700 1 -- 172.21.15.7:0/3483722965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c080073a0 con 0x7f9c100c1bd0 2023-10-06T11:01:18.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.858+0000 7f9bf6ffd700 1 -- 172.21.15.7:0/3483722965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c08007540 con 0x7f9c100c1bd0 2023-10-06T11:01:18.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.858+0000 7f9c15166700 1 -- 172.21.15.7:0/3483722965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c100a9f10 con 0x7f9c100c1bd0 2023-10-06T11:01:18.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.858+0000 7f9bf6ffd700 1 -- 172.21.15.7:0/3483722965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0801e680 con 0x7f9c100c1bd0 2023-10-06T11:01:18.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.858+0000 7f9c15166700 1 -- 172.21.15.7:0/3483722965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c100aa4d0 con 0x7f9c100c1bd0 2023-10-06T11:01:18.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.859+0000 7f9c15166700 1 -- 172.21.15.7:0/3483722965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c100aa6c0 con 0x7f9c100c1bd0 2023-10-06T11:01:18.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.859+0000 7f9bf6ffd700 1 -- 172.21.15.7:0/3483722965 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c0801e9f0 con 0x7f9c100c1bd0 2023-10-06T11:01:18.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.860+0000 7f9bf6ffd700 1 --2- 172.21.15.7:0/3483722965 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9bfc066f30 0x7f9bfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:18.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.860+0000 7f9bf6ffd700 1 -- 172.21.15.7:0/3483722965 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9c08086bf0 con 0x7f9c100c1bd0 2023-10-06T11:01:18.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.860+0000 7f9c0ed9d700 1 --2- 172.21.15.7:0/3483722965 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9bfc066f30 0x7f9bfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:18.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.860+0000 7f9c0ed9d700 1 --2- 172.21.15.7:0/3483722965 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9bfc066f30 0x7f9bfc0693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9c04007fd0 tx=0x7f9c04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:18.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:18.864+0000 7f9bf6ffd700 1 -- 172.21.15.7:0/3483722965 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c08053bc0 con 0x7f9c100c1bd0 2023-10-06T11:01:19.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.148+0000 7f9c15166700 1 -- 172.21.15.7:0/3483722965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9c10070480 con 0x7f9c100c1bd0 2023-10-06T11:01:19.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.152+0000 7f9bf6ffd700 1 -- 172.21.15.7:0/3483722965 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9c080571e0 con 0x7f9c100c1bd0 2023-10-06T11:01:19.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.154+0000 7f9c15166700 1 -- 172.21.15.7:0/3483722965 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9bfc066f30 msgr2=0x7f9bfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:19.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.154+0000 7f9c15166700 1 --2- 172.21.15.7:0/3483722965 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9bfc066f30 0x7f9bfc0693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9c04007fd0 tx=0x7f9c04009040 comp rx=0 tx=0).stop 2023-10-06T11:01:19.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.154+0000 7f9c15166700 1 -- 172.21.15.7:0/3483722965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c100c1bd0 msgr2=0x7f9c100c2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:19.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.154+0000 7f9c15166700 1 --2- 172.21.15.7:0/3483722965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c100c1bd0 0x7f9c100c2070 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800bc40 tx=0x7f9c08016000 comp rx=0 tx=0).stop 2023-10-06T11:01:19.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.154+0000 7f9c15166700 1 -- 172.21.15.7:0/3483722965 shutdown_connections 2023-10-06T11:01:19.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.154+0000 7f9c15166700 1 --2- 172.21.15.7:0/3483722965 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9bfc066f30 0x7f9bfc0693e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:19.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.154+0000 7f9c15166700 1 --2- 172.21.15.7:0/3483722965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c100c1bd0 0x7f9c100c2070 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:19.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.154+0000 7f9c15166700 1 --2- 172.21.15.7:0/3483722965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf8004d50 0x7f9c1015a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:19.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.154+0000 7f9c15166700 1 --2- 172.21.15.7:0/3483722965 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9c100a8f00 0x7f9c100a9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:19.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.154+0000 7f9c15166700 1 -- 172.21.15.7:0/3483722965 >> 172.21.15.7:0/3483722965 conn(0x7f9c100cce30 msgr2=0x7f9c100adae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:19.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.155+0000 7f9c15166700 1 -- 172.21.15.7:0/3483722965 shutdown_connections 2023-10-06T11:01:19.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.155+0000 7f9c15166700 1 -- 172.21.15.7:0/3483722965 wait complete. 2023-10-06T11:01:19.158 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-06T11:01:19.169 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:01:19.170 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:01:19.216 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:01:19.272 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:01:19.272 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2023-10-06T11:01:19.273 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:01:19.273 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:01:19.317 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[141813]: fuse finished with error 0 and tester_r 0 2023-10-06T11:01:19.319 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T11:01:19.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:19.319 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:01:19.452 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T11:01:19.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:19.453 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:01:19.475 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T11:01:19.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:01:19.476 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T11:01:19.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:19.477 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:01:19.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:01:19.516 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T11:01:19.516 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T11:01:19.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:19.516 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:01:19.539 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T11:01:19.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:01:19.540 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:01:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.695+0000 7f765ed74700 1 Processor -- start 2023-10-06T11:01:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.695+0000 7f765ed74700 1 -- start start 2023-10-06T11:01:19.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.696+0000 7f765ed74700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f76580cacf0 0x7f765815b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.696+0000 7f765ed74700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765815bb40 con 0x7f76580acff0 2023-10-06T11:01:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.696+0000 7f765ed74700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765806dba0 con 0x7f76580ad3c0 2023-10-06T11:01:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.696+0000 7f765ed74700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765806de80 con 0x7f76580cacf0 2023-10-06T11:01:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.696+0000 7f765d311700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f76580cacf0 0x7f765815b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.696+0000 7f765d311700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f76580cacf0 0x7f765815b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38338/0 (socket says 172.21.15.7:38338) 2023-10-06T11:01:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.696+0000 7f765d311700 1 -- 172.21.15.7:0/3278292050 learned_addr learned my addr 172.21.15.7:0/3278292050 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.696+0000 7f765cb10700 1 --1- 172.21.15.7:0/3278292050 >> v1:172.21.15.7:6789/0 conn(0x7f76580acff0 0x7f76580ca5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48520/0 (socket says 172.21.15.7:48520) 2023-10-06T11:01:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.697+0000 7f765d311700 1 -- 172.21.15.7:0/3278292050 >> v1:172.21.15.50:6789/0 conn(0x7f76580ad3c0 legacy=0x7f76580cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.697+0000 7f765d311700 1 -- 172.21.15.7:0/3278292050 >> v1:172.21.15.7:6789/0 conn(0x7f76580acff0 legacy=0x7f76580ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.697+0000 7f765d311700 1 -- 172.21.15.7:0/3278292050 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765806e160 con 0x7f76580cacf0 2023-10-06T11:01:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.697+0000 7f765d311700 1 --2- 172.21.15.7:0/3278292050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76580cacf0 0x7f765815b600 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7650009f20 tx=0x7f7650009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be7c4d42ab80134 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.698+0000 7f76577fe700 1 -- 172.21.15.7:0/3278292050 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000e070 con 0x7f76580cacf0 2023-10-06T11:01:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.698+0000 7f76577fe700 1 -- 172.21.15.7:0/3278292050 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765000ba80 con 0x7f76580cacf0 2023-10-06T11:01:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.698+0000 7f76577fe700 1 -- 172.21.15.7:0/3278292050 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500092e0 con 0x7f76580cacf0 2023-10-06T11:01:19.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.699+0000 7f765ed74700 1 -- 172.21.15.7:0/3278292050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76580cacf0 msgr2=0x7f765815b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:19.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.699+0000 7f765ed74700 1 --2- 172.21.15.7:0/3278292050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76580cacf0 0x7f765815b600 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7650009f20 tx=0x7f7650009840 comp rx=0 tx=0).stop 2023-10-06T11:01:19.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.699+0000 7f765ed74700 1 -- 172.21.15.7:0/3278292050 shutdown_connections 2023-10-06T11:01:19.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.699+0000 7f765ed74700 1 --2- 172.21.15.7:0/3278292050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76580cacf0 0x7f765815b600 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:19.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.699+0000 7f765ed74700 1 -- 172.21.15.7:0/3278292050 >> 172.21.15.7:0/3278292050 conn(0x7f765806c2c0 msgr2=0x7f765806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.699+0000 7f765ed74700 1 -- 172.21.15.7:0/3278292050 shutdown_connections 2023-10-06T11:01:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.699+0000 7f765ed74700 1 -- 172.21.15.7:0/3278292050 wait complete. 2023-10-06T11:01:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.700+0000 7f765ed74700 1 Processor -- start 2023-10-06T11:01:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.701+0000 7f765ed74700 1 -- start start 2023-10-06T11:01:19.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.701+0000 7f765ed74700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76580acff0 0x7f76580c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:19.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.701+0000 7f765ed74700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76580ad3c0 0x7f7658154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:19.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.701+0000 7f765ed74700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f76580cacf0 0x7f76580c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:19.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.701+0000 7f765ed74700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76580c61e0 con 0x7f76580acff0 2023-10-06T11:01:19.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.701+0000 7f765ed74700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76580c4f70 con 0x7f76580ad3c0 2023-10-06T11:01:19.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.701+0000 7f765ed74700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76580c5810 con 0x7f76580cacf0 2023-10-06T11:01:19.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f765cb10700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76580acff0 0x7f76580c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:19.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f765cb10700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76580acff0 0x7f76580c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38346/0 (socket says 172.21.15.7:38346) 2023-10-06T11:01:19.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f765cb10700 1 -- 172.21.15.7:0/1336598370 learned_addr learned my addr 172.21.15.7:0/1336598370 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:19.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f7657fff700 1 --2- 172.21.15.7:0/1336598370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76580ad3c0 0x7f7658154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:19.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f765d311700 1 --2- 172.21.15.7:0/1336598370 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f76580cacf0 0x7f76580c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:19.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f765cb10700 1 -- 172.21.15.7:0/1336598370 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f76580cacf0 msgr2=0x7f76580c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:19.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f765cb10700 1 --2- 172.21.15.7:0/1336598370 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f76580cacf0 0x7f76580c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:19.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f765cb10700 1 -- 172.21.15.7:0/1336598370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76580ad3c0 msgr2=0x7f7658154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:19.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f765cb10700 1 --2- 172.21.15.7:0/1336598370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76580ad3c0 0x7f7658154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:19.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f765cb10700 1 -- 172.21.15.7:0/1336598370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7650009ae0 con 0x7f76580acff0 2023-10-06T11:01:19.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f765cb10700 1 --2- 172.21.15.7:0/1336598370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76580acff0 0x7f76580c5ca0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f764c00c7f0 tx=0x7f764c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:19.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f7654ff9700 1 -- 172.21.15.7:0/1336598370 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c005a70 con 0x7f76580acff0 2023-10-06T11:01:19.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f7654ff9700 1 -- 172.21.15.7:0/1336598370 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c005bf0 con 0x7f76580acff0 2023-10-06T11:01:19.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f7654ff9700 1 -- 172.21.15.7:0/1336598370 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c0070d0 con 0x7f76580acff0 2023-10-06T11:01:19.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.702+0000 7f765ed74700 1 -- 172.21.15.7:0/1336598370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765806a950 con 0x7f76580acff0 2023-10-06T11:01:19.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.703+0000 7f765ed74700 1 -- 172.21.15.7:0/1336598370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76580c54a0 con 0x7f76580acff0 2023-10-06T11:01:19.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.703+0000 7f765ed74700 1 -- 172.21.15.7:0/1336598370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76580c8c20 con 0x7f76580acff0 2023-10-06T11:01:19.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.704+0000 7f7654ff9700 1 -- 172.21.15.7:0/1336598370 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f764c007480 con 0x7f76580acff0 2023-10-06T11:01:19.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.704+0000 7f7654ff9700 1 --2- 172.21.15.7:0/1336598370 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f763c066f30 0x7f763c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:19.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.705+0000 7f7657fff700 1 --2- 172.21.15.7:0/1336598370 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f763c066f30 0x7f763c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:19.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.705+0000 7f7654ff9700 1 -- 172.21.15.7:0/1336598370 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f764c083a40 con 0x7f76580acff0 2023-10-06T11:01:19.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.705+0000 7f7657fff700 1 --2- 172.21.15.7:0/1336598370 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f763c066f30 0x7f763c0693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f76580c4bc0 tx=0x7f7644007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:19.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.709+0000 7f7654ff9700 1 -- 172.21.15.7:0/1336598370 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f764c085e60 con 0x7f76580acff0 2023-10-06T11:01:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.963+0000 7f765ed74700 1 -- 172.21.15.7:0/1336598370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f765815bb40 con 0x7f76580acff0 2023-10-06T11:01:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.963+0000 7f7654ff9700 1 -- 172.21.15.7:0/1336598370 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4589 (secure 0 0 0) 0x7f765815bb40 con 0x7f76580acff0 2023-10-06T11:01:19.965 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:19.966 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3539274987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3539274987},{"type":"v1","addr":"172.21.15.7:6836","nonce":3539274987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1716655212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1716655212},{"type":"v1","addr":"172.21.15.50:6834","nonce":1716655212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/186446686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":186446686},{"type":"v1","addr":"172.21.15.50:6835","nonce":186446686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:01:04.009956+0000","modified":"2023-10-06T11:01:07.613415+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5520":{"gid":5520,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/1121258860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1121258860},{"type":"v1","addr":"172.21.15.7:6837","nonce":1121258860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:01:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.966+0000 7f765ed74700 1 -- 172.21.15.7:0/1336598370 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f763c066f30 msgr2=0x7f763c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.966+0000 7f765ed74700 1 --2- 172.21.15.7:0/1336598370 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f763c066f30 0x7f763c0693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f76580c4bc0 tx=0x7f7644007ec0 comp rx=0 tx=0).stop 2023-10-06T11:01:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.966+0000 7f765ed74700 1 -- 172.21.15.7:0/1336598370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76580acff0 msgr2=0x7f76580c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.966+0000 7f765ed74700 1 --2- 172.21.15.7:0/1336598370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76580acff0 0x7f76580c5ca0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f764c00c7f0 tx=0x7f764c007f70 comp rx=0 tx=0).stop 2023-10-06T11:01:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.966+0000 7f765ed74700 1 -- 172.21.15.7:0/1336598370 shutdown_connections 2023-10-06T11:01:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.966+0000 7f765ed74700 1 --2- 172.21.15.7:0/1336598370 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f763c066f30 0x7f763c0693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.966+0000 7f765ed74700 1 --2- 172.21.15.7:0/1336598370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76580acff0 0x7f76580c5ca0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.966+0000 7f765ed74700 1 --2- 172.21.15.7:0/1336598370 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f76580cacf0 0x7f76580c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.966+0000 7f765ed74700 1 --2- 172.21.15.7:0/1336598370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76580ad3c0 0x7f7658154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.966+0000 7f765ed74700 1 -- 172.21.15.7:0/1336598370 >> 172.21.15.7:0/1336598370 conn(0x7f765806c2c0 msgr2=0x7f76580c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.966+0000 7f765ed74700 1 -- 172.21.15.7:0/1336598370 shutdown_connections 2023-10-06T11:01:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:19.966+0000 7f765ed74700 1 -- 172.21.15.7:0/1336598370 wait complete. 2023-10-06T11:01:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2023-10-06T11:01:19.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:01:20.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.113+0000 7f0173bb7700 1 Processor -- start 2023-10-06T11:01:20.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.113+0000 7f0173bb7700 1 -- start start 2023-10-06T11:01:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.114+0000 7f0173bb7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f016c0ccda0 0x7f016c0cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.114+0000 7f0173bb7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f016c0ac8d0 0x7f016c0aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.114+0000 7f0173bb7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016c069110 con 0x7f016c0aa870 2023-10-06T11:01:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.114+0000 7f0173bb7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f016c068b30 con 0x7f016c0ccda0 2023-10-06T11:01:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.114+0000 7f0173bb7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c0aacf0 con 0x7f016c0ac8d0 2023-10-06T11:01:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.114+0000 7f0172154700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f016c0aa870 0x7f016c155af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34806/0 (socket says 172.21.15.7:34806) 2023-10-06T11:01:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.114+0000 7f0172154700 1 -- 172.21.15.7:0/1160643316 learned_addr learned my addr 172.21.15.7:0/1160643316 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.114+0000 7f0171152700 1 --2- 172.21.15.7:0/1160643316 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f016c0ac8d0 0x7f016c0aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.114+0000 7f0171953700 1 --2- 172.21.15.7:0/1160643316 >> v2:172.21.15.50:3300/0 conn(0x7f016c0ccda0 0x7f016c0cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.114+0000 7f0170951700 1 -- 172.21.15.7:0/1160643316 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304737421 0 0) 0x7f016c069110 con 0x7f016c0aa870 2023-10-06T11:01:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.114+0000 7f0170951700 1 -- 172.21.15.7:0/1160643316 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0158003570 con 0x7f016c0aa870 2023-10-06T11:01:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0170951700 1 -- 172.21.15.7:0/1160643316 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 624666748 0 0) 0x7f0158003570 con 0x7f016c0aa870 2023-10-06T11:01:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0170951700 1 -- 172.21.15.7:0/1160643316 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f016c0ac8d0 msgr2=0x7f016c0aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0170951700 1 --2- 172.21.15.7:0/1160643316 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f016c0ac8d0 0x7f016c0aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0170951700 1 -- 172.21.15.7:0/1160643316 >> v2:172.21.15.50:3300/0 conn(0x7f016c0ccda0 msgr2=0x7f016c0cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0170951700 1 --2- 172.21.15.7:0/1160643316 >> v2:172.21.15.50:3300/0 conn(0x7f016c0ccda0 0x7f016c0cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0170951700 1 -- 172.21.15.7:0/1160643316 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c0aafb0 con 0x7f016c0aa870 2023-10-06T11:01:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0170951700 1 -- 172.21.15.7:0/1160643316 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f01640017f0 con 0x7f016c0aa870 2023-10-06T11:01:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0170951700 1 -- 172.21.15.7:0/1160643316 >> v1:172.21.15.7:6789/0 conn(0x7f016c0aa870 legacy=0x7f016c155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0170951700 1 --2- 172.21.15.7:0/1160643316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0158003a60 0x7f0158003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0170951700 1 --2- 172.21.15.7:0/1160643316 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f016c0ac8d0 0x7f0158004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0170951700 1 --2- 172.21.15.7:0/1160643316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0158004d50 0x7f01580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0170951700 1 -- 172.21.15.7:0/1160643316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c068b30 con 0x7f0158003a60 2023-10-06T11:01:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0170951700 1 -- 172.21.15.7:0/1160643316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c0aacf0 con 0x7f0158004d50 2023-10-06T11:01:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0170951700 1 -- 172.21.15.7:0/1160643316 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015800ba60 con 0x7f016c0ac8d0 2023-10-06T11:01:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0171953700 1 --2- 172.21.15.7:0/1160643316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0158003a60 0x7f0158003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0171152700 1 --2- 172.21.15.7:0/1160643316 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f016c0ac8d0 0x7f0158004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0172154700 1 --2- 172.21.15.7:0/1160643316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0158004d50 0x7f01580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0171953700 1 -- 172.21.15.7:0/1160643316 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f016c0ac8d0 msgr2=0x7f0158004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0171953700 1 --2- 172.21.15.7:0/1160643316 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f016c0ac8d0 0x7f0158004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0171953700 1 -- 172.21.15.7:0/1160643316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0158004d50 msgr2=0x7f01580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0171953700 1 --2- 172.21.15.7:0/1160643316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0158004d50 0x7f01580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0171953700 1 -- 172.21.15.7:0/1160643316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158003570 con 0x7f0158003a60 2023-10-06T11:01:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.115+0000 7f0171953700 1 --2- 172.21.15.7:0/1160643316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0158003a60 0x7f0158003e70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0168009c00 tx=0x7f01680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3aa8eb0168ebd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.116+0000 7f0170951700 1 -- 172.21.15.7:0/1160643316 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800e6b0 con 0x7f0158003a60 2023-10-06T11:01:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.116+0000 7f0170951700 1 -- 172.21.15.7:0/1160643316 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016800e810 con 0x7f0158003a60 2023-10-06T11:01:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.116+0000 7f0170951700 1 -- 172.21.15.7:0/1160643316 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800ebd0 con 0x7f0158003a60 2023-10-06T11:01:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.116+0000 7f0173bb7700 1 -- 172.21.15.7:0/1160643316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0158003a60 msgr2=0x7f0158003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.116+0000 7f0173bb7700 1 --2- 172.21.15.7:0/1160643316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0158003a60 0x7f0158003e70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0168009c00 tx=0x7f01680091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.116+0000 7f0172154700 1 -- 172.21.15.7:0/1160643316 reap_dead start 2023-10-06T11:01:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.116+0000 7f0173bb7700 1 -- 172.21.15.7:0/1160643316 shutdown_connections 2023-10-06T11:01:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.116+0000 7f0173bb7700 1 -- 172.21.15.7:0/1160643316 >> 172.21.15.7:0/1160643316 conn(0x7f016c096160 msgr2=0x7f016c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.116+0000 7f0173bb7700 1 -- 172.21.15.7:0/1160643316 shutdown_connections 2023-10-06T11:01:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.116+0000 7f0173bb7700 1 -- 172.21.15.7:0/1160643316 wait complete. 2023-10-06T11:01:20.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.118+0000 7f0173bb7700 1 Processor -- start 2023-10-06T11:01:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.118+0000 7f0173bb7700 1 -- start start 2023-10-06T11:01:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.119+0000 7f0173bb7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0158003a60 0x7f016c0cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.119+0000 7f0173bb7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f016c0cc780 0x7f016c067980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.119+0000 7f0173bb7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f016c067ec0 0x7f016c158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.119+0000 7f0173bb7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c096ee0 con 0x7f016c067ec0 2023-10-06T11:01:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.119+0000 7f0173bb7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c0682f0 con 0x7f0158003a60 2023-10-06T11:01:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.119+0000 7f0173bb7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c159070 con 0x7f016c0cc780 2023-10-06T11:01:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.119+0000 7f0172154700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f016c067ec0 0x7f016c158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.119+0000 7f0172154700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f016c067ec0 0x7f016c158340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39746/0 (socket says 172.21.15.7:39746) 2023-10-06T11:01:20.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.119+0000 7f0172154700 1 -- 172.21.15.7:0/766326718 learned_addr learned my addr 172.21.15.7:0/766326718 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:20.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.119+0000 7f0171953700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0158003a60 0x7f016c0cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.119+0000 7f0171152700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f016c0cc780 0x7f016c067980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.120+0000 7f0172154700 1 -- 172.21.15.7:0/766326718 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f016c0cc780 msgr2=0x7f016c067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.120+0000 7f0172154700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f016c0cc780 0x7f016c067980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.120+0000 7f0172154700 1 -- 172.21.15.7:0/766326718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0158003a60 msgr2=0x7f016c0cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.120+0000 7f0172154700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0158003a60 0x7f016c0cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.120+0000 7f0172154700 1 -- 172.21.15.7:0/766326718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c159350 con 0x7f016c067ec0 2023-10-06T11:01:20.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.120+0000 7f0171152700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f016c0cc780 0x7f016c067980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:20.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.120+0000 7f0172154700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f016c067ec0 0x7f016c158340 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f016c06dbd0 tx=0x7f016c0cd6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.120+0000 7f0161ffb700 1 -- 172.21.15.7:0/766326718 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016400adb0 con 0x7f016c067ec0 2023-10-06T11:01:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.120+0000 7f0161ffb700 1 -- 172.21.15.7:0/766326718 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01640133f0 con 0x7f016c067ec0 2023-10-06T11:01:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.120+0000 7f0173bb7700 1 -- 172.21.15.7:0/766326718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016c159630 con 0x7f016c067ec0 2023-10-06T11:01:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.120+0000 7f0161ffb700 1 -- 172.21.15.7:0/766326718 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164013790 con 0x7f016c067ec0 2023-10-06T11:01:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.120+0000 7f0173bb7700 1 -- 172.21.15.7:0/766326718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016c158880 con 0x7f016c067ec0 2023-10-06T11:01:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.121+0000 7f0173bb7700 1 -- 172.21.15.7:0/766326718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016c097090 con 0x7f016c067ec0 2023-10-06T11:01:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.122+0000 7f0161ffb700 1 -- 172.21.15.7:0/766326718 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0164013b80 con 0x7f016c067ec0 2023-10-06T11:01:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.122+0000 7f0161ffb700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0150066f30 0x7f01500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.123+0000 7f0161ffb700 1 -- 172.21.15.7:0/766326718 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0164085280 con 0x7f016c067ec0 2023-10-06T11:01:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.123+0000 7f0171953700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0150066f30 0x7f01500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.123+0000 7f0171953700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0150066f30 0x7f01500693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f01680091e0 tx=0x7f016801a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:20.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.127+0000 7f0161ffb700 1 -- 172.21.15.7:0/766326718 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f016c097090 con 0x7f016c067ec0 2023-10-06T11:01:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.332+0000 7f0173bb7700 1 -- 172.21.15.7:0/766326718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f016c097090 con 0x7f016c067ec0 2023-10-06T11:01:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.333+0000 7f0161ffb700 1 -- 172.21.15.7:0/766326718 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+17073 (secure 0 0 0) 0x7f016c097090 con 0x7f016c067ec0 2023-10-06T11:01:20.335 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:20.335 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":57,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:01:05.587241+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:01:01.839698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T11:01:02.986831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:01:20.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.335+0000 7f0173bb7700 1 -- 172.21.15.7:0/766326718 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0150066f30 msgr2=0x7f01500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.335+0000 7f0173bb7700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0150066f30 0x7f01500693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f01680091e0 tx=0x7f016801a000 comp rx=0 tx=0).stop 2023-10-06T11:01:20.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.335+0000 7f0173bb7700 1 -- 172.21.15.7:0/766326718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f016c067ec0 msgr2=0x7f016c158340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.335+0000 7f0173bb7700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f016c067ec0 0x7f016c158340 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f016c06dbd0 tx=0x7f016c0cd6b0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.335+0000 7f0173bb7700 1 -- 172.21.15.7:0/766326718 shutdown_connections 2023-10-06T11:01:20.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.335+0000 7f0173bb7700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0150066f30 0x7f01500693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.335+0000 7f0173bb7700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f016c067ec0 0x7f016c158340 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.335+0000 7f0173bb7700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0158003a60 0x7f016c0cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.335+0000 7f0173bb7700 1 --2- 172.21.15.7:0/766326718 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f016c0cc780 0x7f016c067980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.335+0000 7f0173bb7700 1 -- 172.21.15.7:0/766326718 >> 172.21.15.7:0/766326718 conn(0x7f016c096160 msgr2=0x7f016c06b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:20.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.335+0000 7f0173bb7700 1 -- 172.21.15.7:0/766326718 shutdown_connections 2023-10-06T11:01:20.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.335+0000 7f0173bb7700 1 -- 172.21.15.7:0/766326718 wait complete. 2023-10-06T11:01:20.350 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T10:58:55.224661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T10:58:56.032929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:01:01.839698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:01:02.986831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:01:20.351 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.484+0000 7f0cea2c1700 1 Processor -- start 2023-10-06T11:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.484+0000 7f0cea2c1700 1 -- start start 2023-10-06T11:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.485+0000 7f0cea2c1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ce41554e0 0x7f0ce41558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.485+0000 7f0cea2c1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0ce40c7e30 0x7f0ce40c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.485+0000 7f0cea2c1700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce40aeaa0 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.485+0000 7f0cea2c1700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce40af900 con 0x7f0ce40c7e30 2023-10-06T11:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.485+0000 7f0cea2c1700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce40b0c40 con 0x7f0ce41554e0 2023-10-06T11:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.485+0000 7f0ce37fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0ce40c7e30 0x7f0ce40c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.485+0000 7f0ce885e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0ce40ab6a0 0x7f0ce40afd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34818/0 (socket says 172.21.15.7:34818) 2023-10-06T11:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.485+0000 7f0ce885e700 1 -- 172.21.15.7:0/2597836757 learned_addr learned my addr 172.21.15.7:0/2597836757 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.485+0000 7f0ce3fff700 1 --2- 172.21.15.7:0/2597836757 >> v2:172.21.15.50:3300/0 conn(0x7f0ce41554e0 0x7f0ce41558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.486+0000 7f0ce37fe700 1 -- 172.21.15.7:0/2597836757 >> v2:172.21.15.50:3300/0 conn(0x7f0ce41554e0 msgr2=0x7f0ce41558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:20.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.486+0000 7f0ce37fe700 1 --2- 172.21.15.7:0/2597836757 >> v2:172.21.15.50:3300/0 conn(0x7f0ce41554e0 0x7f0ce41558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.486+0000 7f0ce37fe700 1 -- 172.21.15.7:0/2597836757 >> v1:172.21.15.7:6789/0 conn(0x7f0ce40ab6a0 legacy=0x7f0ce40afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.486+0000 7f0ce37fe700 1 -- 172.21.15.7:0/2597836757 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce40aecf0 con 0x7f0ce40c7e30 2023-10-06T11:01:20.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.486+0000 7f0ce2ffd700 1 -- 172.21.15.7:0/2597836757 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682707306 0 0) 0x7f0ce40aeaa0 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.486+0000 7f0ce37fe700 1 --2- 172.21.15.7:0/2597836757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce40c7e30 0x7f0ce40c82a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0ce406d9b0 tx=0x7f0cd8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc5aabab781ccb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:20.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.486+0000 7f0ce2ffd700 1 -- 172.21.15.7:0/2597836757 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8005c10 con 0x7f0ce40c7e30 2023-10-06T11:01:20.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.486+0000 7f0ce2ffd700 1 -- 172.21.15.7:0/2597836757 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd8005d70 con 0x7f0ce40c7e30 2023-10-06T11:01:20.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.486+0000 7f0ce2ffd700 1 -- 172.21.15.7:0/2597836757 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8006260 con 0x7f0ce40c7e30 2023-10-06T11:01:20.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.486+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2597836757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce40c7e30 msgr2=0x7f0ce40c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.486+0000 7f0cea2c1700 1 --2- 172.21.15.7:0/2597836757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce40c7e30 0x7f0ce40c82a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0ce406d9b0 tx=0x7f0cd8009120 comp rx=0 tx=0).stop 2023-10-06T11:01:20.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.486+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2597836757 shutdown_connections 2023-10-06T11:01:20.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.486+0000 7f0cea2c1700 1 --2- 172.21.15.7:0/2597836757 >> v2:172.21.15.50:3300/0 conn(0x7f0ce41554e0 0x7f0ce41558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.486+0000 7f0cea2c1700 1 --2- 172.21.15.7:0/2597836757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce40c7e30 0x7f0ce40c82a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.487+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2597836757 >> 172.21.15.7:0/2597836757 conn(0x7f0ce406ea40 msgr2=0x7f0ce40670f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:20.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.487+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2597836757 shutdown_connections 2023-10-06T11:01:20.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.487+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2597836757 wait complete. 2023-10-06T11:01:20.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.488+0000 7f0cea2c1700 1 Processor -- start 2023-10-06T11:01:20.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.488+0000 7f0cea2c1700 1 -- start start 2023-10-06T11:01:20.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0cea2c1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce40ab6a0 0x7f0ce41445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0cea2c1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce40c7e30 0x7f0ce4157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0cea2c1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ce41554e0 0x7f0ce4157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0cea2c1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce4152a00 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0cea2c1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40a9780 con 0x7f0ce40c7e30 2023-10-06T11:01:20.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0cea2c1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce41520d0 con 0x7f0ce41554e0 2023-10-06T11:01:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0ce3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce40ab6a0 0x7f0ce41445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0ce3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce40ab6a0 0x7f0ce41445d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39758/0 (socket says 172.21.15.7:39758) 2023-10-06T11:01:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0ce3fff700 1 -- 172.21.15.7:0/2174414947 learned_addr learned my addr 172.21.15.7:0/2174414947 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0ce37fe700 1 --2- 172.21.15.7:0/2174414947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce40c7e30 0x7f0ce4157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0ce885e700 1 --2- 172.21.15.7:0/2174414947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ce41554e0 0x7f0ce4157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0ce3fff700 1 -- 172.21.15.7:0/2174414947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ce41554e0 msgr2=0x7f0ce4157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0ce3fff700 1 --2- 172.21.15.7:0/2174414947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ce41554e0 0x7f0ce4157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0ce3fff700 1 -- 172.21.15.7:0/2174414947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce40c7e30 msgr2=0x7f0ce4157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0ce3fff700 1 --2- 172.21.15.7:0/2174414947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce40c7e30 0x7f0ce4157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0ce3fff700 1 -- 172.21.15.7:0/2174414947 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80093c0 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.489+0000 7f0ce3fff700 1 --2- 172.21.15.7:0/2174414947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce40ab6a0 0x7f0ce41445d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400ec80 tx=0x7f0cd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.490+0000 7f0ccbfff700 1 -- 172.21.15.7:0/2174414947 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd400c850 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.490+0000 7f0ccbfff700 1 -- 172.21.15.7:0/2174414947 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd400c9b0 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.490+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2174414947 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce41523b0 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.490+0000 7f0ccbfff700 1 -- 172.21.15.7:0/2174414947 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd400cd50 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.490+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2174414947 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce40a8a00 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.491+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2174414947 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce4152ce0 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.491+0000 7f0ccbfff700 1 -- 172.21.15.7:0/2174414947 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0cd4013680 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.492+0000 7f0ccbfff700 1 --2- 172.21.15.7:0/2174414947 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0cd0066f30 0x7f0cd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.492+0000 7f0ccbfff700 1 -- 172.21.15.7:0/2174414947 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0cd4084e00 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.492+0000 7f0ce37fe700 1 --2- 172.21.15.7:0/2174414947 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0cd0066f30 0x7f0cd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.492+0000 7f0ce37fe700 1 --2- 172.21.15.7:0/2174414947 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0cd0066f30 0x7f0cd00693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800a010 tx=0x7f0cd8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:20.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.496+0000 7f0ccbfff700 1 -- 172.21.15.7:0/2174414947 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cd4051dd0 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.701+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2174414947 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0ce4070480 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.702+0000 7f0ccbfff700 1 -- 172.21.15.7:0/2174414947 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0cd40170a0 con 0x7f0ce40ab6a0 2023-10-06T11:01:20.703 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-10-06T11:01:20.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.704+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2174414947 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0cd0066f30 msgr2=0x7f0cd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.704+0000 7f0cea2c1700 1 --2- 172.21.15.7:0/2174414947 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0cd0066f30 0x7f0cd00693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800a010 tx=0x7f0cd8016000 comp rx=0 tx=0).stop 2023-10-06T11:01:20.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.704+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2174414947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce40ab6a0 msgr2=0x7f0ce41445d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.704+0000 7f0cea2c1700 1 --2- 172.21.15.7:0/2174414947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce40ab6a0 0x7f0ce41445d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400ec80 tx=0x7f0cd40091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.704+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2174414947 shutdown_connections 2023-10-06T11:01:20.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.704+0000 7f0cea2c1700 1 --2- 172.21.15.7:0/2174414947 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0cd0066f30 0x7f0cd00693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.704+0000 7f0cea2c1700 1 --2- 172.21.15.7:0/2174414947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce40ab6a0 0x7f0ce41445d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.704+0000 7f0cea2c1700 1 --2- 172.21.15.7:0/2174414947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ce41554e0 0x7f0ce4157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.704+0000 7f0cea2c1700 1 --2- 172.21.15.7:0/2174414947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce40c7e30 0x7f0ce4157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.704+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2174414947 >> 172.21.15.7:0/2174414947 conn(0x7f0ce406ea40 msgr2=0x7f0ce40adc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:20.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.704+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2174414947 shutdown_connections 2023-10-06T11:01:20.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.704+0000 7f0cea2c1700 1 -- 172.21.15.7:0/2174414947 wait complete. 2023-10-06T11:01:20.719 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:01:20.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.852+0000 7fbec1054700 1 Processor -- start 2023-10-06T11:01:20.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.852+0000 7fbec1054700 1 -- start start 2023-10-06T11:01:20.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.853+0000 7fbec1054700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbebc1590f0 0x7fbebc068500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.853+0000 7fbec1054700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbebc0afbf0 0x7fbebc06c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.853+0000 7fbec1054700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbebc0abf30 con 0x7fbebc1594c0 2023-10-06T11:01:20.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.853+0000 7fbec1054700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbebc0ac210 con 0x7fbebc1590f0 2023-10-06T11:01:20.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.853+0000 7fbec1054700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc067a20 con 0x7fbebc0afbf0 2023-10-06T11:01:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.853+0000 7fbebad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbebc1590f0 0x7fbebc068500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.853+0000 7fbebb59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbebc0afbf0 0x7fbebc06c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.854+0000 7fbebad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbebc1590f0 0x7fbebc068500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.7:56970/0 (socket says 172.21.15.7:56970) 2023-10-06T11:01:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.854+0000 7fbebad9d700 1 -- 172.21.15.7:0/3382113247 learned_addr learned my addr 172.21.15.7:0/3382113247 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.854+0000 7fbeba59c700 1 --1- 172.21.15.7:0/3382113247 >> v1:172.21.15.50:6789/0 conn(0x7fbebc1594c0 0x7fbebc0ab750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:42708/0 (socket says 172.21.15.7:42708) 2023-10-06T11:01:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.854+0000 7fbebad9d700 1 -- 172.21.15.7:0/3382113247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbebc0afbf0 msgr2=0x7fbebc06c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.854+0000 7fbebad9d700 1 --2- 172.21.15.7:0/3382113247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbebc0afbf0 0x7fbebc06c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.854+0000 7fbebad9d700 1 -- 172.21.15.7:0/3382113247 >> v1:172.21.15.50:6789/0 conn(0x7fbebc1594c0 legacy=0x7fbebc0ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.854+0000 7fbeb9d9b700 1 -- 172.21.15.7:0/3382113247 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919988779 0 0) 0x7fbebc0abf30 con 0x7fbebc1594c0 2023-10-06T11:01:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.854+0000 7fbebad9d700 1 -- 172.21.15.7:0/3382113247 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc067d00 con 0x7fbebc1590f0 2023-10-06T11:01:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.854+0000 7fbebad9d700 1 --2- 172.21.15.7:0/3382113247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbebc1590f0 0x7fbebc068500 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0009990 tx=0x7fbeb0009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a725991b0e39cb72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.854+0000 7fbeb9d9b700 1 -- 172.21.15.7:0/3382113247 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0009e80 con 0x7fbebc1590f0 2023-10-06T11:01:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.854+0000 7fbeb9d9b700 1 -- 172.21.15.7:0/3382113247 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb0005c10 con 0x7fbebc1590f0 2023-10-06T11:01:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.854+0000 7fbeb9d9b700 1 -- 172.21.15.7:0/3382113247 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb000b650 con 0x7fbebc1590f0 2023-10-06T11:01:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.855+0000 7fbec1054700 1 -- 172.21.15.7:0/3382113247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbebc1590f0 msgr2=0x7fbebc068500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.855+0000 7fbec1054700 1 --2- 172.21.15.7:0/3382113247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbebc1590f0 0x7fbebc068500 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0009990 tx=0x7fbeb0009220 comp rx=0 tx=0).stop 2023-10-06T11:01:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.855+0000 7fbec1054700 1 -- 172.21.15.7:0/3382113247 shutdown_connections 2023-10-06T11:01:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.855+0000 7fbec1054700 1 --2- 172.21.15.7:0/3382113247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbebc0afbf0 0x7fbebc06c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.855+0000 7fbec1054700 1 --2- 172.21.15.7:0/3382113247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbebc1590f0 0x7fbebc068500 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.855+0000 7fbec1054700 1 -- 172.21.15.7:0/3382113247 >> 172.21.15.7:0/3382113247 conn(0x7fbebc0cce30 msgr2=0x7fbebc0cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.855+0000 7fbec1054700 1 -- 172.21.15.7:0/3382113247 shutdown_connections 2023-10-06T11:01:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.855+0000 7fbec1054700 1 -- 172.21.15.7:0/3382113247 wait complete. 2023-10-06T11:01:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.856+0000 7fbec1054700 1 Processor -- start 2023-10-06T11:01:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.856+0000 7fbec1054700 1 -- start start 2023-10-06T11:01:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.857+0000 7fbec1054700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbebc0afbf0 0x7fbebc15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.857+0000 7fbec1054700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbebc1590f0 0x7fbebc14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.857+0000 7fbec1054700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbebc1594c0 0x7fbebc14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.857+0000 7fbec1054700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc14c740 con 0x7fbebc0afbf0 2023-10-06T11:01:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.857+0000 7fbec1054700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc14b8d0 con 0x7fbebc1590f0 2023-10-06T11:01:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.857+0000 7fbec1054700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc14b1a0 con 0x7fbebc1594c0 2023-10-06T11:01:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.857+0000 7fbebad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbebc0afbf0 0x7fbebc15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.857+0000 7fbebad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbebc0afbf0 0x7fbebc15c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39768/0 (socket says 172.21.15.7:39768) 2023-10-06T11:01:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.857+0000 7fbebad9d700 1 -- 172.21.15.7:0/1357770449 learned_addr learned my addr 172.21.15.7:0/1357770449 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.858+0000 7fbeba59c700 1 --2- 172.21.15.7:0/1357770449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbebc1590f0 0x7fbebc14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.858+0000 7fbebb59e700 1 --2- 172.21.15.7:0/1357770449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbebc1594c0 0x7fbebc14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.858+0000 7fbebad9d700 1 -- 172.21.15.7:0/1357770449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbebc1594c0 msgr2=0x7fbebc14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.858+0000 7fbebad9d700 1 --2- 172.21.15.7:0/1357770449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbebc1594c0 0x7fbebc14ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.858+0000 7fbebad9d700 1 -- 172.21.15.7:0/1357770449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbebc1590f0 msgr2=0x7fbebc14b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.858+0000 7fbebad9d700 1 --2- 172.21.15.7:0/1357770449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbebc1590f0 0x7fbebc14b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.858+0000 7fbebad9d700 1 -- 172.21.15.7:0/1357770449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb0009480 con 0x7fbebc0afbf0 2023-10-06T11:01:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.858+0000 7fbebad9d700 1 --2- 172.21.15.7:0/1357770449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbebc0afbf0 0x7fbebc15c6b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbebc06e960 tx=0x7fbeb0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.858+0000 7fbea2ffd700 1 -- 172.21.15.7:0/1357770449 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb001db60 con 0x7fbebc0afbf0 2023-10-06T11:01:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.858+0000 7fbea2ffd700 1 -- 172.21.15.7:0/1357770449 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb001dce0 con 0x7fbebc0afbf0 2023-10-06T11:01:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.858+0000 7fbec1054700 1 -- 172.21.15.7:0/1357770449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc14bb30 con 0x7fbebc0afbf0 2023-10-06T11:01:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.858+0000 7fbea2ffd700 1 -- 172.21.15.7:0/1357770449 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb001b6d0 con 0x7fbebc0afbf0 2023-10-06T11:01:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.858+0000 7fbec1054700 1 -- 172.21.15.7:0/1357770449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc14c0f0 con 0x7fbebc0afbf0 2023-10-06T11:01:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.859+0000 7fbec1054700 1 -- 172.21.15.7:0/1357770449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbebc15cbf0 con 0x7fbebc0afbf0 2023-10-06T11:01:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.860+0000 7fbea2ffd700 1 -- 172.21.15.7:0/1357770449 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbeb001ba40 con 0x7fbebc0afbf0 2023-10-06T11:01:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.860+0000 7fbea2ffd700 1 --2- 172.21.15.7:0/1357770449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbea8066f30 0x7fbea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.860+0000 7fbea2ffd700 1 -- 172.21.15.7:0/1357770449 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbeb0086710 con 0x7fbebc0afbf0 2023-10-06T11:01:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.861+0000 7fbeba59c700 1 --2- 172.21.15.7:0/1357770449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbea8066f30 0x7fbea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.861+0000 7fbeba59c700 1 --2- 172.21.15.7:0/1357770449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbea8066f30 0x7fbea80693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbebc14cad0 tx=0x7fbeac007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:20.865+0000 7fbea2ffd700 1 -- 172.21.15.7:0/1357770449 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbeb0053760 con 0x7fbebc0afbf0 2023-10-06T11:01:21.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.066+0000 7fbec1054700 1 -- 172.21.15.7:0/1357770449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbebc070480 con 0x7fbebc0afbf0 2023-10-06T11:01:21.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.067+0000 7fbea2ffd700 1 -- 172.21.15.7:0/1357770449 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbeb0056d80 con 0x7fbebc0afbf0 2023-10-06T11:01:21.070 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-06T11:01:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.069+0000 7fbec1054700 1 -- 172.21.15.7:0/1357770449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbea8066f30 msgr2=0x7fbea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.069+0000 7fbec1054700 1 --2- 172.21.15.7:0/1357770449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbea8066f30 0x7fbea80693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbebc14cad0 tx=0x7fbeac007d50 comp rx=0 tx=0).stop 2023-10-06T11:01:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.069+0000 7fbec1054700 1 -- 172.21.15.7:0/1357770449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbebc0afbf0 msgr2=0x7fbebc15c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.069+0000 7fbec1054700 1 --2- 172.21.15.7:0/1357770449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbebc0afbf0 0x7fbebc15c6b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbebc06e960 tx=0x7fbeb0016000 comp rx=0 tx=0).stop 2023-10-06T11:01:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.069+0000 7fbec1054700 1 -- 172.21.15.7:0/1357770449 shutdown_connections 2023-10-06T11:01:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.069+0000 7fbec1054700 1 --2- 172.21.15.7:0/1357770449 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbea8066f30 0x7fbea80693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.069+0000 7fbec1054700 1 --2- 172.21.15.7:0/1357770449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbebc0afbf0 0x7fbebc15c6b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.069+0000 7fbec1054700 1 --2- 172.21.15.7:0/1357770449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbebc1594c0 0x7fbebc14ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.069+0000 7fbec1054700 1 --2- 172.21.15.7:0/1357770449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbebc1590f0 0x7fbebc14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.069+0000 7fbec1054700 1 -- 172.21.15.7:0/1357770449 >> 172.21.15.7:0/1357770449 conn(0x7fbebc0cce30 msgr2=0x7fbebc0ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.069+0000 7fbec1054700 1 -- 172.21.15.7:0/1357770449 shutdown_connections 2023-10-06T11:01:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.069+0000 7fbec1054700 1 -- 172.21.15.7:0/1357770449 wait complete. 2023-10-06T11:01:21.084 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:01:21.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.218+0000 7f4d6bc17700 1 Processor -- start 2023-10-06T11:01:21.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.218+0000 7f4d6bc17700 1 -- start start 2023-10-06T11:01:21.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.219+0000 7f4d6bc17700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d640ccc10 0x7f4d640c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.219+0000 7f4d6bc17700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4d640b0590 0x7f4d640c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.219+0000 7f4d6bc17700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d640cedc0 con 0x7f4d640b01c0 2023-10-06T11:01:21.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.219+0000 7f4d6bc17700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d640c9530 con 0x7f4d640b0590 2023-10-06T11:01:21.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.219+0000 7f4d6bc17700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d640c9720 con 0x7f4d640ccc10 2023-10-06T11:01:21.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.220+0000 7f4d6a1b4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4d640b0590 0x7f4d640c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.220+0000 7f4d6a1b4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4d640b0590 0x7f4d640c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39780/0 (socket says 172.21.15.7:39780) 2023-10-06T11:01:21.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.220+0000 7f4d6a1b4700 1 -- 172.21.15.7:0/3738570318 learned_addr learned my addr 172.21.15.7:0/3738570318 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:21.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.220+0000 7f4d691b2700 1 --2- 172.21.15.7:0/3738570318 >> v2:172.21.15.50:3300/0 conn(0x7f4d640ccc10 0x7f4d640c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.220+0000 7f4d6a1b4700 1 -- 172.21.15.7:0/3738570318 >> v2:172.21.15.50:3300/0 conn(0x7f4d640ccc10 msgr2=0x7f4d640c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:21.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.220+0000 7f4d6a1b4700 1 --2- 172.21.15.7:0/3738570318 >> v2:172.21.15.50:3300/0 conn(0x7f4d640ccc10 0x7f4d640c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.220+0000 7f4d6a1b4700 1 -- 172.21.15.7:0/3738570318 >> v1:172.21.15.50:6789/0 conn(0x7f4d640b01c0 legacy=0x7f4d640cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.220+0000 7f4d689b1700 1 -- 172.21.15.7:0/3738570318 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883361938 0 0) 0x7f4d640cedc0 con 0x7f4d640b01c0 2023-10-06T11:01:21.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.220+0000 7f4d6a1b4700 1 -- 172.21.15.7:0/3738570318 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d640c9a00 con 0x7f4d640b0590 2023-10-06T11:01:21.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.220+0000 7f4d6a1b4700 1 --2- 172.21.15.7:0/3738570318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d640b0590 0x7f4d640c8ff0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4d6406f910 tx=0x7f4d5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf7d94349d57813 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:21.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.220+0000 7f4d689b1700 1 -- 172.21.15.7:0/3738570318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00e070 con 0x7f4d640b0590 2023-10-06T11:01:21.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.220+0000 7f4d689b1700 1 -- 172.21.15.7:0/3738570318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c00ba20 con 0x7f4d640b0590 2023-10-06T11:01:21.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.220+0000 7f4d689b1700 1 -- 172.21.15.7:0/3738570318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0092e0 con 0x7f4d640b0590 2023-10-06T11:01:21.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.221+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3738570318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d640b0590 msgr2=0x7f4d640c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.221+0000 7f4d6bc17700 1 --2- 172.21.15.7:0/3738570318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d640b0590 0x7f4d640c8ff0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4d6406f910 tx=0x7f4d5c009840 comp rx=0 tx=0).stop 2023-10-06T11:01:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.221+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3738570318 shutdown_connections 2023-10-06T11:01:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.221+0000 7f4d6bc17700 1 --2- 172.21.15.7:0/3738570318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d640b0590 0x7f4d640c8ff0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.221+0000 7f4d6bc17700 1 --2- 172.21.15.7:0/3738570318 >> v2:172.21.15.50:3300/0 conn(0x7f4d640ccc10 0x7f4d640c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.221+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3738570318 >> 172.21.15.7:0/3738570318 conn(0x7f4d6406cd00 msgr2=0x7f4d640cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.221+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3738570318 shutdown_connections 2023-10-06T11:01:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.221+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3738570318 wait complete. 2023-10-06T11:01:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.222+0000 7f4d6bc17700 1 Processor -- start 2023-10-06T11:01:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.222+0000 7f4d6bc17700 1 -- start start 2023-10-06T11:01:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.223+0000 7f4d6bc17700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d640b01c0 0x7f4d64157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.223+0000 7f4d6bc17700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d640b0590 0x7f4d6416c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.223+0000 7f4d6bc17700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d640ccc10 0x7f4d6416c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.223+0000 7f4d6bc17700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6416d2e0 con 0x7f4d640b0590 2023-10-06T11:01:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.223+0000 7f4d6bc17700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d640c78a0 con 0x7f4d640ccc10 2023-10-06T11:01:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.223+0000 7f4d6bc17700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d640c6c90 con 0x7f4d640b01c0 2023-10-06T11:01:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.223+0000 7f4d691b2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d640b0590 0x7f4d6416c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.223+0000 7f4d691b2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d640b0590 0x7f4d6416c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39792/0 (socket says 172.21.15.7:39792) 2023-10-06T11:01:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.223+0000 7f4d691b2700 1 -- 172.21.15.7:0/3465853859 learned_addr learned my addr 172.21.15.7:0/3465853859 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.223+0000 7f4d6a1b4700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d640ccc10 0x7f4d6416c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.223+0000 7f4d699b3700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d640b01c0 0x7f4d64157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.224+0000 7f4d691b2700 1 -- 172.21.15.7:0/3465853859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d640b01c0 msgr2=0x7f4d64157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.224+0000 7f4d691b2700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d640b01c0 0x7f4d64157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.224+0000 7f4d691b2700 1 -- 172.21.15.7:0/3465853859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d640ccc10 msgr2=0x7f4d6416c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.224+0000 7f4d691b2700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d640ccc10 0x7f4d6416c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.224+0000 7f4d691b2700 1 -- 172.21.15.7:0/3465853859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c009ae0 con 0x7f4d640b0590 2023-10-06T11:01:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.224+0000 7f4d6a1b4700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d640ccc10 0x7f4d6416c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.224+0000 7f4d699b3700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d640b01c0 0x7f4d64157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.224+0000 7f4d691b2700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d640b0590 0x7f4d6416c470 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000e930 tx=0x7f4d600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.224+0000 7f4d59ffb700 1 -- 172.21.15.7:0/3465853859 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60009510 con 0x7f4d640b0590 2023-10-06T11:01:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.224+0000 7f4d59ffb700 1 -- 172.21.15.7:0/3465853859 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6000c850 con 0x7f4d640b0590 2023-10-06T11:01:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.224+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3465853859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d640c6f70 con 0x7f4d640b0590 2023-10-06T11:01:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.224+0000 7f4d59ffb700 1 -- 172.21.15.7:0/3465853859 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000cc10 con 0x7f4d640b0590 2023-10-06T11:01:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.224+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3465853859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d640c7530 con 0x7f4d640b0590 2023-10-06T11:01:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.225+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3465853859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6415af30 con 0x7f4d640b0590 2023-10-06T11:01:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.226+0000 7f4d59ffb700 1 -- 172.21.15.7:0/3465853859 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d60013470 con 0x7f4d640b0590 2023-10-06T11:01:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.226+0000 7f4d59ffb700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4d48066f30 0x7f4d480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.226+0000 7f4d59ffb700 1 -- 172.21.15.7:0/3465853859 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4d600849b0 con 0x7f4d640b0590 2023-10-06T11:01:21.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.226+0000 7f4d699b3700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4d48066f30 0x7f4d480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.227+0000 7f4d699b3700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4d48066f30 0x7f4d480693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4d540011e0 tx=0x7f4d54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:21.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.231+0000 7f4d59ffb700 1 -- 172.21.15.7:0/3465853859 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d600518e0 con 0x7f4d640b0590 2023-10-06T11:01:21.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.433+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3465853859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d64070480 con 0x7f4d640b0590 2023-10-06T11:01:21.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.433+0000 7f4d59ffb700 1 -- 172.21.15.7:0/3465853859 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4d60054f00 con 0x7f4d640b0590 2023-10-06T11:01:21.435 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-06T11:01:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.435+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3465853859 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4d48066f30 msgr2=0x7f4d480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.435+0000 7f4d6bc17700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4d48066f30 0x7f4d480693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4d540011e0 tx=0x7f4d54009040 comp rx=0 tx=0).stop 2023-10-06T11:01:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.435+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3465853859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d640b0590 msgr2=0x7f4d6416c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.435+0000 7f4d6bc17700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d640b0590 0x7f4d6416c470 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000e930 tx=0x7f4d600091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.435+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3465853859 shutdown_connections 2023-10-06T11:01:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.435+0000 7f4d6bc17700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f4d48066f30 0x7f4d480693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.435+0000 7f4d6bc17700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d640ccc10 0x7f4d6416c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.435+0000 7f4d6bc17700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d640b01c0 0x7f4d64157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.435+0000 7f4d6bc17700 1 --2- 172.21.15.7:0/3465853859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d640b0590 0x7f4d6416c470 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.435+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3465853859 >> 172.21.15.7:0/3465853859 conn(0x7f4d6406cd00 msgr2=0x7f4d640b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.435+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3465853859 shutdown_connections 2023-10-06T11:01:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.435+0000 7f4d6bc17700 1 -- 172.21.15.7:0/3465853859 wait complete. 2023-10-06T11:01:21.451 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:01:21.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.584+0000 7f668d28c700 1 Processor -- start 2023-10-06T11:01:21.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.584+0000 7f668d28c700 1 -- start start 2023-10-06T11:01:21.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.585+0000 7f668d28c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6688069b30 0x7f66881641e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.585+0000 7f668d28c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66880cedc0 con 0x7f66880b01c0 2023-10-06T11:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.585+0000 7f668d28c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66880c9720 con 0x7f66880ccc10 2023-10-06T11:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.585+0000 7f668d28c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66880c9a00 con 0x7f6688069b30 2023-10-06T11:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.585+0000 7f66877fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6688069b30 0x7f66881641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.585+0000 7f6686ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f66880b01c0 0x7f66880cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34826/0 (socket says 172.21.15.7:34826) 2023-10-06T11:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.585+0000 7f6686ffd700 1 -- 172.21.15.7:0/2293537276 learned_addr learned my addr 172.21.15.7:0/2293537276 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.586+0000 7f66877fe700 1 -- 172.21.15.7:0/2293537276 >> v1:172.21.15.50:6789/0 conn(0x7f66880ccc10 legacy=0x7f66880c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.586+0000 7f66877fe700 1 -- 172.21.15.7:0/2293537276 >> v1:172.21.15.7:6789/0 conn(0x7f66880b01c0 legacy=0x7f66880cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.586+0000 7f66877fe700 1 -- 172.21.15.7:0/2293537276 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880c9ce0 con 0x7f6688069b30 2023-10-06T11:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.586+0000 7f6685ffb700 1 -- 172.21.15.7:0/2293537276 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186723260 0 0) 0x7f66880cedc0 con 0x7f66880b01c0 2023-10-06T11:01:21.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.586+0000 7f66877fe700 1 --2- 172.21.15.7:0/2293537276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6688069b30 0x7f66881641e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6680009e60 tx=0x7f6680009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e191d993d68318a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:21.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.586+0000 7f6685ffb700 1 -- 172.21.15.7:0/2293537276 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668000e070 con 0x7f6688069b30 2023-10-06T11:01:21.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.586+0000 7f6685ffb700 1 -- 172.21.15.7:0/2293537276 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668000bc30 con 0x7f6688069b30 2023-10-06T11:01:21.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.586+0000 7f6685ffb700 1 -- 172.21.15.7:0/2293537276 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6680012430 con 0x7f6688069b30 2023-10-06T11:01:21.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.587+0000 7f668d28c700 1 -- 172.21.15.7:0/2293537276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6688069b30 msgr2=0x7f66881641e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.587+0000 7f668d28c700 1 --2- 172.21.15.7:0/2293537276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6688069b30 0x7f66881641e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6680009e60 tx=0x7f6680009780 comp rx=0 tx=0).stop 2023-10-06T11:01:21.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.587+0000 7f668d28c700 1 -- 172.21.15.7:0/2293537276 shutdown_connections 2023-10-06T11:01:21.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.587+0000 7f668d28c700 1 --2- 172.21.15.7:0/2293537276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6688069b30 0x7f66881641e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.587+0000 7f668d28c700 1 -- 172.21.15.7:0/2293537276 >> 172.21.15.7:0/2293537276 conn(0x7f668806cd00 msgr2=0x7f66880cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:21.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.587+0000 7f668d28c700 1 -- 172.21.15.7:0/2293537276 shutdown_connections 2023-10-06T11:01:21.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.587+0000 7f668d28c700 1 -- 172.21.15.7:0/2293537276 wait complete. 2023-10-06T11:01:21.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.588+0000 7f668d28c700 1 Processor -- start 2023-10-06T11:01:21.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.588+0000 7f668d28c700 1 -- start start 2023-10-06T11:01:21.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f668d28c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6688069b30 0x7f66881544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f668d28c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66880b01c0 0x7f66881598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f668d28c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66880ccc10 0x7f6688159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f668d28c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880c4fd0 con 0x7f66880ccc10 2023-10-06T11:01:21.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f668d28c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668815acf0 con 0x7f66880b01c0 2023-10-06T11:01:21.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f668d28c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668815b2b0 con 0x7f6688069b30 2023-10-06T11:01:21.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f66877fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66880ccc10 0x7f6688159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f66877fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66880ccc10 0x7f6688159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39812/0 (socket says 172.21.15.7:39812) 2023-10-06T11:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f66877fe700 1 -- 172.21.15.7:0/2380871119 learned_addr learned my addr 172.21.15.7:0/2380871119 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f6686ffd700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6688069b30 0x7f66881544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f66867fc700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66880b01c0 0x7f66881598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f66877fe700 1 -- 172.21.15.7:0/2380871119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6688069b30 msgr2=0x7f66881544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f66877fe700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6688069b30 0x7f66881544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f66877fe700 1 -- 172.21.15.7:0/2380871119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66880b01c0 msgr2=0x7f66881598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f66877fe700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66880b01c0 0x7f66881598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f66877fe700 1 -- 172.21.15.7:0/2380871119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6680009a20 con 0x7f66880ccc10 2023-10-06T11:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.589+0000 7f66867fc700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66880b01c0 0x7f66881598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.590+0000 7f66877fe700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66880ccc10 0x7f6688159e30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6688067c00 tx=0x7f6680018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.590+0000 7f667effd700 1 -- 172.21.15.7:0/2380871119 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668001e640 con 0x7f66880ccc10 2023-10-06T11:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.590+0000 7f667effd700 1 -- 172.21.15.7:0/2380871119 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668001e7c0 con 0x7f66880ccc10 2023-10-06T11:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.590+0000 7f668d28c700 1 -- 172.21.15.7:0/2380871119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6688155180 con 0x7f66880ccc10 2023-10-06T11:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.590+0000 7f667effd700 1 -- 172.21.15.7:0/2380871119 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668001eb80 con 0x7f66880ccc10 2023-10-06T11:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.590+0000 7f668d28c700 1 -- 172.21.15.7:0/2380871119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668815a770 con 0x7f66880ccc10 2023-10-06T11:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.591+0000 7f668d28c700 1 -- 172.21.15.7:0/2380871119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6688070480 con 0x7f66880ccc10 2023-10-06T11:01:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.591+0000 7f667effd700 1 -- 172.21.15.7:0/2380871119 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6680024070 con 0x7f66880ccc10 2023-10-06T11:01:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.592+0000 7f667effd700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6668066f30 0x7f66680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.592+0000 7f667effd700 1 -- 172.21.15.7:0/2380871119 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6680087200 con 0x7f66880ccc10 2023-10-06T11:01:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.592+0000 7f6686ffd700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6668066f30 0x7f66680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.592+0000 7f6686ffd700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6668066f30 0x7f66680693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6678007fd0 tx=0x7f6678007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.596+0000 7f667effd700 1 -- 172.21.15.7:0/2380871119 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66800541d0 con 0x7f66880ccc10 2023-10-06T11:01:21.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.799+0000 7f668d28c700 1 -- 172.21.15.7:0/2380871119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f668806ea70 con 0x7f66880ccc10 2023-10-06T11:01:21.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.799+0000 7f667effd700 1 -- 172.21.15.7:0/2380871119 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) v1 ==== 100+0+11 (secure 0 0 0) 0x7f66800577f0 con 0x7f66880ccc10 2023-10-06T11:01:21.801 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-06T11:01:21.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.801+0000 7f668d28c700 1 -- 172.21.15.7:0/2380871119 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6668066f30 msgr2=0x7f66680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.801+0000 7f668d28c700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6668066f30 0x7f66680693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6678007fd0 tx=0x7f6678007d30 comp rx=0 tx=0).stop 2023-10-06T11:01:21.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.801+0000 7f668d28c700 1 -- 172.21.15.7:0/2380871119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66880ccc10 msgr2=0x7f6688159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.801+0000 7f668d28c700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66880ccc10 0x7f6688159e30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6688067c00 tx=0x7f6680018000 comp rx=0 tx=0).stop 2023-10-06T11:01:21.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.801+0000 7f668d28c700 1 -- 172.21.15.7:0/2380871119 shutdown_connections 2023-10-06T11:01:21.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.801+0000 7f668d28c700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6668066f30 0x7f66680693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.801+0000 7f668d28c700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66880ccc10 0x7f6688159e30 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.801+0000 7f668d28c700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6688069b30 0x7f66881544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.801+0000 7f668d28c700 1 --2- 172.21.15.7:0/2380871119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66880b01c0 0x7f66881598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.801+0000 7f668d28c700 1 -- 172.21.15.7:0/2380871119 >> 172.21.15.7:0/2380871119 conn(0x7f668806cd00 msgr2=0x7f66880c2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:21.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.801+0000 7f668d28c700 1 -- 172.21.15.7:0/2380871119 shutdown_connections 2023-10-06T11:01:21.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.801+0000 7f668d28c700 1 -- 172.21.15.7:0/2380871119 wait complete. 2023-10-06T11:01:21.817 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:01:21.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.947+0000 7f35a9d50700 1 Processor -- start 2023-10-06T11:01:21.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.947+0000 7f35a9d50700 1 -- start start 2023-10-06T11:01:21.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.948+0000 7f35a9d50700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35a40a7090 0x7f35a4163eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.948+0000 7f35a9d50700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a40b0250 con 0x7f35a4159360 2023-10-06T11:01:21.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.948+0000 7f35a9d50700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a40aeba0 con 0x7f35a4068100 2023-10-06T11:01:21.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.948+0000 7f35a9d50700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a4159730 con 0x7f35a40a7090 2023-10-06T11:01:21.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.948+0000 7f35a37fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f35a4159360 0x7f35a40afb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34828/0 (socket says 172.21.15.7:34828) 2023-10-06T11:01:21.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.948+0000 7f35a37fe700 1 -- 172.21.15.7:0/1319467862 learned_addr learned my addr 172.21.15.7:0/1319467862 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:21.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.948+0000 7f35a3fff700 1 --2- 172.21.15.7:0/1319467862 >> v2:172.21.15.50:3300/0 conn(0x7f35a40a7090 0x7f35a4163eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.949+0000 7f35a27fc700 1 -- 172.21.15.7:0/1319467862 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203200846 0 0) 0x7f3594001110 con 0x7f35a4159360 2023-10-06T11:01:21.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.949+0000 7f35a27fc700 1 -- 172.21.15.7:0/1319467862 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3590003570 con 0x7f35a4159360 2023-10-06T11:01:21.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.949+0000 7f35a27fc700 1 -- 172.21.15.7:0/1319467862 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278929750 0 0) 0x7f35a40aeba0 con 0x7f35a4068100 2023-10-06T11:01:21.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.949+0000 7f35a27fc700 1 -- 172.21.15.7:0/1319467862 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3594001110 con 0x7f35a4068100 2023-10-06T11:01:21.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.949+0000 7f35a3fff700 1 -- 172.21.15.7:0/1319467862 >> v1:172.21.15.50:6789/0 conn(0x7f35a4068100 legacy=0x7f35a40a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.949+0000 7f35a3fff700 1 -- 172.21.15.7:0/1319467862 >> v1:172.21.15.7:6789/0 conn(0x7f35a4159360 legacy=0x7f35a40afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.949+0000 7f35a3fff700 1 -- 172.21.15.7:0/1319467862 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40ae270 con 0x7f35a40a7090 2023-10-06T11:01:21.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.949+0000 7f35a3fff700 1 --2- 172.21.15.7:0/1319467862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a40a7090 0x7f35a4163eb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f359c009e60 tx=0x7f359c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b927dfb7ed049e4d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:21.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.949+0000 7f35a27fc700 1 -- 172.21.15.7:0/1319467862 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c00e070 con 0x7f35a40a7090 2023-10-06T11:01:21.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.949+0000 7f35a27fc700 1 -- 172.21.15.7:0/1319467862 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c00bab0 con 0x7f35a40a7090 2023-10-06T11:01:21.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.949+0000 7f35a27fc700 1 -- 172.21.15.7:0/1319467862 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c00be70 con 0x7f35a40a7090 2023-10-06T11:01:21.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.950+0000 7f35a9d50700 1 -- 172.21.15.7:0/1319467862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a40a7090 msgr2=0x7f35a4163eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.950+0000 7f35a9d50700 1 --2- 172.21.15.7:0/1319467862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a40a7090 0x7f35a4163eb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f359c009e60 tx=0x7f359c009780 comp rx=0 tx=0).stop 2023-10-06T11:01:21.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.950+0000 7f35a9d50700 1 -- 172.21.15.7:0/1319467862 shutdown_connections 2023-10-06T11:01:21.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.950+0000 7f35a9d50700 1 --2- 172.21.15.7:0/1319467862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a40a7090 0x7f35a4163eb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.950+0000 7f35a9d50700 1 -- 172.21.15.7:0/1319467862 >> 172.21.15.7:0/1319467862 conn(0x7f35a4095a70 msgr2=0x7f35a40af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:21.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.950+0000 7f35a9d50700 1 -- 172.21.15.7:0/1319467862 shutdown_connections 2023-10-06T11:01:21.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.950+0000 7f35a9d50700 1 -- 172.21.15.7:0/1319467862 wait complete. 2023-10-06T11:01:21.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.951+0000 7f35a9d50700 1 Processor -- start 2023-10-06T11:01:21.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.951+0000 7f35a9d50700 1 -- start start 2023-10-06T11:01:21.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a9d50700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a4068100 0x7f35a4145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a9d50700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35a40a7090 0x7f35a415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a9d50700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35a4159360 0x7f35a415e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a9d50700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40cbbf0 con 0x7f35a40a7090 2023-10-06T11:01:21.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a9d50700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40cbed0 con 0x7f35a4068100 2023-10-06T11:01:21.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a9d50700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40cc1b0 con 0x7f35a4159360 2023-10-06T11:01:21.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a2ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35a40a7090 0x7f35a415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a2ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35a40a7090 0x7f35a415dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39824/0 (socket says 172.21.15.7:39824) 2023-10-06T11:01:21.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a2ffd700 1 -- 172.21.15.7:0/1504039086 learned_addr learned my addr 172.21.15.7:0/1504039086 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:21.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a37fe700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a4068100 0x7f35a4145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a3fff700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35a4159360 0x7f35a415e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a2ffd700 1 -- 172.21.15.7:0/1504039086 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35a4159360 msgr2=0x7f35a415e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a2ffd700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35a4159360 0x7f35a415e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a2ffd700 1 -- 172.21.15.7:0/1504039086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a4068100 msgr2=0x7f35a4145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:21.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.952+0000 7f35a2ffd700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a4068100 0x7f35a4145a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:21.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.953+0000 7f35a2ffd700 1 -- 172.21.15.7:0/1504039086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c009a20 con 0x7f35a40a7090 2023-10-06T11:01:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.953+0000 7f35a37fe700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a4068100 0x7f35a4145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.953+0000 7f35a3fff700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35a4159360 0x7f35a415e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.953+0000 7f35a2ffd700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35a40a7090 0x7f35a415dbe0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f358c00c7c0 tx=0x7f358c007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.953+0000 7f359b7fe700 1 -- 172.21.15.7:0/1504039086 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0015f0 con 0x7f35a40a7090 2023-10-06T11:01:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.953+0000 7f359b7fe700 1 -- 172.21.15.7:0/1504039086 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c001770 con 0x7f35a40a7090 2023-10-06T11:01:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.953+0000 7f35a9d50700 1 -- 172.21.15.7:0/1504039086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a40cc490 con 0x7f35a40a7090 2023-10-06T11:01:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.953+0000 7f359b7fe700 1 -- 172.21.15.7:0/1504039086 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c001b30 con 0x7f35a40a7090 2023-10-06T11:01:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.953+0000 7f35a9d50700 1 -- 172.21.15.7:0/1504039086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a40cae70 con 0x7f35a40a7090 2023-10-06T11:01:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.954+0000 7f35a9d50700 1 -- 172.21.15.7:0/1504039086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a4070480 con 0x7f35a40a7090 2023-10-06T11:01:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.954+0000 7f359b7fe700 1 -- 172.21.15.7:0/1504039086 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f358c0123e0 con 0x7f35a40a7090 2023-10-06T11:01:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.955+0000 7f359b7fe700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3584066f30 0x7f35840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:21.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.955+0000 7f359b7fe700 1 -- 172.21.15.7:0/1504039086 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f358c0844d0 con 0x7f35a40a7090 2023-10-06T11:01:21.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.955+0000 7f35a37fe700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3584066f30 0x7f35840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:21.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.955+0000 7f35a37fe700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3584066f30 0x7f35840693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3594007fd0 tx=0x7f3594009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:21.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:21.959+0000 7f359b7fe700 1 -- 172.21.15.7:0/1504039086 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f358c0514a0 con 0x7f35a40a7090 2023-10-06T11:01:22.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.203+0000 7f35a9d50700 1 -- 172.21.15.7:0/1504039086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35a40ae550 con 0x7f35a40a7090 2023-10-06T11:01:22.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.204+0000 7f359b7fe700 1 -- 172.21.15.7:0/1504039086 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4589 (secure 0 0 0) 0x7f358c054ac0 con 0x7f35a40a7090 2023-10-06T11:01:22.206 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:22.206 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3539274987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3539274987},{"type":"v1","addr":"172.21.15.7:6836","nonce":3539274987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1716655212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1716655212},{"type":"v1","addr":"172.21.15.50:6834","nonce":1716655212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/186446686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":186446686},{"type":"v1","addr":"172.21.15.50:6835","nonce":186446686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:01:04.009956+0000","modified":"2023-10-06T11:01:07.613415+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5520":{"gid":5520,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/1121258860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1121258860},{"type":"v1","addr":"172.21.15.7:6837","nonce":1121258860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:01:22.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.206+0000 7f35a9d50700 1 -- 172.21.15.7:0/1504039086 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3584066f30 msgr2=0x7f35840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.206+0000 7f35a9d50700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3584066f30 0x7f35840693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3594007fd0 tx=0x7f3594009040 comp rx=0 tx=0).stop 2023-10-06T11:01:22.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.206+0000 7f35a9d50700 1 -- 172.21.15.7:0/1504039086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35a40a7090 msgr2=0x7f35a415dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.206+0000 7f35a9d50700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35a40a7090 0x7f35a415dbe0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f358c00c7c0 tx=0x7f358c007da0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.206+0000 7f35a9d50700 1 -- 172.21.15.7:0/1504039086 shutdown_connections 2023-10-06T11:01:22.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.206+0000 7f35a9d50700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3584066f30 0x7f35840693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.206+0000 7f35a9d50700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35a4159360 0x7f35a415e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.206+0000 7f35a9d50700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a4068100 0x7f35a4145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.206+0000 7f35a9d50700 1 --2- 172.21.15.7:0/1504039086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35a40a7090 0x7f35a415dbe0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.206+0000 7f35a9d50700 1 -- 172.21.15.7:0/1504039086 >> 172.21.15.7:0/1504039086 conn(0x7f35a4095a70 msgr2=0x7f35a40ac590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:22.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.206+0000 7f35a9d50700 1 -- 172.21.15.7:0/1504039086 shutdown_connections 2023-10-06T11:01:22.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.206+0000 7f35a9d50700 1 -- 172.21.15.7:0/1504039086 wait complete. 2023-10-06T11:01:22.210 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2023-10-06T11:01:22.221 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:01:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.352+0000 7f636c2c2700 1 Processor -- start 2023-10-06T11:01:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.352+0000 7f636c2c2700 1 -- start start 2023-10-06T11:01:22.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.353+0000 7f636c2c2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6364158120 0x7f63640c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:22.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.353+0000 7f636c2c2700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63640cbd10 con 0x7f63640c8ba0 2023-10-06T11:01:22.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.353+0000 7f636c2c2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63640cb9e0 con 0x7f63640cae30 2023-10-06T11:01:22.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.353+0000 7f636c2c2700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63640c9300 con 0x7f6364158120 2023-10-06T11:01:22.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.353+0000 7f636a05e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6364158120 0x7f63640c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:22.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.353+0000 7f636985d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f63640c8ba0 0x7f63640ca720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34830/0 (socket says 172.21.15.7:34830) 2023-10-06T11:01:22.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.353+0000 7f636a05e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6364158120 0x7f63640c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39834/0 (socket says 172.21.15.7:39834) 2023-10-06T11:01:22.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.353+0000 7f636985d700 1 -- 172.21.15.7:0/1436929434 learned_addr learned my addr 172.21.15.7:0/1436929434 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:22.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.354+0000 7f636a05e700 1 -- 172.21.15.7:0/1436929434 >> v1:172.21.15.50:6789/0 conn(0x7f63640cae30 legacy=0x7f63640cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.354+0000 7f636a05e700 1 -- 172.21.15.7:0/1436929434 >> v1:172.21.15.7:6789/0 conn(0x7f63640c8ba0 legacy=0x7f63640ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.354+0000 7f636a05e700 1 -- 172.21.15.7:0/1436929434 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63640c95e0 con 0x7f6364158120 2023-10-06T11:01:22.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.354+0000 7f636905c700 1 -- 172.21.15.7:0/1436929434 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449917796 0 0) 0x7f63640cbd10 con 0x7f63640c8ba0 2023-10-06T11:01:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.354+0000 7f636a05e700 1 --2- 172.21.15.7:0/1436929434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6364158120 0x7f63640c8660 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f63600098d0 tx=0x7f6360009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9e0bcac3bc2204 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.354+0000 7f636905c700 1 -- 172.21.15.7:0/1436929434 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6360009e70 con 0x7f6364158120 2023-10-06T11:01:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.354+0000 7f636905c700 1 -- 172.21.15.7:0/1436929434 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6360005c10 con 0x7f6364158120 2023-10-06T11:01:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.354+0000 7f636905c700 1 -- 172.21.15.7:0/1436929434 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636000b650 con 0x7f6364158120 2023-10-06T11:01:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.355+0000 7f636c2c2700 1 -- 172.21.15.7:0/1436929434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6364158120 msgr2=0x7f63640c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.355+0000 7f636c2c2700 1 --2- 172.21.15.7:0/1436929434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6364158120 0x7f63640c8660 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f63600098d0 tx=0x7f6360009120 comp rx=0 tx=0).stop 2023-10-06T11:01:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.355+0000 7f636c2c2700 1 -- 172.21.15.7:0/1436929434 shutdown_connections 2023-10-06T11:01:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.355+0000 7f636c2c2700 1 --2- 172.21.15.7:0/1436929434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6364158120 0x7f63640c8660 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.355+0000 7f636c2c2700 1 -- 172.21.15.7:0/1436929434 >> 172.21.15.7:0/1436929434 conn(0x7f6364087920 msgr2=0x7f6364097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:22.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.355+0000 7f636c2c2700 1 -- 172.21.15.7:0/1436929434 shutdown_connections 2023-10-06T11:01:22.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.355+0000 7f636c2c2700 1 -- 172.21.15.7:0/1436929434 wait complete. 2023-10-06T11:01:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.356+0000 7f636c2c2700 1 Processor -- start 2023-10-06T11:01:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.356+0000 7f636c2c2700 1 -- start start 2023-10-06T11:01:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636c2c2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63640c8ba0 0x7f6364166bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636c2c2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63640cae30 0x7f63640c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636c2c2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6364158120 0x7f63640c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:22.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636c2c2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6364150e70 con 0x7f63640cae30 2023-10-06T11:01:22.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636c2c2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63640af620 con 0x7f6364158120 2023-10-06T11:01:22.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636c2c2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63640af900 con 0x7f63640c8ba0 2023-10-06T11:01:22.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636985d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63640cae30 0x7f63640c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:22.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636985d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63640cae30 0x7f63640c16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39846/0 (socket says 172.21.15.7:39846) 2023-10-06T11:01:22.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636985d700 1 -- 172.21.15.7:0/940353215 learned_addr learned my addr 172.21.15.7:0/940353215 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:22.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636a05e700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63640c8ba0 0x7f6364166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:22.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636a85f700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6364158120 0x7f63640c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:22.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636985d700 1 -- 172.21.15.7:0/940353215 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63640c8ba0 msgr2=0x7f6364166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636985d700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63640c8ba0 0x7f6364166bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636985d700 1 -- 172.21.15.7:0/940353215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6364158120 msgr2=0x7f63640c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636985d700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6364158120 0x7f63640c1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636985d700 1 -- 172.21.15.7:0/940353215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63600093c0 con 0x7f63640cae30 2023-10-06T11:01:22.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636a05e700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63640c8ba0 0x7f6364166bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:22.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.357+0000 7f636985d700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63640cae30 0x7f63640c16d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f635400c810 tx=0x7f6354007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:22.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.358+0000 7f635a7fc700 1 -- 172.21.15.7:0/940353215 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6354005c00 con 0x7f63640cae30 2023-10-06T11:01:22.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.358+0000 7f635a7fc700 1 -- 172.21.15.7:0/940353215 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6354005d60 con 0x7f63640cae30 2023-10-06T11:01:22.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.358+0000 7f636c2c2700 1 -- 172.21.15.7:0/940353215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63640afbe0 con 0x7f63640cae30 2023-10-06T11:01:22.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.358+0000 7f635a7fc700 1 -- 172.21.15.7:0/940353215 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6354007320 con 0x7f63640cae30 2023-10-06T11:01:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.358+0000 7f636c2c2700 1 -- 172.21.15.7:0/940353215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63640b11f0 con 0x7f63640cae30 2023-10-06T11:01:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.359+0000 7f636c2c2700 1 -- 172.21.15.7:0/940353215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63640b1380 con 0x7f63640cae30 2023-10-06T11:01:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.359+0000 7f635a7fc700 1 -- 172.21.15.7:0/940353215 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f635401b3b0 con 0x7f63640cae30 2023-10-06T11:01:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.360+0000 7f635a7fc700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6348066f30 0x7f63480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.360+0000 7f635a7fc700 1 -- 172.21.15.7:0/940353215 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6354083d00 con 0x7f63640cae30 2023-10-06T11:01:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.360+0000 7f636a05e700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6348066f30 0x7f63480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.360+0000 7f636a05e700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6348066f30 0x7f63480693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6360009160 tx=0x7f6360016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.364+0000 7f635a7fc700 1 -- 172.21.15.7:0/940353215 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6354050cd0 con 0x7f63640cae30 2023-10-06T11:01:22.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.566+0000 7f636c2c2700 1 -- 172.21.15.7:0/940353215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6364070480 con 0x7f63640cae30 2023-10-06T11:01:22.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.567+0000 7f635a7fc700 1 -- 172.21.15.7:0/940353215 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+17073 (secure 0 0 0) 0x7f6354017020 con 0x7f63640cae30 2023-10-06T11:01:22.569 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:22.569 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":57,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:01:05.587241+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:01:01.839698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T11:01:02.986831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:01:22.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.569+0000 7f636c2c2700 1 -- 172.21.15.7:0/940353215 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6348066f30 msgr2=0x7f63480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.569+0000 7f636c2c2700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6348066f30 0x7f63480693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6360009160 tx=0x7f6360016000 comp rx=0 tx=0).stop 2023-10-06T11:01:22.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.569+0000 7f636c2c2700 1 -- 172.21.15.7:0/940353215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63640cae30 msgr2=0x7f63640c16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.569+0000 7f636c2c2700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63640cae30 0x7f63640c16d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f635400c810 tx=0x7f6354007d90 comp rx=0 tx=0).stop 2023-10-06T11:01:22.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.569+0000 7f636c2c2700 1 -- 172.21.15.7:0/940353215 shutdown_connections 2023-10-06T11:01:22.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.569+0000 7f636c2c2700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6348066f30 0x7f63480693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.569+0000 7f636c2c2700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6364158120 0x7f63640c1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.569+0000 7f636c2c2700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63640c8ba0 0x7f6364166bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.569+0000 7f636c2c2700 1 --2- 172.21.15.7:0/940353215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63640cae30 0x7f63640c16d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.569+0000 7f636c2c2700 1 -- 172.21.15.7:0/940353215 >> 172.21.15.7:0/940353215 conn(0x7f6364087920 msgr2=0x7f63640ab2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:22.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.569+0000 7f636c2c2700 1 -- 172.21.15.7:0/940353215 shutdown_connections 2023-10-06T11:01:22.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.569+0000 7f636c2c2700 1 -- 172.21.15.7:0/940353215 wait complete. 2023-10-06T11:01:22.584 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:01:22.585 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:01:22.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.716+0000 7f657a374700 1 Processor -- start 2023-10-06T11:01:22.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.717+0000 7f657a374700 1 -- start start 2023-10-06T11:01:22.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.718+0000 7f657a374700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65740ccda0 0x7f65740cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:22.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.718+0000 7f657a374700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f65740ac8d0 0x7f65740aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:22.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.718+0000 7f657a374700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6574069110 con 0x7f65740aa870 2023-10-06T11:01:22.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.718+0000 7f657a374700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6574068b30 con 0x7f65740ccda0 2023-10-06T11:01:22.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.718+0000 7f657a374700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65740aacf0 con 0x7f65740ac8d0 2023-10-06T11:01:22.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.718+0000 7f6573fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65740ccda0 0x7f65740cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:22.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.718+0000 7f6578911700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f65740aa870 0x7f6574155af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34834/0 (socket says 172.21.15.7:34834) 2023-10-06T11:01:22.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.718+0000 7f6578911700 1 -- 172.21.15.7:0/4110188636 learned_addr learned my addr 172.21.15.7:0/4110188636 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:22.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.718+0000 7f65737fe700 1 --2- 172.21.15.7:0/4110188636 >> v2:172.21.15.50:3300/0 conn(0x7f65740ac8d0 0x7f65740aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.718+0000 7f6573fff700 1 -- 172.21.15.7:0/4110188636 >> v2:172.21.15.50:3300/0 conn(0x7f65740ac8d0 msgr2=0x7f65740aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.718+0000 7f6573fff700 1 --2- 172.21.15.7:0/4110188636 >> v2:172.21.15.50:3300/0 conn(0x7f65740ac8d0 0x7f65740aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.718+0000 7f6573fff700 1 -- 172.21.15.7:0/4110188636 >> v1:172.21.15.7:6789/0 conn(0x7f65740aa870 legacy=0x7f6574155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.718+0000 7f6573fff700 1 -- 172.21.15.7:0/4110188636 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65740aafb0 con 0x7f65740ccda0 2023-10-06T11:01:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.718+0000 7f6572ffd700 1 -- 172.21.15.7:0/4110188636 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481117268 0 0) 0x7f6574069110 con 0x7f65740aa870 2023-10-06T11:01:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.719+0000 7f6573fff700 1 --2- 172.21.15.7:0/4110188636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65740ccda0 0x7f65740cd170 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f65740cdb30 tx=0x7f65640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5263378696557ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.719+0000 7f6572ffd700 1 -- 172.21.15.7:0/4110188636 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564011630 con 0x7f65740ccda0 2023-10-06T11:01:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.719+0000 7f6572ffd700 1 -- 172.21.15.7:0/4110188636 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6564011790 con 0x7f65740ccda0 2023-10-06T11:01:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.719+0000 7f6572ffd700 1 -- 172.21.15.7:0/4110188636 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564011b30 con 0x7f65740ccda0 2023-10-06T11:01:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.719+0000 7f657a374700 1 -- 172.21.15.7:0/4110188636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65740ccda0 msgr2=0x7f65740cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.719+0000 7f657a374700 1 --2- 172.21.15.7:0/4110188636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65740ccda0 0x7f65740cd170 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f65740cdb30 tx=0x7f65640091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.719+0000 7f657a374700 1 -- 172.21.15.7:0/4110188636 shutdown_connections 2023-10-06T11:01:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.719+0000 7f657a374700 1 --2- 172.21.15.7:0/4110188636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65740ccda0 0x7f65740cd170 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.719+0000 7f657a374700 1 --2- 172.21.15.7:0/4110188636 >> v2:172.21.15.50:3300/0 conn(0x7f65740ac8d0 0x7f65740aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.719+0000 7f657a374700 1 -- 172.21.15.7:0/4110188636 >> 172.21.15.7:0/4110188636 conn(0x7f6574096160 msgr2=0x7f65740afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.720+0000 7f657a374700 1 -- 172.21.15.7:0/4110188636 shutdown_connections 2023-10-06T11:01:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.720+0000 7f657a374700 1 -- 172.21.15.7:0/4110188636 wait complete. 2023-10-06T11:01:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.721+0000 7f657a374700 1 Processor -- start 2023-10-06T11:01:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.721+0000 7f657a374700 1 -- start start 2023-10-06T11:01:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.722+0000 7f657a374700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65740aa870 0x7f657414e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f657a374700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65740ac8d0 0x7f65740973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f657a374700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65740ccda0 0x7f65740cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f657a374700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6574099a90 con 0x7f65740ccda0 2023-10-06T11:01:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f657a374700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657409a890 con 0x7f65740ac8d0 2023-10-06T11:01:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f657a374700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6574099c80 con 0x7f65740aa870 2023-10-06T11:01:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f6578911700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65740ccda0 0x7f65740cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f6578911700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65740ccda0 0x7f65740cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39872/0 (socket says 172.21.15.7:39872) 2023-10-06T11:01:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f65737fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65740ac8d0 0x7f65740973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f6578911700 1 -- 172.21.15.7:0/2787233835 learned_addr learned my addr 172.21.15.7:0/2787233835 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f6573fff700 1 --2- 172.21.15.7:0/2787233835 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65740aa870 0x7f657414e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f6578911700 1 -- 172.21.15.7:0/2787233835 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65740aa870 msgr2=0x7f657414e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f6578911700 1 --2- 172.21.15.7:0/2787233835 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65740aa870 0x7f657414e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f6578911700 1 -- 172.21.15.7:0/2787233835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65740ac8d0 msgr2=0x7f65740973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f6578911700 1 --2- 172.21.15.7:0/2787233835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65740ac8d0 0x7f65740973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f6578911700 1 -- 172.21.15.7:0/2787233835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6564009420 con 0x7f65740ccda0 2023-10-06T11:01:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f65737fe700 1 --2- 172.21.15.7:0/2787233835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65740ac8d0 0x7f65740973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:01:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.723+0000 7f6578911700 1 --2- 172.21.15.7:0/2787233835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65740ccda0 0x7f65740cbe50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f656c00cc90 tx=0x7f656c001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.724+0000 7f655bfff700 1 -- 172.21.15.7:0/2787233835 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c00a8b0 con 0x7f65740ccda0 2023-10-06T11:01:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.724+0000 7f655bfff700 1 -- 172.21.15.7:0/2787233835 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656c00aa10 con 0x7f65740ccda0 2023-10-06T11:01:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.724+0000 7f657a374700 1 -- 172.21.15.7:0/2787233835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6574099f60 con 0x7f65740ccda0 2023-10-06T11:01:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.724+0000 7f655bfff700 1 -- 172.21.15.7:0/2787233835 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c00add0 con 0x7f65740ccda0 2023-10-06T11:01:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.724+0000 7f657a374700 1 -- 172.21.15.7:0/2787233835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657409a520 con 0x7f65740ccda0 2023-10-06T11:01:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.725+0000 7f657a374700 1 -- 172.21.15.7:0/2787233835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657409aa00 con 0x7f65740ccda0 2023-10-06T11:01:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.725+0000 7f655bfff700 1 -- 172.21.15.7:0/2787233835 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f656c007300 con 0x7f65740ccda0 2023-10-06T11:01:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.726+0000 7f655bfff700 1 --2- 172.21.15.7:0/2787233835 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6560066f30 0x7f65600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:22.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.726+0000 7f655bfff700 1 -- 172.21.15.7:0/2787233835 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f656c084b30 con 0x7f65740ccda0 2023-10-06T11:01:22.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.726+0000 7f6573fff700 1 --2- 172.21.15.7:0/2787233835 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6560066f30 0x7f65600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:22.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.726+0000 7f6573fff700 1 --2- 172.21.15.7:0/2787233835 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6560066f30 0x7f65600693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f65640093f0 tx=0x7f6564017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:22.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.730+0000 7f655bfff700 1 -- 172.21.15.7:0/2787233835 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f656c051b00 con 0x7f65740ccda0 2023-10-06T11:01:22.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.978+0000 7f657a374700 1 -- 172.21.15.7:0/2787233835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6574070480 con 0x7f65740ccda0 2023-10-06T11:01:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.979+0000 7f655bfff700 1 -- 172.21.15.7:0/2787233835 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4589 (secure 0 0 0) 0x7f656c055120 con 0x7f65740ccda0 2023-10-06T11:01:22.981 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:22.981 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3539274987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3539274987},{"type":"v1","addr":"172.21.15.7:6836","nonce":3539274987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1716655212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1716655212},{"type":"v1","addr":"172.21.15.50:6834","nonce":1716655212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/186446686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":186446686},{"type":"v1","addr":"172.21.15.50:6835","nonce":186446686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:01:04.009956+0000","modified":"2023-10-06T11:01:07.613415+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5520":{"gid":5520,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/1121258860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1121258860},{"type":"v1","addr":"172.21.15.7:6837","nonce":1121258860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:01:22.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.981+0000 7f657a374700 1 -- 172.21.15.7:0/2787233835 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6560066f30 msgr2=0x7f65600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.981+0000 7f657a374700 1 --2- 172.21.15.7:0/2787233835 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6560066f30 0x7f65600693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f65640093f0 tx=0x7f6564017000 comp rx=0 tx=0).stop 2023-10-06T11:01:22.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.981+0000 7f657a374700 1 -- 172.21.15.7:0/2787233835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65740ccda0 msgr2=0x7f65740cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:22.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.981+0000 7f657a374700 1 --2- 172.21.15.7:0/2787233835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65740ccda0 0x7f65740cbe50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f656c00cc90 tx=0x7f656c001a80 comp rx=0 tx=0).stop 2023-10-06T11:01:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.981+0000 7f657a374700 1 -- 172.21.15.7:0/2787233835 shutdown_connections 2023-10-06T11:01:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.981+0000 7f657a374700 1 --2- 172.21.15.7:0/2787233835 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f6560066f30 0x7f65600693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.981+0000 7f657a374700 1 --2- 172.21.15.7:0/2787233835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65740ccda0 0x7f65740cbe50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.981+0000 7f657a374700 1 --2- 172.21.15.7:0/2787233835 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65740aa870 0x7f657414e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.981+0000 7f657a374700 1 --2- 172.21.15.7:0/2787233835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65740ac8d0 0x7f65740973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.981+0000 7f657a374700 1 -- 172.21.15.7:0/2787233835 >> 172.21.15.7:0/2787233835 conn(0x7f6574096160 msgr2=0x7f657414f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.981+0000 7f657a374700 1 -- 172.21.15.7:0/2787233835 shutdown_connections 2023-10-06T11:01:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:22.981+0000 7f657a374700 1 -- 172.21.15.7:0/2787233835 wait complete. 2023-10-06T11:01:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2023-10-06T11:01:22.997 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:01:23.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.126+0000 7f7303fba700 1 Processor -- start 2023-10-06T11:01:23.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.126+0000 7f7303fba700 1 -- start start 2023-10-06T11:01:23.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.127+0000 7f7303fba700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f72fc1590d0 0x7f72fc069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.127+0000 7f7303fba700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f72fc06a0f0 0x7f72fc15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.127+0000 7f7303fba700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc0694d0 con 0x7f72fc15d350 2023-10-06T11:01:23.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.127+0000 7f7303fba700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72fc15d770 con 0x7f72fc06a0f0 2023-10-06T11:01:23.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.127+0000 7f7303fba700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72fc068ba0 con 0x7f72fc1590d0 2023-10-06T11:01:23.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.127+0000 7f7301555700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f72fc06a0f0 0x7f72fc15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.127+0000 7f7302557700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f72fc15d350 0x7f72fc067980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34846/0 (socket says 172.21.15.7:34846) 2023-10-06T11:01:23.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.127+0000 7f7302557700 1 -- 172.21.15.7:0/2948647402 learned_addr learned my addr 172.21.15.7:0/2948647402 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:23.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.128+0000 7f7301d56700 1 --2- 172.21.15.7:0/2948647402 >> v2:172.21.15.50:3300/0 conn(0x7f72fc1590d0 0x7f72fc069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.128+0000 7f7301555700 1 -- 172.21.15.7:0/2948647402 >> v2:172.21.15.50:3300/0 conn(0x7f72fc1590d0 msgr2=0x7f72fc069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:23.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.128+0000 7f7301555700 1 --2- 172.21.15.7:0/2948647402 >> v2:172.21.15.50:3300/0 conn(0x7f72fc1590d0 0x7f72fc069bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.128+0000 7f7301555700 1 -- 172.21.15.7:0/2948647402 >> v1:172.21.15.7:6789/0 conn(0x7f72fc15d350 legacy=0x7f72fc067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.128+0000 7f7301555700 1 -- 172.21.15.7:0/2948647402 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc068e80 con 0x7f72fc06a0f0 2023-10-06T11:01:23.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.128+0000 7f7301555700 1 --2- 172.21.15.7:0/2948647402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72fc06a0f0 0x7f72fc15ce10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f72fc06ec40 tx=0x7f72ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d5c49741694af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:23.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.128+0000 7f7300d54700 1 -- 172.21.15.7:0/2948647402 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec011630 con 0x7f72fc06a0f0 2023-10-06T11:01:23.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.128+0000 7f7300d54700 1 -- 172.21.15.7:0/2948647402 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec011790 con 0x7f72fc06a0f0 2023-10-06T11:01:23.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.128+0000 7f7300d54700 1 -- 172.21.15.7:0/2948647402 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec011b30 con 0x7f72fc06a0f0 2023-10-06T11:01:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.129+0000 7f7303fba700 1 -- 172.21.15.7:0/2948647402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72fc06a0f0 msgr2=0x7f72fc15ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.129+0000 7f7303fba700 1 --2- 172.21.15.7:0/2948647402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72fc06a0f0 0x7f72fc15ce10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f72fc06ec40 tx=0x7f72ec0091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.129+0000 7f7303fba700 1 -- 172.21.15.7:0/2948647402 shutdown_connections 2023-10-06T11:01:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.129+0000 7f7303fba700 1 --2- 172.21.15.7:0/2948647402 >> v2:172.21.15.50:3300/0 conn(0x7f72fc1590d0 0x7f72fc069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.129+0000 7f7303fba700 1 --2- 172.21.15.7:0/2948647402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72fc06a0f0 0x7f72fc15ce10 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.129+0000 7f7303fba700 1 -- 172.21.15.7:0/2948647402 >> 172.21.15.7:0/2948647402 conn(0x7f72fc096160 msgr2=0x7f72fc0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.129+0000 7f7303fba700 1 -- 172.21.15.7:0/2948647402 shutdown_connections 2023-10-06T11:01:23.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.129+0000 7f7303fba700 1 -- 172.21.15.7:0/2948647402 wait complete. 2023-10-06T11:01:23.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.130+0000 7f7303fba700 1 Processor -- start 2023-10-06T11:01:23.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.130+0000 7f7303fba700 1 -- start start 2023-10-06T11:01:23.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7303fba700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f72fc06a0f0 0x7f72fc169c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7303fba700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72fc1590d0 0x7f72fc152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7303fba700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72fc15d350 0x7f72fc1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7303fba700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15a4b0 con 0x7f72fc1590d0 2023-10-06T11:01:23.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7303fba700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15ad20 con 0x7f72fc15d350 2023-10-06T11:01:23.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7303fba700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc159ef0 con 0x7f72fc06a0f0 2023-10-06T11:01:23.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7301555700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72fc1590d0 0x7f72fc152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7301555700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72fc1590d0 0x7f72fc152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39890/0 (socket says 172.21.15.7:39890) 2023-10-06T11:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7301555700 1 -- 172.21.15.7:0/1967307877 learned_addr learned my addr 172.21.15.7:0/1967307877 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7302557700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72fc15d350 0x7f72fc1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7301d56700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f72fc06a0f0 0x7f72fc169c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7301555700 1 -- 172.21.15.7:0/1967307877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f72fc06a0f0 msgr2=0x7f72fc169c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7301555700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f72fc06a0f0 0x7f72fc169c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7301555700 1 -- 172.21.15.7:0/1967307877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72fc15d350 msgr2=0x7f72fc1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7301555700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72fc15d350 0x7f72fc1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7301555700 1 -- 172.21.15.7:0/1967307877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec009420 con 0x7f72fc1590d0 2023-10-06T11:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.131+0000 7f7301d56700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f72fc06a0f0 0x7f72fc169c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.132+0000 7f7301555700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72fc1590d0 0x7f72fc152740 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0b2e50 tx=0x7f72ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.132+0000 7f72f1ffb700 1 -- 172.21.15.7:0/1967307877 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec011b10 con 0x7f72fc1590d0 2023-10-06T11:01:23.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.132+0000 7f72f1ffb700 1 -- 172.21.15.7:0/1967307877 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec0253f0 con 0x7f72fc1590d0 2023-10-06T11:01:23.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.132+0000 7f7303fba700 1 -- 172.21.15.7:0/1967307877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc15a1d0 con 0x7f72fc1590d0 2023-10-06T11:01:23.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.132+0000 7f72f1ffb700 1 -- 172.21.15.7:0/1967307877 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec025790 con 0x7f72fc1590d0 2023-10-06T11:01:23.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.132+0000 7f7303fba700 1 -- 172.21.15.7:0/1967307877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc16a1a0 con 0x7f72fc1590d0 2023-10-06T11:01:23.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.133+0000 7f7303fba700 1 -- 172.21.15.7:0/1967307877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc070480 con 0x7f72fc1590d0 2023-10-06T11:01:23.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.133+0000 7f72f1ffb700 1 -- 172.21.15.7:0/1967307877 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72ec025b80 con 0x7f72fc1590d0 2023-10-06T11:01:23.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.134+0000 7f72f1ffb700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f72e0066f30 0x7f72e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.134+0000 7f72f1ffb700 1 -- 172.21.15.7:0/1967307877 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f72ec085fa0 con 0x7f72fc1590d0 2023-10-06T11:01:23.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.134+0000 7f7301d56700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f72e0066f30 0x7f72e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.134+0000 7f7301d56700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f72e0066f30 0x7f72e00693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009d80 tx=0x7f72f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:23.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.138+0000 7f72f1ffb700 1 -- 172.21.15.7:0/1967307877 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72ec0b75a0 con 0x7f72fc1590d0 2023-10-06T11:01:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.387+0000 7f7303fba700 1 -- 172.21.15.7:0/1967307877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72fc069160 con 0x7f72fc1590d0 2023-10-06T11:01:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.388+0000 7f72f1ffb700 1 -- 172.21.15.7:0/1967307877 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4589 (secure 0 0 0) 0x7f72ec052f70 con 0x7f72fc1590d0 2023-10-06T11:01:23.390 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:23.390 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3539274987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3539274987},{"type":"v1","addr":"172.21.15.7:6836","nonce":3539274987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1716655212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1716655212},{"type":"v1","addr":"172.21.15.50:6834","nonce":1716655212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/186446686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":186446686},{"type":"v1","addr":"172.21.15.50:6835","nonce":186446686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:01:04.009956+0000","modified":"2023-10-06T11:01:07.613415+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5520":{"gid":5520,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/1121258860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1121258860},{"type":"v1","addr":"172.21.15.7:6837","nonce":1121258860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:01:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.390+0000 7f7303fba700 1 -- 172.21.15.7:0/1967307877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f72e0066f30 msgr2=0x7f72e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.390+0000 7f7303fba700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f72e0066f30 0x7f72e00693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009d80 tx=0x7f72f8008040 comp rx=0 tx=0).stop 2023-10-06T11:01:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.390+0000 7f7303fba700 1 -- 172.21.15.7:0/1967307877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72fc1590d0 msgr2=0x7f72fc152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.390+0000 7f7303fba700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72fc1590d0 0x7f72fc152740 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0b2e50 tx=0x7f72ec017000 comp rx=0 tx=0).stop 2023-10-06T11:01:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.390+0000 7f7303fba700 1 -- 172.21.15.7:0/1967307877 shutdown_connections 2023-10-06T11:01:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.390+0000 7f7303fba700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f72e0066f30 0x7f72e00693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.390+0000 7f7303fba700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72fc15d350 0x7f72fc1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.390+0000 7f7303fba700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f72fc06a0f0 0x7f72fc169c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.390+0000 7f7303fba700 1 --2- 172.21.15.7:0/1967307877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72fc1590d0 0x7f72fc152740 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.390+0000 7f7303fba700 1 -- 172.21.15.7:0/1967307877 >> 172.21.15.7:0/1967307877 conn(0x7f72fc096160 msgr2=0x7f72fc154ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.390+0000 7f7303fba700 1 -- 172.21.15.7:0/1967307877 shutdown_connections 2023-10-06T11:01:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.390+0000 7f7303fba700 1 -- 172.21.15.7:0/1967307877 wait complete. 2023-10-06T11:01:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2023-10-06T11:01:23.405 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:01:23.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.535+0000 7fc551fce700 1 Processor -- start 2023-10-06T11:01:23.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.535+0000 7fc551fce700 1 -- start start 2023-10-06T11:01:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.536+0000 7fc551fce700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc54c0ce7a0 0x7fc54c0b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.536+0000 7fc551fce700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc54c1595f0 0x7fc54c0b3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.536+0000 7fc551fce700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54c0cf820 con 0x7fc54c159220 2023-10-06T11:01:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.536+0000 7fc551fce700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54c0cec10 con 0x7fc54c1595f0 2023-10-06T11:01:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.536+0000 7fc551fce700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54c0ceef0 con 0x7fc54c0ce7a0 2023-10-06T11:01:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.536+0000 7fc54bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc54c1595f0 0x7fc54c0b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.536+0000 7fc54b7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc54c159220 0x7fc54c0aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34856/0 (socket says 172.21.15.7:34856) 2023-10-06T11:01:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.536+0000 7fc54b7fe700 1 -- 172.21.15.7:0/2065653065 learned_addr learned my addr 172.21.15.7:0/2065653065 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.536+0000 7fc54affd700 1 --2- 172.21.15.7:0/2065653065 >> v2:172.21.15.50:3300/0 conn(0x7fc54c0ce7a0 0x7fc54c0b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.537+0000 7fc54bfff700 1 -- 172.21.15.7:0/2065653065 >> v2:172.21.15.50:3300/0 conn(0x7fc54c0ce7a0 msgr2=0x7fc54c0b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.537+0000 7fc54bfff700 1 --2- 172.21.15.7:0/2065653065 >> v2:172.21.15.50:3300/0 conn(0x7fc54c0ce7a0 0x7fc54c0b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.537+0000 7fc54bfff700 1 -- 172.21.15.7:0/2065653065 >> v1:172.21.15.7:6789/0 conn(0x7fc54c159220 legacy=0x7fc54c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.537+0000 7fc54a7fc700 1 -- 172.21.15.7:0/2065653065 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036979453 0 0) 0x7fc54c0cf820 con 0x7fc54c159220 2023-10-06T11:01:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.537+0000 7fc54bfff700 1 -- 172.21.15.7:0/2065653065 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c0cf1d0 con 0x7fc54c1595f0 2023-10-06T11:01:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.537+0000 7fc54bfff700 1 --2- 172.21.15.7:0/2065653065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc54c1595f0 0x7fc54c0b3400 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc54c06fb90 tx=0x7fc544009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93499c5ebe4e3316 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.537+0000 7fc54a7fc700 1 -- 172.21.15.7:0/2065653065 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54400e070 con 0x7fc54c1595f0 2023-10-06T11:01:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.537+0000 7fc54a7fc700 1 -- 172.21.15.7:0/2065653065 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54400bc30 con 0x7fc54c1595f0 2023-10-06T11:01:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.537+0000 7fc54a7fc700 1 -- 172.21.15.7:0/2065653065 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544012430 con 0x7fc54c1595f0 2023-10-06T11:01:23.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.537+0000 7fc551fce700 1 -- 172.21.15.7:0/2065653065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc54c1595f0 msgr2=0x7fc54c0b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.538+0000 7fc551fce700 1 --2- 172.21.15.7:0/2065653065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc54c1595f0 0x7fc54c0b3400 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc54c06fb90 tx=0x7fc544009780 comp rx=0 tx=0).stop 2023-10-06T11:01:23.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.538+0000 7fc551fce700 1 -- 172.21.15.7:0/2065653065 shutdown_connections 2023-10-06T11:01:23.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.538+0000 7fc551fce700 1 --2- 172.21.15.7:0/2065653065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc54c1595f0 0x7fc54c0b3400 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.538+0000 7fc551fce700 1 --2- 172.21.15.7:0/2065653065 >> v2:172.21.15.50:3300/0 conn(0x7fc54c0ce7a0 0x7fc54c0b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.538+0000 7fc551fce700 1 -- 172.21.15.7:0/2065653065 >> 172.21.15.7:0/2065653065 conn(0x7fc54c069f60 msgr2=0x7fc54c0670f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:23.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.538+0000 7fc551fce700 1 -- 172.21.15.7:0/2065653065 shutdown_connections 2023-10-06T11:01:23.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.538+0000 7fc551fce700 1 -- 172.21.15.7:0/2065653065 wait complete. 2023-10-06T11:01:23.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.539+0000 7fc551fce700 1 Processor -- start 2023-10-06T11:01:23.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.539+0000 7fc551fce700 1 -- start start 2023-10-06T11:01:23.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc551fce700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc54c0ce7a0 0x7fc54c0c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc551fce700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc54c159220 0x7fc54c0c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc551fce700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc54c16c590 0x7fc54c16ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc551fce700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c16cf70 con 0x7fc54c159220 2023-10-06T11:01:23.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc551fce700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c15eda0 con 0x7fc54c16c590 2023-10-06T11:01:23.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc551fce700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c0c5a80 con 0x7fc54c0ce7a0 2023-10-06T11:01:23.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc54affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc54c159220 0x7fc54c0c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc54affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc54c159220 0x7fc54c0c53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39912/0 (socket says 172.21.15.7:39912) 2023-10-06T11:01:23.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc54affd700 1 -- 172.21.15.7:0/978537331 learned_addr learned my addr 172.21.15.7:0/978537331 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:23.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc54b7fe700 1 --2- 172.21.15.7:0/978537331 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc54c0ce7a0 0x7fc54c0c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc54bfff700 1 --2- 172.21.15.7:0/978537331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc54c16c590 0x7fc54c16ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc54affd700 1 -- 172.21.15.7:0/978537331 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc54c0ce7a0 msgr2=0x7fc54c0c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc54affd700 1 --2- 172.21.15.7:0/978537331 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc54c0ce7a0 0x7fc54c0c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc54affd700 1 -- 172.21.15.7:0/978537331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc54c16c590 msgr2=0x7fc54c16ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc54affd700 1 --2- 172.21.15.7:0/978537331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc54c16c590 0x7fc54c16ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc54affd700 1 -- 172.21.15.7:0/978537331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc544009a20 con 0x7fc54c159220 2023-10-06T11:01:23.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.540+0000 7fc54affd700 1 --2- 172.21.15.7:0/978537331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc54c159220 0x7fc54c0c53e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc54000d890 tx=0x7fc540008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:23.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.541+0000 7fc5337fe700 1 -- 172.21.15.7:0/978537331 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5400125f0 con 0x7fc54c159220 2023-10-06T11:01:23.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.541+0000 7fc5337fe700 1 -- 172.21.15.7:0/978537331 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc540012770 con 0x7fc54c159220 2023-10-06T11:01:23.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.541+0000 7fc551fce700 1 -- 172.21.15.7:0/978537331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54c0c5d60 con 0x7fc54c159220 2023-10-06T11:01:23.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.541+0000 7fc5337fe700 1 -- 172.21.15.7:0/978537331 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc540012b30 con 0x7fc54c159220 2023-10-06T11:01:23.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.541+0000 7fc551fce700 1 -- 172.21.15.7:0/978537331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54c0c63a0 con 0x7fc54c159220 2023-10-06T11:01:23.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.542+0000 7fc551fce700 1 -- 172.21.15.7:0/978537331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54c070480 con 0x7fc54c159220 2023-10-06T11:01:23.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.542+0000 7fc5337fe700 1 -- 172.21.15.7:0/978537331 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc54001e460 con 0x7fc54c159220 2023-10-06T11:01:23.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.543+0000 7fc5337fe700 1 --2- 172.21.15.7:0/978537331 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc538066f30 0x7fc5380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.543+0000 7fc5337fe700 1 -- 172.21.15.7:0/978537331 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc540084ed0 con 0x7fc54c159220 2023-10-06T11:01:23.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.543+0000 7fc54b7fe700 1 --2- 172.21.15.7:0/978537331 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc538066f30 0x7fc5380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.543+0000 7fc54b7fe700 1 --2- 172.21.15.7:0/978537331 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc538066f30 0x7fc5380693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0011e0 tx=0x7fc53c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:23.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.547+0000 7fc5337fe700 1 -- 172.21.15.7:0/978537331 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc540051ea0 con 0x7fc54c159220 2023-10-06T11:01:23.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.753+0000 7fc551fce700 1 -- 172.21.15.7:0/978537331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc54c0cf4b0 con 0x7fc54c159220 2023-10-06T11:01:23.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.754+0000 7fc5337fe700 1 -- 172.21.15.7:0/978537331 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+17073 (secure 0 0 0) 0x7fc5400554c0 con 0x7fc54c159220 2023-10-06T11:01:23.756 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:23.756 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":57,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:01:05.587241+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:01:01.839698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T11:01:02.986831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:01:23.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.756+0000 7fc551fce700 1 -- 172.21.15.7:0/978537331 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc538066f30 msgr2=0x7fc5380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.756+0000 7fc551fce700 1 --2- 172.21.15.7:0/978537331 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc538066f30 0x7fc5380693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0011e0 tx=0x7fc53c009040 comp rx=0 tx=0).stop 2023-10-06T11:01:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.756+0000 7fc551fce700 1 -- 172.21.15.7:0/978537331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc54c159220 msgr2=0x7fc54c0c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.756+0000 7fc551fce700 1 --2- 172.21.15.7:0/978537331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc54c159220 0x7fc54c0c53e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc54000d890 tx=0x7fc540008040 comp rx=0 tx=0).stop 2023-10-06T11:01:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.757+0000 7fc551fce700 1 -- 172.21.15.7:0/978537331 shutdown_connections 2023-10-06T11:01:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.757+0000 7fc551fce700 1 --2- 172.21.15.7:0/978537331 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc538066f30 0x7fc5380693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.757+0000 7fc551fce700 1 --2- 172.21.15.7:0/978537331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc54c16c590 0x7fc54c16ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.757+0000 7fc551fce700 1 --2- 172.21.15.7:0/978537331 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc54c0ce7a0 0x7fc54c0c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.757+0000 7fc551fce700 1 --2- 172.21.15.7:0/978537331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc54c159220 0x7fc54c0c53e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.757+0000 7fc551fce700 1 -- 172.21.15.7:0/978537331 >> 172.21.15.7:0/978537331 conn(0x7fc54c069f60 msgr2=0x7fc54c0b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.757+0000 7fc551fce700 1 -- 172.21.15.7:0/978537331 shutdown_connections 2023-10-06T11:01:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.757+0000 7fc551fce700 1 -- 172.21.15.7:0/978537331 wait complete. 2023-10-06T11:01:23.772 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:01:23.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.903+0000 7f8665263700 1 Processor -- start 2023-10-06T11:01:23.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.903+0000 7f8665263700 1 -- start start 2023-10-06T11:01:23.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.904+0000 7f8665263700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86600cfb50 0x7f8660068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.904+0000 7f8665263700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8660069420 0x7f86600afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.904+0000 7f8665263700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86600cf6c0 con 0x7f86600af320 2023-10-06T11:01:23.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.904+0000 7f8665263700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8660159c00 con 0x7f8660069420 2023-10-06T11:01:23.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.904+0000 7f8665263700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86600698a0 con 0x7f86600cfb50 2023-10-06T11:01:23.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.904+0000 7f865f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8660069420 0x7f86600afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.904+0000 7f865f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8660069420 0x7f86600afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39922/0 (socket says 172.21.15.7:39922) 2023-10-06T11:01:23.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.904+0000 7f865f7fe700 1 -- 172.21.15.7:0/862091997 learned_addr learned my addr 172.21.15.7:0/862091997 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:23.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.904+0000 7f865e7fc700 1 --2- 172.21.15.7:0/862091997 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86600cfb50 0x7f8660068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.904+0000 7f865f7fe700 1 -- 172.21.15.7:0/862091997 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86600cfb50 msgr2=0x7f8660068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:23.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.904+0000 7f865f7fe700 1 --2- 172.21.15.7:0/862091997 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86600cfb50 0x7f8660068ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.905+0000 7f865f7fe700 1 -- 172.21.15.7:0/862091997 >> v1:172.21.15.50:6789/0 conn(0x7f86600af320 legacy=0x7f86600cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.905+0000 7f865f7fe700 1 -- 172.21.15.7:0/862091997 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86600cb750 con 0x7f8660069420 2023-10-06T11:01:23.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.905+0000 7f865f7fe700 1 --2- 172.21.15.7:0/862091997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8660069420 0x7f86600afc90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8658009f50 tx=0x7f8658009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706974bb75396c40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:23.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.905+0000 7f865dffb700 1 -- 172.21.15.7:0/862091997 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865800e070 con 0x7f8660069420 2023-10-06T11:01:23.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.905+0000 7f865dffb700 1 -- 172.21.15.7:0/862091997 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865800ba50 con 0x7f8660069420 2023-10-06T11:01:23.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.905+0000 7f865dffb700 1 -- 172.21.15.7:0/862091997 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86580092e0 con 0x7f8660069420 2023-10-06T11:01:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.905+0000 7f8665263700 1 -- 172.21.15.7:0/862091997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8660069420 msgr2=0x7f86600afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.905+0000 7f8665263700 1 --2- 172.21.15.7:0/862091997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8660069420 0x7f86600afc90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8658009f50 tx=0x7f8658009840 comp rx=0 tx=0).stop 2023-10-06T11:01:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.905+0000 7f8665263700 1 -- 172.21.15.7:0/862091997 shutdown_connections 2023-10-06T11:01:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.905+0000 7f8665263700 1 --2- 172.21.15.7:0/862091997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8660069420 0x7f86600afc90 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.905+0000 7f8665263700 1 --2- 172.21.15.7:0/862091997 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86600cfb50 0x7f8660068ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.905+0000 7f8665263700 1 -- 172.21.15.7:0/862091997 >> 172.21.15.7:0/862091997 conn(0x7f8660067b80 msgr2=0x7f86600d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.906+0000 7f8665263700 1 -- 172.21.15.7:0/862091997 shutdown_connections 2023-10-06T11:01:23.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.906+0000 7f8665263700 1 -- 172.21.15.7:0/862091997 wait complete. 2023-10-06T11:01:23.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.907+0000 7f8665263700 1 Processor -- start 2023-10-06T11:01:23.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.907+0000 7f8665263700 1 -- start start 2023-10-06T11:01:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f8665263700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8660069420 0x7f866015b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f8665263700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86600af320 0x7f866015b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f8665263700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86600cfb50 0x7f866015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f8665263700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8660158fc0 con 0x7f86600cfb50 2023-10-06T11:01:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f8665263700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8660158b30 con 0x7f86600af320 2023-10-06T11:01:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f8665263700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866014c710 con 0x7f8660069420 2023-10-06T11:01:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f865f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86600cfb50 0x7f866015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f865f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86600cfb50 0x7f866015a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39926/0 (socket says 172.21.15.7:39926) 2023-10-06T11:01:23.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f865f7fe700 1 -- 172.21.15.7:0/3958426704 learned_addr learned my addr 172.21.15.7:0/3958426704 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:23.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f865e7fc700 1 --2- 172.21.15.7:0/3958426704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86600af320 0x7f866015b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f865effd700 1 --2- 172.21.15.7:0/3958426704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8660069420 0x7f866015b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f865f7fe700 1 -- 172.21.15.7:0/3958426704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8660069420 msgr2=0x7f866015b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f865f7fe700 1 --2- 172.21.15.7:0/3958426704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8660069420 0x7f866015b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f865f7fe700 1 -- 172.21.15.7:0/3958426704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86600af320 msgr2=0x7f866015b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:23.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f865f7fe700 1 --2- 172.21.15.7:0/3958426704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86600af320 0x7f866015b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:23.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f865f7fe700 1 -- 172.21.15.7:0/3958426704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658009ae0 con 0x7f86600cfb50 2023-10-06T11:01:23.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.908+0000 7f865f7fe700 1 --2- 172.21.15.7:0/3958426704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86600cfb50 0x7f866015a1c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f866006fad0 tx=0x7f8658018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:23.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.909+0000 7f8656ffd700 1 -- 172.21.15.7:0/3958426704 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658008ce0 con 0x7f86600cfb50 2023-10-06T11:01:23.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.909+0000 7f8656ffd700 1 -- 172.21.15.7:0/3958426704 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8658008e60 con 0x7f86600cfb50 2023-10-06T11:01:23.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.909+0000 7f8656ffd700 1 -- 172.21.15.7:0/3958426704 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865801d670 con 0x7f86600cfb50 2023-10-06T11:01:23.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.909+0000 7f8665263700 1 -- 172.21.15.7:0/3958426704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8660157f20 con 0x7f86600cfb50 2023-10-06T11:01:23.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.909+0000 7f8665263700 1 -- 172.21.15.7:0/3958426704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86601584e0 con 0x7f86600cfb50 2023-10-06T11:01:23.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.910+0000 7f8665263700 1 -- 172.21.15.7:0/3958426704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866006f480 con 0x7f86600cfb50 2023-10-06T11:01:23.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.910+0000 7f8656ffd700 1 -- 172.21.15.7:0/3958426704 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8658003040 con 0x7f86600cfb50 2023-10-06T11:01:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.911+0000 7f8656ffd700 1 --2- 172.21.15.7:0/3958426704 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8640066f30 0x7f86400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.911+0000 7f8656ffd700 1 -- 172.21.15.7:0/3958426704 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f86580862a0 con 0x7f86600cfb50 2023-10-06T11:01:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.911+0000 7f865effd700 1 --2- 172.21.15.7:0/3958426704 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8640066f30 0x7f86400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.911+0000 7f865effd700 1 --2- 172.21.15.7:0/3958426704 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8640066f30 0x7f86400693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8660157a70 tx=0x7f8650009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:23.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:23.915+0000 7f8656ffd700 1 -- 172.21.15.7:0/3958426704 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8658053270 con 0x7f86600cfb50 2023-10-06T11:01:24.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.163+0000 7f8665263700 1 -- 172.21.15.7:0/3958426704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8660158ca0 con 0x7f86600cfb50 2023-10-06T11:01:24.165 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-06T11:01:24.164+0000 7f516a233700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:01:24.170 INFO:tasks.ceph.mds.c.smithi007.stderr: -3315> 2023-10-06T11:00:57.608+0000 7f6334187700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T11:01:24.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.169+0000 7f8656ffd700 1 -- 172.21.15.7:0/3958426704 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8658056890 con 0x7f86600cfb50 2023-10-06T11:01:24.172 INFO:tasks.ceph.mds.c.smithi007.stderr: -2148> 2023-10-06T11:01:08.565+0000 7f632e17b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:01:24.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.172+0000 7f8665263700 1 -- 172.21.15.7:0/3958426704 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8640066f30 msgr2=0x7f86400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:24.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.172+0000 7f8665263700 1 --2- 172.21.15.7:0/3958426704 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8640066f30 0x7f86400693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8660157a70 tx=0x7f8650009040 comp rx=0 tx=0).stop 2023-10-06T11:01:24.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.172+0000 7f8665263700 1 -- 172.21.15.7:0/3958426704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86600cfb50 msgr2=0x7f866015a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:24.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.172+0000 7f8665263700 1 --2- 172.21.15.7:0/3958426704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86600cfb50 0x7f866015a1c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f866006fad0 tx=0x7f8658018000 comp rx=0 tx=0).stop 2023-10-06T11:01:24.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.172+0000 7f8665263700 1 -- 172.21.15.7:0/3958426704 shutdown_connections 2023-10-06T11:01:24.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.172+0000 7f8665263700 1 --2- 172.21.15.7:0/3958426704 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8640066f30 0x7f86400693e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:24.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.172+0000 7f8665263700 1 --2- 172.21.15.7:0/3958426704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86600cfb50 0x7f866015a1c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:24.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.172+0000 7f8665263700 1 --2- 172.21.15.7:0/3958426704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8660069420 0x7f866015b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:24.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.172+0000 7f8665263700 1 --2- 172.21.15.7:0/3958426704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86600af320 0x7f866015b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:24.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.172+0000 7f8665263700 1 -- 172.21.15.7:0/3958426704 >> 172.21.15.7:0/3958426704 conn(0x7f8660067b80 msgr2=0x7f86600cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:24.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.172+0000 7f8665263700 1 -- 172.21.15.7:0/3958426704 shutdown_connections 2023-10-06T11:01:24.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.172+0000 7f8665263700 1 -- 172.21.15.7:0/3958426704 wait complete. 2023-10-06T11:01:24.175 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:01:24.188 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:01:24.198 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-06T11:01:24.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.320+0000 7f82939a1700 1 Processor -- start 2023-10-06T11:01:24.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.320+0000 7f82939a1700 1 -- start start 2023-10-06T11:01:24.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.321+0000 7f82939a1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f828c0b01c0 0x7f828c0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:24.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.321+0000 7f82939a1700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c0cedc0 con 0x7f828c0c91c0 2023-10-06T11:01:24.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.321+0000 7f82939a1700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c0c9720 con 0x7f828c0b0590 2023-10-06T11:01:24.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.321+0000 7f82939a1700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c0c9a00 con 0x7f828c0b01c0 2023-10-06T11:01:24.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.322+0000 7f829173d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f828c0b01c0 0x7f828c0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:24.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.322+0000 7f8291f3e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f828c0c91c0 0x7f828c068b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34874/0 (socket says 172.21.15.7:34874) 2023-10-06T11:01:24.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.322+0000 7f8291f3e700 1 -- 172.21.15.7:0/3509561846 learned_addr learned my addr 172.21.15.7:0/3509561846 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:24.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.322+0000 7f829173d700 1 -- 172.21.15.7:0/3509561846 >> v1:172.21.15.50:6789/0 conn(0x7f828c0b0590 legacy=0x7f828c0c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:24.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.322+0000 7f829173d700 1 -- 172.21.15.7:0/3509561846 >> v1:172.21.15.7:6789/0 conn(0x7f828c0c91c0 legacy=0x7f828c068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:24.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.322+0000 7f829173d700 1 -- 172.21.15.7:0/3509561846 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c0c9ce0 con 0x7f828c0b01c0 2023-10-06T11:01:24.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.322+0000 7f827ffff700 1 -- 172.21.15.7:0/3509561846 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417856034 0 0) 0x7f828c0cedc0 con 0x7f828c0c91c0 2023-10-06T11:01:24.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.322+0000 7f829173d700 1 --2- 172.21.15.7:0/3509561846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f828c0b01c0 0x7f828c0cc500 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f82800098e0 tx=0x7f82800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caaf9da8f4746e3f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:24.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.322+0000 7f827ffff700 1 -- 172.21.15.7:0/3509561846 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280009e80 con 0x7f828c0b01c0 2023-10-06T11:01:24.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.322+0000 7f827ffff700 1 -- 172.21.15.7:0/3509561846 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828000b820 con 0x7f828c0b01c0 2023-10-06T11:01:24.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.322+0000 7f827ffff700 1 -- 172.21.15.7:0/3509561846 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828000bba0 con 0x7f828c0b01c0 2023-10-06T11:01:24.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.323+0000 7f82939a1700 1 -- 172.21.15.7:0/3509561846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f828c0b01c0 msgr2=0x7f828c0cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:24.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.323+0000 7f82939a1700 1 --2- 172.21.15.7:0/3509561846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f828c0b01c0 0x7f828c0cc500 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f82800098e0 tx=0x7f82800091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:24.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.323+0000 7f82939a1700 1 -- 172.21.15.7:0/3509561846 shutdown_connections 2023-10-06T11:01:24.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.323+0000 7f82939a1700 1 --2- 172.21.15.7:0/3509561846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f828c0b01c0 0x7f828c0cc500 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:24.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.323+0000 7f82939a1700 1 -- 172.21.15.7:0/3509561846 >> 172.21.15.7:0/3509561846 conn(0x7f828c06cd00 msgr2=0x7f828c0cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.323+0000 7f82939a1700 1 -- 172.21.15.7:0/3509561846 shutdown_connections 2023-10-06T11:01:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.323+0000 7f82939a1700 1 -- 172.21.15.7:0/3509561846 wait complete. 2023-10-06T11:01:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.324+0000 7f82939a1700 1 Processor -- start 2023-10-06T11:01:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.324+0000 7f82939a1700 1 -- start start 2023-10-06T11:01:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.325+0000 7f82939a1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f828c0b01c0 0x7f828c15e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.325+0000 7f82939a1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f828c0b0590 0x7f828c151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.325+0000 7f82939a1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f828c0c91c0 0x7f828c069d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.325+0000 7f82939a1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c16d020 con 0x7f828c0b0590 2023-10-06T11:01:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.325+0000 7f82939a1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c16de80 con 0x7f828c0c91c0 2023-10-06T11:01:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.325+0000 7f82939a1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c15eca0 con 0x7f828c0b01c0 2023-10-06T11:01:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.325+0000 7f8290f3c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f828c0b0590 0x7f828c151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.325+0000 7f8290f3c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f828c0b0590 0x7f828c151950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39946/0 (socket says 172.21.15.7:39946) 2023-10-06T11:01:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.325+0000 7f8290f3c700 1 -- 172.21.15.7:0/2932137686 learned_addr learned my addr 172.21.15.7:0/2932137686 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.326+0000 7f8290f3c700 1 -- 172.21.15.7:0/2932137686 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f828c0b01c0 msgr2=0x7f828c15e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.326+0000 7f8290f3c700 1 --2- 172.21.15.7:0/2932137686 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f828c0b01c0 0x7f828c15e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.326+0000 7f8291f3e700 1 --2- 172.21.15.7:0/2932137686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f828c0c91c0 0x7f828c069d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.326+0000 7f8290f3c700 1 -- 172.21.15.7:0/2932137686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f828c0c91c0 msgr2=0x7f828c069d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.326+0000 7f8290f3c700 1 --2- 172.21.15.7:0/2932137686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f828c0c91c0 0x7f828c069d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:24.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.326+0000 7f8290f3c700 1 -- 172.21.15.7:0/2932137686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280009420 con 0x7f828c0b0590 2023-10-06T11:01:24.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.326+0000 7f8291f3e700 1 --2- 172.21.15.7:0/2932137686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f828c0c91c0 0x7f828c069d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:24.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.326+0000 7f8290f3c700 1 --2- 172.21.15.7:0/2932137686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f828c0b0590 0x7f828c151950 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f828800c600 tx=0x7f8288007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:24.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.326+0000 7f827d7fa700 1 -- 172.21.15.7:0/2932137686 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288011590 con 0x7f828c0b0590 2023-10-06T11:01:24.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.326+0000 7f827d7fa700 1 -- 172.21.15.7:0/2932137686 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8288011710 con 0x7f828c0b0590 2023-10-06T11:01:24.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.326+0000 7f82939a1700 1 -- 172.21.15.7:0/2932137686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c16d270 con 0x7f828c0b0590 2023-10-06T11:01:24.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.326+0000 7f827d7fa700 1 -- 172.21.15.7:0/2932137686 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288011ad0 con 0x7f828c0b0590 2023-10-06T11:01:24.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.326+0000 7f82939a1700 1 -- 172.21.15.7:0/2932137686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c16d830 con 0x7f828c0b0590 2023-10-06T11:01:24.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.327+0000 7f82939a1700 1 -- 172.21.15.7:0/2932137686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c070480 con 0x7f828c0b0590 2023-10-06T11:01:24.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.328+0000 7f827d7fa700 1 -- 172.21.15.7:0/2932137686 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f828801c460 con 0x7f828c0b0590 2023-10-06T11:01:24.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.328+0000 7f827d7fa700 1 --2- 172.21.15.7:0/2932137686 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8270066f30 0x7f82700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:24.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.328+0000 7f827d7fa700 1 -- 172.21.15.7:0/2932137686 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f82880845d0 con 0x7f828c0b0590 2023-10-06T11:01:24.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.328+0000 7f829173d700 1 --2- 172.21.15.7:0/2932137686 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8270066f30 0x7f82700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:24.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.329+0000 7f829173d700 1 --2- 172.21.15.7:0/2932137686 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8270066f30 0x7f82700693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f82800098e0 tx=0x7f8280016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:24.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.333+0000 7f827d7fa700 1 -- 172.21.15.7:0/2932137686 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8288051550 con 0x7f828c0b0590 2023-10-06T11:01:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:24.580+0000 7f82939a1700 1 -- 172.21.15.7:0/2932137686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f828c16dfc0 con 0x7f828c0b0590 2023-10-06T11:01:25.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.169+0000 7f827d7fa700 1 -- 172.21.15.7:0/2932137686 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) v1 ==== 104+0+0 (secure 0 0 0) 0x7f828c16dfc0 con 0x7f828c0b0590 2023-10-06T11:01:25.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.172+0000 7f82939a1700 1 -- 172.21.15.7:0/2932137686 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8270066f30 msgr2=0x7f82700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:25.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.172+0000 7f82939a1700 1 --2- 172.21.15.7:0/2932137686 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8270066f30 0x7f82700693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f82800098e0 tx=0x7f8280016000 comp rx=0 tx=0).stop 2023-10-06T11:01:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.172+0000 7f82939a1700 1 -- 172.21.15.7:0/2932137686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f828c0b0590 msgr2=0x7f828c151950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.172+0000 7f82939a1700 1 --2- 172.21.15.7:0/2932137686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f828c0b0590 0x7f828c151950 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f828800c600 tx=0x7f8288007f60 comp rx=0 tx=0).stop 2023-10-06T11:01:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.172+0000 7f82939a1700 1 -- 172.21.15.7:0/2932137686 shutdown_connections 2023-10-06T11:01:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.172+0000 7f82939a1700 1 --2- 172.21.15.7:0/2932137686 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8270066f30 0x7f82700693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.172+0000 7f82939a1700 1 --2- 172.21.15.7:0/2932137686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f828c0c91c0 0x7f828c069d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.172+0000 7f82939a1700 1 --2- 172.21.15.7:0/2932137686 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f828c0b01c0 0x7f828c15e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.172+0000 7f82939a1700 1 --2- 172.21.15.7:0/2932137686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f828c0b0590 0x7f828c151950 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.172+0000 7f82939a1700 1 -- 172.21.15.7:0/2932137686 >> 172.21.15.7:0/2932137686 conn(0x7f828c06cd00 msgr2=0x7f828c157210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.173+0000 7f82939a1700 1 -- 172.21.15.7:0/2932137686 shutdown_connections 2023-10-06T11:01:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.173+0000 7f82939a1700 1 -- 172.21.15.7:0/2932137686 wait complete. 2023-10-06T11:01:25.190 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:01:25.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.371+0000 7f14a8423700 1 Processor -- start 2023-10-06T11:01:25.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.371+0000 7f14a8423700 1 -- start start 2023-10-06T11:01:25.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.372+0000 7f14a8423700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a00cc860 0x7f14a006d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:25.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.372+0000 7f14a8423700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a00ca590 con 0x7f14a006dd90 2023-10-06T11:01:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.372+0000 7f14a8423700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a006e310 con 0x7f14a00cc490 2023-10-06T11:01:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.372+0000 7f14a8423700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a006e5f0 con 0x7f14a00cc860 2023-10-06T11:01:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.372+0000 7f14a69c0700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f14a006dd90 0x7f14a0153160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34882/0 (socket says 172.21.15.7:34882) 2023-10-06T11:01:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.372+0000 7f14a69c0700 1 -- 172.21.15.7:0/1942472248 learned_addr learned my addr 172.21.15.7:0/1942472248 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a59be700 1 --2- 172.21.15.7:0/1942472248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a00cc860 0x7f14a006d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 -- 172.21.15.7:0/1942472248 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394528382 0 0) 0x7f14a00ca590 con 0x7f14a006dd90 2023-10-06T11:01:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 -- 172.21.15.7:0/1942472248 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f148c003570 con 0x7f14a006dd90 2023-10-06T11:01:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 -- 172.21.15.7:0/1942472248 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2481246159 0 0) 0x7f148c003570 con 0x7f14a006dd90 2023-10-06T11:01:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 -- 172.21.15.7:0/1942472248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a00cc860 msgr2=0x7f14a006d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 --2- 172.21.15.7:0/1942472248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a00cc860 0x7f14a006d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 -- 172.21.15.7:0/1942472248 >> v1:172.21.15.50:6789/0 conn(0x7f14a00cc490 legacy=0x7f14a00cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:25.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 -- 172.21.15.7:0/1942472248 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a00ca7e0 con 0x7f14a006dd90 2023-10-06T11:01:25.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 -- 172.21.15.7:0/1942472248 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f14980017f0 con 0x7f14a006dd90 2023-10-06T11:01:25.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 -- 172.21.15.7:0/1942472248 >> v1:172.21.15.7:6789/0 conn(0x7f14a006dd90 legacy=0x7f14a0153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:25.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 --2- 172.21.15.7:0/1942472248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a00cc860 0x7f148c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:25.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 --2- 172.21.15.7:0/1942472248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c003fd0 0x7f148c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:25.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 --2- 172.21.15.7:0/1942472248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f148c004d50 0x7f148c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:25.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 -- 172.21.15.7:0/1942472248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a006e5f0 con 0x7f148c004d50 2023-10-06T11:01:25.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 -- 172.21.15.7:0/1942472248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c00bb40 con 0x7f148c003fd0 2023-10-06T11:01:25.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a51bd700 1 -- 172.21.15.7:0/1942472248 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c00bd00 con 0x7f14a00cc860 2023-10-06T11:01:25.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a69c0700 1 --2- 172.21.15.7:0/1942472248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f148c004d50 0x7f148c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a61bf700 1 --2- 172.21.15.7:0/1942472248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a00cc860 0x7f148c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.373+0000 7f14a59be700 1 --2- 172.21.15.7:0/1942472248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c003fd0 0x7f148c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.374+0000 7f14a69c0700 1 -- 172.21.15.7:0/1942472248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a00cc860 msgr2=0x7f148c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.374+0000 7f14a69c0700 1 --2- 172.21.15.7:0/1942472248 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a00cc860 0x7f148c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.374+0000 7f14a69c0700 1 -- 172.21.15.7:0/1942472248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c003fd0 msgr2=0x7f148c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.374+0000 7f14a69c0700 1 --2- 172.21.15.7:0/1942472248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c003fd0 0x7f148c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.374+0000 7f14a69c0700 1 -- 172.21.15.7:0/1942472248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c003570 con 0x7f148c004d50 2023-10-06T11:01:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.374+0000 7f14a69c0700 1 --2- 172.21.15.7:0/1942472248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f148c004d50 0x7f148c0051c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f149800a8c0 tx=0x7f14a00cdac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa1745263355db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.374+0000 7f14a51bd700 1 -- 172.21.15.7:0/1942472248 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14980070f0 con 0x7f148c004d50 2023-10-06T11:01:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.374+0000 7f14a51bd700 1 -- 172.21.15.7:0/1942472248 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1498007250 con 0x7f148c004d50 2023-10-06T11:01:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.374+0000 7f14a51bd700 1 -- 172.21.15.7:0/1942472248 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498007610 con 0x7f148c004d50 2023-10-06T11:01:25.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.374+0000 7f14a8423700 1 -- 172.21.15.7:0/1942472248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f148c004d50 msgr2=0x7f148c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:25.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.374+0000 7f14a8423700 1 --2- 172.21.15.7:0/1942472248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f148c004d50 0x7f148c0051c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f149800a8c0 tx=0x7f14a00cdac0 comp rx=0 tx=0).stop 2023-10-06T11:01:25.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.375+0000 7f14a69c0700 1 -- 172.21.15.7:0/1942472248 reap_dead start 2023-10-06T11:01:25.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.375+0000 7f14a8423700 1 -- 172.21.15.7:0/1942472248 shutdown_connections 2023-10-06T11:01:25.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.375+0000 7f14a8423700 1 -- 172.21.15.7:0/1942472248 >> 172.21.15.7:0/1942472248 conn(0x7f14a006c2c0 msgr2=0x7f14a006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:25.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.375+0000 7f14a8423700 1 -- 172.21.15.7:0/1942472248 shutdown_connections 2023-10-06T11:01:25.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.375+0000 7f14a8423700 1 -- 172.21.15.7:0/1942472248 wait complete. 2023-10-06T11:01:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.376+0000 7f14a8423700 1 Processor -- start 2023-10-06T11:01:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.376+0000 7f14a8423700 1 -- start start 2023-10-06T11:01:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a8423700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f148c004d50 0x7f14a01586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a8423700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14a00c5980 0x7f14a00b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a8423700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14a00c5df0 0x7f14a00b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a8423700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a00c6920 con 0x7f14a00c5df0 2023-10-06T11:01:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a8423700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a00b1280 con 0x7f14a00c5980 2023-10-06T11:01:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a8423700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a00c6360 con 0x7f148c004d50 2023-10-06T11:01:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a69c0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14a00c5df0 0x7f14a00b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a69c0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14a00c5df0 0x7f14a00b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39954/0 (socket says 172.21.15.7:39954) 2023-10-06T11:01:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a69c0700 1 -- 172.21.15.7:0/582652160 learned_addr learned my addr 172.21.15.7:0/582652160 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a61bf700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f148c004d50 0x7f14a01586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a59be700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14a00c5980 0x7f14a00b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a69c0700 1 -- 172.21.15.7:0/582652160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f148c004d50 msgr2=0x7f14a01586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a69c0700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f148c004d50 0x7f14a01586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a69c0700 1 -- 172.21.15.7:0/582652160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14a00c5980 msgr2=0x7f14a00b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a69c0700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14a00c5980 0x7f14a00b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a69c0700 1 -- 172.21.15.7:0/582652160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a00c6640 con 0x7f14a00c5df0 2023-10-06T11:01:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a61bf700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f148c004d50 0x7f14a01586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:01:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.377+0000 7f14a69c0700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14a00c5df0 0x7f14a00b3740 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1498000f80 tx=0x7f1498016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.378+0000 7f14967fc700 1 -- 172.21.15.7:0/582652160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14980017f0 con 0x7f14a00c5df0 2023-10-06T11:01:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.378+0000 7f14967fc700 1 -- 172.21.15.7:0/582652160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1498007070 con 0x7f14a00c5df0 2023-10-06T11:01:25.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.378+0000 7f14a8423700 1 -- 172.21.15.7:0/582652160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a00b1520 con 0x7f14a00c5df0 2023-10-06T11:01:25.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.378+0000 7f14967fc700 1 -- 172.21.15.7:0/582652160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498001fb0 con 0x7f14a00c5df0 2023-10-06T11:01:25.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.378+0000 7f14a8423700 1 -- 172.21.15.7:0/582652160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a0159090 con 0x7f14a00c5df0 2023-10-06T11:01:25.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.379+0000 7f14a8423700 1 -- 172.21.15.7:0/582652160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a00b0420 con 0x7f14a00c5df0 2023-10-06T11:01:25.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.379+0000 7f14967fc700 1 -- 172.21.15.7:0/582652160 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1498004bb0 con 0x7f14a00c5df0 2023-10-06T11:01:25.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.380+0000 7f14967fc700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1484066f30 0x7f14840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:25.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.380+0000 7f14967fc700 1 -- 172.21.15.7:0/582652160 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f1498086de0 con 0x7f14a00c5df0 2023-10-06T11:01:25.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.380+0000 7f14a61bf700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1484066f30 0x7f14840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:25.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.380+0000 7f14a61bf700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1484066f30 0x7f14840693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f149c002530 tx=0x7f149c007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:25.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.384+0000 7f14967fc700 1 -- 172.21.15.7:0/582652160 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1498053e10 con 0x7f14a00c5df0 2023-10-06T11:01:25.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:25.585+0000 7f14a8423700 1 -- 172.21.15.7:0/582652160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f14a00b16b0 con 0x7f14a00c5df0 2023-10-06T11:01:26.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.173+0000 7f14967fc700 1 -- 172.21.15.7:0/582652160 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1498004e60 con 0x7f14a00c5df0 2023-10-06T11:01:26.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.178+0000 7f14a8423700 1 -- 172.21.15.7:0/582652160 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1484066f30 msgr2=0x7f14840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:26.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.178+0000 7f14a8423700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1484066f30 0x7f14840693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f149c002530 tx=0x7f149c007d10 comp rx=0 tx=0).stop 2023-10-06T11:01:26.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.178+0000 7f14a8423700 1 -- 172.21.15.7:0/582652160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14a00c5df0 msgr2=0x7f14a00b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.178+0000 7f14a8423700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14a00c5df0 0x7f14a00b3740 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1498000f80 tx=0x7f1498016000 comp rx=0 tx=0).stop 2023-10-06T11:01:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.178+0000 7f14a8423700 1 -- 172.21.15.7:0/582652160 shutdown_connections 2023-10-06T11:01:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.178+0000 7f14a8423700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1484066f30 0x7f14840693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.178+0000 7f14a8423700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14a00c5df0 0x7f14a00b3740 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.178+0000 7f14a8423700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f148c004d50 0x7f14a01586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.178+0000 7f14a8423700 1 --2- 172.21.15.7:0/582652160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14a00c5980 0x7f14a00b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.178+0000 7f14a8423700 1 -- 172.21.15.7:0/582652160 >> 172.21.15.7:0/582652160 conn(0x7f14a006c2c0 msgr2=0x7f14a00696f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.178+0000 7f14a8423700 1 -- 172.21.15.7:0/582652160 shutdown_connections 2023-10-06T11:01:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.178+0000 7f14a8423700 1 -- 172.21.15.7:0/582652160 wait complete. 2023-10-06T11:01:26.182 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:01:26.196 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:01:26.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.334+0000 7f871ea8c700 1 Processor -- start 2023-10-06T11:01:26.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.335+0000 7f871ea8c700 1 -- start start 2023-10-06T11:01:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.335+0000 7f871ea8c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87180c8f50 0x7f87180cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.335+0000 7f871ea8c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f87180ac840 0x7f87180cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.335+0000 7f871ea8c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87180adf90 con 0x7f87180cbc30 2023-10-06T11:01:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.335+0000 7f871ea8c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87180b0370 con 0x7f87180ac840 2023-10-06T11:01:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.335+0000 7f871ea8c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87180ae230 con 0x7f87180c8f50 2023-10-06T11:01:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.336+0000 7f871c828700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f87180cbc30 0x7f87180afb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34898/0 (socket says 172.21.15.7:34898) 2023-10-06T11:01:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.336+0000 7f871c828700 1 -- 172.21.15.7:0/3914223165 learned_addr learned my addr 172.21.15.7:0/3914223165 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.336+0000 7f8717fff700 1 --2- 172.21.15.7:0/3914223165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87180c8f50 0x7f87180cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.336+0000 7f871d029700 1 --2- 172.21.15.7:0/3914223165 >> v2:172.21.15.50:3300/0 conn(0x7f87180ac840 0x7f87180cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.336+0000 7f87177fe700 1 -- 172.21.15.7:0/3914223165 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075915675 0 0) 0x7f87180adf90 con 0x7f87180cbc30 2023-10-06T11:01:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.336+0000 7f87177fe700 1 -- 172.21.15.7:0/3914223165 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8704003570 con 0x7f87180cbc30 2023-10-06T11:01:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.336+0000 7f871d029700 1 -- 172.21.15.7:0/3914223165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87180c8f50 msgr2=0x7f87180cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.336+0000 7f871d029700 1 --2- 172.21.15.7:0/3914223165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87180c8f50 0x7f87180cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.336+0000 7f871d029700 1 -- 172.21.15.7:0/3914223165 >> v1:172.21.15.7:6789/0 conn(0x7f87180cbc30 legacy=0x7f87180afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.336+0000 7f87177fe700 1 -- 172.21.15.7:0/3914223165 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2837502160 0 0) 0x7f8704003570 con 0x7f87180cbc30 2023-10-06T11:01:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.336+0000 7f871d029700 1 -- 172.21.15.7:0/3914223165 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87180ae510 con 0x7f87180ac840 2023-10-06T11:01:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.336+0000 7f8717fff700 1 --2- 172.21.15.7:0/3914223165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87180c8f50 0x7f87180cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:01:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.337+0000 7f871d029700 1 --2- 172.21.15.7:0/3914223165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87180ac840 0x7f87180cc8b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8710009e60 tx=0x7f8710009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b62ea425077d29c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.337+0000 7f87177fe700 1 -- 172.21.15.7:0/3914223165 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871000e070 con 0x7f87180ac840 2023-10-06T11:01:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.337+0000 7f87177fe700 1 -- 172.21.15.7:0/3914223165 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871000b7a0 con 0x7f87180ac840 2023-10-06T11:01:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.337+0000 7f87177fe700 1 -- 172.21.15.7:0/3914223165 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708001470 con 0x7f87180ac840 2023-10-06T11:01:26.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.337+0000 7f871ea8c700 1 -- 172.21.15.7:0/3914223165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87180ac840 msgr2=0x7f87180cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:26.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.337+0000 7f871ea8c700 1 --2- 172.21.15.7:0/3914223165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87180ac840 0x7f87180cc8b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8710009e60 tx=0x7f8710009780 comp rx=0 tx=0).stop 2023-10-06T11:01:26.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.337+0000 7f871ea8c700 1 -- 172.21.15.7:0/3914223165 shutdown_connections 2023-10-06T11:01:26.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.337+0000 7f871ea8c700 1 --2- 172.21.15.7:0/3914223165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87180ac840 0x7f87180cc8b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:26.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.337+0000 7f871ea8c700 1 --2- 172.21.15.7:0/3914223165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87180c8f50 0x7f87180cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:26.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.337+0000 7f871ea8c700 1 -- 172.21.15.7:0/3914223165 >> 172.21.15.7:0/3914223165 conn(0x7f8718095a70 msgr2=0x7f87180af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:26.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.337+0000 7f871ea8c700 1 -- 172.21.15.7:0/3914223165 shutdown_connections 2023-10-06T11:01:26.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.337+0000 7f871ea8c700 1 -- 172.21.15.7:0/3914223165 wait complete. 2023-10-06T11:01:26.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.339+0000 7f871ea8c700 1 Processor -- start 2023-10-06T11:01:26.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.339+0000 7f871ea8c700 1 -- start start 2023-10-06T11:01:26.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871ea8c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87180ac840 0x7f8718157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:26.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871ea8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87180c8f50 0x7f8718068550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:26.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871ea8c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87180cbc30 0x7f8718068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:26.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871ea8c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871815da50 con 0x7f87180cbc30 2023-10-06T11:01:26.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871ea8c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871816a910 con 0x7f87180c8f50 2023-10-06T11:01:26.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871ea8c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8718158230 con 0x7f87180ac840 2023-10-06T11:01:26.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871d029700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87180cbc30 0x7f8718068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:26.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871d029700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87180cbc30 0x7f8718068a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39962/0 (socket says 172.21.15.7:39962) 2023-10-06T11:01:26.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871d029700 1 -- 172.21.15.7:0/3148794592 learned_addr learned my addr 172.21.15.7:0/3148794592 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:26.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f8717fff700 1 --2- 172.21.15.7:0/3148794592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87180c8f50 0x7f8718068550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:26.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871c828700 1 --2- 172.21.15.7:0/3148794592 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87180ac840 0x7f8718157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:26.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871d029700 1 -- 172.21.15.7:0/3148794592 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87180ac840 msgr2=0x7f8718157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:26.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871d029700 1 --2- 172.21.15.7:0/3148794592 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87180ac840 0x7f8718157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:26.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871d029700 1 -- 172.21.15.7:0/3148794592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87180c8f50 msgr2=0x7f8718068550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:26.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871d029700 1 --2- 172.21.15.7:0/3148794592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87180c8f50 0x7f8718068550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:26.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871d029700 1 -- 172.21.15.7:0/3148794592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8700009420 con 0x7f87180cbc30 2023-10-06T11:01:26.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f871d029700 1 --2- 172.21.15.7:0/3148794592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87180cbc30 0x7f8718068a90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f87100097c0 tx=0x7f8710018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:26.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.340+0000 7f8714ff9700 1 -- 172.21.15.7:0/3148794592 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710012af0 con 0x7f87180cbc30 2023-10-06T11:01:26.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.341+0000 7f8714ff9700 1 -- 172.21.15.7:0/3148794592 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710012c50 con 0x7f87180cbc30 2023-10-06T11:01:26.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.341+0000 7f8714ff9700 1 -- 172.21.15.7:0/3148794592 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871001e680 con 0x7f87180cbc30 2023-10-06T11:01:26.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.341+0000 7f871ea8c700 1 -- 172.21.15.7:0/3148794592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8710009a20 con 0x7f87180cbc30 2023-10-06T11:01:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.341+0000 7f871ea8c700 1 -- 172.21.15.7:0/3148794592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871815d490 con 0x7f87180cbc30 2023-10-06T11:01:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.342+0000 7f871ea8c700 1 -- 172.21.15.7:0/3148794592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8718070480 con 0x7f87180cbc30 2023-10-06T11:01:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.342+0000 7f8714ff9700 1 -- 172.21.15.7:0/3148794592 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f871001eab0 con 0x7f87180cbc30 2023-10-06T11:01:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.343+0000 7f8714ff9700 1 --2- 172.21.15.7:0/3148794592 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f86f8066f30 0x7f86f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.343+0000 7f871c828700 1 --2- 172.21.15.7:0/3148794592 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f86f8066f30 0x7f86f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.343+0000 7f8714ff9700 1 -- 172.21.15.7:0/3148794592 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6026+0+0 (secure 0 0 0) 0x7f8710086380 con 0x7f87180cbc30 2023-10-06T11:01:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.343+0000 7f871c828700 1 --2- 172.21.15.7:0/3148794592 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f86f8066f30 0x7f86f80693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8708004e60 tx=0x7f8708001a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:26.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.348+0000 7f8714ff9700 1 -- 172.21.15.7:0/3148794592 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8710053560 con 0x7f87180cbc30 2023-10-06T11:01:26.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:26.553+0000 7f871ea8c700 1 -- 172.21.15.7:0/3148794592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f871806c510 con 0x7f87180cbc30 2023-10-06T11:01:27.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.174+0000 7f8714ff9700 1 -- 172.21.15.7:0/3148794592 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8710056b80 con 0x7f87180cbc30 2023-10-06T11:01:27.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.183+0000 7f871ea8c700 1 -- 172.21.15.7:0/3148794592 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f86f8066f30 msgr2=0x7f86f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:27.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.183+0000 7f871ea8c700 1 --2- 172.21.15.7:0/3148794592 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f86f8066f30 0x7f86f80693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8708004e60 tx=0x7f8708001a10 comp rx=0 tx=0).stop 2023-10-06T11:01:27.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.183+0000 7f871ea8c700 1 -- 172.21.15.7:0/3148794592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87180cbc30 msgr2=0x7f8718068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:27.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.183+0000 7f871ea8c700 1 --2- 172.21.15.7:0/3148794592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87180cbc30 0x7f8718068a90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f87100097c0 tx=0x7f8710018000 comp rx=0 tx=0).stop 2023-10-06T11:01:27.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.184+0000 7f871ea8c700 1 -- 172.21.15.7:0/3148794592 shutdown_connections 2023-10-06T11:01:27.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.184+0000 7f871ea8c700 1 --2- 172.21.15.7:0/3148794592 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f86f8066f30 0x7f86f80693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.184+0000 7f871ea8c700 1 --2- 172.21.15.7:0/3148794592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87180cbc30 0x7f8718068a90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.184+0000 7f871ea8c700 1 --2- 172.21.15.7:0/3148794592 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87180ac840 0x7f8718157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.184+0000 7f871ea8c700 1 --2- 172.21.15.7:0/3148794592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87180c8f50 0x7f8718068550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.184+0000 7f871ea8c700 1 -- 172.21.15.7:0/3148794592 >> 172.21.15.7:0/3148794592 conn(0x7f8718095a70 msgr2=0x7f87181586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:27.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.184+0000 7f871ea8c700 1 -- 172.21.15.7:0/3148794592 shutdown_connections 2023-10-06T11:01:27.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.184+0000 7f871ea8c700 1 -- 172.21.15.7:0/3148794592 wait complete. 2023-10-06T11:01:27.187 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-10-06T11:01:27.202 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:01:27.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.337+0000 7fc020617700 1 Processor -- start 2023-10-06T11:01:27.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.337+0000 7fc020617700 1 -- start start 2023-10-06T11:01:27.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.338+0000 7fc020617700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc0180cbf20 0x7fc0180c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.338+0000 7fc020617700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0180c8fe0 con 0x7fc0180cb2b0 2023-10-06T11:01:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.338+0000 7fc020617700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0180c92c0 con 0x7fc0180cc2f0 2023-10-06T11:01:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.338+0000 7fc020617700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0180ca790 con 0x7fc0180cbf20 2023-10-06T11:01:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.338+0000 7fc01e3b3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc0180cbf20 0x7fc0180c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.338+0000 7fc01ebb4700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc0180cb2b0 0x7fc018158ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34910/0 (socket says 172.21.15.7:34910) 2023-10-06T11:01:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.338+0000 7fc01ebb4700 1 -- 172.21.15.7:0/1701632622 learned_addr learned my addr 172.21.15.7:0/1701632622 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.339+0000 7fc01e3b3700 1 -- 172.21.15.7:0/1701632622 >> v1:172.21.15.50:6789/0 conn(0x7fc0180cc2f0 legacy=0x7fc0180ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.339+0000 7fc01e3b3700 1 -- 172.21.15.7:0/1701632622 >> v1:172.21.15.7:6789/0 conn(0x7fc0180cb2b0 legacy=0x7fc018158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.339+0000 7fc01d3b1700 1 -- 172.21.15.7:0/1701632622 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007670240 0 0) 0x7fc0180c8fe0 con 0x7fc0180cb2b0 2023-10-06T11:01:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.339+0000 7fc01e3b3700 1 -- 172.21.15.7:0/1701632622 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0180c95a0 con 0x7fc0180cbf20 2023-10-06T11:01:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.339+0000 7fc01e3b3700 1 --2- 172.21.15.7:0/1701632622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0180cbf20 0x7fc0180c8920 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc0140098e0 tx=0x7fc0140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8687a98a51513c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.339+0000 7fc01d3b1700 1 -- 172.21.15.7:0/1701632622 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc014009e80 con 0x7fc0180cbf20 2023-10-06T11:01:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.339+0000 7fc01d3b1700 1 -- 172.21.15.7:0/1701632622 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01400b860 con 0x7fc0180cbf20 2023-10-06T11:01:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.339+0000 7fc01d3b1700 1 -- 172.21.15.7:0/1701632622 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01400bbe0 con 0x7fc0180cbf20 2023-10-06T11:01:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.340+0000 7fc020617700 1 -- 172.21.15.7:0/1701632622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0180cbf20 msgr2=0x7fc0180c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.340+0000 7fc020617700 1 --2- 172.21.15.7:0/1701632622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0180cbf20 0x7fc0180c8920 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc0140098e0 tx=0x7fc0140091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.340+0000 7fc020617700 1 -- 172.21.15.7:0/1701632622 shutdown_connections 2023-10-06T11:01:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.340+0000 7fc020617700 1 --2- 172.21.15.7:0/1701632622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0180cbf20 0x7fc0180c8920 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.340+0000 7fc020617700 1 -- 172.21.15.7:0/1701632622 >> 172.21.15.7:0/1701632622 conn(0x7fc0180afc90 msgr2=0x7fc0180b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.340+0000 7fc020617700 1 -- 172.21.15.7:0/1701632622 shutdown_connections 2023-10-06T11:01:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.340+0000 7fc020617700 1 -- 172.21.15.7:0/1701632622 wait complete. 2023-10-06T11:01:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.341+0000 7fc020617700 1 Processor -- start 2023-10-06T11:01:27.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.341+0000 7fc020617700 1 -- start start 2023-10-06T11:01:27.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.342+0000 7fc020617700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0180cb2b0 0x7fc0181504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:27.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.342+0000 7fc020617700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0180cbf20 0x7fc0180c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:27.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.342+0000 7fc020617700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0180cc2f0 0x7fc018155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:27.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.342+0000 7fc020617700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0181509f0 con 0x7fc0180cbf20 2023-10-06T11:01:27.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.342+0000 7fc020617700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0180c61b0 con 0x7fc0180cb2b0 2023-10-06T11:01:27.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.342+0000 7fc020617700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0180c0930 con 0x7fc0180cc2f0 2023-10-06T11:01:27.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc01dbb2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0180cbf20 0x7fc0180c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:27.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc01dbb2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0180cbf20 0x7fc0180c4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39976/0 (socket says 172.21.15.7:39976) 2023-10-06T11:01:27.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc01dbb2700 1 -- 172.21.15.7:0/2202061252 learned_addr learned my addr 172.21.15.7:0/2202061252 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:27.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc01e3b3700 1 --2- 172.21.15.7:0/2202061252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0180cb2b0 0x7fc0181504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:27.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc01ebb4700 1 --2- 172.21.15.7:0/2202061252 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0180cc2f0 0x7fc018155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:27.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc01dbb2700 1 -- 172.21.15.7:0/2202061252 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0180cc2f0 msgr2=0x7fc018155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:27.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc01dbb2700 1 --2- 172.21.15.7:0/2202061252 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0180cc2f0 0x7fc018155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc01dbb2700 1 -- 172.21.15.7:0/2202061252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0180cb2b0 msgr2=0x7fc0181504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:27.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc01dbb2700 1 --2- 172.21.15.7:0/2202061252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0180cb2b0 0x7fc0181504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc01dbb2700 1 -- 172.21.15.7:0/2202061252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc014009420 con 0x7fc0180cbf20 2023-10-06T11:01:27.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc01dbb2700 1 --2- 172.21.15.7:0/2202061252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0180cbf20 0x7fc0180c4790 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc00800c4e0 tx=0x7fc00800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:27.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc00e7fc700 1 -- 172.21.15.7:0/2202061252 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008011590 con 0x7fc0180cbf20 2023-10-06T11:01:27.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc00e7fc700 1 -- 172.21.15.7:0/2202061252 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc008011710 con 0x7fc0180cbf20 2023-10-06T11:01:27.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc020617700 1 -- 172.21.15.7:0/2202061252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0180c0c10 con 0x7fc0180cbf20 2023-10-06T11:01:27.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc00e7fc700 1 -- 172.21.15.7:0/2202061252 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008011ad0 con 0x7fc0180cbf20 2023-10-06T11:01:27.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.343+0000 7fc020617700 1 -- 172.21.15.7:0/2202061252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0180c11d0 con 0x7fc0180cbf20 2023-10-06T11:01:27.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.344+0000 7fc020617700 1 -- 172.21.15.7:0/2202061252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc018070480 con 0x7fc0180cbf20 2023-10-06T11:01:27.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.345+0000 7fc00e7fc700 1 -- 172.21.15.7:0/2202061252 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc008001020 con 0x7fc0180cbf20 2023-10-06T11:01:27.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.345+0000 7fc00e7fc700 1 --2- 172.21.15.7:0/2202061252 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbffc066f30 0x7fbffc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:27.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.345+0000 7fc00e7fc700 1 -- 172.21.15.7:0/2202061252 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fc008083990 con 0x7fc0180cbf20 2023-10-06T11:01:27.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.345+0000 7fc01e3b3700 1 --2- 172.21.15.7:0/2202061252 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbffc066f30 0x7fbffc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:27.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.346+0000 7fc01e3b3700 1 --2- 172.21.15.7:0/2202061252 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbffc066f30 0x7fbffc0693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc0140093f0 tx=0x7fc014017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:27.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.350+0000 7fc00e7fc700 1 -- 172.21.15.7:0/2202061252 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc008050bc0 con 0x7fc0180cbf20 2023-10-06T11:01:27.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.553+0000 7fc020617700 1 -- 172.21.15.7:0/2202061252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc0180c9880 con 0x7fc0180cbf20 2023-10-06T11:01:27.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.557+0000 7fc00e7fc700 1 -- 172.21.15.7:0/2202061252 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc008017020 con 0x7fc0180cbf20 2023-10-06T11:01:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.560+0000 7fc020617700 1 -- 172.21.15.7:0/2202061252 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbffc066f30 msgr2=0x7fbffc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.560+0000 7fc020617700 1 --2- 172.21.15.7:0/2202061252 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbffc066f30 0x7fbffc0693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc0140093f0 tx=0x7fc014017000 comp rx=0 tx=0).stop 2023-10-06T11:01:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.560+0000 7fc020617700 1 -- 172.21.15.7:0/2202061252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0180cbf20 msgr2=0x7fc0180c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.560+0000 7fc020617700 1 --2- 172.21.15.7:0/2202061252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0180cbf20 0x7fc0180c4790 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc00800c4e0 tx=0x7fc00800c8a0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.560+0000 7fc020617700 1 -- 172.21.15.7:0/2202061252 shutdown_connections 2023-10-06T11:01:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.560+0000 7fc020617700 1 --2- 172.21.15.7:0/2202061252 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbffc066f30 0x7fbffc0693e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.560+0000 7fc020617700 1 --2- 172.21.15.7:0/2202061252 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0180cc2f0 0x7fc018155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.560+0000 7fc020617700 1 --2- 172.21.15.7:0/2202061252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0180cb2b0 0x7fc0181504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.560+0000 7fc020617700 1 --2- 172.21.15.7:0/2202061252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0180cbf20 0x7fc0180c4790 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.560+0000 7fc020617700 1 -- 172.21.15.7:0/2202061252 >> 172.21.15.7:0/2202061252 conn(0x7fc0180afc90 msgr2=0x7fc018156660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:27.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.560+0000 7fc020617700 1 -- 172.21.15.7:0/2202061252 shutdown_connections 2023-10-06T11:01:27.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.560+0000 7fc020617700 1 -- 172.21.15.7:0/2202061252 wait complete. 2023-10-06T11:01:27.575 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-10-06T11:01:27.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.705+0000 7fd177137700 1 Processor -- start 2023-10-06T11:01:27.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.705+0000 7fd177137700 1 -- start start 2023-10-06T11:01:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.706+0000 7fd177137700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd170158120 0x7fd1700c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.706+0000 7fd177137700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1700c8ba0 0x7fd1700ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.706+0000 7fd177137700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1700cbd10 con 0x7fd1700cac60 2023-10-06T11:01:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.706+0000 7fd177137700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1700cb9e0 con 0x7fd1700c8ba0 2023-10-06T11:01:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.706+0000 7fd177137700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1700c9300 con 0x7fd170158120 2023-10-06T11:01:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.706+0000 7fd16ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1700c8ba0 0x7fd1700ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.707+0000 7fd1756d4700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd1700cac60 0x7fd17015ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34922/0 (socket says 172.21.15.7:34922) 2023-10-06T11:01:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.707+0000 7fd1756d4700 1 -- 172.21.15.7:0/1589254979 learned_addr learned my addr 172.21.15.7:0/1589254979 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.707+0000 7fd174ed3700 1 --2- 172.21.15.7:0/1589254979 >> v2:172.21.15.50:3300/0 conn(0x7fd170158120 0x7fd1700c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.707+0000 7fd16ffff700 1 -- 172.21.15.7:0/1589254979 >> v2:172.21.15.50:3300/0 conn(0x7fd170158120 msgr2=0x7fd1700c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.707+0000 7fd16ffff700 1 --2- 172.21.15.7:0/1589254979 >> v2:172.21.15.50:3300/0 conn(0x7fd170158120 0x7fd1700c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.707+0000 7fd16ffff700 1 -- 172.21.15.7:0/1589254979 >> v1:172.21.15.7:6789/0 conn(0x7fd1700cac60 legacy=0x7fd17015ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.707+0000 7fd16ffff700 1 -- 172.21.15.7:0/1589254979 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1700c95e0 con 0x7fd1700c8ba0 2023-10-06T11:01:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.707+0000 7fd16f7fe700 1 -- 172.21.15.7:0/1589254979 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941089971 0 0) 0x7fd1700cbd10 con 0x7fd1700cac60 2023-10-06T11:01:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.707+0000 7fd16ffff700 1 --2- 172.21.15.7:0/1589254979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1700c8ba0 0x7fd1700ca720 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd17006ec50 tx=0x7fd1580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23778be76d264d73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.707+0000 7fd16f7fe700 1 -- 172.21.15.7:0/1589254979 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd158011630 con 0x7fd1700c8ba0 2023-10-06T11:01:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.707+0000 7fd16f7fe700 1 -- 172.21.15.7:0/1589254979 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd158011790 con 0x7fd1700c8ba0 2023-10-06T11:01:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.707+0000 7fd16f7fe700 1 -- 172.21.15.7:0/1589254979 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd158011b30 con 0x7fd1700c8ba0 2023-10-06T11:01:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.708+0000 7fd177137700 1 -- 172.21.15.7:0/1589254979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1700c8ba0 msgr2=0x7fd1700ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.708+0000 7fd177137700 1 --2- 172.21.15.7:0/1589254979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1700c8ba0 0x7fd1700ca720 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd17006ec50 tx=0x7fd1580091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.708+0000 7fd177137700 1 -- 172.21.15.7:0/1589254979 shutdown_connections 2023-10-06T11:01:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.708+0000 7fd177137700 1 --2- 172.21.15.7:0/1589254979 >> v2:172.21.15.50:3300/0 conn(0x7fd170158120 0x7fd1700c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.708+0000 7fd177137700 1 --2- 172.21.15.7:0/1589254979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1700c8ba0 0x7fd1700ca720 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.708+0000 7fd177137700 1 -- 172.21.15.7:0/1589254979 >> 172.21.15.7:0/1589254979 conn(0x7fd170087920 msgr2=0x7fd170097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.708+0000 7fd177137700 1 -- 172.21.15.7:0/1589254979 shutdown_connections 2023-10-06T11:01:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.708+0000 7fd177137700 1 -- 172.21.15.7:0/1589254979 wait complete. 2023-10-06T11:01:27.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.710+0000 7fd177137700 1 Processor -- start 2023-10-06T11:01:27.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.710+0000 7fd177137700 1 -- start start 2023-10-06T11:01:27.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd177137700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1700c8ba0 0x7fd1700c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:27.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd177137700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1700cac60 0x7fd17014f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:27.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd177137700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd170158120 0x7fd1700b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:27.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd177137700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700b1de0 con 0x7fd1700c8ba0 2023-10-06T11:01:27.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd177137700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700b2680 con 0x7fd1700cac60 2023-10-06T11:01:27.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd177137700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700c5d60 con 0x7fd170158120 2023-10-06T11:01:27.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd174ed3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1700c8ba0 0x7fd1700c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:27.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd174ed3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1700c8ba0 0x7fd1700c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39990/0 (socket says 172.21.15.7:39990) 2023-10-06T11:01:27.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd174ed3700 1 -- 172.21.15.7:0/4102681350 learned_addr learned my addr 172.21.15.7:0/4102681350 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:27.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd16ffff700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1700cac60 0x7fd17014f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:27.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd1756d4700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd170158120 0x7fd1700b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:27.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd174ed3700 1 -- 172.21.15.7:0/4102681350 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd170158120 msgr2=0x7fd1700b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:27.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd174ed3700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd170158120 0x7fd1700b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd174ed3700 1 -- 172.21.15.7:0/4102681350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1700cac60 msgr2=0x7fd17014f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:27.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd174ed3700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1700cac60 0x7fd17014f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:27.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd174ed3700 1 -- 172.21.15.7:0/4102681350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd158009420 con 0x7fd1700c8ba0 2023-10-06T11:01:27.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.711+0000 7fd1756d4700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd170158120 0x7fd1700b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:27.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.712+0000 7fd174ed3700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1700c8ba0 0x7fd1700c5820 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd16000ea30 tx=0x7fd160009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:27.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.712+0000 7fd16cff9700 1 -- 172.21.15.7:0/4102681350 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16000c850 con 0x7fd1700c8ba0 2023-10-06T11:01:27.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.712+0000 7fd16cff9700 1 -- 172.21.15.7:0/4102681350 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16000c9b0 con 0x7fd1700c8ba0 2023-10-06T11:01:27.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.712+0000 7fd177137700 1 -- 172.21.15.7:0/4102681350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17009ad30 con 0x7fd1700c8ba0 2023-10-06T11:01:27.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.712+0000 7fd16cff9700 1 -- 172.21.15.7:0/4102681350 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16000cd30 con 0x7fd1700c8ba0 2023-10-06T11:01:27.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.712+0000 7fd177137700 1 -- 172.21.15.7:0/4102681350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1700b2310 con 0x7fd1700c8ba0 2023-10-06T11:01:27.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.713+0000 7fd177137700 1 -- 172.21.15.7:0/4102681350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1700b2960 con 0x7fd1700c8ba0 2023-10-06T11:01:27.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.714+0000 7fd16cff9700 1 -- 172.21.15.7:0/4102681350 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd160013680 con 0x7fd1700c8ba0 2023-10-06T11:01:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.714+0000 7fd16cff9700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd150066f30 0x7fd1500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.714+0000 7fd16cff9700 1 -- 172.21.15.7:0/4102681350 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fd160084ee0 con 0x7fd1700c8ba0 2023-10-06T11:01:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.714+0000 7fd16ffff700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd150066f30 0x7fd1500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.715+0000 7fd16ffff700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd150066f30 0x7fd1500693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd1580091e0 tx=0x7fd158017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:27.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:27.718+0000 7fd16cff9700 1 -- 172.21.15.7:0/4102681350 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd160052230 con 0x7fd1700c8ba0 2023-10-06T11:01:28.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.014+0000 7fd177137700 1 -- 172.21.15.7:0/4102681350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7fd170070480 con 0x7fd1700c8ba0 2023-10-06T11:01:28.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.184+0000 7fd16cff9700 1 -- 172.21.15.7:0/4102681350 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v149) v1 ==== 134+0+0 (secure 0 0 0) 0x7fd160055850 con 0x7fd1700c8ba0 2023-10-06T11:01:28.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.187+0000 7fd177137700 1 -- 172.21.15.7:0/4102681350 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd150066f30 msgr2=0x7fd1500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:28.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.187+0000 7fd177137700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd150066f30 0x7fd1500693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd1580091e0 tx=0x7fd158017000 comp rx=0 tx=0).stop 2023-10-06T11:01:28.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.187+0000 7fd177137700 1 -- 172.21.15.7:0/4102681350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1700c8ba0 msgr2=0x7fd1700c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:28.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.187+0000 7fd177137700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1700c8ba0 0x7fd1700c5820 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd16000ea30 tx=0x7fd160009120 comp rx=0 tx=0).stop 2023-10-06T11:01:28.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.187+0000 7fd177137700 1 -- 172.21.15.7:0/4102681350 shutdown_connections 2023-10-06T11:01:28.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.187+0000 7fd177137700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd150066f30 0x7fd1500693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:28.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.187+0000 7fd177137700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1700c8ba0 0x7fd1700c5820 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:28.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.187+0000 7fd177137700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd170158120 0x7fd1700b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:28.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.187+0000 7fd177137700 1 --2- 172.21.15.7:0/4102681350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1700cac60 0x7fd17014f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:28.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.187+0000 7fd177137700 1 -- 172.21.15.7:0/4102681350 >> 172.21.15.7:0/4102681350 conn(0x7fd170087920 msgr2=0x7fd1700ab310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:28.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.187+0000 7fd177137700 1 -- 172.21.15.7:0/4102681350 shutdown_connections 2023-10-06T11:01:28.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.187+0000 7fd177137700 1 -- 172.21.15.7:0/4102681350 wait complete. 2023-10-06T11:01:28.204 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ok 2023-10-06T11:01:28.204 INFO:tasks.cephfs_test_runner: 2023-10-06T11:01:28.204 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T11:01:28.205 INFO:tasks.cephfs_test_runner:Ran 2 tests in 93.676s 2023-10-06T11:01:28.205 INFO:tasks.cephfs_test_runner: 2023-10-06T11:01:28.205 INFO:tasks.cephfs_test_runner:OK 2023-10-06T11:01:28.205 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T11:01:28.215 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-06T11:01:28.271 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-06T11:01:28.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:28.272 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-06T11:01:28.295 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:01:28.295 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:01:28.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:28.296 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:01:28.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:28.384 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:01:28.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:28.438 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2023-10-06T11:01:28.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:28.523 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-06T11:01:28.548 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T11:01:28.548 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T11:01:28.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:28.548 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T11:01:28.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:28.637 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T11:01:28.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:01:28.696 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-10-06T11:01:28.783 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T11:01:28.792 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T11:01:28.793 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:01:28.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.934+0000 7fc04a329700 1 Processor -- start 2023-10-06T11:01:28.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.934+0000 7fc04a329700 1 -- start start 2023-10-06T11:01:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.935+0000 7fc04a329700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc0440cb0d0 0x7fc044159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.935+0000 7fc04a329700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc044159e70 con 0x7fc0441597d0 2023-10-06T11:01:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.935+0000 7fc04a329700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04415a150 con 0x7fc0440cad00 2023-10-06T11:01:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.935+0000 7fc04a329700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc044159c50 con 0x7fc0440cb0d0 2023-10-06T11:01:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.935+0000 7fc0488c6700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc0441597d0 0x7fc0440670f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34928/0 (socket says 172.21.15.7:34928) 2023-10-06T11:01:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.935+0000 7fc0488c6700 1 -- 172.21.15.7:0/3013735658 learned_addr learned my addr 172.21.15.7:0/3013735658 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.935+0000 7fc0437fe700 1 --2- 172.21.15.7:0/3013735658 >> v2:172.21.15.50:3300/0 conn(0x7fc0440cb0d0 0x7fc044159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 -- 172.21.15.7:0/3013735658 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793178772 0 0) 0x7fc044159e70 con 0x7fc0441597d0 2023-10-06T11:01:28.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 -- 172.21.15.7:0/3013735658 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc02c003570 con 0x7fc0441597d0 2023-10-06T11:01:28.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 -- 172.21.15.7:0/3013735658 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2501218686 0 0) 0x7fc02c003570 con 0x7fc0441597d0 2023-10-06T11:01:28.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 -- 172.21.15.7:0/3013735658 >> v2:172.21.15.50:3300/0 conn(0x7fc0440cb0d0 msgr2=0x7fc044159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:28.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 --2- 172.21.15.7:0/3013735658 >> v2:172.21.15.50:3300/0 conn(0x7fc0440cb0d0 0x7fc044159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:28.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 -- 172.21.15.7:0/3013735658 >> v1:172.21.15.50:6789/0 conn(0x7fc0440cad00 legacy=0x7fc0440c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:28.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 -- 172.21.15.7:0/3013735658 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0440c74e0 con 0x7fc0441597d0 2023-10-06T11:01:28.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 -- 172.21.15.7:0/3013735658 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7fc03c0017f0 con 0x7fc0441597d0 2023-10-06T11:01:28.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 -- 172.21.15.7:0/3013735658 >> v1:172.21.15.7:6789/0 conn(0x7fc0441597d0 legacy=0x7fc0440670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:28.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 --2- 172.21.15.7:0/3013735658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc02c003a60 0x7fc02c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:28.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 --2- 172.21.15.7:0/3013735658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc02c004810 0x7fc02c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:28.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 --2- 172.21.15.7:0/3013735658 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c0051c0 0x7fc02c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:28.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 -- 172.21.15.7:0/3013735658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc044159c50 con 0x7fc02c003a60 2023-10-06T11:01:28.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 -- 172.21.15.7:0/3013735658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c00c0d0 con 0x7fc02c004810 2023-10-06T11:01:28.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc042ffd700 1 -- 172.21.15.7:0/3013735658 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c00c290 con 0x7fc02c0051c0 2023-10-06T11:01:28.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc043fff700 1 --2- 172.21.15.7:0/3013735658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc02c003a60 0x7fc02c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:28.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc0437fe700 1 --2- 172.21.15.7:0/3013735658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc02c004810 0x7fc02c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:28.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.936+0000 7fc0488c6700 1 --2- 172.21.15.7:0/3013735658 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c0051c0 0x7fc02c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:28.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.937+0000 7fc043fff700 1 -- 172.21.15.7:0/3013735658 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c0051c0 msgr2=0x7fc02c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:28.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.937+0000 7fc043fff700 1 --2- 172.21.15.7:0/3013735658 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c0051c0 0x7fc02c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:28.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.937+0000 7fc043fff700 1 -- 172.21.15.7:0/3013735658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc02c004810 msgr2=0x7fc02c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:28.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.937+0000 7fc043fff700 1 --2- 172.21.15.7:0/3013735658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc02c004810 0x7fc02c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:28.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.937+0000 7fc043fff700 1 -- 172.21.15.7:0/3013735658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c003570 con 0x7fc02c003a60 2023-10-06T11:01:28.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.937+0000 7fc0488c6700 1 -- 172.21.15.7:0/3013735658 reap_dead start 2023-10-06T11:01:28.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.937+0000 7fc043fff700 1 --2- 172.21.15.7:0/3013735658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc02c003a60 0x7fc02c003e70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc0340018b0 tx=0x7fc034007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb416d7bdc29657 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:28.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.937+0000 7fc042ffd700 1 -- 172.21.15.7:0/3013735658 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034012420 con 0x7fc02c003a60 2023-10-06T11:01:28.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.937+0000 7fc042ffd700 1 -- 172.21.15.7:0/3013735658 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0340125a0 con 0x7fc02c003a60 2023-10-06T11:01:28.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.937+0000 7fc042ffd700 1 -- 172.21.15.7:0/3013735658 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034012960 con 0x7fc02c003a60 2023-10-06T11:01:28.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.937+0000 7fc04a329700 1 -- 172.21.15.7:0/3013735658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc02c003a60 msgr2=0x7fc02c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:28.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.937+0000 7fc04a329700 1 --2- 172.21.15.7:0/3013735658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc02c003a60 0x7fc02c003e70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc0340018b0 tx=0x7fc034007d30 comp rx=0 tx=0).stop 2023-10-06T11:01:28.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.938+0000 7fc04a329700 1 -- 172.21.15.7:0/3013735658 shutdown_connections 2023-10-06T11:01:28.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.938+0000 7fc04a329700 1 --2- 172.21.15.7:0/3013735658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc02c003a60 0x7fc02c003e70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:28.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.938+0000 7fc04a329700 1 -- 172.21.15.7:0/3013735658 >> 172.21.15.7:0/3013735658 conn(0x7fc0440cc790 msgr2=0x7fc0440c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:28.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.938+0000 7fc04a329700 1 -- 172.21.15.7:0/3013735658 shutdown_connections 2023-10-06T11:01:28.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.938+0000 7fc04a329700 1 -- 172.21.15.7:0/3013735658 wait complete. 2023-10-06T11:01:28.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.939+0000 7fc04a329700 1 Processor -- start 2023-10-06T11:01:28.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.940+0000 7fc04a329700 1 -- start start 2023-10-06T11:01:28.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.940+0000 7fc04a329700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c003a60 0x7fc0440b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:28.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.940+0000 7fc04a329700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc04414f410 0x7fc044155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:28.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.940+0000 7fc04a329700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc044143350 0x7fc0441437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:28.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.940+0000 7fc04a329700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc044143d30 con 0x7fc04414f410 2023-10-06T11:01:28.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.940+0000 7fc04a329700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440b0f70 con 0x7fc044143350 2023-10-06T11:01:28.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc04a329700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440b1940 con 0x7fc02c003a60 2023-10-06T11:01:28.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc0437fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc04414f410 0x7fc044155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:28.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc0437fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc04414f410 0x7fc044155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40012/0 (socket says 172.21.15.7:40012) 2023-10-06T11:01:28.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc0437fe700 1 -- 172.21.15.7:0/634100293 learned_addr learned my addr 172.21.15.7:0/634100293 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:28.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc043fff700 1 --2- 172.21.15.7:0/634100293 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c003a60 0x7fc0440b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:28.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc0488c6700 1 --2- 172.21.15.7:0/634100293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc044143350 0x7fc0441437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:28.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc0437fe700 1 -- 172.21.15.7:0/634100293 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c003a60 msgr2=0x7fc0440b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:28.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc0437fe700 1 --2- 172.21.15.7:0/634100293 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c003a60 0x7fc0440b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:28.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc0437fe700 1 -- 172.21.15.7:0/634100293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc044143350 msgr2=0x7fc0441437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:28.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc0437fe700 1 --2- 172.21.15.7:0/634100293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc044143350 0x7fc0441437f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:28.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc0437fe700 1 -- 172.21.15.7:0/634100293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0440b00c0 con 0x7fc04414f410 2023-10-06T11:01:28.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc0437fe700 1 --2- 172.21.15.7:0/634100293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc04414f410 0x7fc044155550 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc038011a90 tx=0x7fc03800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:28.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc02bfff700 1 -- 172.21.15.7:0/634100293 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03800fa40 con 0x7fc04414f410 2023-10-06T11:01:28.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc02bfff700 1 -- 172.21.15.7:0/634100293 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03800fbc0 con 0x7fc04414f410 2023-10-06T11:01:28.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc04a329700 1 -- 172.21.15.7:0/634100293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0440b0360 con 0x7fc04414f410 2023-10-06T11:01:28.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc02bfff700 1 -- 172.21.15.7:0/634100293 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038013440 con 0x7fc04414f410 2023-10-06T11:01:28.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.941+0000 7fc04a329700 1 -- 172.21.15.7:0/634100293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0440b0920 con 0x7fc04414f410 2023-10-06T11:01:28.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.942+0000 7fc04a329700 1 -- 172.21.15.7:0/634100293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0440b10e0 con 0x7fc04414f410 2023-10-06T11:01:28.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.943+0000 7fc02bfff700 1 -- 172.21.15.7:0/634100293 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0380137f0 con 0x7fc04414f410 2023-10-06T11:01:28.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.943+0000 7fc02bfff700 1 --2- 172.21.15.7:0/634100293 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc030066f30 0x7fc0300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:28.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.943+0000 7fc02bfff700 1 -- 172.21.15.7:0/634100293 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fc038017030 con 0x7fc04414f410 2023-10-06T11:01:28.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.943+0000 7fc043fff700 1 --2- 172.21.15.7:0/634100293 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc030066f30 0x7fc0300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:28.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.944+0000 7fc043fff700 1 --2- 172.21.15.7:0/634100293 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc030066f30 0x7fc0300693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc0340018b0 tx=0x7fc034015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:28.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:28.949+0000 7fc02bfff700 1 -- 172.21.15.7:0/634100293 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc038052160 con 0x7fc04414f410 2023-10-06T11:01:29.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.151+0000 7fc04a329700 1 -- 172.21.15.7:0/634100293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc044070480 con 0x7fc04414f410 2023-10-06T11:01:29.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.152+0000 7fc02bfff700 1 -- 172.21.15.7:0/634100293 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+13983 (secure 0 0 0) 0x7fc038055780 con 0x7fc04414f410 2023-10-06T11:01:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:29.154 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":60,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:01:27.170146+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/1121258860":"2023-10-07T11:01:24.165186+0000","172.21.15.7:6835/1121258860":"2023-10-07T11:01:24.165186+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:01:29.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.154+0000 7fc04a329700 1 -- 172.21.15.7:0/634100293 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc030066f30 msgr2=0x7fc0300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:29.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.155+0000 7fc04a329700 1 --2- 172.21.15.7:0/634100293 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc030066f30 0x7fc0300693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc0340018b0 tx=0x7fc034015000 comp rx=0 tx=0).stop 2023-10-06T11:01:29.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.155+0000 7fc04a329700 1 -- 172.21.15.7:0/634100293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc04414f410 msgr2=0x7fc044155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:29.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.155+0000 7fc04a329700 1 --2- 172.21.15.7:0/634100293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc04414f410 0x7fc044155550 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc038011a90 tx=0x7fc03800a330 comp rx=0 tx=0).stop 2023-10-06T11:01:29.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.155+0000 7fc04a329700 1 -- 172.21.15.7:0/634100293 shutdown_connections 2023-10-06T11:01:29.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.155+0000 7fc04a329700 1 --2- 172.21.15.7:0/634100293 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc030066f30 0x7fc0300693e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.155+0000 7fc04a329700 1 --2- 172.21.15.7:0/634100293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc044143350 0x7fc0441437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.155+0000 7fc04a329700 1 --2- 172.21.15.7:0/634100293 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c003a60 0x7fc0440b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.155+0000 7fc04a329700 1 --2- 172.21.15.7:0/634100293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc04414f410 0x7fc044155550 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.155+0000 7fc04a329700 1 -- 172.21.15.7:0/634100293 >> 172.21.15.7:0/634100293 conn(0x7fc0440cc790 msgr2=0x7fc044158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:29.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.155+0000 7fc04a329700 1 -- 172.21.15.7:0/634100293 shutdown_connections 2023-10-06T11:01:29.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.155+0000 7fc04a329700 1 -- 172.21.15.7:0/634100293 wait complete. 2023-10-06T11:01:29.170 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T11:01:29.170 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:01:29.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.302+0000 7fbe9985f700 1 Processor -- start 2023-10-06T11:01:29.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.302+0000 7fbe9985f700 1 -- start start 2023-10-06T11:01:29.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.303+0000 7fbe9985f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe940af320 0x7fbe940cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:29.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.303+0000 7fbe9985f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe940cb580 0x7fbe94068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:29.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.303+0000 7fbe9985f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbe940cfb50 0x7fbe94069420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:29.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.303+0000 7fbe9985f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe94159c00 con 0x7fbe940cfb50 2023-10-06T11:01:29.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.303+0000 7fbe9985f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe940cf6c0 con 0x7fbe940af320 2023-10-06T11:01:29.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.303+0000 7fbe9985f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe940ceab0 con 0x7fbe940cb580 2023-10-06T11:01:29.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.303+0000 7fbe937fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbe940cfb50 0x7fbe94069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:29.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.303+0000 7fbe937fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbe940cfb50 0x7fbe94069420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40020/0 (socket says 172.21.15.7:40020) 2023-10-06T11:01:29.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.303+0000 7fbe937fe700 1 -- 172.21.15.7:0/140175870 learned_addr learned my addr 172.21.15.7:0/140175870 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.303+0000 7fbe92ffd700 1 --2- 172.21.15.7:0/140175870 >> v2:172.21.15.50:3300/0 conn(0x7fbe940af320 0x7fbe940cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.303+0000 7fbe927fc700 1 --2- 172.21.15.7:0/140175870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe940cb580 0x7fbe94068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.304+0000 7fbe937fe700 1 -- 172.21.15.7:0/140175870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe940cb580 msgr2=0x7fbe94068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.304+0000 7fbe937fe700 1 --2- 172.21.15.7:0/140175870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe940cb580 0x7fbe94068ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.304+0000 7fbe937fe700 1 -- 172.21.15.7:0/140175870 >> v2:172.21.15.50:3300/0 conn(0x7fbe940af320 msgr2=0x7fbe940cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.304+0000 7fbe937fe700 1 --2- 172.21.15.7:0/140175870 >> v2:172.21.15.50:3300/0 conn(0x7fbe940af320 0x7fbe940cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.304+0000 7fbe937fe700 1 -- 172.21.15.7:0/140175870 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe940ced90 con 0x7fbe940cfb50 2023-10-06T11:01:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.304+0000 7fbe927fc700 1 --2- 172.21.15.7:0/140175870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe940cb580 0x7fbe94068ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.304+0000 7fbe937fe700 1 --2- 172.21.15.7:0/140175870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe940cfb50 0x7fbe94069420 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fbe94068620 tx=0x7fbe8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2cfc6fc0306108 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.304+0000 7fbe91ffb700 1 -- 172.21.15.7:0/140175870 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c00e070 con 0x7fbe940cfb50 2023-10-06T11:01:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.304+0000 7fbe91ffb700 1 -- 172.21.15.7:0/140175870 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c00bab0 con 0x7fbe940cfb50 2023-10-06T11:01:29.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.304+0000 7fbe91ffb700 1 -- 172.21.15.7:0/140175870 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0092e0 con 0x7fbe940cfb50 2023-10-06T11:01:29.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.305+0000 7fbe9985f700 1 -- 172.21.15.7:0/140175870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe940cfb50 msgr2=0x7fbe94069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:29.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.305+0000 7fbe9985f700 1 --2- 172.21.15.7:0/140175870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe940cfb50 0x7fbe94069420 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fbe94068620 tx=0x7fbe8c009840 comp rx=0 tx=0).stop 2023-10-06T11:01:29.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.305+0000 7fbe9985f700 1 -- 172.21.15.7:0/140175870 shutdown_connections 2023-10-06T11:01:29.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.305+0000 7fbe9985f700 1 --2- 172.21.15.7:0/140175870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe940cfb50 0x7fbe94069420 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.305+0000 7fbe9985f700 1 --2- 172.21.15.7:0/140175870 >> v2:172.21.15.50:3300/0 conn(0x7fbe940af320 0x7fbe940cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.305+0000 7fbe9985f700 1 --2- 172.21.15.7:0/140175870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe940cb580 0x7fbe94068ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.305+0000 7fbe9985f700 1 -- 172.21.15.7:0/140175870 >> 172.21.15.7:0/140175870 conn(0x7fbe94067b80 msgr2=0x7fbe940d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:29.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.305+0000 7fbe9985f700 1 -- 172.21.15.7:0/140175870 shutdown_connections 2023-10-06T11:01:29.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.305+0000 7fbe9985f700 1 -- 172.21.15.7:0/140175870 wait complete. 2023-10-06T11:01:29.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.306+0000 7fbe9985f700 1 Processor -- start 2023-10-06T11:01:29.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.306+0000 7fbe9985f700 1 -- start start 2023-10-06T11:01:29.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe9985f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe940af320 0x7fbe940b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:29.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe9985f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe940cb580 0x7fbe940b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:29.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe9985f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe940cfb50 0x7fbe9415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:29.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe9985f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe940b52e0 con 0x7fbe940cfb50 2023-10-06T11:01:29.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe9985f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe940b5540 con 0x7fbe940af320 2023-10-06T11:01:29.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe9985f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe940b57e0 con 0x7fbe940cb580 2023-10-06T11:01:29.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe937fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe940cfb50 0x7fbe9415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:29.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe937fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe940cfb50 0x7fbe9415bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40026/0 (socket says 172.21.15.7:40026) 2023-10-06T11:01:29.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe937fe700 1 -- 172.21.15.7:0/3992743056 learned_addr learned my addr 172.21.15.7:0/3992743056 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:29.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe927fc700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe940cb580 0x7fbe940b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:29.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe92ffd700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe940af320 0x7fbe940b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:29.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe937fe700 1 -- 172.21.15.7:0/3992743056 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe940cb580 msgr2=0x7fbe940b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:29.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe937fe700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe940cb580 0x7fbe940b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe937fe700 1 -- 172.21.15.7:0/3992743056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe940af320 msgr2=0x7fbe940b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:29.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe937fe700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe940af320 0x7fbe940b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe937fe700 1 -- 172.21.15.7:0/3992743056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c009ae0 con 0x7fbe940cfb50 2023-10-06T11:01:29.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.307+0000 7fbe927fc700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe940cb580 0x7fbe940b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:29.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.308+0000 7fbe937fe700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe940cfb50 0x7fbe9415bef0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fbe9406fad0 tx=0x7fbe8c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:29.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.308+0000 7fbe8affd700 1 -- 172.21.15.7:0/3992743056 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0032f0 con 0x7fbe940cfb50 2023-10-06T11:01:29.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.308+0000 7fbe8affd700 1 -- 172.21.15.7:0/3992743056 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c008e80 con 0x7fbe940cfb50 2023-10-06T11:01:29.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.308+0000 7fbe9985f700 1 -- 172.21.15.7:0/3992743056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe940b5ac0 con 0x7fbe940cfb50 2023-10-06T11:01:29.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.308+0000 7fbe8affd700 1 -- 172.21.15.7:0/3992743056 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c01c640 con 0x7fbe940cfb50 2023-10-06T11:01:29.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.308+0000 7fbe9985f700 1 -- 172.21.15.7:0/3992743056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe94155350 con 0x7fbe940cfb50 2023-10-06T11:01:29.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.309+0000 7fbe9985f700 1 -- 172.21.15.7:0/3992743056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe94070480 con 0x7fbe940cfb50 2023-10-06T11:01:29.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.309+0000 7fbe8affd700 1 -- 172.21.15.7:0/3992743056 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe8c003040 con 0x7fbe940cfb50 2023-10-06T11:01:29.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.310+0000 7fbe8affd700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbe74066f30 0x7fbe740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:29.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.310+0000 7fbe8affd700 1 -- 172.21.15.7:0/3992743056 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fbe8c085c60 con 0x7fbe940cfb50 2023-10-06T11:01:29.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.310+0000 7fbe92ffd700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbe74066f30 0x7fbe740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:29.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.310+0000 7fbe92ffd700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbe74066f30 0x7fbe740693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009d40 tx=0x7fbe84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:29.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.314+0000 7fbe8affd700 1 -- 172.21.15.7:0/3992743056 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe8c052f30 con 0x7fbe940cfb50 2023-10-06T11:01:29.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.512+0000 7fbe9985f700 1 -- 172.21.15.7:0/3992743056 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe940cf070 con 0x7fbe74066f30 2023-10-06T11:01:29.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.515+0000 7fbe8affd700 1 -- 172.21.15.7:0/3992743056 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72999 (secure 0 0 0) 0x7fbe940cf070 con 0x7fbe74066f30 2023-10-06T11:01:29.518 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:29.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.518+0000 7fbe9985f700 1 -- 172.21.15.7:0/3992743056 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbe74066f30 msgr2=0x7fbe740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:29.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.518+0000 7fbe9985f700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbe74066f30 0x7fbe740693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009d40 tx=0x7fbe84008040 comp rx=0 tx=0).stop 2023-10-06T11:01:29.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.518+0000 7fbe9985f700 1 -- 172.21.15.7:0/3992743056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe940cfb50 msgr2=0x7fbe9415bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:29.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.518+0000 7fbe9985f700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe940cfb50 0x7fbe9415bef0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fbe9406fad0 tx=0x7fbe8c018000 comp rx=0 tx=0).stop 2023-10-06T11:01:29.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.518+0000 7fbe9985f700 1 -- 172.21.15.7:0/3992743056 shutdown_connections 2023-10-06T11:01:29.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.518+0000 7fbe9985f700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbe74066f30 0x7fbe740693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.518+0000 7fbe9985f700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe940cfb50 0x7fbe9415bef0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.518+0000 7fbe9985f700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe940af320 0x7fbe940b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.518+0000 7fbe9985f700 1 --2- 172.21.15.7:0/3992743056 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe940cb580 0x7fbe940b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.518+0000 7fbe9985f700 1 -- 172.21.15.7:0/3992743056 >> 172.21.15.7:0/3992743056 conn(0x7fbe94067b80 msgr2=0x7fbe940cdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:29.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.518+0000 7fbe9985f700 1 -- 172.21.15.7:0/3992743056 shutdown_connections 2023-10-06T11:01:29.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.518+0000 7fbe9985f700 1 -- 172.21.15.7:0/3992743056 wait complete. 2023-10-06T11:01:29.521 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-06T11:01:29.532 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2023-10-06T11:01:28.005102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384928,"kb_used_data":6624,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589792,"statfs":{"total":773094113280,"available":770651947008,"internally_reserved":0,"allocated":6782976,"data_stored":3806270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14580,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001564"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.596014+0000","last_change":"2023-10-06T10:58:56.328381+0000","last_active":"2023-10-06T11:01:04.596014+0000","last_peered":"2023-10-06T11:01:04.596014+0000","last_clean":"2023-10-06T11:01:04.596014+0000","last_became_active":"2023-10-06T10:58:56.328054+0000","last_became_peered":"2023-10-06T10:58:56.328054+0000","last_unstale":"2023-10-06T11:01:04.596014+0000","last_undegraded":"2023-10-06T11:01:04.596014+0000","last_fullsized":"2023-10-06T11:01:04.596014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.599650+0000","last_change":"2023-10-06T10:58:56.326189+0000","last_active":"2023-10-06T11:01:04.599650+0000","last_peered":"2023-10-06T11:01:04.599650+0000","last_clean":"2023-10-06T11:01:04.599650+0000","last_became_active":"2023-10-06T10:58:56.325852+0000","last_became_peered":"2023-10-06T10:58:56.325852+0000","last_unstale":"2023-10-06T11:01:04.599650+0000","last_undegraded":"2023-10-06T11:01:04.599650+0000","last_fullsized":"2023-10-06T11:01:04.599650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:28.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":51,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:05.591944+0000","last_change":"2023-10-06T10:58:56.325363+0000","last_active":"2023-10-06T11:01:05.591944+0000","last_peered":"2023-10-06T11:01:05.591944+0000","last_clean":"2023-10-06T11:01:05.591944+0000","last_became_active":"2023-10-06T10:58:56.325095+0000","last_became_peered":"2023-10-06T10:58:56.325095+0000","last_unstale":"2023-10-06T11:01:05.591944+0000","last_undegraded":"2023-10-06T11:01:05.591944+0000","last_fullsized":"2023-10-06T11:01:05.591944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":194,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:06.568585+0000","last_change":"2023-10-06T10:58:57.328525+0000","last_active":"2023-10-06T11:01:06.568585+0000","last_peered":"2023-10-06T11:01:06.568585+0000","last_clean":"2023-10-06T11:01:06.568585+0000","last_became_active":"2023-10-06T10:58:57.327509+0000","last_became_peered":"2023-10-06T10:58:57.327509+0000","last_unstale":"2023-10-06T11:01:06.568585+0000","last_undegraded":"2023-10-06T11:01:06.568585+0000","last_fullsized":"2023-10-06T11:01:06.568585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_clean_scrub_stamp":"2023-10-06T10:58:56.314996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:45.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:06.569229+0000","last_change":"2023-10-06T10:58:56.331567+0000","last_active":"2023-10-06T11:01:06.569229+0000","last_peered":"2023-10-06T11:01:06.569229+0000","last_clean":"2023-10-06T11:01:06.569229+0000","last_became_active":"2023-10-06T10:58:56.331244+0000","last_became_peered":"2023-10-06T10:58:56.331244+0000","last_unstale":"2023-10-06T11:01:06.569229+0000","last_undegraded":"2023-10-06T11:01:06.569229+0000","last_fullsized":"2023-10-06T11:01:06.569229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:06.568698+0000","last_change":"2023-10-06T10:58:56.332184+0000","last_active":"2023-10-06T11:01:06.568698+0000","last_peered":"2023-10-06T11:01:06.568698+0000","last_clean":"2023-10-06T11:01:06.568698+0000","last_became_active":"2023-10-06T10:58:56.331830+0000","last_became_peered":"2023-10-06T10:58:56.331830+0000","last_unstale":"2023-10-06T11:01:06.568698+0000","last_undegraded":"2023-10-06T11:01:06.568698+0000","last_fullsized":"2023-10-06T11:01:06.568698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:54:02.320834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.597610+0000","last_change":"2023-10-06T10:58:56.331654+0000","last_active":"2023-10-06T11:01:04.597610+0000","last_peered":"2023-10-06T11:01:04.597610+0000","last_clean":"2023-10-06T11:01:04.597610+0000","last_became_active":"2023-10-06T10:58:56.331345+0000","last_became_peered":"2023-10-06T10:58:56.331345+0000","last_unstale":"2023-10-06T11:01:04.597610+0000","last_undegraded":"2023-10-06T11:01:04.597610+0000","last_fullsized":"2023-10-06T11:01:04.597610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:07.070474+0000","last_change":"2023-10-06T10:58:56.331650+0000","last_active":"2023-10-06T11:01:07.070474+0000","last_peered":"2023-10-06T11:01:07.070474+0000","last_clean":"2023-10-06T11:01:07.070474+0000","last_became_active":"2023-10-06T10:58:56.331344+0000","last_became_peered":"2023-10-06T10:58:56.331344+0000","last_unstale":"2023-10-06T11:01:07.070474+0000","last_undegraded":"2023-10-06T11:01:07.070474+0000","last_fullsized":"2023-10-06T11:01:07.070474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:45.584545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:07.070475+0000","last_change":"2023-10-06T10:58:56.326315+0000","last_active":"2023-10-06T11:01:07.070475+0000","last_peered":"2023-10-06T11:01:07.070475+0000","last_clean":"2023-10-06T11:01:07.070475+0000","last_became_active":"2023-10-06T10:58:56.325897+0000","last_became_peered":"2023-10-06T10:58:56.325897+0000","last_unstale":"2023-10-06T11:01:07.070475+0000","last_undegraded":"2023-10-06T11:01:07.070475+0000","last_fullsized":"2023-10-06T11:01:07.070475+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298564,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073276,"statfs":{"total":96636764160,"available":96331034624,"internally_reserved":0,"allocated":1306624,"data_stored":918995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.46000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77800000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66900000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.502},{"interface":"front","average":{"1min":0.622,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.47199999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.628},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.69699999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.66400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":696320,"data_stored":326935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79200000000000004,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.62},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.621,"15min":0.61599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.40999999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":1.036,"15min":1.036},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.72299999999999998,"5min":1.274,"15min":1.274},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.40500000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77700000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86799999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.505},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.249,"15min":0.249},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.36399999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84799999999999998,"5min":0.873,"15min":0.873},"last":0.40600000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82299999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.37},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.49099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83299999999999996,"5min":1.006,"15min":1.006},"last":0.44600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298588,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073252,"statfs":{"total":96636764160,"available":96331010048,"internally_reserved":0,"allocated":1331200,"data_stored":934904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.379,"15min":0.38100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56000000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.34300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.40799999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44,"15min":0.441},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.28299999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64700000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.438,"15min":0.438},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.35199999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93100000000000005,"5min":1.123,"15min":1.123},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69599999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70599999999999996,"15min":0.70999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297952,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073888,"statfs":{"total":96636764160,"available":96331661312,"internally_reserved":0,"allocated":679936,"data_stored":320159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.40699999999999997,"15min":0.41499999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.66600000000000004,"5min":0.746,"15min":0.746},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44,"15min":0.438},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46000000000000002,"15min":0.45300000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.317},{"interface":"front","average":{"1min":0.5,"5min":0.61899999999999999,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.746,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79200000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89500000000000002,"5min":1.002,"15min":1.002},"last":0.47899999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68400000000000005,"15min":0.68899999999999995},"min":{"1min":0.51400000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.85499999999999998,"5min":1.022,"15min":1.022},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0069999999999999,"5min":1.238,"15min":1.238},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0549999999999999,"5min":2.9540000000000002,"15min":2.9540000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71899999999999997,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83299999999999996,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92400000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94799999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.45600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":696320,"data_stored":327879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.379},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63800000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.311},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.432,"15min":0.435},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46000000000000002,"15min":0.46100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40400000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.66600000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.496},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.374,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.036},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0780000000000001,"5min":1.107,"15min":1.107},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.47399999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.498,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86599999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.52100000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.65500000000000003,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.2130000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.58399999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98299999999999998,"5min":1.232,"15min":1.232},"last":0.625},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.57699999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.60299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297952,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073888,"statfs":{"total":96636764160,"available":96331661312,"internally_reserved":0,"allocated":679936,"data_stored":320159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52600000000000002,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.54700000000000004,"15min":0.57399999999999995},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57199999999999995,"5min":4.617,"15min":4.617},"last":0.29399999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52700000000000002,"15min":0.54700000000000004},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70699999999999996,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.51800000000000002,"15min":0.53100000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.59799999999999998,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.68899999999999995,"15min":0.72499999999999998},"min":{"1min":0.36499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.61299999999999999,"5min":6.4400000000000004,"15min":6.4400000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.72199999999999998,"15min":0.75800000000000001},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66900000000000004,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.74299999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.83699999999999997,"15min":0.86799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92500000000000004,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.59199999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90900000000000003,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.57799999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.81499999999999995,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.016,"5min":4.4470000000000001,"15min":4.4470000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73499999999999999,"15min":0.748},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85899999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.70599999999999996,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88400000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.87,"15min":0.89400000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95899999999999996,"5min":4.4130000000000003,"15min":4.4130000000000003},"last":0.495}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":337058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88200000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.748,"5min":5.476,"15min":5.476},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.44900000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.495}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88100000000000001,"5min":1.978,"15min":1.978},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.58499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":320181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.42799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76700000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66700000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78200000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.503}]},{"osd":3,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78300000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.65700000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.745},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77100000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.629,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63300000000000001,"15min":0.64000000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.629},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67000000000000004,"15min":0.68000000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.73899999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:01:29.535 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:01:29.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.667+0000 7fd1345df700 1 Processor -- start 2023-10-06T11:01:29.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.667+0000 7fd1345df700 1 -- start start 2023-10-06T11:01:29.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd1345df700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd12c0abdb0 0x7fd12c0ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:29.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd1345df700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd12c0ac180 0x7fd12c156a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:29.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd1345df700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd12c15b830 0x7fd12c156f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:29.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd1345df700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12c0cdc30 con 0x7fd12c0abdb0 2023-10-06T11:01:29.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd1345df700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12c068d60 con 0x7fd12c15b830 2023-10-06T11:01:29.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd1345df700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c0cd390 con 0x7fd12c0ac180 2023-10-06T11:01:29.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd13237b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd12c0abdb0 0x7fd12c0ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:29.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd13237b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd12c0abdb0 0x7fd12c0ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40032/0 (socket says 172.21.15.7:40032) 2023-10-06T11:01:29.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd13237b700 1 -- 172.21.15.7:0/2066952601 learned_addr learned my addr 172.21.15.7:0/2066952601 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:29.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd131b7a700 1 --2- 172.21.15.7:0/2066952601 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd12c0ac180 0x7fd12c156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:29.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd132b7c700 1 --2- 172.21.15.7:0/2066952601 >> v2:172.21.15.50:3300/0 conn(0x7fd12c15b830 0x7fd12c156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:29.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd13237b700 1 -- 172.21.15.7:0/2066952601 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd12c0ac180 msgr2=0x7fd12c156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:29.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd13237b700 1 --2- 172.21.15.7:0/2066952601 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd12c0ac180 0x7fd12c156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd13237b700 1 -- 172.21.15.7:0/2066952601 >> v2:172.21.15.50:3300/0 conn(0x7fd12c15b830 msgr2=0x7fd12c156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:29.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd13237b700 1 --2- 172.21.15.7:0/2066952601 >> v2:172.21.15.50:3300/0 conn(0x7fd12c15b830 0x7fd12c156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd13237b700 1 -- 172.21.15.7:0/2066952601 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c0cd670 con 0x7fd12c0abdb0 2023-10-06T11:01:29.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.668+0000 7fd132b7c700 1 --2- 172.21.15.7:0/2066952601 >> v2:172.21.15.50:3300/0 conn(0x7fd12c15b830 0x7fd12c156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:29.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.669+0000 7fd13237b700 1 --2- 172.21.15.7:0/2066952601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd12c0abdb0 0x7fd12c0ccb60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd12c06dbb0 tx=0x7fd128009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa746b36d8a0008 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:29.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.669+0000 7fd131379700 1 -- 172.21.15.7:0/2066952601 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128009e70 con 0x7fd12c0abdb0 2023-10-06T11:01:29.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.669+0000 7fd131379700 1 -- 172.21.15.7:0/2066952601 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12800b860 con 0x7fd12c0abdb0 2023-10-06T11:01:29.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.669+0000 7fd131379700 1 -- 172.21.15.7:0/2066952601 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12800bc00 con 0x7fd12c0abdb0 2023-10-06T11:01:29.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.669+0000 7fd1345df700 1 -- 172.21.15.7:0/2066952601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd12c0abdb0 msgr2=0x7fd12c0ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.669+0000 7fd1345df700 1 --2- 172.21.15.7:0/2066952601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd12c0abdb0 0x7fd12c0ccb60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd12c06dbb0 tx=0x7fd128009250 comp rx=0 tx=0).stop 2023-10-06T11:01:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.669+0000 7fd1345df700 1 -- 172.21.15.7:0/2066952601 shutdown_connections 2023-10-06T11:01:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.669+0000 7fd1345df700 1 --2- 172.21.15.7:0/2066952601 >> v2:172.21.15.50:3300/0 conn(0x7fd12c15b830 0x7fd12c156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.669+0000 7fd1345df700 1 --2- 172.21.15.7:0/2066952601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd12c0abdb0 0x7fd12c0ccb60 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.669+0000 7fd1345df700 1 --2- 172.21.15.7:0/2066952601 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd12c0ac180 0x7fd12c156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.669+0000 7fd1345df700 1 -- 172.21.15.7:0/2066952601 >> 172.21.15.7:0/2066952601 conn(0x7fd12c096160 msgr2=0x7fd12c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.669+0000 7fd1345df700 1 -- 172.21.15.7:0/2066952601 shutdown_connections 2023-10-06T11:01:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.669+0000 7fd1345df700 1 -- 172.21.15.7:0/2066952601 wait complete. 2023-10-06T11:01:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.671+0000 7fd1345df700 1 Processor -- start 2023-10-06T11:01:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.671+0000 7fd1345df700 1 -- start start 2023-10-06T11:01:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.671+0000 7fd1345df700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd12c0abdb0 0x7fd12c16ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.671+0000 7fd1345df700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd12c0ac180 0x7fd12c149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.671+0000 7fd1345df700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd12c15b830 0x7fd12c0aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd1345df700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c0a9e60 con 0x7fd12c0abdb0 2023-10-06T11:01:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd1345df700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c16d4c0 con 0x7fd12c0ac180 2023-10-06T11:01:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd1345df700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c16d7a0 con 0x7fd12c15b830 2023-10-06T11:01:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd13237b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd12c0abdb0 0x7fd12c16ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd13237b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd12c0abdb0 0x7fd12c16ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40048/0 (socket says 172.21.15.7:40048) 2023-10-06T11:01:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd13237b700 1 -- 172.21.15.7:0/1516954814 learned_addr learned my addr 172.21.15.7:0/1516954814 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd131b7a700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd12c0ac180 0x7fd12c149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd132b7c700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd12c15b830 0x7fd12c0aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd13237b700 1 -- 172.21.15.7:0/1516954814 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd12c15b830 msgr2=0x7fd12c0aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:29.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd13237b700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd12c15b830 0x7fd12c0aa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd13237b700 1 -- 172.21.15.7:0/1516954814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd12c0ac180 msgr2=0x7fd12c149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:29.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd13237b700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd12c0ac180 0x7fd12c149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd13237b700 1 -- 172.21.15.7:0/1516954814 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1280094f0 con 0x7fd12c0abdb0 2023-10-06T11:01:29.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd132b7c700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd12c15b830 0x7fd12c0aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:29.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd13237b700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd12c0abdb0 0x7fd12c16ca70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd128009290 tx=0x7fd128017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:29.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd1227fc700 1 -- 172.21.15.7:0/1516954814 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128000d10 con 0x7fd12c0abdb0 2023-10-06T11:01:29.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd1227fc700 1 -- 172.21.15.7:0/1516954814 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12800bbe0 con 0x7fd12c0abdb0 2023-10-06T11:01:29.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd1345df700 1 -- 172.21.15.7:0/1516954814 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12c0a9af0 con 0x7fd12c0abdb0 2023-10-06T11:01:29.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd1227fc700 1 -- 172.21.15.7:0/1516954814 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12801a680 con 0x7fd12c0abdb0 2023-10-06T11:01:29.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.672+0000 7fd1345df700 1 -- 172.21.15.7:0/1516954814 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12c1478e0 con 0x7fd12c0abdb0 2023-10-06T11:01:29.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.673+0000 7fd1345df700 1 -- 172.21.15.7:0/1516954814 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12c0a9950 con 0x7fd12c0abdb0 2023-10-06T11:01:29.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.674+0000 7fd1227fc700 1 -- 172.21.15.7:0/1516954814 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd12801aa30 con 0x7fd12c0abdb0 2023-10-06T11:01:29.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.674+0000 7fd1227fc700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd110066f30 0x7fd1100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:29.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.674+0000 7fd1227fc700 1 -- 172.21.15.7:0/1516954814 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fd128085770 con 0x7fd12c0abdb0 2023-10-06T11:01:29.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.674+0000 7fd131b7a700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd110066f30 0x7fd1100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:29.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.675+0000 7fd131b7a700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd110066f30 0x7fd1100693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd12c156670 tx=0x7fd11c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:29.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.679+0000 7fd1227fc700 1 -- 172.21.15.7:0/1516954814 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd12c0a9950 con 0x7fd12c0abdb0 2023-10-06T11:01:29.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.875+0000 7fd1345df700 1 -- 172.21.15.7:0/1516954814 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd12c0a9fa0 con 0x7fd110066f30 2023-10-06T11:01:29.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.878+0000 7fd1227fc700 1 -- 172.21.15.7:0/1516954814 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72999 (secure 0 0 0) 0x7fd11c011a50 con 0x7fd110066f30 2023-10-06T11:01:29.880 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:29.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.880+0000 7fd1345df700 1 -- 172.21.15.7:0/1516954814 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd110066f30 msgr2=0x7fd1100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:29.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.880+0000 7fd1345df700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd110066f30 0x7fd1100693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd12c156670 tx=0x7fd11c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.880+0000 7fd1345df700 1 -- 172.21.15.7:0/1516954814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd12c0abdb0 msgr2=0x7fd12c16ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:29.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.880+0000 7fd1345df700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd12c0abdb0 0x7fd12c16ca70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd128009290 tx=0x7fd128017000 comp rx=0 tx=0).stop 2023-10-06T11:01:29.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.880+0000 7fd1345df700 1 -- 172.21.15.7:0/1516954814 shutdown_connections 2023-10-06T11:01:29.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.880+0000 7fd1345df700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd110066f30 0x7fd1100693e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.880+0000 7fd1345df700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd12c0abdb0 0x7fd12c16ca70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.880+0000 7fd1345df700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd12c15b830 0x7fd12c0aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.880+0000 7fd1345df700 1 --2- 172.21.15.7:0/1516954814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd12c0ac180 0x7fd12c149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:29.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.880+0000 7fd1345df700 1 -- 172.21.15.7:0/1516954814 >> 172.21.15.7:0/1516954814 conn(0x7fd12c096160 msgr2=0x7fd12c0aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:29.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.880+0000 7fd1345df700 1 -- 172.21.15.7:0/1516954814 shutdown_connections 2023-10-06T11:01:29.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:29.880+0000 7fd1345df700 1 -- 172.21.15.7:0/1516954814 wait complete. 2023-10-06T11:01:29.883 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-06T11:01:29.894 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2023-10-06T11:01:28.005102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384928,"kb_used_data":6624,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589792,"statfs":{"total":773094113280,"available":770651947008,"internally_reserved":0,"allocated":6782976,"data_stored":3806270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14580,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001564"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.596014+0000","last_change":"2023-10-06T10:58:56.328381+0000","last_active":"2023-10-06T11:01:04.596014+0000","last_peered":"2023-10-06T11:01:04.596014+0000","last_clean":"2023-10-06T11:01:04.596014+0000","last_became_active":"2023-10-06T10:58:56.328054+0000","last_became_peered":"2023-10-06T10:58:56.328054+0000","last_unstale":"2023-10-06T11:01:04.596014+0000","last_undegraded":"2023-10-06T11:01:04.596014+0000","last_fullsized":"2023-10-06T11:01:04.596014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.599650+0000","last_change":"2023-10-06T10:58:56.326189+0000","last_active":"2023-10-06T11:01:04.599650+0000","last_peered":"2023-10-06T11:01:04.599650+0000","last_clean":"2023-10-06T11:01:04.599650+0000","last_became_active":"2023-10-06T10:58:56.325852+0000","last_became_peered":"2023-10-06T10:58:56.325852+0000","last_unstale":"2023-10-06T11:01:04.599650+0000","last_undegraded":"2023-10-06T11:01:04.599650+0000","last_fullsized":"2023-10-06T11:01:04.599650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:28.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":51,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:05.591944+0000","last_change":"2023-10-06T10:58:56.325363+0000","last_active":"2023-10-06T11:01:05.591944+0000","last_peered":"2023-10-06T11:01:05.591944+0000","last_clean":"2023-10-06T11:01:05.591944+0000","last_became_active":"2023-10-06T10:58:56.325095+0000","last_became_peered":"2023-10-06T10:58:56.325095+0000","last_unstale":"2023-10-06T11:01:05.591944+0000","last_undegraded":"2023-10-06T11:01:05.591944+0000","last_fullsized":"2023-10-06T11:01:05.591944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":194,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:06.568585+0000","last_change":"2023-10-06T10:58:57.328525+0000","last_active":"2023-10-06T11:01:06.568585+0000","last_peered":"2023-10-06T11:01:06.568585+0000","last_clean":"2023-10-06T11:01:06.568585+0000","last_became_active":"2023-10-06T10:58:57.327509+0000","last_became_peered":"2023-10-06T10:58:57.327509+0000","last_unstale":"2023-10-06T11:01:06.568585+0000","last_undegraded":"2023-10-06T11:01:06.568585+0000","last_fullsized":"2023-10-06T11:01:06.568585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_clean_scrub_stamp":"2023-10-06T10:58:56.314996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:45.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:06.569229+0000","last_change":"2023-10-06T10:58:56.331567+0000","last_active":"2023-10-06T11:01:06.569229+0000","last_peered":"2023-10-06T11:01:06.569229+0000","last_clean":"2023-10-06T11:01:06.569229+0000","last_became_active":"2023-10-06T10:58:56.331244+0000","last_became_peered":"2023-10-06T10:58:56.331244+0000","last_unstale":"2023-10-06T11:01:06.569229+0000","last_undegraded":"2023-10-06T11:01:06.569229+0000","last_fullsized":"2023-10-06T11:01:06.569229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:06.568698+0000","last_change":"2023-10-06T10:58:56.332184+0000","last_active":"2023-10-06T11:01:06.568698+0000","last_peered":"2023-10-06T11:01:06.568698+0000","last_clean":"2023-10-06T11:01:06.568698+0000","last_became_active":"2023-10-06T10:58:56.331830+0000","last_became_peered":"2023-10-06T10:58:56.331830+0000","last_unstale":"2023-10-06T11:01:06.568698+0000","last_undegraded":"2023-10-06T11:01:06.568698+0000","last_fullsized":"2023-10-06T11:01:06.568698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:54:02.320834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.597610+0000","last_change":"2023-10-06T10:58:56.331654+0000","last_active":"2023-10-06T11:01:04.597610+0000","last_peered":"2023-10-06T11:01:04.597610+0000","last_clean":"2023-10-06T11:01:04.597610+0000","last_became_active":"2023-10-06T10:58:56.331345+0000","last_became_peered":"2023-10-06T10:58:56.331345+0000","last_unstale":"2023-10-06T11:01:04.597610+0000","last_undegraded":"2023-10-06T11:01:04.597610+0000","last_fullsized":"2023-10-06T11:01:04.597610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:07.070474+0000","last_change":"2023-10-06T10:58:56.331650+0000","last_active":"2023-10-06T11:01:07.070474+0000","last_peered":"2023-10-06T11:01:07.070474+0000","last_clean":"2023-10-06T11:01:07.070474+0000","last_became_active":"2023-10-06T10:58:56.331344+0000","last_became_peered":"2023-10-06T10:58:56.331344+0000","last_unstale":"2023-10-06T11:01:07.070474+0000","last_undegraded":"2023-10-06T11:01:07.070474+0000","last_fullsized":"2023-10-06T11:01:07.070474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:45.584545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:07.070475+0000","last_change":"2023-10-06T10:58:56.326315+0000","last_active":"2023-10-06T11:01:07.070475+0000","last_peered":"2023-10-06T11:01:07.070475+0000","last_clean":"2023-10-06T11:01:07.070475+0000","last_became_active":"2023-10-06T10:58:56.325897+0000","last_became_peered":"2023-10-06T10:58:56.325897+0000","last_unstale":"2023-10-06T11:01:07.070475+0000","last_undegraded":"2023-10-06T11:01:07.070475+0000","last_fullsized":"2023-10-06T11:01:07.070475+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298564,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073276,"statfs":{"total":96636764160,"available":96331034624,"internally_reserved":0,"allocated":1306624,"data_stored":918995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.46000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77800000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66900000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.502},{"interface":"front","average":{"1min":0.622,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.47199999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.628},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.69699999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.66400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":696320,"data_stored":326935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79200000000000004,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.62},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.621,"15min":0.61599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.40999999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":1.036,"15min":1.036},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.72299999999999998,"5min":1.274,"15min":1.274},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.40500000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77700000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86799999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.505},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.249,"15min":0.249},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.36399999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84799999999999998,"5min":0.873,"15min":0.873},"last":0.40600000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82299999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.37},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.49099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83299999999999996,"5min":1.006,"15min":1.006},"last":0.44600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298588,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073252,"statfs":{"total":96636764160,"available":96331010048,"internally_reserved":0,"allocated":1331200,"data_stored":934904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.379,"15min":0.38100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56000000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.34300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.40799999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44,"15min":0.441},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.28299999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64700000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.438,"15min":0.438},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.35199999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93100000000000005,"5min":1.123,"15min":1.123},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69599999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70599999999999996,"15min":0.70999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297952,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073888,"statfs":{"total":96636764160,"available":96331661312,"internally_reserved":0,"allocated":679936,"data_stored":320159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.40699999999999997,"15min":0.41499999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.66600000000000004,"5min":0.746,"15min":0.746},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44,"15min":0.438},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46000000000000002,"15min":0.45300000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.317},{"interface":"front","average":{"1min":0.5,"5min":0.61899999999999999,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.746,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79200000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89500000000000002,"5min":1.002,"15min":1.002},"last":0.47899999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68400000000000005,"15min":0.68899999999999995},"min":{"1min":0.51400000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.85499999999999998,"5min":1.022,"15min":1.022},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0069999999999999,"5min":1.238,"15min":1.238},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0549999999999999,"5min":2.9540000000000002,"15min":2.9540000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71899999999999997,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83299999999999996,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92400000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94799999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.45600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":696320,"data_stored":327879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.379},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63800000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.311},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.432,"15min":0.435},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46000000000000002,"15min":0.46100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40400000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.66600000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.496},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.374,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.036},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0780000000000001,"5min":1.107,"15min":1.107},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.47399999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.498,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86599999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.52100000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.65500000000000003,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.2130000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.58399999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98299999999999998,"5min":1.232,"15min":1.232},"last":0.625},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.57699999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.60299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297952,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073888,"statfs":{"total":96636764160,"available":96331661312,"internally_reserved":0,"allocated":679936,"data_stored":320159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52600000000000002,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.54700000000000004,"15min":0.57399999999999995},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57199999999999995,"5min":4.617,"15min":4.617},"last":0.29399999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52700000000000002,"15min":0.54700000000000004},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70699999999999996,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.51800000000000002,"15min":0.53100000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.59799999999999998,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.68899999999999995,"15min":0.72499999999999998},"min":{"1min":0.36499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.61299999999999999,"5min":6.4400000000000004,"15min":6.4400000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.72199999999999998,"15min":0.75800000000000001},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66900000000000004,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.74299999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.83699999999999997,"15min":0.86799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92500000000000004,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.59199999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90900000000000003,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.57799999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.81499999999999995,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.016,"5min":4.4470000000000001,"15min":4.4470000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73499999999999999,"15min":0.748},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85899999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.70599999999999996,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88400000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.87,"15min":0.89400000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95899999999999996,"5min":4.4130000000000003,"15min":4.4130000000000003},"last":0.495}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":337058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88200000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.748,"5min":5.476,"15min":5.476},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.44900000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.495}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88100000000000001,"5min":1.978,"15min":1.978},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.58499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":320181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.42799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76700000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66700000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78200000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.503}]},{"osd":3,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78300000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.65700000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.745},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77100000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.629,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63300000000000001,"15min":0.64000000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.629},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67000000000000004,"15min":0.68000000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.73899999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:01:29.896 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T11:01:29.897 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:01:30.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.028+0000 7f832f93d700 1 Processor -- start 2023-10-06T11:01:30.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.028+0000 7f832f93d700 1 -- start start 2023-10-06T11:01:30.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832f93d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83280a69a0 0x7f83280aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:30.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832f93d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83280afb40 0x7f83280a6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:30.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832f93d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83280ac8d0 0x7f83280acd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:30.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832f93d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83280ad250 con 0x7f83280afb40 2023-10-06T11:01:30.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832f93d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83280aff90 con 0x7f83280ac8d0 2023-10-06T11:01:30.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832f93d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83280ad560 con 0x7f83280a69a0 2023-10-06T11:01:30.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832ced8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83280afb40 0x7f83280a6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:30.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832ced8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83280afb40 0x7f83280a6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40052/0 (socket says 172.21.15.7:40052) 2023-10-06T11:01:30.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832ced8700 1 -- 172.21.15.7:0/1178172998 learned_addr learned my addr 172.21.15.7:0/1178172998 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:30.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832d6d9700 1 --2- 172.21.15.7:0/1178172998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83280a69a0 0x7f83280aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:30.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832deda700 1 --2- 172.21.15.7:0/1178172998 >> v2:172.21.15.50:3300/0 conn(0x7f83280ac8d0 0x7f83280acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832ced8700 1 -- 172.21.15.7:0/1178172998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83280a69a0 msgr2=0x7f83280aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832ced8700 1 --2- 172.21.15.7:0/1178172998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83280a69a0 0x7f83280aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832ced8700 1 -- 172.21.15.7:0/1178172998 >> v2:172.21.15.50:3300/0 conn(0x7f83280ac8d0 msgr2=0x7f83280acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832ced8700 1 --2- 172.21.15.7:0/1178172998 >> v2:172.21.15.50:3300/0 conn(0x7f83280ac8d0 0x7f83280acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832ced8700 1 -- 172.21.15.7:0/1178172998 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83280b0240 con 0x7f83280afb40 2023-10-06T11:01:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.029+0000 7f832deda700 1 --2- 172.21.15.7:0/1178172998 >> v2:172.21.15.50:3300/0 conn(0x7f83280ac8d0 0x7f83280acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.030+0000 7f832ced8700 1 --2- 172.21.15.7:0/1178172998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280afb40 0x7f83280a6d70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f832806e8a0 tx=0x7f831c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8fd8c27d83f483 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.030+0000 7f831bfff700 1 -- 172.21.15.7:0/1178172998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00b860 con 0x7f83280afb40 2023-10-06T11:01:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.030+0000 7f831bfff700 1 -- 172.21.15.7:0/1178172998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c00b9c0 con 0x7f83280afb40 2023-10-06T11:01:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.030+0000 7f831bfff700 1 -- 172.21.15.7:0/1178172998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00bd60 con 0x7f83280afb40 2023-10-06T11:01:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.030+0000 7f832f93d700 1 -- 172.21.15.7:0/1178172998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280afb40 msgr2=0x7f83280a6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.030+0000 7f832f93d700 1 --2- 172.21.15.7:0/1178172998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280afb40 0x7f83280a6d70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f832806e8a0 tx=0x7f831c009250 comp rx=0 tx=0).stop 2023-10-06T11:01:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.030+0000 7f832f93d700 1 -- 172.21.15.7:0/1178172998 shutdown_connections 2023-10-06T11:01:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.030+0000 7f832f93d700 1 --2- 172.21.15.7:0/1178172998 >> v2:172.21.15.50:3300/0 conn(0x7f83280ac8d0 0x7f83280acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.030+0000 7f832f93d700 1 --2- 172.21.15.7:0/1178172998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83280a69a0 0x7f83280aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.030+0000 7f832f93d700 1 --2- 172.21.15.7:0/1178172998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280afb40 0x7f83280a6d70 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.030+0000 7f832f93d700 1 -- 172.21.15.7:0/1178172998 >> 172.21.15.7:0/1178172998 conn(0x7f8328095a70 msgr2=0x7f83280af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.031+0000 7f832f93d700 1 -- 172.21.15.7:0/1178172998 shutdown_connections 2023-10-06T11:01:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.031+0000 7f832f93d700 1 -- 172.21.15.7:0/1178172998 wait complete. 2023-10-06T11:01:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.032+0000 7f832f93d700 1 Processor -- start 2023-10-06T11:01:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.032+0000 7f832f93d700 1 -- start start 2023-10-06T11:01:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832f93d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83280a69a0 0x7f83280c2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832f93d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83280ac8d0 0x7f83280c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832f93d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280afb40 0x7f8328147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832f93d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83280c2320 con 0x7f83280afb40 2023-10-06T11:01:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832f93d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83280c2c70 con 0x7f83280ac8d0 2023-10-06T11:01:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832f93d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83280c2f50 con 0x7f83280a69a0 2023-10-06T11:01:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832deda700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280afb40 0x7f8328147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832deda700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280afb40 0x7f8328147a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40056/0 (socket says 172.21.15.7:40056) 2023-10-06T11:01:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832deda700 1 -- 172.21.15.7:0/3052000341 learned_addr learned my addr 172.21.15.7:0/3052000341 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832ced8700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83280ac8d0 0x7f83280c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832d6d9700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83280a69a0 0x7f83280c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832deda700 1 -- 172.21.15.7:0/3052000341 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83280a69a0 msgr2=0x7f83280c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832deda700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83280a69a0 0x7f83280c2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832deda700 1 -- 172.21.15.7:0/3052000341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83280ac8d0 msgr2=0x7f83280c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832deda700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83280ac8d0 0x7f83280c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832deda700 1 -- 172.21.15.7:0/3052000341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c0094f0 con 0x7f83280afb40 2023-10-06T11:01:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832d6d9700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83280a69a0 0x7f83280c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.033+0000 7f832ced8700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83280ac8d0 0x7f83280c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.034+0000 7f832deda700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280afb40 0x7f8328147a50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f832000d180 tx=0x7f8320009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.034+0000 7f83197fa700 1 -- 172.21.15.7:0/3052000341 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832000de20 con 0x7f83280afb40 2023-10-06T11:01:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.034+0000 7f83197fa700 1 -- 172.21.15.7:0/3052000341 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832000f040 con 0x7f83280afb40 2023-10-06T11:01:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.034+0000 7f832f93d700 1 -- 172.21.15.7:0/3052000341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83280c3230 con 0x7f83280afb40 2023-10-06T11:01:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.034+0000 7f83197fa700 1 -- 172.21.15.7:0/3052000341 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320015690 con 0x7f83280afb40 2023-10-06T11:01:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.034+0000 7f832f93d700 1 -- 172.21.15.7:0/3052000341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83280c37f0 con 0x7f83280afb40 2023-10-06T11:01:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.035+0000 7f832f93d700 1 -- 172.21.15.7:0/3052000341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83280c3a10 con 0x7f83280afb40 2023-10-06T11:01:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.035+0000 7f83197fa700 1 -- 172.21.15.7:0/3052000341 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f832001e3b0 con 0x7f83280afb40 2023-10-06T11:01:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.036+0000 7f83197fa700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f830c066f30 0x7f830c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.036+0000 7f83197fa700 1 -- 172.21.15.7:0/3052000341 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f8320084ae0 con 0x7f83280afb40 2023-10-06T11:01:30.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.036+0000 7f832d6d9700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f830c066f30 0x7f830c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:30.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.036+0000 7f832d6d9700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f830c066f30 0x7f830c0693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8324009900 tx=0x7f8324008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:30.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.040+0000 7f83197fa700 1 -- 172.21.15.7:0/3052000341 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8320051db0 con 0x7f83280afb40 2023-10-06T11:01:30.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.239+0000 7f832f93d700 1 -- 172.21.15.7:0/3052000341 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8328070480 con 0x7f830c066f30 2023-10-06T11:01:30.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.242+0000 7f83197fa700 1 -- 172.21.15.7:0/3052000341 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72999 (secure 0 0 0) 0x7f8328070480 con 0x7f830c066f30 2023-10-06T11:01:30.244 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:30.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.244+0000 7f832f93d700 1 -- 172.21.15.7:0/3052000341 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f830c066f30 msgr2=0x7f830c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:30.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.244+0000 7f832f93d700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f830c066f30 0x7f830c0693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8324009900 tx=0x7f8324008040 comp rx=0 tx=0).stop 2023-10-06T11:01:30.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.244+0000 7f832f93d700 1 -- 172.21.15.7:0/3052000341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280afb40 msgr2=0x7f8328147a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:30.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.244+0000 7f832f93d700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280afb40 0x7f8328147a50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f832000d180 tx=0x7f8320009a50 comp rx=0 tx=0).stop 2023-10-06T11:01:30.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.244+0000 7f832f93d700 1 -- 172.21.15.7:0/3052000341 shutdown_connections 2023-10-06T11:01:30.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.244+0000 7f832f93d700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f830c066f30 0x7f830c0693e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.244+0000 7f832f93d700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280afb40 0x7f8328147a50 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.244+0000 7f832f93d700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83280a69a0 0x7f83280c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.244+0000 7f832f93d700 1 --2- 172.21.15.7:0/3052000341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83280ac8d0 0x7f83280c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.244+0000 7f832f93d700 1 -- 172.21.15.7:0/3052000341 >> 172.21.15.7:0/3052000341 conn(0x7f8328095a70 msgr2=0x7f83280979a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:30.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.244+0000 7f832f93d700 1 -- 172.21.15.7:0/3052000341 shutdown_connections 2023-10-06T11:01:30.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.244+0000 7f832f93d700 1 -- 172.21.15.7:0/3052000341 wait complete. 2023-10-06T11:01:30.247 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-06T11:01:30.258 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2023-10-06T11:01:30.005376+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384928,"kb_used_data":6624,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589792,"statfs":{"total":773094113280,"available":770651947008,"internally_reserved":0,"allocated":6782976,"data_stored":3806270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14580,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001333"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.596014+0000","last_change":"2023-10-06T10:58:56.328381+0000","last_active":"2023-10-06T11:01:04.596014+0000","last_peered":"2023-10-06T11:01:04.596014+0000","last_clean":"2023-10-06T11:01:04.596014+0000","last_became_active":"2023-10-06T10:58:56.328054+0000","last_became_peered":"2023-10-06T10:58:56.328054+0000","last_unstale":"2023-10-06T11:01:04.596014+0000","last_undegraded":"2023-10-06T11:01:04.596014+0000","last_fullsized":"2023-10-06T11:01:04.596014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.599650+0000","last_change":"2023-10-06T10:58:56.326189+0000","last_active":"2023-10-06T11:01:04.599650+0000","last_peered":"2023-10-06T11:01:04.599650+0000","last_clean":"2023-10-06T11:01:04.599650+0000","last_became_active":"2023-10-06T10:58:56.325852+0000","last_became_peered":"2023-10-06T10:58:56.325852+0000","last_unstale":"2023-10-06T11:01:04.599650+0000","last_undegraded":"2023-10-06T11:01:04.599650+0000","last_fullsized":"2023-10-06T11:01:04.599650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:28.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":51,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:05.591944+0000","last_change":"2023-10-06T10:58:56.325363+0000","last_active":"2023-10-06T11:01:05.591944+0000","last_peered":"2023-10-06T11:01:05.591944+0000","last_clean":"2023-10-06T11:01:05.591944+0000","last_became_active":"2023-10-06T10:58:56.325095+0000","last_became_peered":"2023-10-06T10:58:56.325095+0000","last_unstale":"2023-10-06T11:01:05.591944+0000","last_undegraded":"2023-10-06T11:01:05.591944+0000","last_fullsized":"2023-10-06T11:01:05.591944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":194,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:06.568585+0000","last_change":"2023-10-06T10:58:57.328525+0000","last_active":"2023-10-06T11:01:06.568585+0000","last_peered":"2023-10-06T11:01:06.568585+0000","last_clean":"2023-10-06T11:01:06.568585+0000","last_became_active":"2023-10-06T10:58:57.327509+0000","last_became_peered":"2023-10-06T10:58:57.327509+0000","last_unstale":"2023-10-06T11:01:06.568585+0000","last_undegraded":"2023-10-06T11:01:06.568585+0000","last_fullsized":"2023-10-06T11:01:06.568585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_clean_scrub_stamp":"2023-10-06T10:58:56.314996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:45.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:06.569229+0000","last_change":"2023-10-06T10:58:56.331567+0000","last_active":"2023-10-06T11:01:06.569229+0000","last_peered":"2023-10-06T11:01:06.569229+0000","last_clean":"2023-10-06T11:01:06.569229+0000","last_became_active":"2023-10-06T10:58:56.331244+0000","last_became_peered":"2023-10-06T10:58:56.331244+0000","last_unstale":"2023-10-06T11:01:06.569229+0000","last_undegraded":"2023-10-06T11:01:06.569229+0000","last_fullsized":"2023-10-06T11:01:06.569229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:06.568698+0000","last_change":"2023-10-06T10:58:56.332184+0000","last_active":"2023-10-06T11:01:06.568698+0000","last_peered":"2023-10-06T11:01:06.568698+0000","last_clean":"2023-10-06T11:01:06.568698+0000","last_became_active":"2023-10-06T10:58:56.331830+0000","last_became_peered":"2023-10-06T10:58:56.331830+0000","last_unstale":"2023-10-06T11:01:06.568698+0000","last_undegraded":"2023-10-06T11:01:06.568698+0000","last_fullsized":"2023-10-06T11:01:06.568698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:54:02.320834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:01:04.597610+0000","last_change":"2023-10-06T10:58:56.331654+0000","last_active":"2023-10-06T11:01:04.597610+0000","last_peered":"2023-10-06T11:01:04.597610+0000","last_clean":"2023-10-06T11:01:04.597610+0000","last_became_active":"2023-10-06T10:58:56.331345+0000","last_became_peered":"2023-10-06T10:58:56.331345+0000","last_unstale":"2023-10-06T11:01:04.597610+0000","last_undegraded":"2023-10-06T11:01:04.597610+0000","last_fullsized":"2023-10-06T11:01:04.597610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:34.808999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:07.070474+0000","last_change":"2023-10-06T10:58:56.331650+0000","last_active":"2023-10-06T11:01:07.070474+0000","last_peered":"2023-10-06T11:01:07.070474+0000","last_clean":"2023-10-06T11:01:07.070474+0000","last_became_active":"2023-10-06T10:58:56.331344+0000","last_became_peered":"2023-10-06T10:58:56.331344+0000","last_unstale":"2023-10-06T11:01:07.070474+0000","last_undegraded":"2023-10-06T11:01:07.070474+0000","last_fullsized":"2023-10-06T11:01:07.070474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:45.584545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:01:07.070475+0000","last_change":"2023-10-06T10:58:56.326315+0000","last_active":"2023-10-06T11:01:07.070475+0000","last_peered":"2023-10-06T11:01:07.070475+0000","last_clean":"2023-10-06T11:01:07.070475+0000","last_became_active":"2023-10-06T10:58:56.325897+0000","last_became_peered":"2023-10-06T10:58:56.325897+0000","last_unstale":"2023-10-06T11:01:07.070475+0000","last_undegraded":"2023-10-06T11:01:07.070475+0000","last_fullsized":"2023-10-06T11:01:07.070475+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298564,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073276,"statfs":{"total":96636764160,"available":96331034624,"internally_reserved":0,"allocated":1306624,"data_stored":918995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.46000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77800000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66900000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.502},{"interface":"front","average":{"1min":0.622,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.47199999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.628},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.69699999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.66400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":696320,"data_stored":326935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79200000000000004,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.62},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.621,"15min":0.61599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.40999999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":1.036,"15min":1.036},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.72299999999999998,"5min":1.274,"15min":1.274},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.40500000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77700000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86799999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.505},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.249,"15min":0.249},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.36399999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84799999999999998,"5min":0.873,"15min":0.873},"last":0.40600000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82299999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.37},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.49099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83299999999999996,"5min":1.006,"15min":1.006},"last":0.44600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298588,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073252,"statfs":{"total":96636764160,"available":96331010048,"internally_reserved":0,"allocated":1331200,"data_stored":934904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.379,"15min":0.38100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56000000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.34300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.40799999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44,"15min":0.441},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.28299999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64700000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.438,"15min":0.438},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.35199999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93100000000000005,"5min":1.123,"15min":1.123},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69599999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70599999999999996,"15min":0.70999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297952,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073888,"statfs":{"total":96636764160,"available":96331661312,"internally_reserved":0,"allocated":679936,"data_stored":320159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.40699999999999997,"15min":0.41499999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.66600000000000004,"5min":0.746,"15min":0.746},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44,"15min":0.438},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46000000000000002,"15min":0.45300000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.317},{"interface":"front","average":{"1min":0.5,"5min":0.61899999999999999,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.746,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79200000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89500000000000002,"5min":1.002,"15min":1.002},"last":0.47899999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68400000000000005,"15min":0.68899999999999995},"min":{"1min":0.51400000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.85499999999999998,"5min":1.022,"15min":1.022},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0069999999999999,"5min":1.238,"15min":1.238},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0549999999999999,"5min":2.9540000000000002,"15min":2.9540000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71899999999999997,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83299999999999996,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92400000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94799999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.45600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":696320,"data_stored":327879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.379},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63800000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.311},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.432,"15min":0.435},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46000000000000002,"15min":0.46100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40400000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.66600000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.496},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.374,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.036},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0780000000000001,"5min":1.107,"15min":1.107},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.47399999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.498,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86599999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.52100000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.65500000000000003,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.2130000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.58399999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98299999999999998,"5min":1.232,"15min":1.232},"last":0.625},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.57699999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.60299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297952,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073888,"statfs":{"total":96636764160,"available":96331661312,"internally_reserved":0,"allocated":679936,"data_stored":320159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52600000000000002,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.54700000000000004,"15min":0.57399999999999995},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57199999999999995,"5min":4.617,"15min":4.617},"last":0.29399999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52700000000000002,"15min":0.54700000000000004},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70699999999999996,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.51800000000000002,"15min":0.53100000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.59799999999999998,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.68899999999999995,"15min":0.72499999999999998},"min":{"1min":0.36499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.61299999999999999,"5min":6.4400000000000004,"15min":6.4400000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.72199999999999998,"15min":0.75800000000000001},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66900000000000004,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.74299999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.83699999999999997,"15min":0.86799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92500000000000004,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.59199999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90900000000000003,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.57799999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.81499999999999995,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.016,"5min":4.4470000000000001,"15min":4.4470000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73499999999999999,"15min":0.748},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85899999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.70599999999999996,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88400000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.87,"15min":0.89400000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95899999999999996,"5min":4.4130000000000003,"15min":4.4130000000000003},"last":0.495}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":337058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88200000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.748,"5min":5.476,"15min":5.476},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.44900000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.495}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88100000000000001,"5min":1.978,"15min":1.978},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.58499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":320181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.42799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76700000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66700000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78200000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.503}]},{"osd":3,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78300000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.65700000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.745},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77100000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.629,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63300000000000001,"15min":0.64000000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.629},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67000000000000004,"15min":0.68000000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.73899999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:01:30.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:01:30.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.391+0000 7f3e7f737700 1 Processor -- start 2023-10-06T11:01:30.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.391+0000 7f3e7f737700 1 -- start start 2023-10-06T11:01:30.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.392+0000 7f3e7f737700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3e78158120 0x7f3e780c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:30.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.392+0000 7f3e7f737700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e780c8ba0 0x7f3e780ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:30.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.392+0000 7f3e7f737700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e780cac60 0x7f3e7815ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:30.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.392+0000 7f3e7f737700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e780cbd10 con 0x7f3e78158120 2023-10-06T11:01:30.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.392+0000 7f3e7f737700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e780cb9e0 con 0x7f3e780c8ba0 2023-10-06T11:01:30.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.392+0000 7f3e7f737700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780c9300 con 0x7f3e780cac60 2023-10-06T11:01:30.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.392+0000 7f3e7d4d3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3e78158120 0x7f3e780c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:30.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.392+0000 7f3e7d4d3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3e78158120 0x7f3e780c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59758/0 (socket says 172.21.15.7:59758) 2023-10-06T11:01:30.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.392+0000 7f3e7d4d3700 1 -- 172.21.15.7:0/981288791 learned_addr learned my addr 172.21.15.7:0/981288791 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:30.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.392+0000 7f3e7ccd2700 1 --2- 172.21.15.7:0/981288791 >> v2:172.21.15.50:3300/0 conn(0x7f3e780c8ba0 0x7f3e780ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:30.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.393+0000 7f3e7dcd4700 1 --2- 172.21.15.7:0/981288791 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e780cac60 0x7f3e7815ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:30.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.393+0000 7f3e7d4d3700 1 -- 172.21.15.7:0/981288791 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e780cac60 msgr2=0x7f3e7815ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:30.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.393+0000 7f3e7d4d3700 1 --2- 172.21.15.7:0/981288791 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e780cac60 0x7f3e7815ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.393+0000 7f3e7d4d3700 1 -- 172.21.15.7:0/981288791 >> v2:172.21.15.50:3300/0 conn(0x7f3e780c8ba0 msgr2=0x7f3e780ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:30.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.393+0000 7f3e7d4d3700 1 --2- 172.21.15.7:0/981288791 >> v2:172.21.15.50:3300/0 conn(0x7f3e780c8ba0 0x7f3e780ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.393+0000 7f3e7d4d3700 1 -- 172.21.15.7:0/981288791 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e780c95e0 con 0x7f3e78158120 2023-10-06T11:01:30.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.393+0000 7f3e7ccd2700 1 --2- 172.21.15.7:0/981288791 >> v2:172.21.15.50:3300/0 conn(0x7f3e780c8ba0 0x7f3e780ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:30.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.393+0000 7f3e7d4d3700 1 --2- 172.21.15.7:0/981288791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e78158120 0x7f3e780c8660 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3e7806bf60 tx=0x7f3e74009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d09066a831eeff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:30.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.393+0000 7f3e6bfff700 1 -- 172.21.15.7:0/981288791 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e74005c10 con 0x7f3e78158120 2023-10-06T11:01:30.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.393+0000 7f3e6bfff700 1 -- 172.21.15.7:0/981288791 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e74005d70 con 0x7f3e78158120 2023-10-06T11:01:30.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.393+0000 7f3e6bfff700 1 -- 172.21.15.7:0/981288791 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7400b880 con 0x7f3e78158120 2023-10-06T11:01:30.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.394+0000 7f3e7f737700 1 -- 172.21.15.7:0/981288791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e78158120 msgr2=0x7f3e780c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:30.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.394+0000 7f3e7f737700 1 --2- 172.21.15.7:0/981288791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e78158120 0x7f3e780c8660 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3e7806bf60 tx=0x7f3e74009220 comp rx=0 tx=0).stop 2023-10-06T11:01:30.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.394+0000 7f3e7f737700 1 -- 172.21.15.7:0/981288791 shutdown_connections 2023-10-06T11:01:30.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.394+0000 7f3e7f737700 1 --2- 172.21.15.7:0/981288791 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e780cac60 0x7f3e7815ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.394+0000 7f3e7f737700 1 --2- 172.21.15.7:0/981288791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e78158120 0x7f3e780c8660 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.394+0000 7f3e7f737700 1 --2- 172.21.15.7:0/981288791 >> v2:172.21.15.50:3300/0 conn(0x7f3e780c8ba0 0x7f3e780ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.394+0000 7f3e7f737700 1 -- 172.21.15.7:0/981288791 >> 172.21.15.7:0/981288791 conn(0x7f3e78087920 msgr2=0x7f3e78097220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:30.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.394+0000 7f3e7f737700 1 -- 172.21.15.7:0/981288791 shutdown_connections 2023-10-06T11:01:30.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.394+0000 7f3e7f737700 1 -- 172.21.15.7:0/981288791 wait complete. 2023-10-06T11:01:30.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.395+0000 7f3e7f737700 1 Processor -- start 2023-10-06T11:01:30.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.395+0000 7f3e7f737700 1 -- start start 2023-10-06T11:01:30.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.396+0000 7f3e7f737700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e780c8ba0 0x7f3e78069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:30.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.396+0000 7f3e7f737700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e780cac60 0x7f3e78156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:30.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.396+0000 7f3e7f737700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e78158120 0x7f3e7814df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:30.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.396+0000 7f3e7f737700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78069820 con 0x7f3e78158120 2023-10-06T11:01:30.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.396+0000 7f3e7f737700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7806a1f0 con 0x7f3e780cac60 2023-10-06T11:01:30.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.396+0000 7f3e7f737700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78068c10 con 0x7f3e780c8ba0 2023-10-06T11:01:30.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.396+0000 7f3e7dcd4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e78158120 0x7f3e7814df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:30.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.396+0000 7f3e7dcd4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e78158120 0x7f3e7814df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59764/0 (socket says 172.21.15.7:59764) 2023-10-06T11:01:30.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.396+0000 7f3e7dcd4700 1 -- 172.21.15.7:0/1146490839 learned_addr learned my addr 172.21.15.7:0/1146490839 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:30.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.396+0000 7f3e7d4d3700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e780c8ba0 0x7f3e78069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:30.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.396+0000 7f3e7ccd2700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e780cac60 0x7f3e78156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:30.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.397+0000 7f3e7dcd4700 1 -- 172.21.15.7:0/1146490839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e780c8ba0 msgr2=0x7f3e78069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:30.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.397+0000 7f3e7dcd4700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e780c8ba0 0x7f3e78069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.397+0000 7f3e7dcd4700 1 -- 172.21.15.7:0/1146490839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e780cac60 msgr2=0x7f3e78156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:30.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.397+0000 7f3e7dcd4700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e780cac60 0x7f3e78156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.397+0000 7f3e7dcd4700 1 -- 172.21.15.7:0/1146490839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e74009480 con 0x7f3e78158120 2023-10-06T11:01:30.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.397+0000 7f3e7ccd2700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e780cac60 0x7f3e78156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:30.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.397+0000 7f3e7d4d3700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e780c8ba0 0x7f3e78069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.397+0000 7f3e7dcd4700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e78158120 0x7f3e7814df60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009fa0 tx=0x7f3e70009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.397+0000 7f3e697fa700 1 -- 172.21.15.7:0/1146490839 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000ed20 con 0x7f3e78158120 2023-10-06T11:01:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.397+0000 7f3e697fa700 1 -- 172.21.15.7:0/1146490839 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7000ee80 con 0x7f3e78158120 2023-10-06T11:01:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.397+0000 7f3e7f737700 1 -- 172.21.15.7:0/1146490839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e78068ef0 con 0x7f3e78158120 2023-10-06T11:01:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.397+0000 7f3e697fa700 1 -- 172.21.15.7:0/1146490839 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70014670 con 0x7f3e78158120 2023-10-06T11:01:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.397+0000 7f3e7f737700 1 -- 172.21.15.7:0/1146490839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e780694b0 con 0x7f3e78158120 2023-10-06T11:01:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.398+0000 7f3e7f737700 1 -- 172.21.15.7:0/1146490839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e78070480 con 0x7f3e78158120 2023-10-06T11:01:30.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.399+0000 7f3e697fa700 1 -- 172.21.15.7:0/1146490839 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e700149e0 con 0x7f3e78158120 2023-10-06T11:01:30.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.399+0000 7f3e697fa700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3e5c066f30 0x7f3e5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:30.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.399+0000 7f3e697fa700 1 -- 172.21.15.7:0/1146490839 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f3e70084d20 con 0x7f3e78158120 2023-10-06T11:01:30.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.399+0000 7f3e7d4d3700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3e5c066f30 0x7f3e5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:30.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.400+0000 7f3e7d4d3700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3e5c066f30 0x7f3e5c0693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009260 tx=0x7f3e74016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:30.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.404+0000 7f3e697fa700 1 -- 172.21.15.7:0/1146490839 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e70051ff0 con 0x7f3e78158120 2023-10-06T11:01:30.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.605+0000 7f3e7f737700 1 -- 172.21.15.7:0/1146490839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e780c98c0 con 0x7f3e78158120 2023-10-06T11:01:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.606+0000 7f3e697fa700 1 -- 172.21.15.7:0/1146490839 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+13983 (secure 0 0 0) 0x7f3e70055610 con 0x7f3e78158120 2023-10-06T11:01:30.607 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:30.607 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":60,"fsid":"ff7fc17b-4d49-4596-ba3b-1d865cad8f21","created":"2023-10-06T10:58:43.706968+0000","modified":"2023-10-06T11:01:27.170146+0000","last_up_change":"2023-10-06T10:58:54.307083+0000","last_in_change":"2023-10-06T10:58:46.356557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T10:58:55.224661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T10:58:56.032929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"05b362f8-8ccf-47df-99fa-e183dcafe65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6817","nonce":119715},{"type":"v1","addr":"172.21.15.7:6819","nonce":119715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":119715},{"type":"v1","addr":"172.21.15.7:6824","nonce":119715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":119715},{"type":"v1","addr":"172.21.15.7:6831","nonce":119715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":119715},{"type":"v1","addr":"172.21.15.7:6829","nonce":119715}]},"public_addr":"172.21.15.7:6819/119715","cluster_addr":"172.21.15.7:6824/119715","heartbeat_back_addr":"172.21.15.7:6831/119715","heartbeat_front_addr":"172.21.15.7:6829/119715","state":["exists","up"]},{"osd":1,"uuid":"b5501e71-257e-4247-9519-112bad21cb46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":119716},{"type":"v1","addr":"172.21.15.7:6809","nonce":119716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":119716},{"type":"v1","addr":"172.21.15.7:6811","nonce":119716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":119716},{"type":"v1","addr":"172.21.15.7:6815","nonce":119716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":119716},{"type":"v1","addr":"172.21.15.7:6813","nonce":119716}]},"public_addr":"172.21.15.7:6809/119716","cluster_addr":"172.21.15.7:6811/119716","heartbeat_back_addr":"172.21.15.7:6815/119716","heartbeat_front_addr":"172.21.15.7:6813/119716","state":["exists","up"]},{"osd":2,"uuid":"b6de38d9-1392-4690-85e2-7f85443247bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":119717},{"type":"v1","addr":"172.21.15.7:6801","nonce":119717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":119717},{"type":"v1","addr":"172.21.15.7:6803","nonce":119717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":119717},{"type":"v1","addr":"172.21.15.7:6807","nonce":119717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":119717},{"type":"v1","addr":"172.21.15.7:6805","nonce":119717}]},"public_addr":"172.21.15.7:6801/119717","cluster_addr":"172.21.15.7:6803/119717","heartbeat_back_addr":"172.21.15.7:6807/119717","heartbeat_front_addr":"172.21.15.7:6805/119717","state":["exists","up"]},{"osd":3,"uuid":"768079ea-3de9-474a-b2f7-17b4ea3f849f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":119718},{"type":"v1","addr":"172.21.15.7:6818","nonce":119718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":119718},{"type":"v1","addr":"172.21.15.7:6821","nonce":119718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":119718},{"type":"v1","addr":"172.21.15.7:6828","nonce":119718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":119718},{"type":"v1","addr":"172.21.15.7:6825","nonce":119718}]},"public_addr":"172.21.15.7:6818/119718","cluster_addr":"172.21.15.7:6821/119718","heartbeat_back_addr":"172.21.15.7:6828/119718","heartbeat_front_addr":"172.21.15.7:6825/119718","state":["exists","up"]},{"osd":4,"uuid":"368896ea-39d9-4ebb-be3b-3d45ef60ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":119979},{"type":"v1","addr":"172.21.15.50:6801","nonce":119979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":119979},{"type":"v1","addr":"172.21.15.50:6803","nonce":119979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":119979},{"type":"v1","addr":"172.21.15.50:6807","nonce":119979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":119979},{"type":"v1","addr":"172.21.15.50:6805","nonce":119979}]},"public_addr":"172.21.15.50:6801/119979","cluster_addr":"172.21.15.50:6803/119979","heartbeat_back_addr":"172.21.15.50:6807/119979","heartbeat_front_addr":"172.21.15.50:6805/119979","state":["exists","up"]},{"osd":5,"uuid":"f2b41a42-1560-44a6-8417-edde43b5fd52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":119980},{"type":"v1","addr":"172.21.15.50:6809","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":119980},{"type":"v1","addr":"172.21.15.50:6811","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":119980},{"type":"v1","addr":"172.21.15.50:6815","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":119980},{"type":"v1","addr":"172.21.15.50:6813","nonce":119980}]},"public_addr":"172.21.15.50:6809/119980","cluster_addr":"172.21.15.50:6811/119980","heartbeat_back_addr":"172.21.15.50:6815/119980","heartbeat_front_addr":"172.21.15.50:6813/119980","state":["exists","up"]},{"osd":6,"uuid":"4070741e-bcef-4070-8c41-6731b75e1023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":120010},{"type":"v1","addr":"172.21.15.50:6817","nonce":120010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":120010},{"type":"v1","addr":"172.21.15.50:6819","nonce":120010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":120010},{"type":"v1","addr":"172.21.15.50:6823","nonce":120010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":120010},{"type":"v1","addr":"172.21.15.50:6821","nonce":120010}]},"public_addr":"172.21.15.50:6817/120010","cluster_addr":"172.21.15.50:6819/120010","heartbeat_back_addr":"172.21.15.50:6823/120010","heartbeat_front_addr":"172.21.15.50:6821/120010","state":["exists","up"]},{"osd":7,"uuid":"f562162d-d284-4631-9697-1b07ff86072e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":120011},{"type":"v1","addr":"172.21.15.50:6825","nonce":120011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":120011},{"type":"v1","addr":"172.21.15.50:6827","nonce":120011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":120011},{"type":"v1","addr":"172.21.15.50:6831","nonce":120011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":120011},{"type":"v1","addr":"172.21.15.50:6829","nonce":120011}]},"public_addr":"172.21.15.50:6825/120011","cluster_addr":"172.21.15.50:6827/120011","heartbeat_back_addr":"172.21.15.50:6831/120011","heartbeat_front_addr":"172.21.15.50:6829/120011","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.487142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.508507+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.304163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.530597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.484802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.511611+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.575558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T10:58:51.566994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/1121258860":"2023-10-07T11:01:24.165186+0000","172.21.15.7:6835/1121258860":"2023-10-07T11:01:24.165186+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:01:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.609+0000 7f3e7f737700 1 -- 172.21.15.7:0/1146490839 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3e5c066f30 msgr2=0x7f3e5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.609+0000 7f3e7f737700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3e5c066f30 0x7f3e5c0693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009260 tx=0x7f3e74016000 comp rx=0 tx=0).stop 2023-10-06T11:01:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.609+0000 7f3e7f737700 1 -- 172.21.15.7:0/1146490839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e78158120 msgr2=0x7f3e7814df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.609+0000 7f3e7f737700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e78158120 0x7f3e7814df60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009fa0 tx=0x7f3e70009900 comp rx=0 tx=0).stop 2023-10-06T11:01:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.609+0000 7f3e7f737700 1 -- 172.21.15.7:0/1146490839 shutdown_connections 2023-10-06T11:01:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.609+0000 7f3e7f737700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3e5c066f30 0x7f3e5c0693e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.609+0000 7f3e7f737700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e78158120 0x7f3e7814df60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.609+0000 7f3e7f737700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e780c8ba0 0x7f3e78069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.609+0000 7f3e7f737700 1 --2- 172.21.15.7:0/1146490839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e780cac60 0x7f3e78156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.609+0000 7f3e7f737700 1 -- 172.21.15.7:0/1146490839 >> 172.21.15.7:0/1146490839 conn(0x7f3e78087920 msgr2=0x7f3e780abb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.609+0000 7f3e7f737700 1 -- 172.21.15.7:0/1146490839 shutdown_connections 2023-10-06T11:01:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:30.609+0000 7f3e7f737700 1 -- 172.21.15.7:0/1146490839 wait complete. 2023-10-06T11:01:31.624 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T11:01:31.625 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:01:31.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.770+0000 7ff66195a700 1 Processor -- start 2023-10-06T11:01:31.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.770+0000 7ff66195a700 1 -- start start 2023-10-06T11:01:31.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff66195a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff65c0af1d0 0x7ff65c06c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:31.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff66195a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff65c0af5a0 0x7ff65c06cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:31.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff66195a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65c15cf80 con 0x7ff65c15da20 2023-10-06T11:01:31.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff66195a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65c0cb9b0 con 0x7ff65c0af5a0 2023-10-06T11:01:31.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff66195a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0cb6d0 con 0x7ff65c0af1d0 2023-10-06T11:01:31.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff65a7fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff65c0af5a0 0x7ff65c06cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:31.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff65b7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff65c15da20 0x7ff65c0ca9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42696/0 (socket says 172.21.15.7:42696) 2023-10-06T11:01:31.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff65b7fe700 1 -- 172.21.15.7:0/745644674 learned_addr learned my addr 172.21.15.7:0/745644674 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:31.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff65affd700 1 --2- 172.21.15.7:0/745644674 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff65c0af1d0 0x7ff65c06c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:31.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff65a7fc700 1 -- 172.21.15.7:0/745644674 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff65c0af1d0 msgr2=0x7ff65c06c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:31.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff65a7fc700 1 --2- 172.21.15.7:0/745644674 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff65c0af1d0 0x7ff65c06c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:31.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff65a7fc700 1 -- 172.21.15.7:0/745644674 >> v1:172.21.15.7:6789/0 conn(0x7ff65c15da20 legacy=0x7ff65c0ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:31.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff659ffb700 1 -- 172.21.15.7:0/745644674 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973453777 0 0) 0x7ff65c15cf80 con 0x7ff65c15da20 2023-10-06T11:01:31.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff65a7fc700 1 -- 172.21.15.7:0/745644674 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c15d220 con 0x7ff65c0af5a0 2023-10-06T11:01:31.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff65a7fc700 1 --2- 172.21.15.7:0/745644674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65c0af5a0 0x7ff65c06cce0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff6500098e0 tx=0x7ff6500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c669f03392c423 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:31.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.771+0000 7ff659ffb700 1 -- 172.21.15.7:0/745644674 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650009e80 con 0x7ff65c0af5a0 2023-10-06T11:01:31.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.772+0000 7ff659ffb700 1 -- 172.21.15.7:0/745644674 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65000b860 con 0x7ff65c0af5a0 2023-10-06T11:01:31.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.772+0000 7ff659ffb700 1 -- 172.21.15.7:0/745644674 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65000bbe0 con 0x7ff65c0af5a0 2023-10-06T11:01:31.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.772+0000 7ff66195a700 1 -- 172.21.15.7:0/745644674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65c0af5a0 msgr2=0x7ff65c06cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:31.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.772+0000 7ff66195a700 1 --2- 172.21.15.7:0/745644674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65c0af5a0 0x7ff65c06cce0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff6500098e0 tx=0x7ff6500091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:31.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.772+0000 7ff66195a700 1 -- 172.21.15.7:0/745644674 shutdown_connections 2023-10-06T11:01:31.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.772+0000 7ff66195a700 1 --2- 172.21.15.7:0/745644674 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff65c0af1d0 0x7ff65c06c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:31.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.772+0000 7ff66195a700 1 --2- 172.21.15.7:0/745644674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65c0af5a0 0x7ff65c06cce0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:31.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.772+0000 7ff66195a700 1 -- 172.21.15.7:0/745644674 >> 172.21.15.7:0/745644674 conn(0x7ff65c0cce10 msgr2=0x7ff65c0cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:31.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.772+0000 7ff66195a700 1 -- 172.21.15.7:0/745644674 shutdown_connections 2023-10-06T11:01:31.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.772+0000 7ff66195a700 1 -- 172.21.15.7:0/745644674 wait complete. 2023-10-06T11:01:31.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.773+0000 7ff66195a700 1 Processor -- start 2023-10-06T11:01:31.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.774+0000 7ff66195a700 1 -- start start 2023-10-06T11:01:31.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.774+0000 7ff66195a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff65c0af1d0 0x7ff65c14a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:31.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.774+0000 7ff66195a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65c15da20 0x7ff65c0c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:31.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.774+0000 7ff66195a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff65c0c7aa0 0x7ff65c0c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:31.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.774+0000 7ff66195a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0c43d0 con 0x7ff65c15da20 2023-10-06T11:01:31.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.774+0000 7ff66195a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0b1910 con 0x7ff65c0c7aa0 2023-10-06T11:01:31.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.774+0000 7ff66195a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0b1bf0 con 0x7ff65c0af1d0 2023-10-06T11:01:31.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.774+0000 7ff65a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65c15da20 0x7ff65c0c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:31.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff65a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65c15da20 0x7ff65c0c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59780/0 (socket says 172.21.15.7:59780) 2023-10-06T11:01:31.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff65a7fc700 1 -- 172.21.15.7:0/1255692303 learned_addr learned my addr 172.21.15.7:0/1255692303 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:31.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff65b7fe700 1 --2- 172.21.15.7:0/1255692303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff65c0c7aa0 0x7ff65c0c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:31.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff65affd700 1 --2- 172.21.15.7:0/1255692303 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff65c0af1d0 0x7ff65c14a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:31.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff65a7fc700 1 -- 172.21.15.7:0/1255692303 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff65c0af1d0 msgr2=0x7ff65c14a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:31.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff65a7fc700 1 --2- 172.21.15.7:0/1255692303 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff65c0af1d0 0x7ff65c14a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:31.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff65a7fc700 1 -- 172.21.15.7:0/1255692303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff65c0c7aa0 msgr2=0x7ff65c0c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:31.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff65a7fc700 1 --2- 172.21.15.7:0/1255692303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff65c0c7aa0 0x7ff65c0c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:31.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff65a7fc700 1 -- 172.21.15.7:0/1255692303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650009420 con 0x7ff65c15da20 2023-10-06T11:01:31.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff65a7fc700 1 --2- 172.21.15.7:0/1255692303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65c15da20 0x7ff65c0c7560 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0c3d50 tx=0x7ff650017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:31.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff642ffd700 1 -- 172.21.15.7:0/1255692303 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65000b9d0 con 0x7ff65c15da20 2023-10-06T11:01:31.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff642ffd700 1 -- 172.21.15.7:0/1255692303 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65000bb30 con 0x7ff65c15da20 2023-10-06T11:01:31.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff66195a700 1 -- 172.21.15.7:0/1255692303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65c0b1ed0 con 0x7ff65c15da20 2023-10-06T11:01:31.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff642ffd700 1 -- 172.21.15.7:0/1255692303 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650025670 con 0x7ff65c15da20 2023-10-06T11:01:31.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.775+0000 7ff66195a700 1 -- 172.21.15.7:0/1255692303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c16dcc0 con 0x7ff65c15da20 2023-10-06T11:01:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.776+0000 7ff66195a700 1 -- 172.21.15.7:0/1255692303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff65c0c3ec0 con 0x7ff65c15da20 2023-10-06T11:01:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.777+0000 7ff642ffd700 1 -- 172.21.15.7:0/1255692303 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff650023070 con 0x7ff65c15da20 2023-10-06T11:01:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.777+0000 7ff642ffd700 1 --2- 172.21.15.7:0/1255692303 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff648066f30 0x7ff6480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.777+0000 7ff642ffd700 1 -- 172.21.15.7:0/1255692303 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7ff650085a70 con 0x7ff65c15da20 2023-10-06T11:01:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.777+0000 7ff65affd700 1 --2- 172.21.15.7:0/1255692303 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff648066f30 0x7ff6480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.777+0000 7ff642ffd700 1 --2- 172.21.15.7:0/1255692303 >> [v2:172.21.15.7:6817/119715,v1:172.21.15.7:6819/119715] conn(0x7ff64806d850 0x7ff64806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.777+0000 7ff642ffd700 1 -- 172.21.15.7:0/1255692303 --> [v2:172.21.15.7:6817/119715,v1:172.21.15.7:6819/119715] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff648070370 con 0x7ff64806d850 2023-10-06T11:01:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.777+0000 7ff642ffd700 1 -- 172.21.15.7:0/1255692303 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff65008a240 con 0x7ff65c15da20 2023-10-06T11:01:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.778+0000 7ff65b7fe700 1 --2- 172.21.15.7:0/1255692303 >> [v2:172.21.15.7:6817/119715,v1:172.21.15.7:6819/119715] conn(0x7ff64806d850 0x7ff64806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:31.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.778+0000 7ff65affd700 1 --2- 172.21.15.7:0/1255692303 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff648066f30 0x7ff6480693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff64c006fd0 tx=0x7ff64c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:31.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.778+0000 7ff65b7fe700 1 --2- 172.21.15.7:0/1255692303 >> [v2:172.21.15.7:6817/119715,v1:172.21.15.7:6819/119715] conn(0x7ff64806d850 0x7ff64806fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:31.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.779+0000 7ff642ffd700 1 -- 172.21.15.7:0/1255692303 <== osd.0 v2:172.21.15.7:6817/119715 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff648070370 con 0x7ff64806d850 2023-10-06T11:01:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.793+0000 7ff66195a700 1 -- 172.21.15.7:0/1255692303 --> [v2:172.21.15.7:6817/119715,v1:172.21.15.7:6819/119715] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff65c070480 con 0x7ff64806d850 2023-10-06T11:01:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.793+0000 7ff642ffd700 1 -- 172.21.15.7:0/1255692303 <== osd.0 v2:172.21.15.7:6817/119715 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff65c070480 con 0x7ff64806d850 2023-10-06T11:01:31.794 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:01:31.794 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:01:31.794 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:01:31.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.794+0000 7ff66195a700 1 -- 172.21.15.7:0/1255692303 >> [v2:172.21.15.7:6817/119715,v1:172.21.15.7:6819/119715] conn(0x7ff64806d850 msgr2=0x7ff64806fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.794+0000 7ff66195a700 1 --2- 172.21.15.7:0/1255692303 >> [v2:172.21.15.7:6817/119715,v1:172.21.15.7:6819/119715] conn(0x7ff64806d850 0x7ff64806fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.794+0000 7ff66195a700 1 -- 172.21.15.7:0/1255692303 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff648066f30 msgr2=0x7ff6480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.794+0000 7ff66195a700 1 --2- 172.21.15.7:0/1255692303 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff648066f30 0x7ff6480693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff64c006fd0 tx=0x7ff64c008040 comp rx=0 tx=0).stop 2023-10-06T11:01:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.794+0000 7ff66195a700 1 -- 172.21.15.7:0/1255692303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65c15da20 msgr2=0x7ff65c0c7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.794+0000 7ff66195a700 1 --2- 172.21.15.7:0/1255692303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65c15da20 0x7ff65c0c7560 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0c3d50 tx=0x7ff650017000 comp rx=0 tx=0).stop 2023-10-06T11:01:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.794+0000 7ff65b7fe700 1 -- 172.21.15.7:0/1255692303 reap_dead start 2023-10-06T11:01:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.794+0000 7ff66195a700 1 -- 172.21.15.7:0/1255692303 shutdown_connections 2023-10-06T11:01:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.794+0000 7ff66195a700 1 -- 172.21.15.7:0/1255692303 >> 172.21.15.7:0/1255692303 conn(0x7ff65c0cce10 msgr2=0x7ff65c156430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.794+0000 7ff66195a700 1 -- 172.21.15.7:0/1255692303 shutdown_connections 2023-10-06T11:01:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.794+0000 7ff66195a700 1 -- 172.21.15.7:0/1255692303 wait complete. 2023-10-06T11:01:31.808 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T11:01:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.940+0000 7fb7d2fc9700 1 Processor -- start 2023-10-06T11:01:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.940+0000 7fb7d2fc9700 1 -- start start 2023-10-06T11:01:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d2fc9700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7cc1590d0 0x7fb7cc069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d2fc9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7cc06a0f0 0x7fb7cc15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d2fc9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb7cc15d350 0x7fb7cc067980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d2fc9700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7cc15d7d0 con 0x7fb7cc1590d0 2023-10-06T11:01:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d2fc9700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7cc0694d0 con 0x7fb7cc15d350 2023-10-06T11:01:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d2fc9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc068ba0 con 0x7fb7cc06a0f0 2023-10-06T11:01:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d0d65700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7cc1590d0 0x7fb7cc069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d0d65700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7cc1590d0 0x7fb7cc069bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59792/0 (socket says 172.21.15.7:59792) 2023-10-06T11:01:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d0d65700 1 -- 172.21.15.7:0/1970544503 learned_addr learned my addr 172.21.15.7:0/1970544503 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7cbfff700 1 --2- 172.21.15.7:0/1970544503 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7cc06a0f0 0x7fb7cc15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d1566700 1 --2- 172.21.15.7:0/1970544503 >> v2:172.21.15.50:3300/0 conn(0x7fb7cc15d350 0x7fb7cc067980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d0d65700 1 -- 172.21.15.7:0/1970544503 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7cc06a0f0 msgr2=0x7fb7cc15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d0d65700 1 --2- 172.21.15.7:0/1970544503 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7cc06a0f0 0x7fb7cc15ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d0d65700 1 -- 172.21.15.7:0/1970544503 >> v2:172.21.15.50:3300/0 conn(0x7fb7cc15d350 msgr2=0x7fb7cc067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d0d65700 1 --2- 172.21.15.7:0/1970544503 >> v2:172.21.15.50:3300/0 conn(0x7fb7cc15d350 0x7fb7cc067980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d0d65700 1 -- 172.21.15.7:0/1970544503 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc068e80 con 0x7fb7cc1590d0 2023-10-06T11:01:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d1566700 1 --2- 172.21.15.7:0/1970544503 >> v2:172.21.15.50:3300/0 conn(0x7fb7cc15d350 0x7fb7cc067980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7cbfff700 1 --2- 172.21.15.7:0/1970544503 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7cc06a0f0 0x7fb7cc15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.941+0000 7fb7d0d65700 1 --2- 172.21.15.7:0/1970544503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1590d0 0x7fb7cc069bb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0af020 tx=0x7fb7bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa560e78668936e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.942+0000 7fb7cb7fe700 1 -- 172.21.15.7:0/1970544503 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc00b860 con 0x7fb7cc1590d0 2023-10-06T11:01:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.942+0000 7fb7cb7fe700 1 -- 172.21.15.7:0/1970544503 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc00b9c0 con 0x7fb7cc1590d0 2023-10-06T11:01:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.942+0000 7fb7cb7fe700 1 -- 172.21.15.7:0/1970544503 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc00bd60 con 0x7fb7cc1590d0 2023-10-06T11:01:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.942+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/1970544503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1590d0 msgr2=0x7fb7cc069bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.942+0000 7fb7d2fc9700 1 --2- 172.21.15.7:0/1970544503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1590d0 0x7fb7cc069bb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0af020 tx=0x7fb7bc009250 comp rx=0 tx=0).stop 2023-10-06T11:01:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.942+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/1970544503 shutdown_connections 2023-10-06T11:01:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.942+0000 7fb7d2fc9700 1 --2- 172.21.15.7:0/1970544503 >> v2:172.21.15.50:3300/0 conn(0x7fb7cc15d350 0x7fb7cc067980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.942+0000 7fb7d2fc9700 1 --2- 172.21.15.7:0/1970544503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1590d0 0x7fb7cc069bb0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.942+0000 7fb7d2fc9700 1 --2- 172.21.15.7:0/1970544503 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7cc06a0f0 0x7fb7cc15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.942+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/1970544503 >> 172.21.15.7:0/1970544503 conn(0x7fb7cc096160 msgr2=0x7fb7cc0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:31.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.942+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/1970544503 shutdown_connections 2023-10-06T11:01:31.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.942+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/1970544503 wait complete. 2023-10-06T11:01:31.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.944+0000 7fb7d2fc9700 1 Processor -- start 2023-10-06T11:01:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.944+0000 7fb7d2fc9700 1 -- start start 2023-10-06T11:01:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.945+0000 7fb7d2fc9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7cc06a0f0 0x7fb7cc096ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.945+0000 7fb7d2fc9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7cc1590d0 0x7fb7cc0afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.945+0000 7fb7d2fc9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc15d350 0x7fb7cc0b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.945+0000 7fb7d2fc9700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc097010 con 0x7fb7cc15d350 2023-10-06T11:01:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.945+0000 7fb7d2fc9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc097e50 con 0x7fb7cc1590d0 2023-10-06T11:01:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.945+0000 7fb7d2fc9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc097240 con 0x7fb7cc06a0f0 2023-10-06T11:01:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.945+0000 7fb7d1566700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc15d350 0x7fb7cc0b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.945+0000 7fb7d1566700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc15d350 0x7fb7cc0b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59802/0 (socket says 172.21.15.7:59802) 2023-10-06T11:01:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.945+0000 7fb7d1566700 1 -- 172.21.15.7:0/3243757114 learned_addr learned my addr 172.21.15.7:0/3243757114 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.945+0000 7fb7d0d65700 1 --2- 172.21.15.7:0/3243757114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7cc06a0f0 0x7fb7cc096ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.945+0000 7fb7cbfff700 1 --2- 172.21.15.7:0/3243757114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7cc1590d0 0x7fb7cc0afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.946+0000 7fb7d1566700 1 -- 172.21.15.7:0/3243757114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7cc06a0f0 msgr2=0x7fb7cc096ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.946+0000 7fb7d1566700 1 --2- 172.21.15.7:0/3243757114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7cc06a0f0 0x7fb7cc096ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.946+0000 7fb7d1566700 1 -- 172.21.15.7:0/3243757114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7cc1590d0 msgr2=0x7fb7cc0afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.946+0000 7fb7d1566700 1 --2- 172.21.15.7:0/3243757114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7cc1590d0 0x7fb7cc0afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.946+0000 7fb7d1566700 1 -- 172.21.15.7:0/3243757114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0094f0 con 0x7fb7cc15d350 2023-10-06T11:01:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.946+0000 7fb7d1566700 1 --2- 172.21.15.7:0/3243757114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc15d350 0x7fb7cc0b01b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400cef0 tx=0x7fb7c4007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.946+0000 7fb7c8ff9700 1 -- 172.21.15.7:0/3243757114 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c400ad20 con 0x7fb7cc15d350 2023-10-06T11:01:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.946+0000 7fb7c8ff9700 1 -- 172.21.15.7:0/3243757114 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c4016420 con 0x7fb7cc15d350 2023-10-06T11:01:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.946+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/3243757114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc097520 con 0x7fb7cc15d350 2023-10-06T11:01:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.946+0000 7fb7c8ff9700 1 -- 172.21.15.7:0/3243757114 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c400aea0 con 0x7fb7cc15d350 2023-10-06T11:01:31.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.946+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/3243757114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7cc097ae0 con 0x7fb7cc15d350 2023-10-06T11:01:31.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.947+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/3243757114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7cc097fc0 con 0x7fb7cc15d350 2023-10-06T11:01:31.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.947+0000 7fb7c8ff9700 1 -- 172.21.15.7:0/3243757114 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7c4016a70 con 0x7fb7cc15d350 2023-10-06T11:01:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.948+0000 7fb7c8ff9700 1 --2- 172.21.15.7:0/3243757114 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb7b8066f30 0x7fb7b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.948+0000 7fb7c8ff9700 1 -- 172.21.15.7:0/3243757114 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fb7c4012070 con 0x7fb7cc15d350 2023-10-06T11:01:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.948+0000 7fb7d0d65700 1 --2- 172.21.15.7:0/3243757114 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb7b8066f30 0x7fb7b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.949+0000 7fb7d0d65700 1 --2- 172.21.15.7:0/3243757114 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb7b8066f30 0x7fb7b80693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0af020 tx=0x7fb7bc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:31.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:31.953+0000 7fb7c8ff9700 1 -- 172.21.15.7:0/3243757114 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7c404e5a0 con 0x7fb7cc15d350 2023-10-06T11:01:32.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.157+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/3243757114 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7cc070480 con 0x7fb7b8066f30 2023-10-06T11:01:32.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.157+0000 7fb7c8ff9700 1 -- 172.21.15.7:0/3243757114 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb7cc070480 con 0x7fb7b8066f30 2023-10-06T11:01:32.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.159+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/3243757114 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb7b8066f30 msgr2=0x7fb7b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.159+0000 7fb7d2fc9700 1 --2- 172.21.15.7:0/3243757114 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb7b8066f30 0x7fb7b80693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0af020 tx=0x7fb7bc017000 comp rx=0 tx=0).stop 2023-10-06T11:01:32.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.160+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/3243757114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc15d350 msgr2=0x7fb7cc0b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.160+0000 7fb7d2fc9700 1 --2- 172.21.15.7:0/3243757114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc15d350 0x7fb7cc0b01b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400cef0 tx=0x7fb7c4007860 comp rx=0 tx=0).stop 2023-10-06T11:01:32.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.160+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/3243757114 shutdown_connections 2023-10-06T11:01:32.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.160+0000 7fb7d2fc9700 1 --2- 172.21.15.7:0/3243757114 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fb7b8066f30 0x7fb7b80693e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.160+0000 7fb7d2fc9700 1 --2- 172.21.15.7:0/3243757114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc15d350 0x7fb7cc0b01b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.160+0000 7fb7d2fc9700 1 --2- 172.21.15.7:0/3243757114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7cc06a0f0 0x7fb7cc096ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.160+0000 7fb7d2fc9700 1 --2- 172.21.15.7:0/3243757114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7cc1590d0 0x7fb7cc0afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.160+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/3243757114 >> 172.21.15.7:0/3243757114 conn(0x7fb7cc096160 msgr2=0x7fb7cc0abaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:32.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.160+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/3243757114 shutdown_connections 2023-10-06T11:01:32.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.160+0000 7fb7d2fc9700 1 -- 172.21.15.7:0/3243757114 wait complete. 2023-10-06T11:01:32.162 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T11:01:32.174 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T11:01:32.174 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:01:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.309+0000 7f947d52a700 1 Processor -- start 2023-10-06T11:01:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.309+0000 7f947d52a700 1 -- start start 2023-10-06T11:01:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f947d52a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9478159650 0x7f94780caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f947d52a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f94780cb480 0x7f94780cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f947d52a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94780cb8e0 con 0x7f9478159280 2023-10-06T11:01:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f947d52a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94780cdcd0 con 0x7f94780cb480 2023-10-06T11:01:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f947d52a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94780ce570 con 0x7f9478159650 2023-10-06T11:01:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f94777fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f94780cb480 0x7f94780cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f9476ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9478159280 0x7f94780aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42708/0 (socket says 172.21.15.7:42708) 2023-10-06T11:01:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f9476ffd700 1 -- 172.21.15.7:0/3008072545 learned_addr learned my addr 172.21.15.7:0/3008072545 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f94767fc700 1 --2- 172.21.15.7:0/3008072545 >> v2:172.21.15.50:3300/0 conn(0x7f9478159650 0x7f94780caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f94777fe700 1 -- 172.21.15.7:0/3008072545 >> v2:172.21.15.50:3300/0 conn(0x7f9478159650 msgr2=0x7f94780caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f94777fe700 1 --2- 172.21.15.7:0/3008072545 >> v2:172.21.15.50:3300/0 conn(0x7f9478159650 0x7f94780caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f94777fe700 1 -- 172.21.15.7:0/3008072545 >> v1:172.21.15.7:6789/0 conn(0x7f9478159280 legacy=0x7f94780aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f9475ffb700 1 -- 172.21.15.7:0/3008072545 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230305682 0 0) 0x7f9460001110 con 0x7f9478159280 2023-10-06T11:01:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f94777fe700 1 -- 172.21.15.7:0/3008072545 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94780cd4d0 con 0x7f94780cb480 2023-10-06T11:01:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.310+0000 7f94767fc700 1 --2- 172.21.15.7:0/3008072545 >> v2:172.21.15.50:3300/0 conn(0x7f9478159650 0x7f94780caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.311+0000 7f94777fe700 1 --2- 172.21.15.7:0/3008072545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94780cb480 0x7f94780cea00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9478063ef0 tx=0x7f9470009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd7351af463e5c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.311+0000 7f9475ffb700 1 -- 172.21.15.7:0/3008072545 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947000e070 con 0x7f94780cb480 2023-10-06T11:01:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.311+0000 7f9475ffb700 1 -- 172.21.15.7:0/3008072545 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947000bc30 con 0x7f94780cb480 2023-10-06T11:01:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.311+0000 7f9475ffb700 1 -- 172.21.15.7:0/3008072545 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470012430 con 0x7f94780cb480 2023-10-06T11:01:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.311+0000 7f947d52a700 1 -- 172.21.15.7:0/3008072545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94780cb480 msgr2=0x7f94780cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.311+0000 7f947d52a700 1 --2- 172.21.15.7:0/3008072545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94780cb480 0x7f94780cea00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9478063ef0 tx=0x7f9470009780 comp rx=0 tx=0).stop 2023-10-06T11:01:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.311+0000 7f947d52a700 1 -- 172.21.15.7:0/3008072545 shutdown_connections 2023-10-06T11:01:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.311+0000 7f947d52a700 1 --2- 172.21.15.7:0/3008072545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94780cb480 0x7f94780cea00 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.311+0000 7f947d52a700 1 --2- 172.21.15.7:0/3008072545 >> v2:172.21.15.50:3300/0 conn(0x7f9478159650 0x7f94780caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.311+0000 7f947d52a700 1 -- 172.21.15.7:0/3008072545 >> 172.21.15.7:0/3008072545 conn(0x7f94780d0b80 msgr2=0x7f94780ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.312+0000 7f947d52a700 1 -- 172.21.15.7:0/3008072545 shutdown_connections 2023-10-06T11:01:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.312+0000 7f947d52a700 1 -- 172.21.15.7:0/3008072545 wait complete. 2023-10-06T11:01:32.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.313+0000 7f947d52a700 1 Processor -- start 2023-10-06T11:01:32.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.313+0000 7f947d52a700 1 -- start start 2023-10-06T11:01:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f947d52a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94780cb480 0x7f9478155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f947d52a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9478159280 0x7f947814dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f947d52a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9478159650 0x7f94781697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f947d52a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947815bde0 con 0x7f9478159280 2023-10-06T11:01:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f947d52a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947816a320 con 0x7f94780cb480 2023-10-06T11:01:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f947d52a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947816a600 con 0x7f9478159650 2023-10-06T11:01:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f94767fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9478159280 0x7f947814dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f94767fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9478159280 0x7f947814dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59812/0 (socket says 172.21.15.7:59812) 2023-10-06T11:01:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f94767fc700 1 -- 172.21.15.7:0/2660947093 learned_addr learned my addr 172.21.15.7:0/2660947093 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f9476ffd700 1 --2- 172.21.15.7:0/2660947093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94780cb480 0x7f9478155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f94777fe700 1 --2- 172.21.15.7:0/2660947093 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9478159650 0x7f94781697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f94767fc700 1 -- 172.21.15.7:0/2660947093 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9478159650 msgr2=0x7f94781697a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f94767fc700 1 --2- 172.21.15.7:0/2660947093 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9478159650 0x7f94781697a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f94767fc700 1 -- 172.21.15.7:0/2660947093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94780cb480 msgr2=0x7f9478155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f94767fc700 1 --2- 172.21.15.7:0/2660947093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94780cb480 0x7f9478155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f94767fc700 1 -- 172.21.15.7:0/2660947093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9470009a20 con 0x7f9478159280 2023-10-06T11:01:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.314+0000 7f94767fc700 1 --2- 172.21.15.7:0/2660947093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9478159280 0x7f947814dc50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f946800c830 tx=0x7f9468008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.315+0000 7f946effd700 1 -- 172.21.15.7:0/2660947093 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468011600 con 0x7f9478159280 2023-10-06T11:01:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.315+0000 7f946effd700 1 -- 172.21.15.7:0/2660947093 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9468011760 con 0x7f9478159280 2023-10-06T11:01:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.315+0000 7f947d52a700 1 -- 172.21.15.7:0/2660947093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947815ba70 con 0x7f9478159280 2023-10-06T11:01:32.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.315+0000 7f946effd700 1 -- 172.21.15.7:0/2660947093 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468011b20 con 0x7f9478159280 2023-10-06T11:01:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.315+0000 7f947d52a700 1 -- 172.21.15.7:0/2660947093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947815b720 con 0x7f9478159280 2023-10-06T11:01:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.315+0000 7f947d52a700 1 -- 172.21.15.7:0/2660947093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9478070480 con 0x7f9478159280 2023-10-06T11:01:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.316+0000 7f946effd700 1 -- 172.21.15.7:0/2660947093 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9468018360 con 0x7f9478159280 2023-10-06T11:01:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.316+0000 7f946effd700 1 --2- 172.21.15.7:0/2660947093 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9458066f30 0x7f94580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.316+0000 7f946effd700 1 -- 172.21.15.7:0/2660947093 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f94680844b0 con 0x7f9478159280 2023-10-06T11:01:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.317+0000 7f9476ffd700 1 --2- 172.21.15.7:0/2660947093 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9458066f30 0x7f94580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.317+0000 7f946effd700 1 --2- 172.21.15.7:0/2660947093 >> [v2:172.21.15.7:6808/119716,v1:172.21.15.7:6809/119716] conn(0x7f945806d850 0x7f945806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.317+0000 7f946effd700 1 -- 172.21.15.7:0/2660947093 --> [v2:172.21.15.7:6808/119716,v1:172.21.15.7:6809/119716] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9458070370 con 0x7f945806d850 2023-10-06T11:01:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.317+0000 7f946effd700 1 -- 172.21.15.7:0/2660947093 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9468086a10 con 0x7f9478159280 2023-10-06T11:01:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.317+0000 7f94777fe700 1 --2- 172.21.15.7:0/2660947093 >> [v2:172.21.15.7:6808/119716,v1:172.21.15.7:6809/119716] conn(0x7f945806d850 0x7f945806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.317+0000 7f9476ffd700 1 --2- 172.21.15.7:0/2660947093 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9458066f30 0x7f94580693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f94781673e0 tx=0x7f9460007b90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.317+0000 7f94777fe700 1 --2- 172.21.15.7:0/2660947093 >> [v2:172.21.15.7:6808/119716,v1:172.21.15.7:6809/119716] conn(0x7f945806d850 0x7f945806fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.318+0000 7f946effd700 1 -- 172.21.15.7:0/2660947093 <== osd.1 v2:172.21.15.7:6808/119716 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9458070370 con 0x7f945806d850 2023-10-06T11:01:32.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.332+0000 7f947d52a700 1 -- 172.21.15.7:0/2660947093 --> [v2:172.21.15.7:6808/119716,v1:172.21.15.7:6809/119716] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f94780af820 con 0x7f945806d850 2023-10-06T11:01:32.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.333+0000 7f946effd700 1 -- 172.21.15.7:0/2660947093 <== osd.1 v2:172.21.15.7:6808/119716 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f94780af820 con 0x7f945806d850 2023-10-06T11:01:32.334 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:01:32.334 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:01:32.334 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:01:32.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.333+0000 7f947d52a700 1 -- 172.21.15.7:0/2660947093 >> [v2:172.21.15.7:6808/119716,v1:172.21.15.7:6809/119716] conn(0x7f945806d850 msgr2=0x7f945806fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.333+0000 7f947d52a700 1 --2- 172.21.15.7:0/2660947093 >> [v2:172.21.15.7:6808/119716,v1:172.21.15.7:6809/119716] conn(0x7f945806d850 0x7f945806fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.333+0000 7f947d52a700 1 -- 172.21.15.7:0/2660947093 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9458066f30 msgr2=0x7f94580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.333+0000 7f947d52a700 1 --2- 172.21.15.7:0/2660947093 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f9458066f30 0x7f94580693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f94781673e0 tx=0x7f9460007b90 comp rx=0 tx=0).stop 2023-10-06T11:01:32.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.333+0000 7f947d52a700 1 -- 172.21.15.7:0/2660947093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9478159280 msgr2=0x7f947814dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.333+0000 7f947d52a700 1 --2- 172.21.15.7:0/2660947093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9478159280 0x7f947814dc50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f946800c830 tx=0x7f9468008040 comp rx=0 tx=0).stop 2023-10-06T11:01:32.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.333+0000 7f94777fe700 1 -- 172.21.15.7:0/2660947093 reap_dead start 2023-10-06T11:01:32.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.333+0000 7f947d52a700 1 -- 172.21.15.7:0/2660947093 shutdown_connections 2023-10-06T11:01:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.333+0000 7f947d52a700 1 -- 172.21.15.7:0/2660947093 >> 172.21.15.7:0/2660947093 conn(0x7f94780d0b80 msgr2=0x7f94780b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.333+0000 7f947d52a700 1 -- 172.21.15.7:0/2660947093 shutdown_connections 2023-10-06T11:01:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.333+0000 7f947d52a700 1 -- 172.21.15.7:0/2660947093 wait complete. 2023-10-06T11:01:32.347 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T11:01:32.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.479+0000 7f0b0586c700 1 Processor -- start 2023-10-06T11:01:32.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.479+0000 7f0b0586c700 1 -- start start 2023-10-06T11:01:32.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.480+0000 7f0b0586c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b000af320 0x7f0b000cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.480+0000 7f0b0586c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b000cb580 0x7f0b00068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.480+0000 7f0b0586c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b000b0ca0 con 0x7f0b000cfb50 2023-10-06T11:01:32.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.480+0000 7f0b0586c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b00159c00 con 0x7f0b000cb580 2023-10-06T11:01:32.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.480+0000 7f0b0586c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b000cf6c0 con 0x7f0b000af320 2023-10-06T11:01:32.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.480+0000 7f0afe7fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b000cb580 0x7f0b00068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.480+0000 7f0afe7fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b000cb580 0x7f0b00068ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59824/0 (socket says 172.21.15.7:59824) 2023-10-06T11:01:32.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.480+0000 7f0afe7fc700 1 -- 172.21.15.7:0/3900248865 learned_addr learned my addr 172.21.15.7:0/3900248865 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:32.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.480+0000 7f0afeffd700 1 --2- 172.21.15.7:0/3900248865 >> v2:172.21.15.50:3300/0 conn(0x7f0b000af320 0x7f0b000cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.481+0000 7f0afe7fc700 1 -- 172.21.15.7:0/3900248865 >> v2:172.21.15.50:3300/0 conn(0x7f0b000af320 msgr2=0x7f0b000cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:32.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.481+0000 7f0afe7fc700 1 --2- 172.21.15.7:0/3900248865 >> v2:172.21.15.50:3300/0 conn(0x7f0b000af320 0x7f0b000cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.481+0000 7f0afe7fc700 1 -- 172.21.15.7:0/3900248865 >> v1:172.21.15.50:6789/0 conn(0x7f0b000cfb50 legacy=0x7f0b0015d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.481+0000 7f0afe7fc700 1 -- 172.21.15.7:0/3900248865 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b000ceab0 con 0x7f0b000cb580 2023-10-06T11:01:32.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.481+0000 7f0afe7fc700 1 --2- 172.21.15.7:0/3900248865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cb580 0x7f0b00068ee0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0b00068620 tx=0x7f0af4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bbe17de0b5c424 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:32.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.481+0000 7f0afdffb700 1 -- 172.21.15.7:0/3900248865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4009e70 con 0x7f0b000cb580 2023-10-06T11:01:32.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.481+0000 7f0afdffb700 1 -- 172.21.15.7:0/3900248865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af400b8f0 con 0x7f0b000cb580 2023-10-06T11:01:32.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.481+0000 7f0afdffb700 1 -- 172.21.15.7:0/3900248865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af400bc90 con 0x7f0b000cb580 2023-10-06T11:01:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.482+0000 7f0b0586c700 1 -- 172.21.15.7:0/3900248865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cb580 msgr2=0x7f0b00068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.482+0000 7f0b0586c700 1 --2- 172.21.15.7:0/3900248865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cb580 0x7f0b00068ee0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0b00068620 tx=0x7f0af4009250 comp rx=0 tx=0).stop 2023-10-06T11:01:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.482+0000 7f0b0586c700 1 -- 172.21.15.7:0/3900248865 shutdown_connections 2023-10-06T11:01:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.482+0000 7f0b0586c700 1 --2- 172.21.15.7:0/3900248865 >> v2:172.21.15.50:3300/0 conn(0x7f0b000af320 0x7f0b000cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.482+0000 7f0b0586c700 1 --2- 172.21.15.7:0/3900248865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cb580 0x7f0b00068ee0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.482+0000 7f0b0586c700 1 -- 172.21.15.7:0/3900248865 >> 172.21.15.7:0/3900248865 conn(0x7f0b00067b80 msgr2=0x7f0b000d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.482+0000 7f0b0586c700 1 -- 172.21.15.7:0/3900248865 shutdown_connections 2023-10-06T11:01:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.482+0000 7f0b0586c700 1 -- 172.21.15.7:0/3900248865 wait complete. 2023-10-06T11:01:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.483+0000 7f0b0586c700 1 Processor -- start 2023-10-06T11:01:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.483+0000 7f0b0586c700 1 -- start start 2023-10-06T11:01:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0b0586c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b000af320 0x7f0b000c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0b0586c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b000cb580 0x7f0b000c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0b0586c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cfb50 0x7f0b0016cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0b0586c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b001524f0 con 0x7f0b000cfb50 2023-10-06T11:01:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0b0586c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000b5890 con 0x7f0b000cb580 2023-10-06T11:01:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0b0586c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b001571a0 con 0x7f0b000af320 2023-10-06T11:01:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0aff7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cfb50 0x7f0b0016cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0aff7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cfb50 0x7f0b0016cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59828/0 (socket says 172.21.15.7:59828) 2023-10-06T11:01:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0aff7fe700 1 -- 172.21.15.7:0/2077645571 learned_addr learned my addr 172.21.15.7:0/2077645571 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0afe7fc700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b000cb580 0x7f0b000c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0afeffd700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b000af320 0x7f0b000c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0aff7fe700 1 -- 172.21.15.7:0/2077645571 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b000af320 msgr2=0x7f0b000c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0aff7fe700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b000af320 0x7f0b000c4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0aff7fe700 1 -- 172.21.15.7:0/2077645571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b000cb580 msgr2=0x7f0b000c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0aff7fe700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b000cb580 0x7f0b000c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0aff7fe700 1 -- 172.21.15.7:0/2077645571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af40094f0 con 0x7f0b000cfb50 2023-10-06T11:01:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0afe7fc700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b000cb580 0x7f0b000c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.484+0000 7f0aff7fe700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cfb50 0x7f0b0016cf40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c840 tx=0x7f0af8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.485+0000 7f0ae6ffd700 1 -- 172.21.15.7:0/2077645571 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8012630 con 0x7f0b000cfb50 2023-10-06T11:01:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.485+0000 7f0ae6ffd700 1 -- 172.21.15.7:0/2077645571 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af80127b0 con 0x7f0b000cfb50 2023-10-06T11:01:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.485+0000 7f0b0586c700 1 -- 172.21.15.7:0/2077645571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b0015b3a0 con 0x7f0b000cfb50 2023-10-06T11:01:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.485+0000 7f0ae6ffd700 1 -- 172.21.15.7:0/2077645571 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8012b70 con 0x7f0b000cfb50 2023-10-06T11:01:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.485+0000 7f0b0586c700 1 -- 172.21.15.7:0/2077645571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b00157440 con 0x7f0b000cfb50 2023-10-06T11:01:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.486+0000 7f0b0586c700 1 -- 172.21.15.7:0/2077645571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b00157630 con 0x7f0b000cfb50 2023-10-06T11:01:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.486+0000 7f0ae6ffd700 1 -- 172.21.15.7:0/2077645571 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0af8003030 con 0x7f0b000cfb50 2023-10-06T11:01:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.487+0000 7f0ae6ffd700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0aec066f30 0x7f0aec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.487+0000 7f0ae6ffd700 1 -- 172.21.15.7:0/2077645571 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f0af8084350 con 0x7f0b000cfb50 2023-10-06T11:01:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.487+0000 7f0afeffd700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0aec066f30 0x7f0aec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.487+0000 7f0afeffd700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0aec066f30 0x7f0aec0693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009d40 tx=0x7f0af0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:32.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.491+0000 7f0ae6ffd700 1 -- 172.21.15.7:0/2077645571 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0af8051620 con 0x7f0b000cfb50 2023-10-06T11:01:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.691+0000 7f0b0586c700 1 -- 172.21.15.7:0/2077645571 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b000b0ca0 con 0x7f0aec066f30 2023-10-06T11:01:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.691+0000 7f0ae6ffd700 1 -- 172.21.15.7:0/2077645571 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0b000b0ca0 con 0x7f0aec066f30 2023-10-06T11:01:32.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.693+0000 7f0b0586c700 1 -- 172.21.15.7:0/2077645571 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0aec066f30 msgr2=0x7f0aec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.693+0000 7f0b0586c700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0aec066f30 0x7f0aec0693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009d40 tx=0x7f0af0008040 comp rx=0 tx=0).stop 2023-10-06T11:01:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.693+0000 7f0b0586c700 1 -- 172.21.15.7:0/2077645571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cfb50 msgr2=0x7f0b0016cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.693+0000 7f0b0586c700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cfb50 0x7f0b0016cf40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c840 tx=0x7f0af8001670 comp rx=0 tx=0).stop 2023-10-06T11:01:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.693+0000 7f0b0586c700 1 -- 172.21.15.7:0/2077645571 shutdown_connections 2023-10-06T11:01:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.693+0000 7f0b0586c700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0aec066f30 0x7f0aec0693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.693+0000 7f0b0586c700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cfb50 0x7f0b0016cf40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.693+0000 7f0b0586c700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b000af320 0x7f0b000c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.693+0000 7f0b0586c700 1 --2- 172.21.15.7:0/2077645571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b000cb580 0x7f0b000c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.693+0000 7f0b0586c700 1 -- 172.21.15.7:0/2077645571 >> 172.21.15.7:0/2077645571 conn(0x7f0b00067b80 msgr2=0x7f0b00156530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.693+0000 7f0b0586c700 1 -- 172.21.15.7:0/2077645571 shutdown_connections 2023-10-06T11:01:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.693+0000 7f0b0586c700 1 -- 172.21.15.7:0/2077645571 wait complete. 2023-10-06T11:01:32.696 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T11:01:32.707 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T11:01:32.708 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:01:32.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.843+0000 7f95c9184700 1 Processor -- start 2023-10-06T11:01:32.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.843+0000 7f95c9184700 1 -- start start 2023-10-06T11:01:32.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c9184700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95c4158ee0 0x7f95c41592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c9184700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f95c40b59f0 0x7f95c40cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c9184700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c40b2ec0 con 0x7f95c40cff50 2023-10-06T11:01:32.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c9184700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c40b3760 con 0x7f95c40b59f0 2023-10-06T11:01:32.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c9184700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40cf770 con 0x7f95c4158ee0 2023-10-06T11:01:32.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f95c40b59f0 0x7f95c40cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f95c40b59f0 0x7f95c40cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59838/0 (socket says 172.21.15.7:59838) 2023-10-06T11:01:32.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c259c700 1 -- 172.21.15.7:0/791679735 learned_addr learned my addr 172.21.15.7:0/791679735 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c2d9d700 1 --2- 172.21.15.7:0/791679735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95c4158ee0 0x7f95c41592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c259c700 1 -- 172.21.15.7:0/791679735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95c4158ee0 msgr2=0x7f95c41592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c259c700 1 --2- 172.21.15.7:0/791679735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95c4158ee0 0x7f95c41592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c259c700 1 -- 172.21.15.7:0/791679735 >> v1:172.21.15.50:6789/0 conn(0x7f95c40cff50 legacy=0x7f95c40b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c259c700 1 -- 172.21.15.7:0/791679735 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c40cf9f0 con 0x7f95c40b59f0 2023-10-06T11:01:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c259c700 1 --2- 172.21.15.7:0/791679735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c40b59f0 0x7f95c40cf230 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f95b80099b0 tx=0x7f95b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dac37f6746d19e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.844+0000 7f95c1d9b700 1 -- 172.21.15.7:0/791679735 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b800b860 con 0x7f95c40b59f0 2023-10-06T11:01:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.845+0000 7f95c1d9b700 1 -- 172.21.15.7:0/791679735 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b800b9c0 con 0x7f95c40b59f0 2023-10-06T11:01:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.845+0000 7f95c1d9b700 1 -- 172.21.15.7:0/791679735 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b800bd60 con 0x7f95c40b59f0 2023-10-06T11:01:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.845+0000 7f95c9184700 1 -- 172.21.15.7:0/791679735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c40b59f0 msgr2=0x7f95c40cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.845+0000 7f95c9184700 1 --2- 172.21.15.7:0/791679735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c40b59f0 0x7f95c40cf230 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f95b80099b0 tx=0x7f95b8009250 comp rx=0 tx=0).stop 2023-10-06T11:01:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.845+0000 7f95c9184700 1 -- 172.21.15.7:0/791679735 shutdown_connections 2023-10-06T11:01:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.845+0000 7f95c9184700 1 --2- 172.21.15.7:0/791679735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95c4158ee0 0x7f95c41592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.845+0000 7f95c9184700 1 --2- 172.21.15.7:0/791679735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c40b59f0 0x7f95c40cf230 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.845+0000 7f95c9184700 1 -- 172.21.15.7:0/791679735 >> 172.21.15.7:0/791679735 conn(0x7f95c4069f60 msgr2=0x7f95c40670f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.845+0000 7f95c9184700 1 -- 172.21.15.7:0/791679735 shutdown_connections 2023-10-06T11:01:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.845+0000 7f95c9184700 1 -- 172.21.15.7:0/791679735 wait complete. 2023-10-06T11:01:32.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.846+0000 7f95c9184700 1 Processor -- start 2023-10-06T11:01:32.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.847+0000 7f95c9184700 1 -- start start 2023-10-06T11:01:32.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.847+0000 7f95c9184700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95c40b59f0 0x7f95c414f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.847+0000 7f95c9184700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c40cff50 0x7f95c41550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.847+0000 7f95c9184700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95c4158ee0 0x7f95c4155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.847+0000 7f95c9184700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c4151d90 con 0x7f95c40cff50 2023-10-06T11:01:32.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.847+0000 7f95c9184700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c4156500 con 0x7f95c40b59f0 2023-10-06T11:01:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.847+0000 7f95c9184700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40cce50 con 0x7f95c4158ee0 2023-10-06T11:01:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.847+0000 7f95c259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c40cff50 0x7f95c41550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.847+0000 7f95c259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c40cff50 0x7f95c41550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59854/0 (socket says 172.21.15.7:59854) 2023-10-06T11:01:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.847+0000 7f95c259c700 1 -- 172.21.15.7:0/2041647654 learned_addr learned my addr 172.21.15.7:0/2041647654 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.848+0000 7f95c2d9d700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95c40b59f0 0x7f95c414f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.848+0000 7f95c359e700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95c4158ee0 0x7f95c4155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.848+0000 7f95c259c700 1 -- 172.21.15.7:0/2041647654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95c4158ee0 msgr2=0x7f95c4155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.848+0000 7f95c259c700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95c4158ee0 0x7f95c4155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.848+0000 7f95c259c700 1 -- 172.21.15.7:0/2041647654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95c40b59f0 msgr2=0x7f95c414f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.848+0000 7f95c259c700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95c40b59f0 0x7f95c414f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.848+0000 7f95c259c700 1 -- 172.21.15.7:0/2041647654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b80094f0 con 0x7f95c40cff50 2023-10-06T11:01:32.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.848+0000 7f95c359e700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95c4158ee0 0x7f95c4155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:32.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.848+0000 7f95c259c700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c40cff50 0x7f95c41550f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f95c406fbc0 tx=0x7f95b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:32.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.848+0000 7f95aaffd700 1 -- 172.21.15.7:0/2041647654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8024440 con 0x7f95c40cff50 2023-10-06T11:01:32.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.848+0000 7f95aaffd700 1 -- 172.21.15.7:0/2041647654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b80245c0 con 0x7f95c40cff50 2023-10-06T11:01:32.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.848+0000 7f95aaffd700 1 -- 172.21.15.7:0/2041647654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8024980 con 0x7f95c40cff50 2023-10-06T11:01:32.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.848+0000 7f95c9184700 1 -- 172.21.15.7:0/2041647654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c4155c60 con 0x7f95c40cff50 2023-10-06T11:01:32.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.848+0000 7f95c9184700 1 -- 172.21.15.7:0/2041647654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c4156220 con 0x7f95c40cff50 2023-10-06T11:01:32.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.849+0000 7f95c9184700 1 -- 172.21.15.7:0/2041647654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95c4151b60 con 0x7f95c40cff50 2023-10-06T11:01:32.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.850+0000 7f95aaffd700 1 -- 172.21.15.7:0/2041647654 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95b801a420 con 0x7f95c40cff50 2023-10-06T11:01:32.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.850+0000 7f95aaffd700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f95b0066f30 0x7f95b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.850+0000 7f95aaffd700 1 -- 172.21.15.7:0/2041647654 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f95b8086200 con 0x7f95c40cff50 2023-10-06T11:01:32.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.850+0000 7f95c2d9d700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f95b0066f30 0x7f95b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.850+0000 7f95aaffd700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.7:6800/119717,v1:172.21.15.7:6801/119717] conn(0x7f95b006d850 0x7f95b006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:32.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.851+0000 7f95aaffd700 1 -- 172.21.15.7:0/2041647654 --> [v2:172.21.15.7:6800/119717,v1:172.21.15.7:6801/119717] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95b0070370 con 0x7f95b006d850 2023-10-06T11:01:32.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.851+0000 7f95aaffd700 1 -- 172.21.15.7:0/2041647654 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95b8088700 con 0x7f95c40cff50 2023-10-06T11:01:32.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.851+0000 7f95c359e700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.7:6800/119717,v1:172.21.15.7:6801/119717] conn(0x7f95b006d850 0x7f95b006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:32.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.851+0000 7f95c2d9d700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f95b0066f30 0x7f95b00693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f95b4006fd0 tx=0x7f95b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:32.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.851+0000 7f95c359e700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.7:6800/119717,v1:172.21.15.7:6801/119717] conn(0x7f95b006d850 0x7f95b006fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:32.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.852+0000 7f95aaffd700 1 -- 172.21.15.7:0/2041647654 <== osd.2 v2:172.21.15.7:6800/119717 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f95b0070370 con 0x7f95b006d850 2023-10-06T11:01:32.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.866+0000 7f95c9184700 1 -- 172.21.15.7:0/2041647654 --> [v2:172.21.15.7:6800/119717,v1:172.21.15.7:6801/119717] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f95c4070480 con 0x7f95b006d850 2023-10-06T11:01:32.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.866+0000 7f95aaffd700 1 -- 172.21.15.7:0/2041647654 <== osd.2 v2:172.21.15.7:6800/119717 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f95c4070480 con 0x7f95b006d850 2023-10-06T11:01:32.867 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:01:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:01:32.868 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:01:32.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.867+0000 7f95c9184700 1 -- 172.21.15.7:0/2041647654 >> [v2:172.21.15.7:6800/119717,v1:172.21.15.7:6801/119717] conn(0x7f95b006d850 msgr2=0x7f95b006fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.867+0000 7f95c9184700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.7:6800/119717,v1:172.21.15.7:6801/119717] conn(0x7f95b006d850 0x7f95b006fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:32.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.867+0000 7f95c9184700 1 -- 172.21.15.7:0/2041647654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f95b0066f30 msgr2=0x7f95b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.867+0000 7f95c9184700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f95b0066f30 0x7f95b00693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f95b4006fd0 tx=0x7f95b4008040 comp rx=0 tx=0).stop 2023-10-06T11:01:32.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.867+0000 7f95c9184700 1 -- 172.21.15.7:0/2041647654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c40cff50 msgr2=0x7f95c41550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:32.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.867+0000 7f95c9184700 1 --2- 172.21.15.7:0/2041647654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c40cff50 0x7f95c41550f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f95c406fbc0 tx=0x7f95b8017000 comp rx=0 tx=0).stop 2023-10-06T11:01:32.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.867+0000 7f95c359e700 1 -- 172.21.15.7:0/2041647654 reap_dead start 2023-10-06T11:01:32.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.867+0000 7f95c9184700 1 -- 172.21.15.7:0/2041647654 shutdown_connections 2023-10-06T11:01:32.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.867+0000 7f95c9184700 1 -- 172.21.15.7:0/2041647654 >> 172.21.15.7:0/2041647654 conn(0x7f95c4069f60 msgr2=0x7f95c4151140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:32.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.867+0000 7f95c9184700 1 -- 172.21.15.7:0/2041647654 shutdown_connections 2023-10-06T11:01:32.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:32.867+0000 7f95c9184700 1 -- 172.21.15.7:0/2041647654 wait complete. 2023-10-06T11:01:32.880 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T11:01:33.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.013+0000 7f3a32460700 1 Processor -- start 2023-10-06T11:01:33.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.013+0000 7f3a32460700 1 -- start start 2023-10-06T11:01:33.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a32460700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a2c159220 0x7f3a2c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a32460700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a2c1595f0 0x7f3a2c0af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a32460700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2c0cf820 con 0x7f3a2c0ce7a0 2023-10-06T11:01:33.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a32460700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2c0cec10 con 0x7f3a2c1595f0 2023-10-06T11:01:33.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a32460700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0ceef0 con 0x7f3a2c159220 2023-10-06T11:01:33.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a2b7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3a2c0ce7a0 0x7f3a2c0cc030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42710/0 (socket says 172.21.15.7:42710) 2023-10-06T11:01:33.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a2b7fe700 1 -- 172.21.15.7:0/3366627024 learned_addr learned my addr 172.21.15.7:0/3366627024 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:33.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a309fd700 1 --2- 172.21.15.7:0/3366627024 >> v2:172.21.15.50:3300/0 conn(0x7f3a2c1595f0 0x7f3a2c0af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a2bfff700 1 --2- 172.21.15.7:0/3366627024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a2c159220 0x7f3a2c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a2affd700 1 -- 172.21.15.7:0/3366627024 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671847019 0 0) 0x7f3a2c0cf820 con 0x7f3a2c0ce7a0 2023-10-06T11:01:33.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a2affd700 1 -- 172.21.15.7:0/3366627024 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a14003570 con 0x7f3a2c0ce7a0 2023-10-06T11:01:33.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a2affd700 1 -- 172.21.15.7:0/3366627024 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1595066372 0 0) 0x7f3a14003570 con 0x7f3a2c0ce7a0 2023-10-06T11:01:33.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a2affd700 1 -- 172.21.15.7:0/3366627024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a2c159220 msgr2=0x7f3a2c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:33.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a2affd700 1 --2- 172.21.15.7:0/3366627024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a2c159220 0x7f3a2c0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a2affd700 1 -- 172.21.15.7:0/3366627024 >> v2:172.21.15.50:3300/0 conn(0x7f3a2c1595f0 msgr2=0x7f3a2c0af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:33.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a2affd700 1 --2- 172.21.15.7:0/3366627024 >> v2:172.21.15.50:3300/0 conn(0x7f3a2c1595f0 0x7f3a2c0af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a2affd700 1 -- 172.21.15.7:0/3366627024 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c0cf1d0 con 0x7f3a2c0ce7a0 2023-10-06T11:01:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a2affd700 1 -- 172.21.15.7:0/3366627024 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7f3a20001470 con 0x7f3a2c0ce7a0 2023-10-06T11:01:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a309fd700 1 --2- 172.21.15.7:0/3366627024 >> v2:172.21.15.50:3300/0 conn(0x7f3a2c1595f0 0x7f3a2c0af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:01:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a2affd700 1 -- 172.21.15.7:0/3366627024 >> v1:172.21.15.7:6789/0 conn(0x7f3a2c0ce7a0 legacy=0x7f3a2c0cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.014+0000 7f3a2affd700 1 --2- 172.21.15.7:0/3366627024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a2c159220 0x7f3a14003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2affd700 1 --2- 172.21.15.7:0/3366627024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a14003fe0 0x7f3a14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2affd700 1 --2- 172.21.15.7:0/3366627024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a14004d50 0x7f3a140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2affd700 1 -- 172.21.15.7:0/3366627024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0cec10 con 0x7f3a14003fe0 2023-10-06T11:01:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2affd700 1 -- 172.21.15.7:0/3366627024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0ceef0 con 0x7f3a14004d50 2023-10-06T11:01:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2affd700 1 -- 172.21.15.7:0/3366627024 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1400ba90 con 0x7f3a2c159220 2023-10-06T11:01:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2b7fe700 1 --2- 172.21.15.7:0/3366627024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a14003fe0 0x7f3a14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2bfff700 1 --2- 172.21.15.7:0/3366627024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a2c159220 0x7f3a14003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a309fd700 1 --2- 172.21.15.7:0/3366627024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a14004d50 0x7f3a140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2b7fe700 1 -- 172.21.15.7:0/3366627024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a2c159220 msgr2=0x7f3a14003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2b7fe700 1 --2- 172.21.15.7:0/3366627024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a2c159220 0x7f3a14003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2b7fe700 1 -- 172.21.15.7:0/3366627024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a14004d50 msgr2=0x7f3a140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2b7fe700 1 --2- 172.21.15.7:0/3366627024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a14004d50 0x7f3a140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2b7fe700 1 -- 172.21.15.7:0/3366627024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a14003570 con 0x7f3a14003fe0 2023-10-06T11:01:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2b7fe700 1 --2- 172.21.15.7:0/3366627024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a14003fe0 0x7f3a14004810 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000c3c0 tx=0x7f3a20001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803bd73bb0727c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:33.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2affd700 1 -- 172.21.15.7:0/3366627024 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2000cc30 con 0x7f3a14003fe0 2023-10-06T11:01:33.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2affd700 1 -- 172.21.15.7:0/3366627024 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2000cdd0 con 0x7f3a14003fe0 2023-10-06T11:01:33.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.015+0000 7f3a2affd700 1 -- 172.21.15.7:0/3366627024 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20005b70 con 0x7f3a14003fe0 2023-10-06T11:01:33.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.016+0000 7f3a32460700 1 -- 172.21.15.7:0/3366627024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a14003fe0 msgr2=0x7f3a14004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.016+0000 7f3a32460700 1 --2- 172.21.15.7:0/3366627024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a14003fe0 0x7f3a14004810 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000c3c0 tx=0x7f3a20001e90 comp rx=0 tx=0).stop 2023-10-06T11:01:33.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.016+0000 7f3a309fd700 1 -- 172.21.15.7:0/3366627024 reap_dead start 2023-10-06T11:01:33.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.016+0000 7f3a32460700 1 -- 172.21.15.7:0/3366627024 shutdown_connections 2023-10-06T11:01:33.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.016+0000 7f3a32460700 1 -- 172.21.15.7:0/3366627024 >> 172.21.15.7:0/3366627024 conn(0x7f3a2c069f60 msgr2=0x7f3a2c0670f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:33.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.016+0000 7f3a32460700 1 -- 172.21.15.7:0/3366627024 shutdown_connections 2023-10-06T11:01:33.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.016+0000 7f3a32460700 1 -- 172.21.15.7:0/3366627024 wait complete. 2023-10-06T11:01:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.018+0000 7f3a32460700 1 Processor -- start 2023-10-06T11:01:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.018+0000 7f3a32460700 1 -- start start 2023-10-06T11:01:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a32460700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a14003fe0 0x7f3a2c15a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a32460700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a2c14ec60 0x7f3a2c16a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a32460700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a2c14e580 0x7f3a2c150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a32460700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c16a5a0 con 0x7f3a14003fe0 2023-10-06T11:01:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a32460700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c151880 con 0x7f3a2c14ec60 2023-10-06T11:01:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a32460700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c14fee0 con 0x7f3a2c14e580 2023-10-06T11:01:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a2bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a14003fe0 0x7f3a2c15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a2bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a14003fe0 0x7f3a2c15a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59878/0 (socket says 172.21.15.7:59878) 2023-10-06T11:01:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a2bfff700 1 -- 172.21.15.7:0/194005195 learned_addr learned my addr 172.21.15.7:0/194005195 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a2b7fe700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a2c14ec60 0x7f3a2c16a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a309fd700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a2c14e580 0x7f3a2c150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a2bfff700 1 -- 172.21.15.7:0/194005195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a2c14e580 msgr2=0x7f3a2c150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a2bfff700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a2c14e580 0x7f3a2c150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a2bfff700 1 -- 172.21.15.7:0/194005195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a2c14ec60 msgr2=0x7f3a2c16a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a2bfff700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a2c14ec60 0x7f3a2c16a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a2bfff700 1 -- 172.21.15.7:0/194005195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c14f920 con 0x7f3a14003fe0 2023-10-06T11:01:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.019+0000 7f3a2b7fe700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a2c14ec60 0x7f3a2c16a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.020+0000 7f3a2bfff700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a14003fe0 0x7f3a2c15a170 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c011d70 tx=0x7f3a1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.020+0000 7f3a13fff700 1 -- 172.21.15.7:0/194005195 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c009e20 con 0x7f3a14003fe0 2023-10-06T11:01:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.020+0000 7f3a13fff700 1 -- 172.21.15.7:0/194005195 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c00fc50 con 0x7f3a14003fe0 2023-10-06T11:01:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.020+0000 7f3a13fff700 1 -- 172.21.15.7:0/194005195 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c014440 con 0x7f3a14003fe0 2023-10-06T11:01:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.020+0000 7f3a32460700 1 -- 172.21.15.7:0/194005195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c14fc00 con 0x7f3a14003fe0 2023-10-06T11:01:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.020+0000 7f3a32460700 1 -- 172.21.15.7:0/194005195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c14e9f0 con 0x7f3a14003fe0 2023-10-06T11:01:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.021+0000 7f3a32460700 1 -- 172.21.15.7:0/194005195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c151b60 con 0x7f3a14003fe0 2023-10-06T11:01:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.021+0000 7f3a13fff700 1 -- 172.21.15.7:0/194005195 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a1c014870 con 0x7f3a14003fe0 2023-10-06T11:01:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.022+0000 7f3a13fff700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3a18066f30 0x7f3a180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.022+0000 7f3a13fff700 1 -- 172.21.15.7:0/194005195 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f3a1c018030 con 0x7f3a14003fe0 2023-10-06T11:01:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.022+0000 7f3a2b7fe700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3a18066f30 0x7f3a180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.022+0000 7f3a2b7fe700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3a18066f30 0x7f3a180693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000c3c0 tx=0x7f3a20015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.026+0000 7f3a13fff700 1 -- 172.21.15.7:0/194005195 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a1c052540 con 0x7f3a14003fe0 2023-10-06T11:01:33.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.227+0000 7f3a32460700 1 -- 172.21.15.7:0/194005195 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a2c1500a0 con 0x7f3a18066f30 2023-10-06T11:01:33.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.228+0000 7f3a13fff700 1 -- 172.21.15.7:0/194005195 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3a2c1500a0 con 0x7f3a18066f30 2023-10-06T11:01:33.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.230+0000 7f3a32460700 1 -- 172.21.15.7:0/194005195 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3a18066f30 msgr2=0x7f3a180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.230+0000 7f3a32460700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3a18066f30 0x7f3a180693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000c3c0 tx=0x7f3a20015000 comp rx=0 tx=0).stop 2023-10-06T11:01:33.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.230+0000 7f3a32460700 1 -- 172.21.15.7:0/194005195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a14003fe0 msgr2=0x7f3a2c15a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.230+0000 7f3a32460700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a14003fe0 0x7f3a2c15a170 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c011d70 tx=0x7f3a1c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.230+0000 7f3a32460700 1 -- 172.21.15.7:0/194005195 shutdown_connections 2023-10-06T11:01:33.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.230+0000 7f3a32460700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f3a18066f30 0x7f3a180693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.230+0000 7f3a32460700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a14003fe0 0x7f3a2c15a170 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.230+0000 7f3a32460700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a2c14e580 0x7f3a2c150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.230+0000 7f3a32460700 1 --2- 172.21.15.7:0/194005195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a2c14ec60 0x7f3a2c16a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.230+0000 7f3a32460700 1 -- 172.21.15.7:0/194005195 >> 172.21.15.7:0/194005195 conn(0x7f3a2c069f60 msgr2=0x7f3a2c158150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:33.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.230+0000 7f3a32460700 1 -- 172.21.15.7:0/194005195 shutdown_connections 2023-10-06T11:01:33.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.230+0000 7f3a32460700 1 -- 172.21.15.7:0/194005195 wait complete. 2023-10-06T11:01:33.232 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T11:01:33.244 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T11:01:33.244 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:01:33.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.379+0000 7f1898dc3700 1 Processor -- start 2023-10-06T11:01:33.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.379+0000 7f1898dc3700 1 -- start start 2023-10-06T11:01:33.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.380+0000 7f1898dc3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1894155f70 0x7f18940ac900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.380+0000 7f1898dc3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f18940cd480 0x7f18940a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.380+0000 7f1898dc3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1894069280 con 0x7f18940a9950 2023-10-06T11:01:33.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.380+0000 7f1898dc3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18940aa680 con 0x7f18940cd480 2023-10-06T11:01:33.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.380+0000 7f1898dc3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18940aa3a0 con 0x7f1894155f70 2023-10-06T11:01:33.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.380+0000 7f1892d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f18940cd480 0x7f18940a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.380+0000 7f1891d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f18940a9950 0x7f18940ccd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42718/0 (socket says 172.21.15.7:42718) 2023-10-06T11:01:33.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.380+0000 7f1891d9b700 1 -- 172.21.15.7:0/22213112 learned_addr learned my addr 172.21.15.7:0/22213112 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:33.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.381+0000 7f189259c700 1 --2- 172.21.15.7:0/22213112 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1894155f70 0x7f18940ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.381+0000 7f1892d9d700 1 -- 172.21.15.7:0/22213112 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1894155f70 msgr2=0x7f18940ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:33.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.381+0000 7f1892d9d700 1 --2- 172.21.15.7:0/22213112 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1894155f70 0x7f18940ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.381+0000 7f1892d9d700 1 -- 172.21.15.7:0/22213112 >> v1:172.21.15.7:6789/0 conn(0x7f18940a9950 legacy=0x7f18940ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.381+0000 7f1892d9d700 1 -- 172.21.15.7:0/22213112 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894068c30 con 0x7f18940cd480 2023-10-06T11:01:33.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.381+0000 7f189159a700 1 -- 172.21.15.7:0/22213112 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19629307 0 0) 0x7f1894069280 con 0x7f18940a9950 2023-10-06T11:01:33.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.381+0000 7f1892d9d700 1 --2- 172.21.15.7:0/22213112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18940cd480 0x7f18940a9dc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f188c009e60 tx=0x7f188c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14789b8ba2bf8b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:33.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.381+0000 7f189159a700 1 -- 172.21.15.7:0/22213112 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00e070 con 0x7f18940cd480 2023-10-06T11:01:33.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.381+0000 7f189159a700 1 -- 172.21.15.7:0/22213112 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c00bb60 con 0x7f18940cd480 2023-10-06T11:01:33.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.381+0000 7f189159a700 1 -- 172.21.15.7:0/22213112 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c012430 con 0x7f18940cd480 2023-10-06T11:01:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.382+0000 7f1898dc3700 1 -- 172.21.15.7:0/22213112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18940cd480 msgr2=0x7f18940a9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.382+0000 7f1898dc3700 1 --2- 172.21.15.7:0/22213112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18940cd480 0x7f18940a9dc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f188c009e60 tx=0x7f188c009780 comp rx=0 tx=0).stop 2023-10-06T11:01:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.382+0000 7f1898dc3700 1 -- 172.21.15.7:0/22213112 shutdown_connections 2023-10-06T11:01:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.382+0000 7f1898dc3700 1 --2- 172.21.15.7:0/22213112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18940cd480 0x7f18940a9dc0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.382+0000 7f1898dc3700 1 --2- 172.21.15.7:0/22213112 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1894155f70 0x7f18940ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.382+0000 7f1898dc3700 1 -- 172.21.15.7:0/22213112 >> 172.21.15.7:0/22213112 conn(0x7f1894096160 msgr2=0x7f18940afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.382+0000 7f1898dc3700 1 -- 172.21.15.7:0/22213112 shutdown_connections 2023-10-06T11:01:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.382+0000 7f1898dc3700 1 -- 172.21.15.7:0/22213112 wait complete. 2023-10-06T11:01:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.383+0000 7f1898dc3700 1 Processor -- start 2023-10-06T11:01:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.383+0000 7f1898dc3700 1 -- start start 2023-10-06T11:01:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.384+0000 7f1898dc3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18940a9950 0x7f18941551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.384+0000 7f1898dc3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18940cd480 0x7f1894150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.384+0000 7f1898dc3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1894155f70 0x7f18941531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.384+0000 7f1898dc3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1894155710 con 0x7f18940cd480 2023-10-06T11:01:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.384+0000 7f1898dc3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189416a130 con 0x7f18940a9950 2023-10-06T11:01:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.384+0000 7f1898dc3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1894150b80 con 0x7f1894155f70 2023-10-06T11:01:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.384+0000 7f1891d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18940cd480 0x7f1894150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.384+0000 7f1891d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18940cd480 0x7f1894150640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59890/0 (socket says 172.21.15.7:59890) 2023-10-06T11:01:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.384+0000 7f1891d9b700 1 -- 172.21.15.7:0/4266823954 learned_addr learned my addr 172.21.15.7:0/4266823954 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.384+0000 7f189259c700 1 --2- 172.21.15.7:0/4266823954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18940a9950 0x7f18941551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.384+0000 7f1892d9d700 1 --2- 172.21.15.7:0/4266823954 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1894155f70 0x7f18941531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.384+0000 7f1891d9b700 1 -- 172.21.15.7:0/4266823954 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1894155f70 msgr2=0x7f18941531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.384+0000 7f1891d9b700 1 --2- 172.21.15.7:0/4266823954 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1894155f70 0x7f18941531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.385+0000 7f1891d9b700 1 -- 172.21.15.7:0/4266823954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18940a9950 msgr2=0x7f18941551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.385+0000 7f1891d9b700 1 --2- 172.21.15.7:0/4266823954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18940a9950 0x7f18941551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.385+0000 7f1891d9b700 1 -- 172.21.15.7:0/4266823954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c009a20 con 0x7f18940cd480 2023-10-06T11:01:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.385+0000 7f1891d9b700 1 --2- 172.21.15.7:0/4266823954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18940cd480 0x7f1894150640 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f187c00c810 tx=0x7f187c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.385+0000 7f188a7fc700 1 -- 172.21.15.7:0/4266823954 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c005b30 con 0x7f18940cd480 2023-10-06T11:01:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.385+0000 7f188a7fc700 1 -- 172.21.15.7:0/4266823954 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c005c90 con 0x7f18940cd480 2023-10-06T11:01:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.385+0000 7f1898dc3700 1 -- 172.21.15.7:0/4266823954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1894152f90 con 0x7f18940cd480 2023-10-06T11:01:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.385+0000 7f188a7fc700 1 -- 172.21.15.7:0/4266823954 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c007300 con 0x7f18940cd480 2023-10-06T11:01:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.385+0000 7f1898dc3700 1 -- 172.21.15.7:0/4266823954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18941524b0 con 0x7f18940cd480 2023-10-06T11:01:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.386+0000 7f1898dc3700 1 -- 172.21.15.7:0/4266823954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1894070480 con 0x7f18940cd480 2023-10-06T11:01:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.386+0000 7f188a7fc700 1 -- 172.21.15.7:0/4266823954 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f187c01b3b0 con 0x7f18940cd480 2023-10-06T11:01:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.387+0000 7f188a7fc700 1 --2- 172.21.15.7:0/4266823954 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1874066f30 0x7f18740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.387+0000 7f188a7fc700 1 -- 172.21.15.7:0/4266823954 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f187c084140 con 0x7f18940cd480 2023-10-06T11:01:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.387+0000 7f189259c700 1 --2- 172.21.15.7:0/4266823954 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1874066f30 0x7f18740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.387+0000 7f188a7fc700 1 --2- 172.21.15.7:0/4266823954 >> [v2:172.21.15.7:6816/119718,v1:172.21.15.7:6818/119718] conn(0x7f187406d850 0x7f187406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.387+0000 7f188a7fc700 1 -- 172.21.15.7:0/4266823954 --> [v2:172.21.15.7:6816/119718,v1:172.21.15.7:6818/119718] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1874070370 con 0x7f187406d850 2023-10-06T11:01:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.387+0000 7f188a7fc700 1 -- 172.21.15.7:0/4266823954 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f187c084510 con 0x7f18940cd480 2023-10-06T11:01:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.387+0000 7f1892d9d700 1 --2- 172.21.15.7:0/4266823954 >> [v2:172.21.15.7:6816/119718,v1:172.21.15.7:6818/119718] conn(0x7f187406d850 0x7f187406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.387+0000 7f189259c700 1 --2- 172.21.15.7:0/4266823954 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1874066f30 0x7f18740693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1884009d10 tx=0x7f18840091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.388+0000 7f1892d9d700 1 --2- 172.21.15.7:0/4266823954 >> [v2:172.21.15.7:6816/119718,v1:172.21.15.7:6818/119718] conn(0x7f187406d850 0x7f187406fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.388+0000 7f188a7fc700 1 -- 172.21.15.7:0/4266823954 <== osd.3 v2:172.21.15.7:6816/119718 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1874070370 con 0x7f187406d850 2023-10-06T11:01:33.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.403+0000 7f1898dc3700 1 -- 172.21.15.7:0/4266823954 --> [v2:172.21.15.7:6816/119718,v1:172.21.15.7:6818/119718] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1894068f10 con 0x7f187406d850 2023-10-06T11:01:33.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.403+0000 7f188a7fc700 1 -- 172.21.15.7:0/4266823954 <== osd.3 v2:172.21.15.7:6816/119718 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1894068f10 con 0x7f187406d850 2023-10-06T11:01:33.404 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:01:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:01:33.404 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:01:33.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.404+0000 7f1898dc3700 1 -- 172.21.15.7:0/4266823954 >> [v2:172.21.15.7:6816/119718,v1:172.21.15.7:6818/119718] conn(0x7f187406d850 msgr2=0x7f187406fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.404+0000 7f1898dc3700 1 --2- 172.21.15.7:0/4266823954 >> [v2:172.21.15.7:6816/119718,v1:172.21.15.7:6818/119718] conn(0x7f187406d850 0x7f187406fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.404+0000 7f1898dc3700 1 -- 172.21.15.7:0/4266823954 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1874066f30 msgr2=0x7f18740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.404+0000 7f1898dc3700 1 --2- 172.21.15.7:0/4266823954 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1874066f30 0x7f18740693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1884009d10 tx=0x7f18840091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.404+0000 7f1898dc3700 1 -- 172.21.15.7:0/4266823954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18940cd480 msgr2=0x7f1894150640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.404+0000 7f1898dc3700 1 --2- 172.21.15.7:0/4266823954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18940cd480 0x7f1894150640 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f187c00c810 tx=0x7f187c007df0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.404+0000 7f1892d9d700 1 -- 172.21.15.7:0/4266823954 reap_dead start 2023-10-06T11:01:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.404+0000 7f1898dc3700 1 -- 172.21.15.7:0/4266823954 shutdown_connections 2023-10-06T11:01:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.404+0000 7f1898dc3700 1 -- 172.21.15.7:0/4266823954 >> 172.21.15.7:0/4266823954 conn(0x7f1894096160 msgr2=0x7f189406c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.404+0000 7f1898dc3700 1 -- 172.21.15.7:0/4266823954 shutdown_connections 2023-10-06T11:01:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.404+0000 7f1898dc3700 1 -- 172.21.15.7:0/4266823954 wait complete. 2023-10-06T11:01:33.417 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T11:01:33.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.549+0000 7f1ae8152700 1 Processor -- start 2023-10-06T11:01:33.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.549+0000 7f1ae8152700 1 -- start start 2023-10-06T11:01:33.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.550+0000 7f1ae8152700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ae015ce10 0x7f1ae015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.550+0000 7f1ae8152700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ae01594a0 0x7f1ae0159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.550+0000 7f1ae8152700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae00694d0 con 0x7f1ae01590d0 2023-10-06T11:01:33.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.550+0000 7f1ae8152700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae015d7f0 con 0x7f1ae015ce10 2023-10-06T11:01:33.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.550+0000 7f1ae8152700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0068990 con 0x7f1ae01594a0 2023-10-06T11:01:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.551+0000 7f1ae5eee700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1ae01590d0 0x7f1ae0069bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42720/0 (socket says 172.21.15.7:42720) 2023-10-06T11:01:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.551+0000 7f1ae5eee700 1 -- 172.21.15.7:0/3385772904 learned_addr learned my addr 172.21.15.7:0/3385772904 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.551+0000 7f1ae56ed700 1 --2- 172.21.15.7:0/3385772904 >> v2:172.21.15.50:3300/0 conn(0x7f1ae015ce10 0x7f1ae015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.551+0000 7f1ae66ef700 1 --2- 172.21.15.7:0/3385772904 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ae01594a0 0x7f1ae0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.551+0000 7f1ae4eec700 1 -- 172.21.15.7:0/3385772904 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667709377 0 0) 0x7f1ae00694d0 con 0x7f1ae01590d0 2023-10-06T11:01:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.551+0000 7f1ae4eec700 1 -- 172.21.15.7:0/3385772904 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1acc003570 con 0x7f1ae01590d0 2023-10-06T11:01:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.551+0000 7f1ae56ed700 1 -- 172.21.15.7:0/3385772904 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ae01594a0 msgr2=0x7f1ae0159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.551+0000 7f1ae56ed700 1 --2- 172.21.15.7:0/3385772904 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ae01594a0 0x7f1ae0159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.551+0000 7f1ae56ed700 1 -- 172.21.15.7:0/3385772904 >> v1:172.21.15.7:6789/0 conn(0x7f1ae01590d0 legacy=0x7f1ae0069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.551+0000 7f1ae56ed700 1 -- 172.21.15.7:0/3385772904 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae0068ba0 con 0x7f1ae015ce10 2023-10-06T11:01:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.551+0000 7f1ae56ed700 1 --2- 172.21.15.7:0/3385772904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ae015ce10 0x7f1ae015d2b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0098e0 tx=0x7f1adc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=892a7e82e507f31c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.552+0000 7f1ae4eec700 1 -- 172.21.15.7:0/3385772904 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc011630 con 0x7f1ae015ce10 2023-10-06T11:01:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.552+0000 7f1ae4eec700 1 -- 172.21.15.7:0/3385772904 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc011790 con 0x7f1ae015ce10 2023-10-06T11:01:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.552+0000 7f1ae4eec700 1 -- 172.21.15.7:0/3385772904 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc011b10 con 0x7f1ae015ce10 2023-10-06T11:01:33.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.552+0000 7f1ae8152700 1 -- 172.21.15.7:0/3385772904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ae015ce10 msgr2=0x7f1ae015d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.552+0000 7f1ae8152700 1 --2- 172.21.15.7:0/3385772904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ae015ce10 0x7f1ae015d2b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0098e0 tx=0x7f1adc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.552+0000 7f1ae8152700 1 -- 172.21.15.7:0/3385772904 shutdown_connections 2023-10-06T11:01:33.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.552+0000 7f1ae8152700 1 --2- 172.21.15.7:0/3385772904 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ae01594a0 0x7f1ae0159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.552+0000 7f1ae8152700 1 --2- 172.21.15.7:0/3385772904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ae015ce10 0x7f1ae015d2b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.552+0000 7f1ae8152700 1 -- 172.21.15.7:0/3385772904 >> 172.21.15.7:0/3385772904 conn(0x7f1ae0096160 msgr2=0x7f1ae00afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.552+0000 7f1ae8152700 1 -- 172.21.15.7:0/3385772904 shutdown_connections 2023-10-06T11:01:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.552+0000 7f1ae8152700 1 -- 172.21.15.7:0/3385772904 wait complete. 2023-10-06T11:01:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.553+0000 7f1ae8152700 1 Processor -- start 2023-10-06T11:01:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.553+0000 7f1ae8152700 1 -- start start 2023-10-06T11:01:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.554+0000 7f1ae8152700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ae01590d0 0x7f1ae0097c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.554+0000 7f1ae8152700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ae01594a0 0x7f1ae01564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.554+0000 7f1ae8152700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ae015ce10 0x7f1ae01569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.554+0000 7f1ae8152700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae015c9c0 con 0x7f1ae015ce10 2023-10-06T11:01:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.554+0000 7f1ae8152700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0155490 con 0x7f1ae01594a0 2023-10-06T11:01:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.554+0000 7f1ae8152700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0156010 con 0x7f1ae01590d0 2023-10-06T11:01:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.554+0000 7f1ae66ef700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ae015ce10 0x7f1ae01569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.554+0000 7f1ae66ef700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ae015ce10 0x7f1ae01569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59892/0 (socket says 172.21.15.7:59892) 2023-10-06T11:01:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.554+0000 7f1ae66ef700 1 -- 172.21.15.7:0/3210321969 learned_addr learned my addr 172.21.15.7:0/3210321969 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.555+0000 7f1ae56ed700 1 --2- 172.21.15.7:0/3210321969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ae01594a0 0x7f1ae01564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.555+0000 7f1ae5eee700 1 --2- 172.21.15.7:0/3210321969 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ae01590d0 0x7f1ae0097c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.555+0000 7f1ae66ef700 1 -- 172.21.15.7:0/3210321969 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ae01590d0 msgr2=0x7f1ae0097c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.555+0000 7f1ae66ef700 1 --2- 172.21.15.7:0/3210321969 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ae01590d0 0x7f1ae0097c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.555+0000 7f1ae66ef700 1 -- 172.21.15.7:0/3210321969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ae01594a0 msgr2=0x7f1ae01564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.555+0000 7f1ae66ef700 1 --2- 172.21.15.7:0/3210321969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ae01594a0 0x7f1ae01564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.555+0000 7f1ae66ef700 1 -- 172.21.15.7:0/3210321969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc009420 con 0x7f1ae015ce10 2023-10-06T11:01:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.555+0000 7f1ae66ef700 1 --2- 172.21.15.7:0/3210321969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ae015ce10 0x7f1ae01569e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009ec0 tx=0x7f1ad800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.555+0000 7f1ad1ffb700 1 -- 172.21.15.7:0/3210321969 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800cc20 con 0x7f1ae015ce10 2023-10-06T11:01:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.555+0000 7f1ad1ffb700 1 -- 172.21.15.7:0/3210321969 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad800f040 con 0x7f1ae015ce10 2023-10-06T11:01:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.555+0000 7f1ae8152700 1 -- 172.21.15.7:0/3210321969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae01556e0 con 0x7f1ae015ce10 2023-10-06T11:01:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.555+0000 7f1ad1ffb700 1 -- 172.21.15.7:0/3210321969 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8014480 con 0x7f1ae015ce10 2023-10-06T11:01:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.555+0000 7f1ae8152700 1 -- 172.21.15.7:0/3210321969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae0155d20 con 0x7f1ae015ce10 2023-10-06T11:01:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.556+0000 7f1ae8152700 1 -- 172.21.15.7:0/3210321969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae0096530 con 0x7f1ae015ce10 2023-10-06T11:01:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.557+0000 7f1ad1ffb700 1 -- 172.21.15.7:0/3210321969 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ad80147f0 con 0x7f1ae015ce10 2023-10-06T11:01:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.557+0000 7f1ad1ffb700 1 --2- 172.21.15.7:0/3210321969 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1ac4066f30 0x7f1ac40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.557+0000 7f1ad1ffb700 1 -- 172.21.15.7:0/3210321969 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f1ad8085270 con 0x7f1ae015ce10 2023-10-06T11:01:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.557+0000 7f1ae5eee700 1 --2- 172.21.15.7:0/3210321969 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1ac4066f30 0x7f1ac40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.558+0000 7f1ae5eee700 1 --2- 172.21.15.7:0/3210321969 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1ac4066f30 0x7f1ac40693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40058d0 tx=0x7f1ad4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:33.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.562+0000 7f1ad1ffb700 1 -- 172.21.15.7:0/3210321969 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ad8055f30 con 0x7f1ae015ce10 2023-10-06T11:01:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.767+0000 7f1ae8152700 1 -- 172.21.15.7:0/3210321969 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ae0070480 con 0x7f1ac4066f30 2023-10-06T11:01:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.768+0000 7f1ad1ffb700 1 -- 172.21.15.7:0/3210321969 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1ae0070480 con 0x7f1ac4066f30 2023-10-06T11:01:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.770+0000 7f1ae8152700 1 -- 172.21.15.7:0/3210321969 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1ac4066f30 msgr2=0x7f1ac40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.770+0000 7f1ae8152700 1 --2- 172.21.15.7:0/3210321969 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1ac4066f30 0x7f1ac40693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40058d0 tx=0x7f1ad4009040 comp rx=0 tx=0).stop 2023-10-06T11:01:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.770+0000 7f1ae8152700 1 -- 172.21.15.7:0/3210321969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ae015ce10 msgr2=0x7f1ae01569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.770+0000 7f1ae8152700 1 --2- 172.21.15.7:0/3210321969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ae015ce10 0x7f1ae01569e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009ec0 tx=0x7f1ad800b040 comp rx=0 tx=0).stop 2023-10-06T11:01:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.770+0000 7f1ae8152700 1 -- 172.21.15.7:0/3210321969 shutdown_connections 2023-10-06T11:01:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.770+0000 7f1ae8152700 1 --2- 172.21.15.7:0/3210321969 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f1ac4066f30 0x7f1ac40693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.770+0000 7f1ae8152700 1 --2- 172.21.15.7:0/3210321969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ae015ce10 0x7f1ae01569e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.770+0000 7f1ae8152700 1 --2- 172.21.15.7:0/3210321969 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ae01590d0 0x7f1ae0097c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.770+0000 7f1ae8152700 1 --2- 172.21.15.7:0/3210321969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ae01594a0 0x7f1ae01564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.770+0000 7f1ae8152700 1 -- 172.21.15.7:0/3210321969 >> 172.21.15.7:0/3210321969 conn(0x7f1ae0096160 msgr2=0x7f1ae0152610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:33.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.770+0000 7f1ae8152700 1 -- 172.21.15.7:0/3210321969 shutdown_connections 2023-10-06T11:01:33.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.770+0000 7f1ae8152700 1 -- 172.21.15.7:0/3210321969 wait complete. 2023-10-06T11:01:33.773 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T11:01:33.784 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T11:01:33.784 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:01:33.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.919+0000 7f009c433700 1 Processor -- start 2023-10-06T11:01:33.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.919+0000 7f009c433700 1 -- start start 2023-10-06T11:01:33.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.920+0000 7f009c433700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f00940cbc30 0x7f00940afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.920+0000 7f009c433700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00940c8f50 0x7f00940cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.920+0000 7f009c433700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00940adf90 con 0x7f00940ac840 2023-10-06T11:01:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.920+0000 7f009c433700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00940b0370 con 0x7f00940cbc30 2023-10-06T11:01:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.920+0000 7f009c433700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00940ae230 con 0x7f00940c8f50 2023-10-06T11:01:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.921+0000 7f009a1cf700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f00940cbc30 0x7f00940afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.921+0000 7f009a9d0700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f00940ac840 0x7f0094161ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42726/0 (socket says 172.21.15.7:42726) 2023-10-06T11:01:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.921+0000 7f009a9d0700 1 -- 172.21.15.7:0/1286428707 learned_addr learned my addr 172.21.15.7:0/1286428707 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.921+0000 7f00999ce700 1 --2- 172.21.15.7:0/1286428707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00940c8f50 0x7f00940cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.921+0000 7f009a1cf700 1 -- 172.21.15.7:0/1286428707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00940c8f50 msgr2=0x7f00940cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.921+0000 7f009a1cf700 1 --2- 172.21.15.7:0/1286428707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00940c8f50 0x7f00940cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.921+0000 7f009a1cf700 1 -- 172.21.15.7:0/1286428707 >> v1:172.21.15.7:6789/0 conn(0x7f00940ac840 legacy=0x7f0094161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.921+0000 7f00991cd700 1 -- 172.21.15.7:0/1286428707 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425852529 0 0) 0x7f00940adf90 con 0x7f00940ac840 2023-10-06T11:01:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.921+0000 7f009a1cf700 1 -- 172.21.15.7:0/1286428707 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940ae510 con 0x7f00940cbc30 2023-10-06T11:01:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.921+0000 7f009a1cf700 1 --2- 172.21.15.7:0/1286428707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00940cbc30 0x7f00940afb40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f00900098e0 tx=0x7f00900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ead3fc145b53606 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.921+0000 7f00991cd700 1 -- 172.21.15.7:0/1286428707 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0090009e80 con 0x7f00940cbc30 2023-10-06T11:01:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.921+0000 7f00991cd700 1 -- 172.21.15.7:0/1286428707 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009000b860 con 0x7f00940cbc30 2023-10-06T11:01:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.921+0000 7f00991cd700 1 -- 172.21.15.7:0/1286428707 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009000bbe0 con 0x7f00940cbc30 2023-10-06T11:01:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.922+0000 7f009c433700 1 -- 172.21.15.7:0/1286428707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00940cbc30 msgr2=0x7f00940afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.922+0000 7f009c433700 1 --2- 172.21.15.7:0/1286428707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00940cbc30 0x7f00940afb40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f00900098e0 tx=0x7f00900091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.922+0000 7f009c433700 1 -- 172.21.15.7:0/1286428707 shutdown_connections 2023-10-06T11:01:33.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.922+0000 7f009c433700 1 --2- 172.21.15.7:0/1286428707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00940cbc30 0x7f00940afb40 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.922+0000 7f009c433700 1 --2- 172.21.15.7:0/1286428707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00940c8f50 0x7f00940cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.922+0000 7f009c433700 1 -- 172.21.15.7:0/1286428707 >> 172.21.15.7:0/1286428707 conn(0x7f0094095a70 msgr2=0x7f00940af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:33.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.922+0000 7f009c433700 1 -- 172.21.15.7:0/1286428707 shutdown_connections 2023-10-06T11:01:33.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.922+0000 7f009c433700 1 -- 172.21.15.7:0/1286428707 wait complete. 2023-10-06T11:01:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.923+0000 7f009c433700 1 Processor -- start 2023-10-06T11:01:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.923+0000 7f009c433700 1 -- start start 2023-10-06T11:01:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.924+0000 7f009c433700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00940ac840 0x7f009416d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.924+0000 7f009c433700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00940c8f50 0x7f0094156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.924+0000 7f009c433700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00940cbc30 0x7f009415d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.924+0000 7f009c433700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009416d060 con 0x7f00940c8f50 2023-10-06T11:01:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.924+0000 7f009c433700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0094099b60 con 0x7f00940ac840 2023-10-06T11:01:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.924+0000 7f009c433700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0094099e40 con 0x7f00940cbc30 2023-10-06T11:01:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.924+0000 7f00999ce700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00940c8f50 0x7f0094156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.924+0000 7f00999ce700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00940c8f50 0x7f0094156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59912/0 (socket says 172.21.15.7:59912) 2023-10-06T11:01:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.924+0000 7f00999ce700 1 -- 172.21.15.7:0/1885640281 learned_addr learned my addr 172.21.15.7:0/1885640281 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.924+0000 7f009a9d0700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00940cbc30 0x7f009415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.924+0000 7f009a1cf700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00940ac840 0x7f009416d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.925+0000 7f00999ce700 1 -- 172.21.15.7:0/1885640281 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00940cbc30 msgr2=0x7f009415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.925+0000 7f00999ce700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00940cbc30 0x7f009415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.925+0000 7f00999ce700 1 -- 172.21.15.7:0/1885640281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00940ac840 msgr2=0x7f009416d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.925+0000 7f00999ce700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00940ac840 0x7f009416d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.925+0000 7f00999ce700 1 -- 172.21.15.7:0/1885640281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0090009420 con 0x7f00940c8f50 2023-10-06T11:01:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.925+0000 7f009a1cf700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00940ac840 0x7f009416d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.925+0000 7f009a9d0700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00940cbc30 0x7f009415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.925+0000 7f00999ce700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00940c8f50 0x7f0094156440 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f008400d890 tx=0x7f0084008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.925+0000 7f008a7fc700 1 -- 172.21.15.7:0/1885640281 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008400b600 con 0x7f00940c8f50 2023-10-06T11:01:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.925+0000 7f008a7fc700 1 -- 172.21.15.7:0/1885640281 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008400b760 con 0x7f00940c8f50 2023-10-06T11:01:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.925+0000 7f009c433700 1 -- 172.21.15.7:0/1885640281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009409a120 con 0x7f00940c8f50 2023-10-06T11:01:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.925+0000 7f008a7fc700 1 -- 172.21.15.7:0/1885640281 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008400bae0 con 0x7f00940c8f50 2023-10-06T11:01:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.925+0000 7f009c433700 1 -- 172.21.15.7:0/1885640281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009416da30 con 0x7f00940c8f50 2023-10-06T11:01:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.926+0000 7f009c433700 1 -- 172.21.15.7:0/1885640281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f009404c130 con 0x7f00940c8f50 2023-10-06T11:01:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.926+0000 7f008a7fc700 1 -- 172.21.15.7:0/1885640281 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f008401e460 con 0x7f00940c8f50 2023-10-06T11:01:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.927+0000 7f008a7fc700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0078066f30 0x7f00780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.927+0000 7f008a7fc700 1 -- 172.21.15.7:0/1885640281 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f0084084bb0 con 0x7f00940c8f50 2023-10-06T11:01:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.927+0000 7f009a1cf700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0078066f30 0x7f00780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.927+0000 7f008a7fc700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.50:6800/119979,v1:172.21.15.50:6801/119979] conn(0x7f007806d850 0x7f007806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.927+0000 7f008a7fc700 1 -- 172.21.15.7:0/1885640281 --> [v2:172.21.15.50:6800/119979,v1:172.21.15.50:6801/119979] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0078070370 con 0x7f007806d850 2023-10-06T11:01:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.927+0000 7f008a7fc700 1 -- 172.21.15.7:0/1885640281 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0084089240 con 0x7f00940c8f50 2023-10-06T11:01:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.927+0000 7f009a1cf700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0078066f30 0x7f00780693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f00900091e0 tx=0x7f0090017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.927+0000 7f009a9d0700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.50:6800/119979,v1:172.21.15.50:6801/119979] conn(0x7f007806d850 0x7f007806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.928+0000 7f009a9d0700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.50:6800/119979,v1:172.21.15.50:6801/119979] conn(0x7f007806d850 0x7f007806fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.929+0000 7f008a7fc700 1 -- 172.21.15.7:0/1885640281 <== osd.4 v2:172.21.15.50:6800/119979 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0078070370 con 0x7f007806d850 2023-10-06T11:01:33.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.943+0000 7f009c433700 1 -- 172.21.15.7:0/1885640281 --> [v2:172.21.15.50:6800/119979,v1:172.21.15.50:6801/119979] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0094070480 con 0x7f007806d850 2023-10-06T11:01:33.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.944+0000 7f008a7fc700 1 -- 172.21.15.7:0/1885640281 <== osd.4 v2:172.21.15.50:6800/119979 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0094070480 con 0x7f007806d850 2023-10-06T11:01:33.944 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:01:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:01:33.945 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:01:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.944+0000 7f009c433700 1 -- 172.21.15.7:0/1885640281 >> [v2:172.21.15.50:6800/119979,v1:172.21.15.50:6801/119979] conn(0x7f007806d850 msgr2=0x7f007806fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.944+0000 7f009c433700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.50:6800/119979,v1:172.21.15.50:6801/119979] conn(0x7f007806d850 0x7f007806fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.944+0000 7f009c433700 1 -- 172.21.15.7:0/1885640281 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0078066f30 msgr2=0x7f00780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.944+0000 7f009c433700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f0078066f30 0x7f00780693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f00900091e0 tx=0x7f0090017000 comp rx=0 tx=0).stop 2023-10-06T11:01:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.944+0000 7f009c433700 1 -- 172.21.15.7:0/1885640281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00940c8f50 msgr2=0x7f0094156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.944+0000 7f009c433700 1 --2- 172.21.15.7:0/1885640281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00940c8f50 0x7f0094156440 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f008400d890 tx=0x7f0084008040 comp rx=0 tx=0).stop 2023-10-06T11:01:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.944+0000 7f009a9d0700 1 -- 172.21.15.7:0/1885640281 reap_dead start 2023-10-06T11:01:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.944+0000 7f009c433700 1 -- 172.21.15.7:0/1885640281 shutdown_connections 2023-10-06T11:01:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.944+0000 7f009c433700 1 -- 172.21.15.7:0/1885640281 >> 172.21.15.7:0/1885640281 conn(0x7f0094095a70 msgr2=0x7f0094158a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:33.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.944+0000 7f009c433700 1 -- 172.21.15.7:0/1885640281 shutdown_connections 2023-10-06T11:01:33.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:33.944+0000 7f009c433700 1 -- 172.21.15.7:0/1885640281 wait complete. 2023-10-06T11:01:33.958 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T11:01:34.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.090+0000 7f079000c700 1 Processor -- start 2023-10-06T11:01:34.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.090+0000 7f079000c700 1 -- start start 2023-10-06T11:01:34.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f079000c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0788159280 0x7f0788095a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f079000c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07880cb9c0 0x7f07880a6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f079000c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07880ac780 0x7f07880a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f079000c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07880b0300 con 0x7f07880ac780 2023-10-06T11:01:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f079000c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07880afaf0 con 0x7f07880cb9c0 2023-10-06T11:01:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f079000c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07880ac2f0 con 0x7f0788159280 2023-10-06T11:01:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f078e5a9700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07880ac780 0x7f07880a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f078e5a9700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07880ac780 0x7f07880a6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59920/0 (socket says 172.21.15.7:59920) 2023-10-06T11:01:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f078e5a9700 1 -- 172.21.15.7:0/3483292909 learned_addr learned my addr 172.21.15.7:0/3483292909 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f078d5a7700 1 --2- 172.21.15.7:0/3483292909 >> v2:172.21.15.50:3300/0 conn(0x7f07880cb9c0 0x7f07880a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f078dda8700 1 --2- 172.21.15.7:0/3483292909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0788159280 0x7f0788095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f078e5a9700 1 -- 172.21.15.7:0/3483292909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0788159280 msgr2=0x7f0788095a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f078e5a9700 1 --2- 172.21.15.7:0/3483292909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0788159280 0x7f0788095a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f078e5a9700 1 -- 172.21.15.7:0/3483292909 >> v2:172.21.15.50:3300/0 conn(0x7f07880cb9c0 msgr2=0x7f07880a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:34.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.091+0000 7f078e5a9700 1 --2- 172.21.15.7:0/3483292909 >> v2:172.21.15.50:3300/0 conn(0x7f07880cb9c0 0x7f07880a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.092+0000 7f078e5a9700 1 -- 172.21.15.7:0/3483292909 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880afd40 con 0x7f07880ac780 2023-10-06T11:01:34.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.092+0000 7f078e5a9700 1 --2- 172.21.15.7:0/3483292909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07880ac780 0x7f07880a6e90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f078806a0d0 tx=0x7f0780009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6225c6fa33bf1f2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:34.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.092+0000 7f078cda6700 1 -- 172.21.15.7:0/3483292909 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078000e070 con 0x7f07880ac780 2023-10-06T11:01:34.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.092+0000 7f078cda6700 1 -- 172.21.15.7:0/3483292909 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078000ba50 con 0x7f07880ac780 2023-10-06T11:01:34.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.092+0000 7f078cda6700 1 -- 172.21.15.7:0/3483292909 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07800092e0 con 0x7f07880ac780 2023-10-06T11:01:34.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.092+0000 7f079000c700 1 -- 172.21.15.7:0/3483292909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07880ac780 msgr2=0x7f07880a6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.092+0000 7f079000c700 1 --2- 172.21.15.7:0/3483292909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07880ac780 0x7f07880a6e90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f078806a0d0 tx=0x7f0780009840 comp rx=0 tx=0).stop 2023-10-06T11:01:34.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.092+0000 7f079000c700 1 -- 172.21.15.7:0/3483292909 shutdown_connections 2023-10-06T11:01:34.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.092+0000 7f079000c700 1 --2- 172.21.15.7:0/3483292909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07880ac780 0x7f07880a6e90 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.092+0000 7f079000c700 1 --2- 172.21.15.7:0/3483292909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0788159280 0x7f0788095a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.092+0000 7f079000c700 1 --2- 172.21.15.7:0/3483292909 >> v2:172.21.15.50:3300/0 conn(0x7f07880cb9c0 0x7f07880a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.092+0000 7f079000c700 1 -- 172.21.15.7:0/3483292909 >> 172.21.15.7:0/3483292909 conn(0x7f078806ed10 msgr2=0x7f07880af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:34.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.093+0000 7f079000c700 1 -- 172.21.15.7:0/3483292909 shutdown_connections 2023-10-06T11:01:34.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.093+0000 7f079000c700 1 -- 172.21.15.7:0/3483292909 wait complete. 2023-10-06T11:01:34.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.094+0000 7f079000c700 1 Processor -- start 2023-10-06T11:01:34.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.094+0000 7f079000c700 1 -- start start 2023-10-06T11:01:34.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f079000c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f07880ac780 0x7f0788157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f079000c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07880cb9c0 0x7f07881497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f079000c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0788159280 0x7f07880961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f079000c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07881580e0 con 0x7f07880cb9c0 2023-10-06T11:01:34.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f079000c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0788098530 con 0x7f0788159280 2023-10-06T11:01:34.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f079000c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0788098220 con 0x7f07880ac780 2023-10-06T11:01:34.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f078d5a7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07880cb9c0 0x7f07881497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f078d5a7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07880cb9c0 0x7f07881497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59922/0 (socket says 172.21.15.7:59922) 2023-10-06T11:01:34.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f078d5a7700 1 -- 172.21.15.7:0/2068436196 learned_addr learned my addr 172.21.15.7:0/2068436196 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:34.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f078dda8700 1 --2- 172.21.15.7:0/2068436196 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f07880ac780 0x7f0788157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f078e5a9700 1 --2- 172.21.15.7:0/2068436196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0788159280 0x7f07880961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f078d5a7700 1 -- 172.21.15.7:0/2068436196 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f07880ac780 msgr2=0x7f0788157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f078d5a7700 1 --2- 172.21.15.7:0/2068436196 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f07880ac780 0x7f0788157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f078d5a7700 1 -- 172.21.15.7:0/2068436196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0788159280 msgr2=0x7f07880961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f078d5a7700 1 --2- 172.21.15.7:0/2068436196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0788159280 0x7f07880961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f078d5a7700 1 -- 172.21.15.7:0/2068436196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0780009ae0 con 0x7f07880cb9c0 2023-10-06T11:01:34.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.095+0000 7f078d5a7700 1 --2- 172.21.15.7:0/2068436196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07880cb9c0 0x7f07881497d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f077800d890 tx=0x7f0778008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:34.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.096+0000 7f077dffb700 1 -- 172.21.15.7:0/2068436196 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07780125f0 con 0x7f07880cb9c0 2023-10-06T11:01:34.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.096+0000 7f077dffb700 1 -- 172.21.15.7:0/2068436196 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0778012750 con 0x7f07880cb9c0 2023-10-06T11:01:34.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.096+0000 7f079000c700 1 -- 172.21.15.7:0/2068436196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0788157840 con 0x7f07880cb9c0 2023-10-06T11:01:34.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.096+0000 7f077dffb700 1 -- 172.21.15.7:0/2068436196 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0778012af0 con 0x7f07880cb9c0 2023-10-06T11:01:34.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.096+0000 7f079000c700 1 -- 172.21.15.7:0/2068436196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0788157bd0 con 0x7f07880cb9c0 2023-10-06T11:01:34.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.097+0000 7f079000c700 1 -- 172.21.15.7:0/2068436196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07880986c0 con 0x7f07880cb9c0 2023-10-06T11:01:34.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.097+0000 7f077dffb700 1 -- 172.21.15.7:0/2068436196 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f077801e460 con 0x7f07880cb9c0 2023-10-06T11:01:34.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.098+0000 7f077dffb700 1 --2- 172.21.15.7:0/2068436196 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f076c066f30 0x7f076c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.098+0000 7f077dffb700 1 -- 172.21.15.7:0/2068436196 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f0778084aa0 con 0x7f07880cb9c0 2023-10-06T11:01:34.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.098+0000 7f078dda8700 1 --2- 172.21.15.7:0/2068436196 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f076c066f30 0x7f076c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.098+0000 7f078dda8700 1 --2- 172.21.15.7:0/2068436196 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f076c066f30 0x7f076c0693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0784006fd0 tx=0x7f0784008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:34.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.102+0000 7f077dffb700 1 -- 172.21.15.7:0/2068436196 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0778051cd0 con 0x7f07880cb9c0 2023-10-06T11:01:34.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.306+0000 7f079000c700 1 -- 172.21.15.7:0/2068436196 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0788070480 con 0x7f076c066f30 2023-10-06T11:01:34.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.306+0000 7f077dffb700 1 -- 172.21.15.7:0/2068436196 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0788070480 con 0x7f076c066f30 2023-10-06T11:01:34.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.308+0000 7f079000c700 1 -- 172.21.15.7:0/2068436196 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f076c066f30 msgr2=0x7f076c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.308+0000 7f079000c700 1 --2- 172.21.15.7:0/2068436196 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f076c066f30 0x7f076c0693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0784006fd0 tx=0x7f0784008040 comp rx=0 tx=0).stop 2023-10-06T11:01:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.308+0000 7f079000c700 1 -- 172.21.15.7:0/2068436196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07880cb9c0 msgr2=0x7f07881497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.308+0000 7f079000c700 1 --2- 172.21.15.7:0/2068436196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07880cb9c0 0x7f07881497d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f077800d890 tx=0x7f0778008040 comp rx=0 tx=0).stop 2023-10-06T11:01:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.308+0000 7f079000c700 1 -- 172.21.15.7:0/2068436196 shutdown_connections 2023-10-06T11:01:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.308+0000 7f079000c700 1 --2- 172.21.15.7:0/2068436196 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f076c066f30 0x7f076c0693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.308+0000 7f079000c700 1 --2- 172.21.15.7:0/2068436196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0788159280 0x7f07880961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.308+0000 7f079000c700 1 --2- 172.21.15.7:0/2068436196 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f07880ac780 0x7f0788157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.308+0000 7f079000c700 1 --2- 172.21.15.7:0/2068436196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07880cb9c0 0x7f07881497d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.308+0000 7f079000c700 1 -- 172.21.15.7:0/2068436196 >> 172.21.15.7:0/2068436196 conn(0x7f078806ed10 msgr2=0x7f0788154960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.309+0000 7f079000c700 1 -- 172.21.15.7:0/2068436196 shutdown_connections 2023-10-06T11:01:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.309+0000 7f079000c700 1 -- 172.21.15.7:0/2068436196 wait complete. 2023-10-06T11:01:34.311 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T11:01:34.323 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T11:01:34.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:01:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.459+0000 7faa15672700 1 Processor -- start 2023-10-06T11:01:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.459+0000 7faa15672700 1 -- start start 2023-10-06T11:01:34.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.460+0000 7faa15672700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa100af320 0x7faa100cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.460+0000 7faa15672700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa100cf6c0 con 0x7faa100cb580 2023-10-06T11:01:34.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.460+0000 7faa15672700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa100ceab0 con 0x7faa100695f0 2023-10-06T11:01:34.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.460+0000 7faa15672700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa10159c00 con 0x7faa100af320 2023-10-06T11:01:34.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.460+0000 7faa0e7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7faa100cb580 0x7faa10068ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42734/0 (socket says 172.21.15.7:42734) 2023-10-06T11:01:34.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.460+0000 7faa0e7fc700 1 -- 172.21.15.7:0/3998265418 learned_addr learned my addr 172.21.15.7:0/3998265418 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:34.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.460+0000 7faa0effd700 1 --2- 172.21.15.7:0/3998265418 >> v2:172.21.15.50:3300/0 conn(0x7faa100af320 0x7faa100cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.460+0000 7faa0dffb700 1 -- 172.21.15.7:0/3998265418 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905484830 0 0) 0x7faa100cf6c0 con 0x7faa100cb580 2023-10-06T11:01:34.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.460+0000 7faa0dffb700 1 -- 172.21.15.7:0/3998265418 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f8003570 con 0x7faa100cb580 2023-10-06T11:01:34.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.460+0000 7faa0effd700 1 -- 172.21.15.7:0/3998265418 >> v1:172.21.15.50:6789/0 conn(0x7faa100695f0 legacy=0x7faa100afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.460+0000 7faa0effd700 1 -- 172.21.15.7:0/3998265418 >> v1:172.21.15.7:6789/0 conn(0x7faa100cb580 legacy=0x7faa10068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.460+0000 7faa0effd700 1 -- 172.21.15.7:0/3998265418 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa100ced90 con 0x7faa100af320 2023-10-06T11:01:34.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.461+0000 7faa0effd700 1 --2- 172.21.15.7:0/3998265418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa100af320 0x7faa100cb040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faa000098e0 tx=0x7faa000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=691e04bebf1c8ea2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.461+0000 7faa0dffb700 1 -- 172.21.15.7:0/3998265418 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0000b6d0 con 0x7faa100af320 2023-10-06T11:01:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.461+0000 7faa0dffb700 1 -- 172.21.15.7:0/3998265418 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0000b830 con 0x7faa100af320 2023-10-06T11:01:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.461+0000 7faa0dffb700 1 -- 172.21.15.7:0/3998265418 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0000bbd0 con 0x7faa100af320 2023-10-06T11:01:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.461+0000 7faa15672700 1 -- 172.21.15.7:0/3998265418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa100af320 msgr2=0x7faa100cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.461+0000 7faa15672700 1 --2- 172.21.15.7:0/3998265418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa100af320 0x7faa100cb040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faa000098e0 tx=0x7faa000091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.461+0000 7faa15672700 1 -- 172.21.15.7:0/3998265418 shutdown_connections 2023-10-06T11:01:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.461+0000 7faa15672700 1 --2- 172.21.15.7:0/3998265418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa100af320 0x7faa100cb040 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.461+0000 7faa15672700 1 -- 172.21.15.7:0/3998265418 >> 172.21.15.7:0/3998265418 conn(0x7faa10067b80 msgr2=0x7faa100d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.461+0000 7faa15672700 1 -- 172.21.15.7:0/3998265418 shutdown_connections 2023-10-06T11:01:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.461+0000 7faa15672700 1 -- 172.21.15.7:0/3998265418 wait complete. 2023-10-06T11:01:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.463+0000 7faa15672700 1 Processor -- start 2023-10-06T11:01:34.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.463+0000 7faa15672700 1 -- start start 2023-10-06T11:01:34.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa15672700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa100695f0 0x7faa1016aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa15672700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa100af320 0x7faa1015ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa15672700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa100cb580 0x7faa1015b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa15672700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1016a2d0 con 0x7faa100695f0 2023-10-06T11:01:34.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa15672700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa10144860 con 0x7faa100af320 2023-10-06T11:01:34.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa15672700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1015b8f0 con 0x7faa100cb580 2023-10-06T11:01:34.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa0effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa100695f0 0x7faa1016aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa0effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa100695f0 0x7faa1016aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59936/0 (socket says 172.21.15.7:59936) 2023-10-06T11:01:34.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa0effd700 1 -- 172.21.15.7:0/41602599 learned_addr learned my addr 172.21.15.7:0/41602599 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:34.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa0f7fe700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa100cb580 0x7faa1015b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa0e7fc700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa100af320 0x7faa1015ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa0effd700 1 -- 172.21.15.7:0/41602599 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa100cb580 msgr2=0x7faa1015b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa0effd700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa100cb580 0x7faa1015b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa0effd700 1 -- 172.21.15.7:0/41602599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa100af320 msgr2=0x7faa1015ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa0effd700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa100af320 0x7faa1015ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa0effd700 1 -- 172.21.15.7:0/41602599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa00009420 con 0x7faa100695f0 2023-10-06T11:01:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa0f7fe700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa100cb580 0x7faa1015b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa0effd700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa100695f0 0x7faa1016aac0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7faa1006fad0 tx=0x7faa00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7fa9f6ffd700 1 -- 172.21.15.7:0/41602599 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0000bbb0 con 0x7faa100695f0 2023-10-06T11:01:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7fa9f6ffd700 1 -- 172.21.15.7:0/41602599 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa00011420 con 0x7faa100695f0 2023-10-06T11:01:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.464+0000 7faa15672700 1 -- 172.21.15.7:0/41602599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1015bbd0 con 0x7faa100695f0 2023-10-06T11:01:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.465+0000 7fa9f6ffd700 1 -- 172.21.15.7:0/41602599 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000117a0 con 0x7faa100695f0 2023-10-06T11:01:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.465+0000 7faa15672700 1 -- 172.21.15.7:0/41602599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1015c190 con 0x7faa100695f0 2023-10-06T11:01:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.465+0000 7faa15672700 1 -- 172.21.15.7:0/41602599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa100d0c40 con 0x7faa100695f0 2023-10-06T11:01:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.466+0000 7fa9f6ffd700 1 -- 172.21.15.7:0/41602599 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa00011b90 con 0x7faa100695f0 2023-10-06T11:01:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.466+0000 7fa9f6ffd700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa9fc066f30 0x7fa9fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.466+0000 7fa9f6ffd700 1 -- 172.21.15.7:0/41602599 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7faa000861f0 con 0x7faa100695f0 2023-10-06T11:01:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.467+0000 7faa0e7fc700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa9fc066f30 0x7fa9fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.467+0000 7fa9f6ffd700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.50:6808/119980,v1:172.21.15.50:6809/119980] conn(0x7fa9fc06d850 0x7fa9fc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.467+0000 7fa9f6ffd700 1 -- 172.21.15.7:0/41602599 --> [v2:172.21.15.50:6808/119980,v1:172.21.15.50:6809/119980] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9fc070370 con 0x7fa9fc06d850 2023-10-06T11:01:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.467+0000 7fa9f6ffd700 1 -- 172.21.15.7:0/41602599 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa000865c0 con 0x7faa100695f0 2023-10-06T11:01:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.467+0000 7faa0f7fe700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.50:6808/119980,v1:172.21.15.50:6809/119980] conn(0x7fa9fc06d850 0x7fa9fc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.467+0000 7faa0e7fc700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa9fc066f30 0x7fa9fc0693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7faa100b29e0 tx=0x7faa04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:34.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.467+0000 7faa0f7fe700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.50:6808/119980,v1:172.21.15.50:6809/119980] conn(0x7fa9fc06d850 0x7fa9fc06fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:34.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.468+0000 7fa9f6ffd700 1 -- 172.21.15.7:0/41602599 <== osd.5 v2:172.21.15.50:6808/119980 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa9fc070370 con 0x7fa9fc06d850 2023-10-06T11:01:34.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.482+0000 7faa15672700 1 -- 172.21.15.7:0/41602599 --> [v2:172.21.15.50:6808/119980,v1:172.21.15.50:6809/119980] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faa10070480 con 0x7fa9fc06d850 2023-10-06T11:01:34.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.483+0000 7fa9f6ffd700 1 -- 172.21.15.7:0/41602599 <== osd.5 v2:172.21.15.50:6808/119980 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7faa10070480 con 0x7fa9fc06d850 2023-10-06T11:01:34.484 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:01:34.484 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:01:34.484 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:01:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.484+0000 7faa15672700 1 -- 172.21.15.7:0/41602599 >> [v2:172.21.15.50:6808/119980,v1:172.21.15.50:6809/119980] conn(0x7fa9fc06d850 msgr2=0x7fa9fc06fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.484+0000 7faa15672700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.50:6808/119980,v1:172.21.15.50:6809/119980] conn(0x7fa9fc06d850 0x7fa9fc06fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.484+0000 7faa15672700 1 -- 172.21.15.7:0/41602599 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa9fc066f30 msgr2=0x7fa9fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.484+0000 7faa15672700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fa9fc066f30 0x7fa9fc0693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7faa100b29e0 tx=0x7faa04009040 comp rx=0 tx=0).stop 2023-10-06T11:01:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.484+0000 7faa15672700 1 -- 172.21.15.7:0/41602599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa100695f0 msgr2=0x7faa1016aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.484+0000 7faa15672700 1 --2- 172.21.15.7:0/41602599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa100695f0 0x7faa1016aac0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7faa1006fad0 tx=0x7faa00017000 comp rx=0 tx=0).stop 2023-10-06T11:01:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.484+0000 7faa0f7fe700 1 -- 172.21.15.7:0/41602599 reap_dead start 2023-10-06T11:01:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.484+0000 7faa15672700 1 -- 172.21.15.7:0/41602599 shutdown_connections 2023-10-06T11:01:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.484+0000 7faa15672700 1 -- 172.21.15.7:0/41602599 >> 172.21.15.7:0/41602599 conn(0x7faa10067b80 msgr2=0x7faa10156660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.484+0000 7faa15672700 1 -- 172.21.15.7:0/41602599 shutdown_connections 2023-10-06T11:01:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.484+0000 7faa15672700 1 -- 172.21.15.7:0/41602599 wait complete. 2023-10-06T11:01:34.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T11:01:34.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.631+0000 7fe59825a700 1 Processor -- start 2023-10-06T11:01:34.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.631+0000 7fe59825a700 1 -- start start 2023-10-06T11:01:34.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.632+0000 7fe59825a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe5900ce7a0 0x7fe5900b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.632+0000 7fe59825a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900cf820 con 0x7fe590159220 2023-10-06T11:01:34.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.632+0000 7fe59825a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900cec10 con 0x7fe5901595f0 2023-10-06T11:01:34.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.632+0000 7fe59825a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900ceef0 con 0x7fe5900ce7a0 2023-10-06T11:01:34.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.632+0000 7fe595ff6700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe590159220 0x7fe5900aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42746/0 (socket says 172.21.15.7:42746) 2023-10-06T11:01:34.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.632+0000 7fe595ff6700 1 -- 172.21.15.7:0/1387520403 learned_addr learned my addr 172.21.15.7:0/1387520403 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:34.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.632+0000 7fe5957f5700 1 --2- 172.21.15.7:0/1387520403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe5900ce7a0 0x7fe5900b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.632+0000 7fe594ff4700 1 -- 172.21.15.7:0/1387520403 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136794814 0 0) 0x7fe5900cf820 con 0x7fe590159220 2023-10-06T11:01:34.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.632+0000 7fe594ff4700 1 -- 172.21.15.7:0/1387520403 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe57c003570 con 0x7fe590159220 2023-10-06T11:01:34.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.633+0000 7fe594ff4700 1 -- 172.21.15.7:0/1387520403 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541666749 0 0) 0x7fe5900cec10 con 0x7fe5901595f0 2023-10-06T11:01:34.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.633+0000 7fe594ff4700 1 -- 172.21.15.7:0/1387520403 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5900cf820 con 0x7fe5901595f0 2023-10-06T11:01:34.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.633+0000 7fe594ff4700 1 -- 172.21.15.7:0/1387520403 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2057208204 0 0) 0x7fe57c003570 con 0x7fe590159220 2023-10-06T11:01:34.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.633+0000 7fe5957f5700 1 -- 172.21.15.7:0/1387520403 >> v1:172.21.15.50:6789/0 conn(0x7fe5901595f0 legacy=0x7fe5900b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.633+0000 7fe5957f5700 1 -- 172.21.15.7:0/1387520403 >> v1:172.21.15.7:6789/0 conn(0x7fe590159220 legacy=0x7fe5900aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.633+0000 7fe5957f5700 1 -- 172.21.15.7:0/1387520403 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5900cf1d0 con 0x7fe5900ce7a0 2023-10-06T11:01:34.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.633+0000 7fe5957f5700 1 --2- 172.21.15.7:0/1387520403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe5900ce7a0 0x7fe5900b2ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe584009910 tx=0x7fe5840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b80759daf523789 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:34.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.633+0000 7fe594ff4700 1 -- 172.21.15.7:0/1387520403 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c001470 con 0x7fe5900ce7a0 2023-10-06T11:01:34.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.633+0000 7fe594ff4700 1 -- 172.21.15.7:0/1387520403 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe584011420 con 0x7fe5900ce7a0 2023-10-06T11:01:34.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.633+0000 7fe594ff4700 1 -- 172.21.15.7:0/1387520403 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5840117c0 con 0x7fe5900ce7a0 2023-10-06T11:01:34.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.634+0000 7fe59825a700 1 -- 172.21.15.7:0/1387520403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe5900ce7a0 msgr2=0x7fe5900b2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.634+0000 7fe59825a700 1 --2- 172.21.15.7:0/1387520403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe5900ce7a0 0x7fe5900b2ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe584009910 tx=0x7fe5840091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.634+0000 7fe59825a700 1 -- 172.21.15.7:0/1387520403 shutdown_connections 2023-10-06T11:01:34.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.634+0000 7fe59825a700 1 --2- 172.21.15.7:0/1387520403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe5900ce7a0 0x7fe5900b2ec0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.634+0000 7fe59825a700 1 -- 172.21.15.7:0/1387520403 >> 172.21.15.7:0/1387520403 conn(0x7fe590069f60 msgr2=0x7fe5900670f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:34.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.634+0000 7fe59825a700 1 -- 172.21.15.7:0/1387520403 shutdown_connections 2023-10-06T11:01:34.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.634+0000 7fe59825a700 1 -- 172.21.15.7:0/1387520403 wait complete. 2023-10-06T11:01:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.635+0000 7fe59825a700 1 Processor -- start 2023-10-06T11:01:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.635+0000 7fe59825a700 1 -- start start 2023-10-06T11:01:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe59825a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5900ce7a0 0x7fe59014edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe59825a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe590159220 0x7fe590151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe59825a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe59015a190 0x7fe590150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe59825a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59014f2f0 con 0x7fe5900ce7a0 2023-10-06T11:01:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe59825a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59015b230 con 0x7fe590159220 2023-10-06T11:01:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe59825a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59015a620 con 0x7fe59015a190 2023-10-06T11:01:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe595ff6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5900ce7a0 0x7fe59014edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe595ff6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5900ce7a0 0x7fe59014edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59946/0 (socket says 172.21.15.7:59946) 2023-10-06T11:01:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe595ff6700 1 -- 172.21.15.7:0/3018056397 learned_addr learned my addr 172.21.15.7:0/3018056397 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe5957f5700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe590159220 0x7fe590151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe5967f7700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe59015a190 0x7fe590150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe595ff6700 1 -- 172.21.15.7:0/3018056397 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe59015a190 msgr2=0x7fe590150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe595ff6700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe59015a190 0x7fe590150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe595ff6700 1 -- 172.21.15.7:0/3018056397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe590159220 msgr2=0x7fe590151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe595ff6700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe590159220 0x7fe590151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe595ff6700 1 -- 172.21.15.7:0/3018056397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe584009420 con 0x7fe5900ce7a0 2023-10-06T11:01:34.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.636+0000 7fe5967f7700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe59015a190 0x7fe590150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:34.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.637+0000 7fe595ff6700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5900ce7a0 0x7fe59014edb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00cb70 tx=0x7fe58c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:34.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.637+0000 7fe581ffb700 1 -- 172.21.15.7:0/3018056397 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c007e90 con 0x7fe5900ce7a0 2023-10-06T11:01:34.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.637+0000 7fe581ffb700 1 -- 172.21.15.7:0/3018056397 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c007360 con 0x7fe5900ce7a0 2023-10-06T11:01:34.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.637+0000 7fe59825a700 1 -- 172.21.15.7:0/3018056397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59015a900 con 0x7fe5900ce7a0 2023-10-06T11:01:34.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.637+0000 7fe581ffb700 1 -- 172.21.15.7:0/3018056397 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c004830 con 0x7fe5900ce7a0 2023-10-06T11:01:34.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.637+0000 7fe59825a700 1 -- 172.21.15.7:0/3018056397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59015aec0 con 0x7fe5900ce7a0 2023-10-06T11:01:34.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.638+0000 7fe59825a700 1 -- 172.21.15.7:0/3018056397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe590070480 con 0x7fe5900ce7a0 2023-10-06T11:01:34.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.638+0000 7fe581ffb700 1 -- 172.21.15.7:0/3018056397 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe58c004ba0 con 0x7fe5900ce7a0 2023-10-06T11:01:34.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.639+0000 7fe581ffb700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe574066f30 0x7fe5740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:34.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.639+0000 7fe581ffb700 1 -- 172.21.15.7:0/3018056397 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fe58c083dd0 con 0x7fe5900ce7a0 2023-10-06T11:01:34.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.639+0000 7fe5957f5700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe574066f30 0x7fe5740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:34.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.639+0000 7fe5957f5700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe574066f30 0x7fe5740693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe5840030c0 tx=0x7fe584016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:34.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.644+0000 7fe581ffb700 1 -- 172.21.15.7:0/3018056397 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe58c051080 con 0x7fe5900ce7a0 2023-10-06T11:01:34.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.847+0000 7fe59825a700 1 -- 172.21.15.7:0/3018056397 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5900cf4b0 con 0x7fe574066f30 2023-10-06T11:01:34.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.847+0000 7fe581ffb700 1 -- 172.21.15.7:0/3018056397 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe5900cf4b0 con 0x7fe574066f30 2023-10-06T11:01:34.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.849+0000 7fe59825a700 1 -- 172.21.15.7:0/3018056397 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe574066f30 msgr2=0x7fe5740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.849+0000 7fe59825a700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe574066f30 0x7fe5740693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe5840030c0 tx=0x7fe584016000 comp rx=0 tx=0).stop 2023-10-06T11:01:34.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.849+0000 7fe59825a700 1 -- 172.21.15.7:0/3018056397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5900ce7a0 msgr2=0x7fe59014edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:34.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.849+0000 7fe59825a700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5900ce7a0 0x7fe59014edb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00cb70 tx=0x7fe58c001b50 comp rx=0 tx=0).stop 2023-10-06T11:01:34.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.849+0000 7fe59825a700 1 -- 172.21.15.7:0/3018056397 shutdown_connections 2023-10-06T11:01:34.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.849+0000 7fe59825a700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fe574066f30 0x7fe5740693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.849+0000 7fe59825a700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5900ce7a0 0x7fe59014edb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.849+0000 7fe59825a700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe59015a190 0x7fe590150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.849+0000 7fe59825a700 1 --2- 172.21.15.7:0/3018056397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe590159220 0x7fe590151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:34.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.849+0000 7fe59825a700 1 -- 172.21.15.7:0/3018056397 >> 172.21.15.7:0/3018056397 conn(0x7fe590069f60 msgr2=0x7fe5900b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:34.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.849+0000 7fe59825a700 1 -- 172.21.15.7:0/3018056397 shutdown_connections 2023-10-06T11:01:34.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.849+0000 7fe59825a700 1 -- 172.21.15.7:0/3018056397 wait complete. 2023-10-06T11:01:34.851 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T11:01:34.863 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T11:01:34.863 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:01:35.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.999+0000 7f51e4f9f700 1 Processor -- start 2023-10-06T11:01:35.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:34.999+0000 7f51e4f9f700 1 -- start start 2023-10-06T11:01:35.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51e4f9f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f51e006e9d0 0x7f51e00af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51e4f9f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51e006eda0 0x7f51e006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51e4f9f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f51e006c220 0x7f51e0158e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51e4f9f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e006aaa0 con 0x7f51e006e9d0 2023-10-06T11:01:35.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51e4f9f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e006ad80 con 0x7f51e006c220 2023-10-06T11:01:35.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51e4f9f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e006b060 con 0x7f51e006eda0 2023-10-06T11:01:35.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51df7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f51e006e9d0 0x7f51e00af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51df7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f51e006e9d0 0x7f51e00af1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59960/0 (socket says 172.21.15.7:59960) 2023-10-06T11:01:35.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51df7fe700 1 -- 172.21.15.7:0/472437063 learned_addr learned my addr 172.21.15.7:0/472437063 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:35.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51deffd700 1 --2- 172.21.15.7:0/472437063 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51e006eda0 0x7f51e006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51dffff700 1 --2- 172.21.15.7:0/472437063 >> v2:172.21.15.50:3300/0 conn(0x7f51e006c220 0x7f51e0158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51df7fe700 1 -- 172.21.15.7:0/472437063 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51e006eda0 msgr2=0x7f51e006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:35.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51df7fe700 1 --2- 172.21.15.7:0/472437063 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51e006eda0 0x7f51e006bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51df7fe700 1 -- 172.21.15.7:0/472437063 >> v2:172.21.15.50:3300/0 conn(0x7f51e006c220 msgr2=0x7f51e0158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51df7fe700 1 --2- 172.21.15.7:0/472437063 >> v2:172.21.15.50:3300/0 conn(0x7f51e006c220 0x7f51e0158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.000+0000 7f51df7fe700 1 -- 172.21.15.7:0/472437063 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e006b340 con 0x7f51e006e9d0 2023-10-06T11:01:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.001+0000 7f51df7fe700 1 --2- 172.21.15.7:0/472437063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e006e9d0 0x7f51e00af1b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f51e00b0300 tx=0x7f51d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9aafea00bbd3c12 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.001+0000 7f51de7fc700 1 -- 172.21.15.7:0/472437063 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000b640 con 0x7f51e006e9d0 2023-10-06T11:01:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.001+0000 7f51de7fc700 1 -- 172.21.15.7:0/472437063 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d000b7a0 con 0x7f51e006e9d0 2023-10-06T11:01:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.001+0000 7f51de7fc700 1 -- 172.21.15.7:0/472437063 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000bb60 con 0x7f51e006e9d0 2023-10-06T11:01:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.001+0000 7f51e4f9f700 1 -- 172.21.15.7:0/472437063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e006e9d0 msgr2=0x7f51e00af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.001+0000 7f51e4f9f700 1 --2- 172.21.15.7:0/472437063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e006e9d0 0x7f51e00af1b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f51e00b0300 tx=0x7f51d0009250 comp rx=0 tx=0).stop 2023-10-06T11:01:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.001+0000 7f51e4f9f700 1 -- 172.21.15.7:0/472437063 shutdown_connections 2023-10-06T11:01:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.001+0000 7f51e4f9f700 1 --2- 172.21.15.7:0/472437063 >> v2:172.21.15.50:3300/0 conn(0x7f51e006c220 0x7f51e0158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.001+0000 7f51e4f9f700 1 --2- 172.21.15.7:0/472437063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e006e9d0 0x7f51e00af1b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.001+0000 7f51e4f9f700 1 --2- 172.21.15.7:0/472437063 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51e006eda0 0x7f51e006bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.001+0000 7f51e4f9f700 1 -- 172.21.15.7:0/472437063 >> 172.21.15.7:0/472437063 conn(0x7f51e00cc3f0 msgr2=0x7f51e00cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:35.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.001+0000 7f51e4f9f700 1 -- 172.21.15.7:0/472437063 shutdown_connections 2023-10-06T11:01:35.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.002+0000 7f51e4f9f700 1 -- 172.21.15.7:0/472437063 wait complete. 2023-10-06T11:01:35.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.003+0000 7f51e4f9f700 1 Processor -- start 2023-10-06T11:01:35.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.003+0000 7f51e4f9f700 1 -- start start 2023-10-06T11:01:35.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51e4f9f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e006c220 0x7f51e00abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51e4f9f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51e006e9d0 0x7f51e0158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51e4f9f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51e006eda0 0x7f51e015c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51e4f9f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00ae3e0 con 0x7f51e006c220 2023-10-06T11:01:35.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51e4f9f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e0158540 con 0x7f51e006eda0 2023-10-06T11:01:35.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51e4f9f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e0156f60 con 0x7f51e006e9d0 2023-10-06T11:01:35.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51df7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e006c220 0x7f51e00abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51df7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e006c220 0x7f51e00abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59974/0 (socket says 172.21.15.7:59974) 2023-10-06T11:01:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51df7fe700 1 -- 172.21.15.7:0/1441730938 learned_addr learned my addr 172.21.15.7:0/1441730938 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51deffd700 1 --2- 172.21.15.7:0/1441730938 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51e006e9d0 0x7f51e0158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51dffff700 1 --2- 172.21.15.7:0/1441730938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51e006eda0 0x7f51e015c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51df7fe700 1 -- 172.21.15.7:0/1441730938 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51e006e9d0 msgr2=0x7f51e0158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51df7fe700 1 --2- 172.21.15.7:0/1441730938 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51e006e9d0 0x7f51e0158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51df7fe700 1 -- 172.21.15.7:0/1441730938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51e006eda0 msgr2=0x7f51e015c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51df7fe700 1 --2- 172.21.15.7:0/1441730938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51e006eda0 0x7f51e015c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51df7fe700 1 -- 172.21.15.7:0/1441730938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d00094f0 con 0x7f51e006c220 2023-10-06T11:01:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51df7fe700 1 --2- 172.21.15.7:0/1441730938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e006c220 0x7f51e00abbb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f51e009a100 tx=0x7f51d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51d77fe700 1 -- 172.21.15.7:0/1441730938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000b910 con 0x7f51e006c220 2023-10-06T11:01:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51d77fe700 1 -- 172.21.15.7:0/1441730938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d000ba70 con 0x7f51e006c220 2023-10-06T11:01:35.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.004+0000 7f51e4f9f700 1 -- 172.21.15.7:0/1441730938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e0157240 con 0x7f51e006c220 2023-10-06T11:01:35.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.005+0000 7f51d77fe700 1 -- 172.21.15.7:0/1441730938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0011630 con 0x7f51e006c220 2023-10-06T11:01:35.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.005+0000 7f51e4f9f700 1 -- 172.21.15.7:0/1441730938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e0157800 con 0x7f51e006c220 2023-10-06T11:01:35.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.005+0000 7f51e4f9f700 1 -- 172.21.15.7:0/1441730938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f51e0070480 con 0x7f51e006c220 2023-10-06T11:01:35.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.006+0000 7f51d77fe700 1 -- 172.21.15.7:0/1441730938 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51d00119a0 con 0x7f51e006c220 2023-10-06T11:01:35.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.006+0000 7f51d77fe700 1 --2- 172.21.15.7:0/1441730938 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f51c0066f30 0x7f51c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.006+0000 7f51d77fe700 1 -- 172.21.15.7:0/1441730938 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f51d0085c10 con 0x7f51e006c220 2023-10-06T11:01:35.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.007+0000 7f51deffd700 1 --2- 172.21.15.7:0/1441730938 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f51c0066f30 0x7f51c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.007+0000 7f51d77fe700 1 --2- 172.21.15.7:0/1441730938 >> [v2:172.21.15.50:6816/120010,v1:172.21.15.50:6817/120010] conn(0x7f51c006d850 0x7f51c006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.007+0000 7f51d77fe700 1 -- 172.21.15.7:0/1441730938 --> [v2:172.21.15.50:6816/120010,v1:172.21.15.50:6817/120010] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51c0070370 con 0x7f51c006d850 2023-10-06T11:01:35.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.007+0000 7f51d77fe700 1 -- 172.21.15.7:0/1441730938 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51d008b220 con 0x7f51e006c220 2023-10-06T11:01:35.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.007+0000 7f51dffff700 1 --2- 172.21.15.7:0/1441730938 >> [v2:172.21.15.50:6816/120010,v1:172.21.15.50:6817/120010] conn(0x7f51c006d850 0x7f51c006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.007+0000 7f51deffd700 1 --2- 172.21.15.7:0/1441730938 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f51c0066f30 0x7f51c00693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009d10 tx=0x7f51c80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:35.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.007+0000 7f51dffff700 1 --2- 172.21.15.7:0/1441730938 >> [v2:172.21.15.50:6816/120010,v1:172.21.15.50:6817/120010] conn(0x7f51c006d850 0x7f51c006fca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:35.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.008+0000 7f51d77fe700 1 -- 172.21.15.7:0/1441730938 <== osd.6 v2:172.21.15.50:6816/120010 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f51c0070370 con 0x7f51c006d850 2023-10-06T11:01:35.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.023+0000 7f51e4f9f700 1 -- 172.21.15.7:0/1441730938 --> [v2:172.21.15.50:6816/120010,v1:172.21.15.50:6817/120010] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f51e006b7c0 con 0x7f51c006d850 2023-10-06T11:01:35.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.024+0000 7f51d77fe700 1 -- 172.21.15.7:0/1441730938 <== osd.6 v2:172.21.15.50:6816/120010 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f51e006b7c0 con 0x7f51c006d850 2023-10-06T11:01:35.025 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:01:35.025 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:01:35.025 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:01:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.024+0000 7f51e4f9f700 1 -- 172.21.15.7:0/1441730938 >> [v2:172.21.15.50:6816/120010,v1:172.21.15.50:6817/120010] conn(0x7f51c006d850 msgr2=0x7f51c006fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.024+0000 7f51e4f9f700 1 --2- 172.21.15.7:0/1441730938 >> [v2:172.21.15.50:6816/120010,v1:172.21.15.50:6817/120010] conn(0x7f51c006d850 0x7f51c006fca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.024+0000 7f51e4f9f700 1 -- 172.21.15.7:0/1441730938 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f51c0066f30 msgr2=0x7f51c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.024+0000 7f51e4f9f700 1 --2- 172.21.15.7:0/1441730938 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f51c0066f30 0x7f51c00693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009d10 tx=0x7f51c80091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.024+0000 7f51e4f9f700 1 -- 172.21.15.7:0/1441730938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e006c220 msgr2=0x7f51e00abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.024+0000 7f51e4f9f700 1 --2- 172.21.15.7:0/1441730938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e006c220 0x7f51e00abbb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f51e009a100 tx=0x7f51d0017000 comp rx=0 tx=0).stop 2023-10-06T11:01:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.024+0000 7f51dffff700 1 -- 172.21.15.7:0/1441730938 reap_dead start 2023-10-06T11:01:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.024+0000 7f51e4f9f700 1 -- 172.21.15.7:0/1441730938 shutdown_connections 2023-10-06T11:01:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.024+0000 7f51e4f9f700 1 -- 172.21.15.7:0/1441730938 >> 172.21.15.7:0/1441730938 conn(0x7f51e00cc3f0 msgr2=0x7f51e00c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:35.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.024+0000 7f51e4f9f700 1 -- 172.21.15.7:0/1441730938 shutdown_connections 2023-10-06T11:01:35.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.025+0000 7f51e4f9f700 1 -- 172.21.15.7:0/1441730938 wait complete. 2023-10-06T11:01:35.042 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T11:01:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.175+0000 7fc7d1ecc700 1 Processor -- start 2023-10-06T11:01:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.175+0000 7fc7d1ecc700 1 -- start start 2023-10-06T11:01:35.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.176+0000 7fc7d1ecc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7cc1590d0 0x7fc7cc069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.176+0000 7fc7d1ecc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7cc06a0f0 0x7fc7cc15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.176+0000 7fc7d1ecc700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7cc0694d0 con 0x7fc7cc15d350 2023-10-06T11:01:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.176+0000 7fc7d1ecc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7cc15d7d0 con 0x7fc7cc1590d0 2023-10-06T11:01:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.176+0000 7fc7d1ecc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc068ba0 con 0x7fc7cc06a0f0 2023-10-06T11:01:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.176+0000 7fc7cbfff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc7cc15d350 0x7fc7cc067980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42754/0 (socket says 172.21.15.7:42754) 2023-10-06T11:01:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.176+0000 7fc7cbfff700 1 -- 172.21.15.7:0/3217638893 learned_addr learned my addr 172.21.15.7:0/3217638893 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.176+0000 7fc7cb7fe700 1 --2- 172.21.15.7:0/3217638893 >> v2:172.21.15.50:3300/0 conn(0x7fc7cc1590d0 0x7fc7cc069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.176+0000 7fc7caffd700 1 --2- 172.21.15.7:0/3217638893 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7cc06a0f0 0x7fc7cc15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.176+0000 7fc7ca7fc700 1 -- 172.21.15.7:0/3217638893 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732475649 0 0) 0x7fc7cc0694d0 con 0x7fc7cc15d350 2023-10-06T11:01:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.176+0000 7fc7ca7fc700 1 -- 172.21.15.7:0/3217638893 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b4003570 con 0x7fc7cc15d350 2023-10-06T11:01:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.177+0000 7fc7cb7fe700 1 -- 172.21.15.7:0/3217638893 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7cc06a0f0 msgr2=0x7fc7cc15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.177+0000 7fc7cb7fe700 1 --2- 172.21.15.7:0/3217638893 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7cc06a0f0 0x7fc7cc15ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.177+0000 7fc7cb7fe700 1 -- 172.21.15.7:0/3217638893 >> v1:172.21.15.7:6789/0 conn(0x7fc7cc15d350 legacy=0x7fc7cc067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.177+0000 7fc7cb7fe700 1 -- 172.21.15.7:0/3217638893 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc068e80 con 0x7fc7cc1590d0 2023-10-06T11:01:35.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.177+0000 7fc7cb7fe700 1 --2- 172.21.15.7:0/3217638893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7cc1590d0 0x7fc7cc069bb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0098e0 tx=0x7fc7bc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58d04f78c4e345ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:35.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.177+0000 7fc7ca7fc700 1 -- 172.21.15.7:0/3217638893 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc011630 con 0x7fc7cc1590d0 2023-10-06T11:01:35.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.177+0000 7fc7ca7fc700 1 -- 172.21.15.7:0/3217638893 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc011790 con 0x7fc7cc1590d0 2023-10-06T11:01:35.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.177+0000 7fc7ca7fc700 1 -- 172.21.15.7:0/3217638893 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc011b30 con 0x7fc7cc1590d0 2023-10-06T11:01:35.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.178+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/3217638893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7cc1590d0 msgr2=0x7fc7cc069bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.178+0000 7fc7d1ecc700 1 --2- 172.21.15.7:0/3217638893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7cc1590d0 0x7fc7cc069bb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0098e0 tx=0x7fc7bc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.178+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/3217638893 shutdown_connections 2023-10-06T11:01:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.178+0000 7fc7d1ecc700 1 --2- 172.21.15.7:0/3217638893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7cc1590d0 0x7fc7cc069bb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.178+0000 7fc7d1ecc700 1 --2- 172.21.15.7:0/3217638893 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7cc06a0f0 0x7fc7cc15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.178+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/3217638893 >> 172.21.15.7:0/3217638893 conn(0x7fc7cc096160 msgr2=0x7fc7cc0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.178+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/3217638893 shutdown_connections 2023-10-06T11:01:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.178+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/3217638893 wait complete. 2023-10-06T11:01:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.179+0000 7fc7d1ecc700 1 Processor -- start 2023-10-06T11:01:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.179+0000 7fc7d1ecc700 1 -- start start 2023-10-06T11:01:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.180+0000 7fc7d1ecc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7cc06a0f0 0x7fc7cc153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.180+0000 7fc7d1ecc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7cc1590d0 0x7fc7cc156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.180+0000 7fc7d1ecc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7cc15d350 0x7fc7cc156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.180+0000 7fc7d1ecc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc1554f0 con 0x7fc7cc15d350 2023-10-06T11:01:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.180+0000 7fc7d1ecc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc155d90 con 0x7fc7cc06a0f0 2023-10-06T11:01:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.180+0000 7fc7d1ecc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc15b250 con 0x7fc7cc1590d0 2023-10-06T11:01:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.180+0000 7fc7cbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7cc15d350 0x7fc7cc156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.180+0000 7fc7cbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7cc15d350 0x7fc7cc156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59978/0 (socket says 172.21.15.7:59978) 2023-10-06T11:01:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.180+0000 7fc7cbfff700 1 -- 172.21.15.7:0/2401864281 learned_addr learned my addr 172.21.15.7:0/2401864281 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.180+0000 7fc7cb7fe700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7cc06a0f0 0x7fc7cc153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.180+0000 7fc7caffd700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7cc1590d0 0x7fc7cc156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.181+0000 7fc7cbfff700 1 -- 172.21.15.7:0/2401864281 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7cc1590d0 msgr2=0x7fc7cc156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.181+0000 7fc7cbfff700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7cc1590d0 0x7fc7cc156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.181+0000 7fc7cbfff700 1 -- 172.21.15.7:0/2401864281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7cc06a0f0 msgr2=0x7fc7cc153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.181+0000 7fc7cbfff700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7cc06a0f0 0x7fc7cc153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.181+0000 7fc7cbfff700 1 -- 172.21.15.7:0/2401864281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc009420 con 0x7fc7cc15d350 2023-10-06T11:01:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.181+0000 7fc7cb7fe700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7cc06a0f0 0x7fc7cc153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.181+0000 7fc7cbfff700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7cc15d350 0x7fc7cc156760 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400cc40 tx=0x7fc7c4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.181+0000 7fc7b37fe700 1 -- 172.21.15.7:0/2401864281 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c400a940 con 0x7fc7cc15d350 2023-10-06T11:01:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.181+0000 7fc7b37fe700 1 -- 172.21.15.7:0/2401864281 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c400aaa0 con 0x7fc7cc15d350 2023-10-06T11:01:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.181+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/2401864281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7cc155740 con 0x7fc7cc15d350 2023-10-06T11:01:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.181+0000 7fc7b37fe700 1 -- 172.21.15.7:0/2401864281 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c400ae20 con 0x7fc7cc15d350 2023-10-06T11:01:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.181+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/2401864281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7cc153ec0 con 0x7fc7cc15d350 2023-10-06T11:01:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.182+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/2401864281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7cc155f20 con 0x7fc7cc15d350 2023-10-06T11:01:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.183+0000 7fc7b37fe700 1 -- 172.21.15.7:0/2401864281 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7c4007300 con 0x7fc7cc15d350 2023-10-06T11:01:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.183+0000 7fc7b37fe700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc7b8066f30 0x7fc7b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.183+0000 7fc7b37fe700 1 -- 172.21.15.7:0/2401864281 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fc7c40849a0 con 0x7fc7cc15d350 2023-10-06T11:01:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.183+0000 7fc7cb7fe700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc7b8066f30 0x7fc7b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.184+0000 7fc7cb7fe700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc7b8066f30 0x7fc7b80693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0091e0 tx=0x7fc7bc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:35.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.188+0000 7fc7b37fe700 1 -- 172.21.15.7:0/2401864281 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7c4051bc0 con 0x7fc7cc15d350 2023-10-06T11:01:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.391+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/2401864281 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7cc070480 con 0x7fc7b8066f30 2023-10-06T11:01:35.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.391+0000 7fc7b37fe700 1 -- 172.21.15.7:0/2401864281 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc7cc070480 con 0x7fc7b8066f30 2023-10-06T11:01:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.393+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/2401864281 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc7b8066f30 msgr2=0x7fc7b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.393+0000 7fc7d1ecc700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc7b8066f30 0x7fc7b80693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0091e0 tx=0x7fc7bc017000 comp rx=0 tx=0).stop 2023-10-06T11:01:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.393+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/2401864281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7cc15d350 msgr2=0x7fc7cc156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.393+0000 7fc7d1ecc700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7cc15d350 0x7fc7cc156760 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400cc40 tx=0x7fc7c4001a40 comp rx=0 tx=0).stop 2023-10-06T11:01:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.394+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/2401864281 shutdown_connections 2023-10-06T11:01:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.394+0000 7fc7d1ecc700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fc7b8066f30 0x7fc7b80693e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.394+0000 7fc7d1ecc700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7cc15d350 0x7fc7cc156760 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.394+0000 7fc7d1ecc700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7cc06a0f0 0x7fc7cc153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.394+0000 7fc7d1ecc700 1 --2- 172.21.15.7:0/2401864281 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7cc1590d0 0x7fc7cc156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.394+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/2401864281 >> 172.21.15.7:0/2401864281 conn(0x7fc7cc096160 msgr2=0x7fc7cc0afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.394+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/2401864281 shutdown_connections 2023-10-06T11:01:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.394+0000 7fc7d1ecc700 1 -- 172.21.15.7:0/2401864281 wait complete. 2023-10-06T11:01:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T11:01:35.408 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T11:01:35.408 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:01:35.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.543+0000 7fd06f25b700 1 Processor -- start 2023-10-06T11:01:35.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.543+0000 7fd06f25b700 1 -- start start 2023-10-06T11:01:35.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.544+0000 7fd06f25b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0680d0660 0x7fd0681592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.544+0000 7fd06f25b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0680b2ec0 con 0x7fd0680b4c00 2023-10-06T11:01:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.544+0000 7fd06f25b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0680b3760 con 0x7fd068158ee0 2023-10-06T11:01:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.544+0000 7fd06f25b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0680cf9f0 con 0x7fd0680d0660 2023-10-06T11:01:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.544+0000 7fd067fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd0680b4c00 0x7fd0680cff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42766/0 (socket says 172.21.15.7:42766) 2023-10-06T11:01:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.544+0000 7fd06d7f8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0680d0660 0x7fd0681592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.544+0000 7fd067fff700 1 -- 172.21.15.7:0/2427731575 learned_addr learned my addr 172.21.15.7:0/2427731575 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.544+0000 7fd06d7f8700 1 -- 172.21.15.7:0/2427731575 >> v1:172.21.15.50:6789/0 conn(0x7fd068158ee0 legacy=0x7fd0680cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.544+0000 7fd06d7f8700 1 -- 172.21.15.7:0/2427731575 >> v1:172.21.15.7:6789/0 conn(0x7fd0680b4c00 legacy=0x7fd0680cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.544+0000 7fd0677fe700 1 -- 172.21.15.7:0/2427731575 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369755895 0 0) 0x7fd0680b2ec0 con 0x7fd0680b4c00 2023-10-06T11:01:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.544+0000 7fd06d7f8700 1 -- 172.21.15.7:0/2427731575 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0680b3110 con 0x7fd0680d0660 2023-10-06T11:01:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.545+0000 7fd06d7f8700 1 --2- 172.21.15.7:0/2427731575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0680d0660 0x7fd0681592b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd060009e60 tx=0x7fd060009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1ab2da5d3ff061 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.545+0000 7fd0677fe700 1 -- 172.21.15.7:0/2427731575 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06000e070 con 0x7fd0680d0660 2023-10-06T11:01:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.545+0000 7fd0677fe700 1 -- 172.21.15.7:0/2427731575 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06000bbf0 con 0x7fd0680d0660 2023-10-06T11:01:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.545+0000 7fd0677fe700 1 -- 172.21.15.7:0/2427731575 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060012430 con 0x7fd0680d0660 2023-10-06T11:01:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.545+0000 7fd06f25b700 1 -- 172.21.15.7:0/2427731575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0680d0660 msgr2=0x7fd0681592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.545+0000 7fd06f25b700 1 --2- 172.21.15.7:0/2427731575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0680d0660 0x7fd0681592b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd060009e60 tx=0x7fd060009780 comp rx=0 tx=0).stop 2023-10-06T11:01:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.546+0000 7fd06f25b700 1 -- 172.21.15.7:0/2427731575 shutdown_connections 2023-10-06T11:01:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.546+0000 7fd06f25b700 1 --2- 172.21.15.7:0/2427731575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0680d0660 0x7fd0681592b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.546+0000 7fd06f25b700 1 -- 172.21.15.7:0/2427731575 >> 172.21.15.7:0/2427731575 conn(0x7fd068069f60 msgr2=0x7fd0680670f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.546+0000 7fd06f25b700 1 -- 172.21.15.7:0/2427731575 shutdown_connections 2023-10-06T11:01:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.546+0000 7fd06f25b700 1 -- 172.21.15.7:0/2427731575 wait complete. 2023-10-06T11:01:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.547+0000 7fd06f25b700 1 Processor -- start 2023-10-06T11:01:35.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.547+0000 7fd06f25b700 1 -- start start 2023-10-06T11:01:35.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06f25b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0680d0660 0x7fd06815b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06f25b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd068158ee0 0x7fd0680c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06f25b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd068154a60 0x7fd068153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06f25b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06815cec0 con 0x7fd068154a60 2023-10-06T11:01:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06f25b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06815bbb0 con 0x7fd0680d0660 2023-10-06T11:01:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06f25b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06815be90 con 0x7fd068158ee0 2023-10-06T11:01:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06d7f8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd068154a60 0x7fd068153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06d7f8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd068154a60 0x7fd068153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59984/0 (socket says 172.21.15.7:59984) 2023-10-06T11:01:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06d7f8700 1 -- 172.21.15.7:0/1281726997 learned_addr learned my addr 172.21.15.7:0/1281726997 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06cff7700 1 --2- 172.21.15.7:0/1281726997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0680d0660 0x7fd06815b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd067fff700 1 --2- 172.21.15.7:0/1281726997 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd068158ee0 0x7fd0680c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06d7f8700 1 -- 172.21.15.7:0/1281726997 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd068158ee0 msgr2=0x7fd0680c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06d7f8700 1 --2- 172.21.15.7:0/1281726997 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd068158ee0 0x7fd0680c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06d7f8700 1 -- 172.21.15.7:0/1281726997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0680d0660 msgr2=0x7fd06815b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06d7f8700 1 --2- 172.21.15.7:0/1281726997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0680d0660 0x7fd06815b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.548+0000 7fd06d7f8700 1 -- 172.21.15.7:0/1281726997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd060009a20 con 0x7fd068154a60 2023-10-06T11:01:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.549+0000 7fd06d7f8700 1 --2- 172.21.15.7:0/1281726997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd068154a60 0x7fd068153e40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd060003000 tx=0x7fd060018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.549+0000 7fd064ff9700 1 -- 172.21.15.7:0/1281726997 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060027470 con 0x7fd068154a60 2023-10-06T11:01:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.549+0000 7fd064ff9700 1 -- 172.21.15.7:0/1281726997 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0600275d0 con 0x7fd068154a60 2023-10-06T11:01:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.549+0000 7fd064ff9700 1 -- 172.21.15.7:0/1281726997 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060027970 con 0x7fd068154a60 2023-10-06T11:01:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.549+0000 7fd06f25b700 1 -- 172.21.15.7:0/1281726997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06815c170 con 0x7fd068154a60 2023-10-06T11:01:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.549+0000 7fd06f25b700 1 -- 172.21.15.7:0/1281726997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06815b7f0 con 0x7fd068154a60 2023-10-06T11:01:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.550+0000 7fd06f25b700 1 -- 172.21.15.7:0/1281726997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd068070480 con 0x7fd068154a60 2023-10-06T11:01:35.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.550+0000 7fd064ff9700 1 -- 172.21.15.7:0/1281726997 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd060024070 con 0x7fd068154a60 2023-10-06T11:01:35.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.551+0000 7fd064ff9700 1 --2- 172.21.15.7:0/1281726997 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd04c066f30 0x7fd04c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.551+0000 7fd064ff9700 1 -- 172.21.15.7:0/1281726997 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fd060086eb0 con 0x7fd068154a60 2023-10-06T11:01:35.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.551+0000 7fd06cff7700 1 --2- 172.21.15.7:0/1281726997 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd04c066f30 0x7fd04c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.551+0000 7fd064ff9700 1 --2- 172.21.15.7:0/1281726997 >> [v2:172.21.15.50:6824/120011,v1:172.21.15.50:6825/120011] conn(0x7fd04c06d850 0x7fd04c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.551+0000 7fd064ff9700 1 -- 172.21.15.7:0/1281726997 --> [v2:172.21.15.50:6824/120011,v1:172.21.15.50:6825/120011] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd04c070370 con 0x7fd04c06d850 2023-10-06T11:01:35.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.551+0000 7fd064ff9700 1 -- 172.21.15.7:0/1281726997 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0600894f0 con 0x7fd068154a60 2023-10-06T11:01:35.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.551+0000 7fd06cff7700 1 --2- 172.21.15.7:0/1281726997 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd04c066f30 0x7fd04c0693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd05c003a30 tx=0x7fd05c007ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:35.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.551+0000 7fd067fff700 1 --2- 172.21.15.7:0/1281726997 >> [v2:172.21.15.50:6824/120011,v1:172.21.15.50:6825/120011] conn(0x7fd04c06d850 0x7fd04c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.552+0000 7fd067fff700 1 --2- 172.21.15.7:0/1281726997 >> [v2:172.21.15.50:6824/120011,v1:172.21.15.50:6825/120011] conn(0x7fd04c06d850 0x7fd04c06fca0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:35.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.552+0000 7fd064ff9700 1 -- 172.21.15.7:0/1281726997 <== osd.7 v2:172.21.15.50:6824/120011 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd04c070370 con 0x7fd04c06d850 2023-10-06T11:01:35.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.567+0000 7fd06f25b700 1 -- 172.21.15.7:0/1281726997 --> [v2:172.21.15.50:6824/120011,v1:172.21.15.50:6825/120011] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd0680b33f0 con 0x7fd04c06d850 2023-10-06T11:01:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.567+0000 7fd064ff9700 1 -- 172.21.15.7:0/1281726997 <== osd.7 v2:172.21.15.50:6824/120011 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd0680b33f0 con 0x7fd04c06d850 2023-10-06T11:01:35.568 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-06T11:01:35.568 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:01:35.568 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-06T11:01:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.568+0000 7fd06f25b700 1 -- 172.21.15.7:0/1281726997 >> [v2:172.21.15.50:6824/120011,v1:172.21.15.50:6825/120011] conn(0x7fd04c06d850 msgr2=0x7fd04c06fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.568+0000 7fd06f25b700 1 --2- 172.21.15.7:0/1281726997 >> [v2:172.21.15.50:6824/120011,v1:172.21.15.50:6825/120011] conn(0x7fd04c06d850 0x7fd04c06fca0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.568+0000 7fd06f25b700 1 -- 172.21.15.7:0/1281726997 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd04c066f30 msgr2=0x7fd04c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.568+0000 7fd06f25b700 1 --2- 172.21.15.7:0/1281726997 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fd04c066f30 0x7fd04c0693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd05c003a30 tx=0x7fd05c007ea0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.568+0000 7fd06f25b700 1 -- 172.21.15.7:0/1281726997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd068154a60 msgr2=0x7fd068153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.568+0000 7fd06f25b700 1 --2- 172.21.15.7:0/1281726997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd068154a60 0x7fd068153e40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd060003000 tx=0x7fd060018000 comp rx=0 tx=0).stop 2023-10-06T11:01:35.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.568+0000 7fd06d7f8700 1 -- 172.21.15.7:0/1281726997 reap_dead start 2023-10-06T11:01:35.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.568+0000 7fd06f25b700 1 -- 172.21.15.7:0/1281726997 shutdown_connections 2023-10-06T11:01:35.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.568+0000 7fd06f25b700 1 -- 172.21.15.7:0/1281726997 >> 172.21.15.7:0/1281726997 conn(0x7fd068069f60 msgr2=0x7fd068157c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:35.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.568+0000 7fd06f25b700 1 -- 172.21.15.7:0/1281726997 shutdown_connections 2023-10-06T11:01:35.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.568+0000 7fd06f25b700 1 -- 172.21.15.7:0/1281726997 wait complete. 2023-10-06T11:01:35.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T11:01:35.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.713+0000 7ff1124d2700 1 Processor -- start 2023-10-06T11:01:35.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.713+0000 7ff1124d2700 1 -- start start 2023-10-06T11:01:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.714+0000 7ff1124d2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff10c1590d0 0x7ff10c069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.714+0000 7ff1124d2700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10c0694d0 con 0x7ff10c06a0f0 2023-10-06T11:01:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.714+0000 7ff1124d2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10c15abc0 con 0x7ff10c15d520 2023-10-06T11:01:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.714+0000 7ff1124d2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10c068990 con 0x7ff10c1590d0 2023-10-06T11:01:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.714+0000 7ff10b7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff10c06a0f0 0x7ff10c15ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42772/0 (socket says 172.21.15.7:42772) 2023-10-06T11:01:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.714+0000 7ff10b7fe700 1 -- 172.21.15.7:0/350095836 learned_addr learned my addr 172.21.15.7:0/350095836 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.714+0000 7ff10bfff700 1 --2- 172.21.15.7:0/350095836 >> v2:172.21.15.50:3300/0 conn(0x7ff10c1590d0 0x7ff10c069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.715+0000 7ff10affd700 1 -- 172.21.15.7:0/350095836 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737924111 0 0) 0x7ff10c0694d0 con 0x7ff10c06a0f0 2023-10-06T11:01:35.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.715+0000 7ff10affd700 1 -- 172.21.15.7:0/350095836 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0f8003570 con 0x7ff10c06a0f0 2023-10-06T11:01:35.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.715+0000 7ff10affd700 1 -- 172.21.15.7:0/350095836 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987864840 0 0) 0x7ff10c15abc0 con 0x7ff10c15d520 2023-10-06T11:01:35.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.715+0000 7ff10affd700 1 -- 172.21.15.7:0/350095836 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff10c0694d0 con 0x7ff10c15d520 2023-10-06T11:01:35.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.715+0000 7ff10bfff700 1 -- 172.21.15.7:0/350095836 >> v1:172.21.15.50:6789/0 conn(0x7ff10c15d520 legacy=0x7ff10c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.715+0000 7ff10bfff700 1 -- 172.21.15.7:0/350095836 >> v1:172.21.15.7:6789/0 conn(0x7ff10c06a0f0 legacy=0x7ff10c15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.715+0000 7ff10bfff700 1 -- 172.21.15.7:0/350095836 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c068ba0 con 0x7ff10c1590d0 2023-10-06T11:01:35.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.715+0000 7ff10bfff700 1 --2- 172.21.15.7:0/350095836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c1590d0 0x7ff10c069bb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0098e0 tx=0x7ff0fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e19937b41dceef93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:35.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.715+0000 7ff10affd700 1 -- 172.21.15.7:0/350095836 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc011630 con 0x7ff10c1590d0 2023-10-06T11:01:35.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.715+0000 7ff10affd700 1 -- 172.21.15.7:0/350095836 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc011790 con 0x7ff10c1590d0 2023-10-06T11:01:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.715+0000 7ff10affd700 1 -- 172.21.15.7:0/350095836 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc011b30 con 0x7ff10c1590d0 2023-10-06T11:01:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.716+0000 7ff1124d2700 1 -- 172.21.15.7:0/350095836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c1590d0 msgr2=0x7ff10c069bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.716+0000 7ff1124d2700 1 --2- 172.21.15.7:0/350095836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c1590d0 0x7ff10c069bb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0098e0 tx=0x7ff0fc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.716+0000 7ff1124d2700 1 -- 172.21.15.7:0/350095836 shutdown_connections 2023-10-06T11:01:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.716+0000 7ff1124d2700 1 --2- 172.21.15.7:0/350095836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c1590d0 0x7ff10c069bb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.716+0000 7ff1124d2700 1 -- 172.21.15.7:0/350095836 >> 172.21.15.7:0/350095836 conn(0x7ff10c096160 msgr2=0x7ff10c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.716+0000 7ff1124d2700 1 -- 172.21.15.7:0/350095836 shutdown_connections 2023-10-06T11:01:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.716+0000 7ff1124d2700 1 -- 172.21.15.7:0/350095836 wait complete. 2023-10-06T11:01:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.717+0000 7ff1124d2700 1 Processor -- start 2023-10-06T11:01:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.717+0000 7ff1124d2700 1 -- start start 2023-10-06T11:01:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.718+0000 7ff1124d2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff10c06a0f0 0x7ff10c0ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.718+0000 7ff1124d2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff10c1590d0 0x7ff10c14cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.718+0000 7ff1124d2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c15d520 0x7ff10c14fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.718+0000 7ff1124d2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c0ae650 con 0x7ff10c1590d0 2023-10-06T11:01:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.718+0000 7ff1124d2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c0ad070 con 0x7ff10c15d520 2023-10-06T11:01:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.718+0000 7ff1124d2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c0ad350 con 0x7ff10c06a0f0 2023-10-06T11:01:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.718+0000 7ff10b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff10c1590d0 0x7ff10c14cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.718+0000 7ff10b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff10c1590d0 0x7ff10c14cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59990/0 (socket says 172.21.15.7:59990) 2023-10-06T11:01:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.718+0000 7ff10b7fe700 1 -- 172.21.15.7:0/2489946344 learned_addr learned my addr 172.21.15.7:0/2489946344 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.718+0000 7ff110a6f700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c15d520 0x7ff10c14fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.718+0000 7ff10bfff700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff10c06a0f0 0x7ff10c0ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.719+0000 7ff10b7fe700 1 -- 172.21.15.7:0/2489946344 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff10c06a0f0 msgr2=0x7ff10c0ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.719+0000 7ff10b7fe700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff10c06a0f0 0x7ff10c0ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.719+0000 7ff10b7fe700 1 -- 172.21.15.7:0/2489946344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c15d520 msgr2=0x7ff10c14fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.719+0000 7ff10b7fe700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c15d520 0x7ff10c14fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.719+0000 7ff10b7fe700 1 -- 172.21.15.7:0/2489946344 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc009420 con 0x7ff10c1590d0 2023-10-06T11:01:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.719+0000 7ff110a6f700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c15d520 0x7ff10c14fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:01:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.719+0000 7ff10b7fe700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff10c1590d0 0x7ff10c14cc10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400c790 tx=0x7ff0f4007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.719+0000 7ff103fff700 1 -- 172.21.15.7:0/2489946344 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4005b30 con 0x7ff10c1590d0 2023-10-06T11:01:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.719+0000 7ff103fff700 1 -- 172.21.15.7:0/2489946344 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f4005c90 con 0x7ff10c1590d0 2023-10-06T11:01:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.719+0000 7ff1124d2700 1 -- 172.21.15.7:0/2489946344 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10c0ad630 con 0x7ff10c1590d0 2023-10-06T11:01:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.719+0000 7ff103fff700 1 -- 172.21.15.7:0/2489946344 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4007300 con 0x7ff10c1590d0 2023-10-06T11:01:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.719+0000 7ff1124d2700 1 -- 172.21.15.7:0/2489946344 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c0adbf0 con 0x7ff10c1590d0 2023-10-06T11:01:35.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.720+0000 7ff1124d2700 1 -- 172.21.15.7:0/2489946344 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c070480 con 0x7ff10c1590d0 2023-10-06T11:01:35.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.721+0000 7ff103fff700 1 -- 172.21.15.7:0/2489946344 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0f401b400 con 0x7ff10c1590d0 2023-10-06T11:01:35.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.721+0000 7ff103fff700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0ec066f30 0x7ff0ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:35.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.721+0000 7ff103fff700 1 -- 172.21.15.7:0/2489946344 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7ff0f4084010 con 0x7ff10c1590d0 2023-10-06T11:01:35.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.721+0000 7ff10bfff700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0ec066f30 0x7ff0ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:35.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.722+0000 7ff10bfff700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0ec066f30 0x7ff0ec0693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0098e0 tx=0x7ff0fc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:35.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.726+0000 7ff103fff700 1 -- 172.21.15.7:0/2489946344 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0f4051410 con 0x7ff10c1590d0 2023-10-06T11:01:35.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.929+0000 7ff1124d2700 1 -- 172.21.15.7:0/2489946344 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff10c068e80 con 0x7ff0ec066f30 2023-10-06T11:01:35.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.929+0000 7ff103fff700 1 -- 172.21.15.7:0/2489946344 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff10c068e80 con 0x7ff0ec066f30 2023-10-06T11:01:35.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.931+0000 7ff1124d2700 1 -- 172.21.15.7:0/2489946344 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0ec066f30 msgr2=0x7ff0ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.931+0000 7ff1124d2700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0ec066f30 0x7ff0ec0693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0098e0 tx=0x7ff0fc017000 comp rx=0 tx=0).stop 2023-10-06T11:01:35.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.931+0000 7ff1124d2700 1 -- 172.21.15.7:0/2489946344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff10c1590d0 msgr2=0x7ff10c14cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.931+0000 7ff1124d2700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff10c1590d0 0x7ff10c14cc10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400c790 tx=0x7ff0f4007e40 comp rx=0 tx=0).stop 2023-10-06T11:01:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.931+0000 7ff1124d2700 1 -- 172.21.15.7:0/2489946344 shutdown_connections 2023-10-06T11:01:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.931+0000 7ff1124d2700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7ff0ec066f30 0x7ff0ec0693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.931+0000 7ff1124d2700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c15d520 0x7ff10c14fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.931+0000 7ff1124d2700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff10c06a0f0 0x7ff10c0ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.931+0000 7ff1124d2700 1 --2- 172.21.15.7:0/2489946344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff10c1590d0 0x7ff10c14cc10 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.931+0000 7ff1124d2700 1 -- 172.21.15.7:0/2489946344 >> 172.21.15.7:0/2489946344 conn(0x7ff10c096160 msgr2=0x7ff10c0a9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.931+0000 7ff1124d2700 1 -- 172.21.15.7:0/2489946344 shutdown_connections 2023-10-06T11:01:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:35.931+0000 7ff1124d2700 1 -- 172.21.15.7:0/2489946344 wait complete. 2023-10-06T11:01:35.934 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T11:01:35.945 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:01:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.076+0000 7fbc75177700 1 Processor -- start 2023-10-06T11:01:36.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.077+0000 7fbc75177700 1 -- start start 2023-10-06T11:01:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.077+0000 7fbc75177700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbc7015b830 0x7fbc70157110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.077+0000 7fbc75177700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc700cdc30 con 0x7fbc700abdb0 2023-10-06T11:01:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.077+0000 7fbc75177700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc70068d60 con 0x7fbc700ac180 2023-10-06T11:01:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.077+0000 7fbc75177700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc700cd390 con 0x7fbc7015b830 2023-10-06T11:01:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6ed9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbc700abdb0 0x7fbc700ccb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42788/0 (socket says 172.21.15.7:42788) 2023-10-06T11:01:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6ed9d700 1 -- 172.21.15.7:0/3711415039 learned_addr learned my addr 172.21.15.7:0/3711415039 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6f59e700 1 --2- 172.21.15.7:0/3711415039 >> v2:172.21.15.50:3300/0 conn(0x7fbc7015b830 0x7fbc70157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 -- 172.21.15.7:0/3711415039 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283269059 0 0) 0x7fbc700cdc30 con 0x7fbc700abdb0 2023-10-06T11:01:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 -- 172.21.15.7:0/3711415039 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc58003570 con 0x7fbc700abdb0 2023-10-06T11:01:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 -- 172.21.15.7:0/3711415039 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1437071792 0 0) 0x7fbc58003570 con 0x7fbc700abdb0 2023-10-06T11:01:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 -- 172.21.15.7:0/3711415039 >> v2:172.21.15.50:3300/0 conn(0x7fbc7015b830 msgr2=0x7fbc70157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 --2- 172.21.15.7:0/3711415039 >> v2:172.21.15.50:3300/0 conn(0x7fbc7015b830 0x7fbc70157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 -- 172.21.15.7:0/3711415039 >> v1:172.21.15.50:6789/0 conn(0x7fbc700ac180 legacy=0x7fbc70156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 -- 172.21.15.7:0/3711415039 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc700cd670 con 0x7fbc700abdb0 2023-10-06T11:01:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 -- 172.21.15.7:0/3711415039 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 294529924 0 0) 0x7fbc60001470 con 0x7fbc700abdb0 2023-10-06T11:01:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 -- 172.21.15.7:0/3711415039 >> v1:172.21.15.7:6789/0 conn(0x7fbc700abdb0 legacy=0x7fbc700ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 --2- 172.21.15.7:0/3711415039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc58003a60 0x7fbc58003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 --2- 172.21.15.7:0/3711415039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc58004810 0x7fbc58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 --2- 172.21.15.7:0/3711415039 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbc580051c0 0x7fbc5800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 -- 172.21.15.7:0/3711415039 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc700cd390 con 0x7fbc58004810 2023-10-06T11:01:36.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 -- 172.21.15.7:0/3711415039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5800c160 con 0x7fbc58003a60 2023-10-06T11:01:36.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6dd9b700 1 -- 172.21.15.7:0/3711415039 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5800c320 con 0x7fbc580051c0 2023-10-06T11:01:36.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6e59c700 1 --2- 172.21.15.7:0/3711415039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc58004810 0x7fbc58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:36.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.078+0000 7fbc6ed9d700 1 --2- 172.21.15.7:0/3711415039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc58003a60 0x7fbc58003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:36.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.079+0000 7fbc6f59e700 1 --2- 172.21.15.7:0/3711415039 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbc580051c0 0x7fbc5800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:36.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.079+0000 7fbc6e59c700 1 -- 172.21.15.7:0/3711415039 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbc580051c0 msgr2=0x7fbc5800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:36.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.079+0000 7fbc6e59c700 1 --2- 172.21.15.7:0/3711415039 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbc580051c0 0x7fbc5800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:36.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.079+0000 7fbc6e59c700 1 -- 172.21.15.7:0/3711415039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc58003a60 msgr2=0x7fbc58003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:36.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.079+0000 7fbc6e59c700 1 --2- 172.21.15.7:0/3711415039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc58003a60 0x7fbc58003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:36.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.079+0000 7fbc6e59c700 1 -- 172.21.15.7:0/3711415039 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc58003570 con 0x7fbc58004810 2023-10-06T11:01:36.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.079+0000 7fbc6f59e700 1 --2- 172.21.15.7:0/3711415039 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbc580051c0 0x7fbc5800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.079+0000 7fbc6f59e700 1 -- 172.21.15.7:0/3711415039 reap_dead start 2023-10-06T11:01:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.079+0000 7fbc6e59c700 1 --2- 172.21.15.7:0/3711415039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc58004810 0x7fbc58004c80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbc640018b0 tx=0x7fbc64007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e4c795dc4740b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.079+0000 7fbc6dd9b700 1 -- 172.21.15.7:0/3711415039 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64012420 con 0x7fbc58004810 2023-10-06T11:01:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.079+0000 7fbc6dd9b700 1 -- 172.21.15.7:0/3711415039 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc640125a0 con 0x7fbc58004810 2023-10-06T11:01:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.079+0000 7fbc6dd9b700 1 -- 172.21.15.7:0/3711415039 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64012960 con 0x7fbc58004810 2023-10-06T11:01:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.080+0000 7fbc75177700 1 -- 172.21.15.7:0/3711415039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc58004810 msgr2=0x7fbc58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.080+0000 7fbc75177700 1 --2- 172.21.15.7:0/3711415039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc58004810 0x7fbc58004c80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbc640018b0 tx=0x7fbc64007d30 comp rx=0 tx=0).stop 2023-10-06T11:01:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.080+0000 7fbc75177700 1 -- 172.21.15.7:0/3711415039 shutdown_connections 2023-10-06T11:01:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.080+0000 7fbc75177700 1 --2- 172.21.15.7:0/3711415039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc58004810 0x7fbc58004c80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.080+0000 7fbc75177700 1 -- 172.21.15.7:0/3711415039 >> 172.21.15.7:0/3711415039 conn(0x7fbc70096160 msgr2=0x7fbc700afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.080+0000 7fbc75177700 1 -- 172.21.15.7:0/3711415039 shutdown_connections 2023-10-06T11:01:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.080+0000 7fbc75177700 1 -- 172.21.15.7:0/3711415039 wait complete. 2023-10-06T11:01:36.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.082+0000 7fbc75177700 1 Processor -- start 2023-10-06T11:01:36.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.082+0000 7fbc75177700 1 -- start start 2023-10-06T11:01:36.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc75177700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbc58004810 0x7fbc701502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:36.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc75177700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc7014f3c0 0x7fbc70167310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:36.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc75177700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc70167850 0x7fbc700c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc75177700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc700c9120 con 0x7fbc7014f3c0 2023-10-06T11:01:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc75177700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7006bd00 con 0x7fbc70167850 2023-10-06T11:01:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc75177700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7006b3d0 con 0x7fbc58004810 2023-10-06T11:01:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc6e59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc7014f3c0 0x7fbc70167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc6e59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc7014f3c0 0x7fbc70167310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60000/0 (socket says 172.21.15.7:60000) 2023-10-06T11:01:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc6e59c700 1 -- 172.21.15.7:0/67491701 learned_addr learned my addr 172.21.15.7:0/67491701 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc6ed9d700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbc58004810 0x7fbc701502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc6f59e700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc70167850 0x7fbc700c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc6e59c700 1 -- 172.21.15.7:0/67491701 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbc58004810 msgr2=0x7fbc701502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc6e59c700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbc58004810 0x7fbc701502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc6e59c700 1 -- 172.21.15.7:0/67491701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc70167850 msgr2=0x7fbc700c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc6e59c700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc70167850 0x7fbc700c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc6e59c700 1 -- 172.21.15.7:0/67491701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7006b6b0 con 0x7fbc7014f3c0 2023-10-06T11:01:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc6f59e700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc70167850 0x7fbc700c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.083+0000 7fbc6e59c700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc7014f3c0 0x7fbc70167310 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800c130 tx=0x7fbc64015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.084+0000 7fbc56ffd700 1 -- 172.21.15.7:0/67491701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6400c800 con 0x7fbc7014f3c0 2023-10-06T11:01:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.084+0000 7fbc56ffd700 1 -- 172.21.15.7:0/67491701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6400c960 con 0x7fbc7014f3c0 2023-10-06T11:01:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.084+0000 7fbc75177700 1 -- 172.21.15.7:0/67491701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7006b990 con 0x7fbc7014f3c0 2023-10-06T11:01:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.084+0000 7fbc56ffd700 1 -- 172.21.15.7:0/67491701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6400cd00 con 0x7fbc7014f3c0 2023-10-06T11:01:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.084+0000 7fbc75177700 1 -- 172.21.15.7:0/67491701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7014af60 con 0x7fbc7014f3c0 2023-10-06T11:01:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.085+0000 7fbc75177700 1 -- 172.21.15.7:0/67491701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7006bb20 con 0x7fbc7014f3c0 2023-10-06T11:01:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.085+0000 7fbc56ffd700 1 -- 172.21.15.7:0/67491701 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc6401f620 con 0x7fbc7014f3c0 2023-10-06T11:01:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.085+0000 7fbc56ffd700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbc5c066f30 0x7fbc5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.086+0000 7fbc56ffd700 1 -- 172.21.15.7:0/67491701 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fbc64085d60 con 0x7fbc7014f3c0 2023-10-06T11:01:36.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.086+0000 7fbc6ed9d700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbc5c066f30 0x7fbc5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:36.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.086+0000 7fbc6ed9d700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbc5c066f30 0x7fbc5c0693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbc600015a0 tx=0x7fbc60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:36.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.090+0000 7fbc56ffd700 1 -- 172.21.15.7:0/67491701 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc64053030 con 0x7fbc7014f3c0 2023-10-06T11:01:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.288+0000 7fbc75177700 1 -- 172.21.15.7:0/67491701 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc7006b540 con 0x7fbc5c066f30 2023-10-06T11:01:36.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.290+0000 7fbc56ffd700 1 -- 172.21.15.7:0/67491701 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72835 (secure 0 0 0) 0x7fbc7006b540 con 0x7fbc5c066f30 2023-10-06T11:01:36.292 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:36.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.293+0000 7fbc75177700 1 -- 172.21.15.7:0/67491701 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbc5c066f30 msgr2=0x7fbc5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:36.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.293+0000 7fbc75177700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbc5c066f30 0x7fbc5c0693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbc600015a0 tx=0x7fbc60009040 comp rx=0 tx=0).stop 2023-10-06T11:01:36.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.293+0000 7fbc75177700 1 -- 172.21.15.7:0/67491701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc7014f3c0 msgr2=0x7fbc70167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:36.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.293+0000 7fbc75177700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc7014f3c0 0x7fbc70167310 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800c130 tx=0x7fbc64015000 comp rx=0 tx=0).stop 2023-10-06T11:01:36.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.293+0000 7fbc75177700 1 -- 172.21.15.7:0/67491701 shutdown_connections 2023-10-06T11:01:36.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.293+0000 7fbc75177700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fbc5c066f30 0x7fbc5c0693e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:36.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.293+0000 7fbc75177700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc70167850 0x7fbc700c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:36.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.293+0000 7fbc75177700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbc58004810 0x7fbc701502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:36.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.293+0000 7fbc75177700 1 --2- 172.21.15.7:0/67491701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc7014f3c0 0x7fbc70167310 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:36.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.293+0000 7fbc75177700 1 -- 172.21.15.7:0/67491701 >> 172.21.15.7:0/67491701 conn(0x7fbc70096160 msgr2=0x7fbc701514d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:36.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.293+0000 7fbc75177700 1 -- 172.21.15.7:0/67491701 shutdown_connections 2023-10-06T11:01:36.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:36.293+0000 7fbc75177700 1 -- 172.21.15.7:0/67491701 wait complete. 2023-10-06T11:01:36.295 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-06T11:01:36.307 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2023-10-06T11:01:36.006258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385144,"kb_used_data":6840,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589576,"statfs":{"total":773094113280,"available":770651725824,"internally_reserved":0,"allocated":7004160,"data_stored":3902976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.835757"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":52,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T11:01:27.177470+0000","last_change":"2023-10-06T10:58:56.328381+0000","last_active":"2023-10-06T11:01:27.177470+0000","last_peered":"2023-10-06T11:01:27.177470+0000","last_clean":"2023-10-06T11:01:27.177470+0000","last_became_active":"2023-10-06T10:58:56.328054+0000","last_became_peered":"2023-10-06T10:58:56.328054+0000","last_unstale":"2023-10-06T11:01:27.177470+0000","last_undegraded":"2023-10-06T11:01:27.177470+0000","last_fullsized":"2023-10-06T11:01:27.177470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":50,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T11:01:27.888732+0000","last_change":"2023-10-06T10:58:56.326189+0000","last_active":"2023-10-06T11:01:27.888732+0000","last_peered":"2023-10-06T11:01:27.888732+0000","last_clean":"2023-10-06T11:01:27.888732+0000","last_became_active":"2023-10-06T10:58:56.325852+0000","last_became_peered":"2023-10-06T10:58:56.325852+0000","last_unstale":"2023-10-06T11:01:27.888732+0000","last_undegraded":"2023-10-06T11:01:27.888732+0000","last_fullsized":"2023-10-06T11:01:27.888732+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":64,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T11:01:34.602555+0000","last_change":"2023-10-06T11:01:34.602519+0000","last_active":"2023-10-06T11:01:34.602555+0000","last_peered":"2023-10-06T11:01:34.602555+0000","last_clean":"2023-10-06T11:01:34.602555+0000","last_became_active":"2023-10-06T10:58:56.325095+0000","last_became_peered":"2023-10-06T10:58:56.325095+0000","last_unstale":"2023-10-06T11:01:34.602555+0000","last_undegraded":"2023-10-06T11:01:34.602555+0000","last_fullsized":"2023-10-06T11:01:34.602555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:34.602394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:34.602394+0000","last_clean_scrub_stamp":"2023-10-06T11:01:34.602394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:20:19.340601+0000","scrub_duration":0.0020844570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":196,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T11:01:26.826667+0000","last_change":"2023-10-06T10:58:57.328525+0000","last_active":"2023-10-06T11:01:26.826667+0000","last_peered":"2023-10-06T11:01:26.826667+0000","last_clean":"2023-10-06T11:01:26.826667+0000","last_became_active":"2023-10-06T10:58:57.327509+0000","last_became_peered":"2023-10-06T10:58:57.327509+0000","last_unstale":"2023-10-06T11:01:26.826667+0000","last_undegraded":"2023-10-06T11:01:26.826667+0000","last_fullsized":"2023-10-06T11:01:26.826667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:56.314996+0000","last_clean_scrub_stamp":"2023-10-06T10:58:56.314996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:45.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T11:01:26.827756+0000","last_change":"2023-10-06T10:58:56.331567+0000","last_active":"2023-10-06T11:01:26.827756+0000","last_peered":"2023-10-06T11:01:26.827756+0000","last_clean":"2023-10-06T11:01:26.827756+0000","last_became_active":"2023-10-06T10:58:56.331244+0000","last_became_peered":"2023-10-06T10:58:56.331244+0000","last_unstale":"2023-10-06T11:01:26.827756+0000","last_undegraded":"2023-10-06T11:01:26.827756+0000","last_fullsized":"2023-10-06T11:01:26.827756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T11:01:26.826754+0000","last_change":"2023-10-06T10:58:56.332184+0000","last_active":"2023-10-06T11:01:26.826754+0000","last_peered":"2023-10-06T11:01:26.826754+0000","last_clean":"2023-10-06T11:01:26.826754+0000","last_became_active":"2023-10-06T10:58:56.331830+0000","last_became_peered":"2023-10-06T10:58:56.331830+0000","last_unstale":"2023-10-06T11:01:26.826754+0000","last_undegraded":"2023-10-06T11:01:26.826754+0000","last_fullsized":"2023-10-06T11:01:26.826754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:54:02.320834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T11:01:27.891056+0000","last_change":"2023-10-06T10:58:56.331654+0000","last_active":"2023-10-06T11:01:27.891056+0000","last_peered":"2023-10-06T11:01:27.891056+0000","last_clean":"2023-10-06T11:01:27.891056+0000","last_became_active":"2023-10-06T10:58:56.331345+0000","last_became_peered":"2023-10-06T10:58:56.331345+0000","last_unstale":"2023-10-06T11:01:27.891056+0000","last_undegraded":"2023-10-06T11:01:27.891056+0000","last_fullsized":"2023-10-06T11:01:27.891056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":46,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T11:01:26.832747+0000","last_change":"2023-10-06T10:58:56.331650+0000","last_active":"2023-10-06T11:01:26.832747+0000","last_peered":"2023-10-06T11:01:26.832747+0000","last_clean":"2023-10-06T11:01:26.832747+0000","last_became_active":"2023-10-06T10:58:56.331344+0000","last_became_peered":"2023-10-06T10:58:56.331344+0000","last_unstale":"2023-10-06T11:01:26.832747+0000","last_undegraded":"2023-10-06T11:01:26.832747+0000","last_fullsized":"2023-10-06T11:01:26.832747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:45.584545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":46,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T11:01:26.832999+0000","last_change":"2023-10-06T10:58:56.326315+0000","last_active":"2023-10-06T11:01:26.832999+0000","last_peered":"2023-10-06T11:01:26.832999+0000","last_clean":"2023-10-06T11:01:26.832999+0000","last_became_active":"2023-10-06T10:58:56.325897+0000","last_became_peered":"2023-10-06T10:58:56.325897+0000","last_unstale":"2023-10-06T11:01:26.832999+0000","last_undegraded":"2023-10-06T11:01:26.832999+0000","last_fullsized":"2023-10-06T11:01:26.832999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T10:58:55.309582+0000","last_clean_scrub_stamp":"2023-10-06T10:58:55.309582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:26.563628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":931137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.46000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77800000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66900000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.441}]},{"osd":3,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.376}]},{"osd":5,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.47199999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":339791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79200000000000004,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.621,"15min":0.61599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.40999999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":1.036,"15min":1.036},"last":0.437},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.72299999999999998,"5min":1.274,"15min":1.274},"last":0.40799999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.40500000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77700000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86799999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.60999999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.249,"15min":0.249},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.36399999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.623},{"interface":"front","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84799999999999998,"5min":0.873,"15min":0.873},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82299999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.49099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83299999999999996,"5min":1.006,"15min":1.006},"last":0.66200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":931137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.379,"15min":0.38100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56000000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.34300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44,"15min":0.441},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47799999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64700000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.438,"15min":0.438},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.37}]},{"osd":4,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93100000000000005,"5min":1.123,"15min":1.123},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69599999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70599999999999996,"15min":0.70999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.81799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":339791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.40699999999999997,"15min":0.41499999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.66600000000000004,"5min":0.746,"15min":0.746},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44,"15min":0.438},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34300000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46000000000000002,"15min":0.45300000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.61899999999999999,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.746,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79200000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.502},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89500000000000002,"5min":1.002,"15min":1.002},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68400000000000005,"15min":0.68899999999999995},"min":{"1min":0.51400000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.85499999999999998,"5min":1.022,"15min":1.022},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0069999999999999,"5min":1.238,"15min":1.238},"last":0.53900000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0549999999999999,"5min":2.9540000000000002,"15min":2.9540000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71899999999999997,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83299999999999996,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92400000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94799999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":340769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.379},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63800000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.432,"15min":0.435},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46000000000000002,"15min":0.46100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.433}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40400000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.66600000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.316},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.374,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.036},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0780000000000001,"5min":1.107,"15min":1.107},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46200000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.47399999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.498,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86599999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.52100000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.65500000000000003,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.2130000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.495}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98299999999999998,"5min":1.232,"15min":1.232},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.57699999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.50700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":339791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52600000000000002,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.54700000000000004,"15min":0.57399999999999995},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57199999999999995,"5min":4.617,"15min":4.617},"last":0.32600000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52700000000000002,"15min":0.54700000000000004},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70699999999999996,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":0.372},{"interface":"front","average":{"1min":0.441,"5min":0.51800000000000002,"15min":0.53100000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.59799999999999998,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.68899999999999995,"15min":0.72499999999999998},"min":{"1min":0.36499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.61299999999999999,"5min":6.4400000000000004,"15min":6.4400000000000004},"last":2.407},{"interface":"front","average":{"1min":0.502,"5min":0.72199999999999998,"15min":0.75800000000000001},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66900000000000004,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":2.3929999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.74299999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.83699999999999997,"15min":0.86799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92500000000000004,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.42199999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90900000000000003,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.81499999999999995,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.016,"5min":4.4470000000000001,"15min":4.4470000000000001},"last":0.625},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73499999999999999,"15min":0.748},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85899999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.70599999999999996,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88400000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.87,"15min":0.89400000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95899999999999996,"5min":4.4130000000000003,"15min":4.4130000000000003},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":340769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88200000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.623},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.748,"5min":5.476,"15min":5.476},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.44900000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88100000000000001,"5min":1.978,"15min":1.978},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.86499999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.73599999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.58499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.92300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":339791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.435},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56200000000000006}]},{"osd":1,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.42799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76700000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.505}]},{"osd":2,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78200000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78300000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77100000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.629,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63300000000000001,"15min":0.64000000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67000000000000004,"15min":0.68000000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.73899999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:01:36.312 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-10-06T10:58:55.309582+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=10, tm_min=58, tm_sec=55, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=1, tm_sec=30, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:01:36.312 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-10-06T10:58:55.309582+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=10, tm_min=58, tm_sec=55, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=1, tm_sec=30, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:01:36.312 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T10:58:56.314996+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=10, tm_min=58, tm_sec=56, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=1, tm_sec=30, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:01:36.312 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-06T10:58:55.309582+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=10, tm_min=58, tm_sec=55, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=1, tm_sec=30, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:01:36.312 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T10:58:55.309582+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=10, tm_min=58, tm_sec=55, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=1, tm_sec=30, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:01:36.312 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-06T10:58:55.309582+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=10, tm_min=58, tm_sec=55, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=1, tm_sec=30, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:01:36.312 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-06T10:58:55.309582+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=10, tm_min=58, tm_sec=55, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=1, tm_sec=30, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:01:36.313 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-06T10:58:55.309582+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=10, tm_min=58, tm_sec=55, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=1, tm_sec=30, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:01:36.313 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T11:01:41.037 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:01:41.040 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:01:56.313 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:01:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.453+0000 7f82838c0700 1 Processor -- start 2023-10-06T11:01:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.454+0000 7f82838c0700 1 -- start start 2023-10-06T11:01:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.454+0000 7f82838c0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f827c159360 0x7f827c0afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:56.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.455+0000 7f82838c0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f827c068100 0x7f827c162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:56.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.455+0000 7f82838c0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827c0aeba0 con 0x7f827c0ac7f0 2023-10-06T11:01:56.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.455+0000 7f82838c0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827c159730 con 0x7f827c068100 2023-10-06T11:01:56.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.455+0000 7f82838c0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c0ae270 con 0x7f827c159360 2023-10-06T11:01:56.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.455+0000 7f828165c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f827c159360 0x7f827c0afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:56.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.455+0000 7f8281e5d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f827c068100 0x7f827c162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:56.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.455+0000 7f8280e5b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f827c0ac7f0 0x7f827c0a6980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.7:45722/0 (socket says 172.21.15.7:45722) 2023-10-06T11:01:56.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.455+0000 7f8280e5b700 1 -- 172.21.15.7:0/3755352925 learned_addr learned my addr 172.21.15.7:0/3755352925 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:56.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.455+0000 7f828165c700 1 -- 172.21.15.7:0/3755352925 >> v2:172.21.15.50:3300/0 conn(0x7f827c068100 msgr2=0x7f827c162ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:56.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.455+0000 7f828165c700 1 --2- 172.21.15.7:0/3755352925 >> v2:172.21.15.50:3300/0 conn(0x7f827c068100 0x7f827c162ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.455+0000 7f828165c700 1 -- 172.21.15.7:0/3755352925 >> v1:172.21.15.50:6789/0 conn(0x7f827c0ac7f0 legacy=0x7f827c0a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:56.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.455+0000 7f828165c700 1 -- 172.21.15.7:0/3755352925 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0ae550 con 0x7f827c159360 2023-10-06T11:01:56.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.455+0000 7f8281e5d700 1 --2- 172.21.15.7:0/3755352925 >> v2:172.21.15.50:3300/0 conn(0x7f827c068100 0x7f827c162ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:01:56.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.456+0000 7f828165c700 1 --2- 172.21.15.7:0/3755352925 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f827c159360 0x7f827c0afb40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f82780098e0 tx=0x7f82780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a0e62bde4b127e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:56.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.456+0000 7f8273fff700 1 -- 172.21.15.7:0/3755352925 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827800b640 con 0x7f827c159360 2023-10-06T11:01:56.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.456+0000 7f8273fff700 1 -- 172.21.15.7:0/3755352925 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827800b7a0 con 0x7f827c159360 2023-10-06T11:01:56.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.456+0000 7f8273fff700 1 -- 172.21.15.7:0/3755352925 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827800bb40 con 0x7f827c159360 2023-10-06T11:01:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.456+0000 7f82838c0700 1 -- 172.21.15.7:0/3755352925 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f827c159360 msgr2=0x7f827c0afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.456+0000 7f82838c0700 1 --2- 172.21.15.7:0/3755352925 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f827c159360 0x7f827c0afb40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f82780098e0 tx=0x7f82780091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.456+0000 7f82838c0700 1 -- 172.21.15.7:0/3755352925 shutdown_connections 2023-10-06T11:01:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.456+0000 7f82838c0700 1 --2- 172.21.15.7:0/3755352925 >> v2:172.21.15.50:3300/0 conn(0x7f827c068100 0x7f827c162ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.456+0000 7f82838c0700 1 --2- 172.21.15.7:0/3755352925 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f827c159360 0x7f827c0afb40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.456+0000 7f82838c0700 1 -- 172.21.15.7:0/3755352925 >> 172.21.15.7:0/3755352925 conn(0x7f827c095a70 msgr2=0x7f827c0af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.456+0000 7f82838c0700 1 -- 172.21.15.7:0/3755352925 shutdown_connections 2023-10-06T11:01:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.457+0000 7f82838c0700 1 -- 172.21.15.7:0/3755352925 wait complete. 2023-10-06T11:01:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.458+0000 7f82838c0700 1 Processor -- start 2023-10-06T11:01:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.458+0000 7f82838c0700 1 -- start start 2023-10-06T11:01:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f82838c0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f827c068100 0x7f827c14c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f82838c0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f827c0ac7f0 0x7f827c14aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f82838c0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f827c159360 0x7f827c16cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f82838c0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c14d160 con 0x7f827c068100 2023-10-06T11:01:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f82838c0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c14d440 con 0x7f827c0ac7f0 2023-10-06T11:01:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f82838c0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c14d720 con 0x7f827c159360 2023-10-06T11:01:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f828165c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f827c068100 0x7f827c14c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f828165c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f827c068100 0x7f827c14c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47406/0 (socket says 172.21.15.7:47406) 2023-10-06T11:01:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f828165c700 1 -- 172.21.15.7:0/1634235694 learned_addr learned my addr 172.21.15.7:0/1634235694 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f8280e5b700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f827c0ac7f0 0x7f827c14aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f8281e5d700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f827c159360 0x7f827c16cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f828165c700 1 -- 172.21.15.7:0/1634235694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f827c159360 msgr2=0x7f827c16cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f828165c700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f827c159360 0x7f827c16cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f828165c700 1 -- 172.21.15.7:0/1634235694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f827c0ac7f0 msgr2=0x7f827c14aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f828165c700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f827c0ac7f0 0x7f827c14aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f828165c700 1 -- 172.21.15.7:0/1634235694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8274009a20 con 0x7f827c068100 2023-10-06T11:01:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f8280e5b700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f827c0ac7f0 0x7f827c14aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f828165c700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f827c068100 0x7f827c14c910 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f827c0ae3b0 tx=0x7f8278017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.459+0000 7f82717fa700 1 -- 172.21.15.7:0/1634235694 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827801bda0 con 0x7f827c068100 2023-10-06T11:01:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.460+0000 7f82717fa700 1 -- 172.21.15.7:0/1634235694 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8278011420 con 0x7f827c068100 2023-10-06T11:01:56.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.460+0000 7f82838c0700 1 -- 172.21.15.7:0/1634235694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8278009420 con 0x7f827c068100 2023-10-06T11:01:56.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.460+0000 7f82717fa700 1 -- 172.21.15.7:0/1634235694 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780117e0 con 0x7f827c068100 2023-10-06T11:01:56.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.460+0000 7f82838c0700 1 -- 172.21.15.7:0/1634235694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827c14dce0 con 0x7f827c068100 2023-10-06T11:01:56.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.460+0000 7f82838c0700 1 -- 172.21.15.7:0/1634235694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f827c070480 con 0x7f827c068100 2023-10-06T11:01:56.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.461+0000 7f82717fa700 1 -- 172.21.15.7:0/1634235694 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8278011b90 con 0x7f827c068100 2023-10-06T11:01:56.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.462+0000 7f82717fa700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8260066f30 0x7f82600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:56.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.462+0000 7f8280e5b700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8260066f30 0x7f82600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:56.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.462+0000 7f82717fa700 1 -- 172.21.15.7:0/1634235694 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f8278085b50 con 0x7f827c068100 2023-10-06T11:01:56.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.462+0000 7f8280e5b700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8260066f30 0x7f82600693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f827c0acc00 tx=0x7f826c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:56.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.466+0000 7f82717fa700 1 -- 172.21.15.7:0/1634235694 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8278052e20 con 0x7f827c068100 2023-10-06T11:01:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.666+0000 7f82838c0700 1 -- 172.21.15.7:0/1634235694 --> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f827c0ae830 con 0x7f8260066f30 2023-10-06T11:01:56.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.669+0000 7f82717fa700 1 -- 172.21.15.7:0/1634235694 <== mgr.4104 v2:172.21.15.7:6832/119417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73115 (secure 0 0 0) 0x7f827c0ae830 con 0x7f8260066f30 2023-10-06T11:01:56.672 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.672+0000 7f82838c0700 1 -- 172.21.15.7:0/1634235694 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8260066f30 msgr2=0x7f82600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.672+0000 7f82838c0700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8260066f30 0x7f82600693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f827c0acc00 tx=0x7f826c009040 comp rx=0 tx=0).stop 2023-10-06T11:01:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.672+0000 7f82838c0700 1 -- 172.21.15.7:0/1634235694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f827c068100 msgr2=0x7f827c14c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.672+0000 7f82838c0700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f827c068100 0x7f827c14c910 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f827c0ae3b0 tx=0x7f8278017000 comp rx=0 tx=0).stop 2023-10-06T11:01:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.672+0000 7f82838c0700 1 -- 172.21.15.7:0/1634235694 shutdown_connections 2023-10-06T11:01:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.672+0000 7f82838c0700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7f8260066f30 0x7f82600693e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.672+0000 7f82838c0700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f827c068100 0x7f827c14c910 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.672+0000 7f82838c0700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f827c159360 0x7f827c16cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.672+0000 7f82838c0700 1 --2- 172.21.15.7:0/1634235694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f827c0ac7f0 0x7f827c14aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.672+0000 7f82838c0700 1 -- 172.21.15.7:0/1634235694 >> 172.21.15.7:0/1634235694 conn(0x7f827c095a70 msgr2=0x7f827c0b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:56.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.672+0000 7f82838c0700 1 -- 172.21.15.7:0/1634235694 shutdown_connections 2023-10-06T11:01:56.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.672+0000 7f82838c0700 1 -- 172.21.15.7:0/1634235694 wait complete. 2023-10-06T11:01:56.675 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-06T11:01:56.687 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2023-10-06T11:01:56.010393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385144,"kb_used_data":6840,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589576,"statfs":{"total":773094113280,"available":770651725824,"internally_reserved":0,"allocated":7004160,"data_stored":3902976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002311"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":62,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T11:01:35.242881+0000","last_change":"2023-10-06T11:01:35.242835+0000","last_active":"2023-10-06T11:01:35.242881+0000","last_peered":"2023-10-06T11:01:35.242881+0000","last_clean":"2023-10-06T11:01:35.242881+0000","last_became_active":"2023-10-06T10:58:56.328054+0000","last_became_peered":"2023-10-06T10:58:56.328054+0000","last_unstale":"2023-10-06T11:01:35.242881+0000","last_undegraded":"2023-10-06T11:01:35.242881+0000","last_fullsized":"2023-10-06T11:01:35.242881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:35.242737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:35.242737+0000","last_clean_scrub_stamp":"2023-10-06T11:01:35.242737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:24:17.991096+0000","scrub_duration":0.001595303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":60,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T11:01:35.177480+0000","last_change":"2023-10-06T11:01:35.177458+0000","last_active":"2023-10-06T11:01:35.177480+0000","last_peered":"2023-10-06T11:01:35.177480+0000","last_clean":"2023-10-06T11:01:35.177480+0000","last_became_active":"2023-10-06T10:58:56.325852+0000","last_became_peered":"2023-10-06T10:58:56.325852+0000","last_unstale":"2023-10-06T11:01:35.177480+0000","last_undegraded":"2023-10-06T11:01:35.177480+0000","last_fullsized":"2023-10-06T11:01:35.177480+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:35.177358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:35.177358+0000","last_clean_scrub_stamp":"2023-10-06T11:01:35.177358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:40.240790+0000","scrub_duration":0.0020231849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":64,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T11:01:34.602555+0000","last_change":"2023-10-06T11:01:34.602519+0000","last_active":"2023-10-06T11:01:34.602555+0000","last_peered":"2023-10-06T11:01:34.602555+0000","last_clean":"2023-10-06T11:01:34.602555+0000","last_became_active":"2023-10-06T10:58:56.325095+0000","last_became_peered":"2023-10-06T10:58:56.325095+0000","last_unstale":"2023-10-06T11:01:34.602555+0000","last_undegraded":"2023-10-06T11:01:34.602555+0000","last_fullsized":"2023-10-06T11:01:34.602555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:34.602394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:34.602394+0000","last_clean_scrub_stamp":"2023-10-06T11:01:34.602394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:20:19.340601+0000","scrub_duration":0.0020844570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"60'119","reported_seq":209,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T11:01:39.563459+0000","last_change":"2023-10-06T11:01:39.563427+0000","last_active":"2023-10-06T11:01:39.563459+0000","last_peered":"2023-10-06T11:01:39.563459+0000","last_clean":"2023-10-06T11:01:39.563459+0000","last_became_active":"2023-10-06T10:58:57.327509+0000","last_became_peered":"2023-10-06T10:58:57.327509+0000","last_unstale":"2023-10-06T11:01:39.563459+0000","last_undegraded":"2023-10-06T11:01:39.563459+0000","last_fullsized":"2023-10-06T11:01:39.563459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'119","last_scrub_stamp":"2023-10-06T11:01:39.563330+0000","last_deep_scrub":"60'119","last_deep_scrub_stamp":"2023-10-06T11:01:39.563330+0000","last_clean_scrub_stamp":"2023-10-06T11:01:39.563330+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:21.730681+0000","scrub_duration":0.005167296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":58,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T11:01:36.511362+0000","last_change":"2023-10-06T11:01:36.511332+0000","last_active":"2023-10-06T11:01:36.511362+0000","last_peered":"2023-10-06T11:01:36.511362+0000","last_clean":"2023-10-06T11:01:36.511362+0000","last_became_active":"2023-10-06T10:58:56.331244+0000","last_became_peered":"2023-10-06T10:58:56.331244+0000","last_unstale":"2023-10-06T11:01:36.511362+0000","last_undegraded":"2023-10-06T11:01:36.511362+0000","last_fullsized":"2023-10-06T11:01:36.511362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:36.511220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:36.511220+0000","last_clean_scrub_stamp":"2023-10-06T11:01:36.511220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:45.943560+0000","scrub_duration":0.0017134139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":58,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T11:01:37.484210+0000","last_change":"2023-10-06T11:01:37.484182+0000","last_active":"2023-10-06T11:01:37.484210+0000","last_peered":"2023-10-06T11:01:37.484210+0000","last_clean":"2023-10-06T11:01:37.484210+0000","last_became_active":"2023-10-06T10:58:56.331830+0000","last_became_peered":"2023-10-06T10:58:56.331830+0000","last_unstale":"2023-10-06T11:01:37.484210+0000","last_undegraded":"2023-10-06T11:01:37.484210+0000","last_fullsized":"2023-10-06T11:01:37.484210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:37.484076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:37.484076+0000","last_clean_scrub_stamp":"2023-10-06T11:01:37.484076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:30:03.264066+0000","scrub_duration":0.002109274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":57,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T11:01:42.023008+0000","last_change":"2023-10-06T11:01:42.022976+0000","last_active":"2023-10-06T11:01:42.023008+0000","last_peered":"2023-10-06T11:01:42.023008+0000","last_clean":"2023-10-06T11:01:42.023008+0000","last_became_active":"2023-10-06T10:58:56.331345+0000","last_became_peered":"2023-10-06T10:58:56.331345+0000","last_unstale":"2023-10-06T11:01:42.023008+0000","last_undegraded":"2023-10-06T11:01:42.023008+0000","last_fullsized":"2023-10-06T11:01:42.023008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:42.022868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:42.022868+0000","last_clean_scrub_stamp":"2023-10-06T11:01:42.022868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:47.086300+0000","scrub_duration":0.002235927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":57,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T11:01:40.319515+0000","last_change":"2023-10-06T11:01:40.319485+0000","last_active":"2023-10-06T11:01:40.319515+0000","last_peered":"2023-10-06T11:01:40.319515+0000","last_clean":"2023-10-06T11:01:40.319515+0000","last_became_active":"2023-10-06T10:58:56.331344+0000","last_became_peered":"2023-10-06T10:58:56.331344+0000","last_unstale":"2023-10-06T11:01:40.319515+0000","last_undegraded":"2023-10-06T11:01:40.319515+0000","last_fullsized":"2023-10-06T11:01:40.319515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:40.319386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:40.319386+0000","last_clean_scrub_stamp":"2023-10-06T11:01:40.319386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:40.677453+0000","scrub_duration":0.0020205140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":57,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T11:01:38.334784+0000","last_change":"2023-10-06T11:01:38.334754+0000","last_active":"2023-10-06T11:01:38.334784+0000","last_peered":"2023-10-06T11:01:38.334784+0000","last_clean":"2023-10-06T11:01:38.334784+0000","last_became_active":"2023-10-06T10:58:56.325897+0000","last_became_peered":"2023-10-06T10:58:56.325897+0000","last_unstale":"2023-10-06T11:01:38.334784+0000","last_undegraded":"2023-10-06T11:01:38.334784+0000","last_fullsized":"2023-10-06T11:01:38.334784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:01:38.334647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:01:38.334647+0000","last_clean_scrub_stamp":"2023-10-06T11:01:38.334647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:24.033102+0000","scrub_duration":0.001797037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":931137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.46000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77800000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66900000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.437}]},{"osd":5,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.47199999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.50600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":339791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79200000000000004,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.621,"15min":0.61599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.76400000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.40999999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":1.036,"15min":1.036},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.72299999999999998,"5min":1.274,"15min":1.274},"last":0.504}]},{"osd":2,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.40500000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77700000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.625},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86799999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.249,"15min":0.249},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.36399999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84799999999999998,"5min":0.873,"15min":0.873},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82299999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.49099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83299999999999996,"5min":1.006,"15min":1.006},"last":0.747}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":931137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.379,"15min":0.38100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56000000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.434},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.34300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44,"15min":0.441},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.56200000000000006}]},{"osd":3,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64700000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.438,"15min":0.438},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93100000000000005,"5min":1.123,"15min":1.123},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69599999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.621}]},{"osd":6,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70599999999999996,"15min":0.70999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.58899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":339791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.40699999999999997,"15min":0.41499999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.66600000000000004,"5min":0.746,"15min":0.746},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44,"15min":0.438},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46000000000000002,"15min":0.45300000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.61899999999999999,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.746,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79200000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89500000000000002,"5min":1.002,"15min":1.002},"last":0.83499999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68400000000000005,"15min":0.68899999999999995},"min":{"1min":0.51400000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.85499999999999998,"5min":1.022,"15min":1.022},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0069999999999999,"5min":1.238,"15min":1.238},"last":0.81999999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0549999999999999,"5min":2.9540000000000002,"15min":2.9540000000000002},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71899999999999997,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83299999999999996,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.85499999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92400000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94799999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.88100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":340769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.379},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63800000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.63},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.432,"15min":0.435},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.64800000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46000000000000002,"15min":0.46100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40400000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.66600000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.374,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.036},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0780000000000001,"5min":1.107,"15min":1.107},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.98199999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.47399999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.498,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86599999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.52100000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.65500000000000003,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.2130000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.95099999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98299999999999998,"5min":1.232,"15min":1.232},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.57699999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":1.022}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":339791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52600000000000002,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.54700000000000004,"15min":0.57399999999999995},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57199999999999995,"5min":4.617,"15min":4.617},"last":0.317}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52700000000000002,"15min":0.54700000000000004},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70699999999999996,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.51800000000000002,"15min":0.53100000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.59799999999999998,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.36199999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.68899999999999995,"15min":0.72499999999999998},"min":{"1min":0.36499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.61299999999999999,"5min":6.4400000000000004,"15min":6.4400000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.72199999999999998,"15min":0.75800000000000001},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66900000000000004,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.74299999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.83699999999999997,"15min":0.86799999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92500000000000004,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90900000000000003,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56499999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.81499999999999995,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.016,"5min":4.4470000000000001,"15min":4.4470000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73499999999999999,"15min":0.748},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85899999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.60399999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.70599999999999996,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88400000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.87,"15min":0.89400000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95899999999999996,"5min":4.4130000000000003,"15min":4.4130000000000003},"last":0.47499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":340769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88200000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.748,"5min":5.476,"15min":5.476},"last":0.66800000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.44900000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88100000000000001,"5min":1.978,"15min":1.978},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.68600000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.496}]},{"osd":6,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:00:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.58499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.71799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":339791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.68000000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.42799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.624},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76700000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.70999999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78200000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78300000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77100000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.629,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63300000000000001,"15min":0.64000000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67000000000000004,"15min":0.68000000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.73899999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.74099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:01:56.689 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T11:01:56.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.819+0000 7efe751e6700 1 Processor -- start 2023-10-06T11:01:56.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.819+0000 7efe751e6700 1 -- start start 2023-10-06T11:01:56.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.820+0000 7efe751e6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efe700ae430 0x7efe700b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:56.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.820+0000 7efe751e6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe7006c940 0x7efe700c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:56.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.820+0000 7efe751e6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7015b050 con 0x7efe700b0540 2023-10-06T11:01:56.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.820+0000 7efe751e6700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe700af590 con 0x7efe7006c940 2023-10-06T11:01:56.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.820+0000 7efe751e6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7015bc60 con 0x7efe700ae430 2023-10-06T11:01:56.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.820+0000 7efe6f59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe7006c940 0x7efe700c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:56.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.820+0000 7efe6f59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe7006c940 0x7efe700c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47412/0 (socket says 172.21.15.7:47412) 2023-10-06T11:01:56.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.820+0000 7efe6f59e700 1 -- 172.21.15.7:0/2525887840 learned_addr learned my addr 172.21.15.7:0/2525887840 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:56.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.820+0000 7efe6ed9d700 1 --2- 172.21.15.7:0/2525887840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efe700ae430 0x7efe700b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:56.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.820+0000 7efe6f59e700 1 -- 172.21.15.7:0/2525887840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efe700ae430 msgr2=0x7efe700b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:01:56.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.820+0000 7efe6f59e700 1 --2- 172.21.15.7:0/2525887840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efe700ae430 0x7efe700b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.820+0000 7efe6f59e700 1 -- 172.21.15.7:0/2525887840 >> v1:172.21.15.50:6789/0 conn(0x7efe700b0540 legacy=0x7efe7006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:56.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.820+0000 7efe6f59e700 1 -- 172.21.15.7:0/2525887840 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7015b330 con 0x7efe7006c940 2023-10-06T11:01:56.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.820+0000 7efe6f59e700 1 --2- 172.21.15.7:0/2525887840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe7006c940 0x7efe700c9040 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7efe68009f20 tx=0x7efe68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bad5112f0ca32c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:56.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.821+0000 7efe6dd9b700 1 -- 172.21.15.7:0/2525887840 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6800e070 con 0x7efe7006c940 2023-10-06T11:01:56.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.821+0000 7efe6dd9b700 1 -- 172.21.15.7:0/2525887840 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6800b9d0 con 0x7efe7006c940 2023-10-06T11:01:56.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.821+0000 7efe6dd9b700 1 -- 172.21.15.7:0/2525887840 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe680092e0 con 0x7efe7006c940 2023-10-06T11:01:56.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.821+0000 7efe751e6700 1 -- 172.21.15.7:0/2525887840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe7006c940 msgr2=0x7efe700c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:56.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.821+0000 7efe751e6700 1 --2- 172.21.15.7:0/2525887840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe7006c940 0x7efe700c9040 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7efe68009f20 tx=0x7efe68009840 comp rx=0 tx=0).stop 2023-10-06T11:01:56.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.821+0000 7efe751e6700 1 -- 172.21.15.7:0/2525887840 shutdown_connections 2023-10-06T11:01:56.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.821+0000 7efe751e6700 1 --2- 172.21.15.7:0/2525887840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe7006c940 0x7efe700c9040 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.821+0000 7efe751e6700 1 --2- 172.21.15.7:0/2525887840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efe700ae430 0x7efe700b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.821+0000 7efe751e6700 1 -- 172.21.15.7:0/2525887840 >> 172.21.15.7:0/2525887840 conn(0x7efe700cded0 msgr2=0x7efe700ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:56.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.821+0000 7efe751e6700 1 -- 172.21.15.7:0/2525887840 shutdown_connections 2023-10-06T11:01:56.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.821+0000 7efe751e6700 1 -- 172.21.15.7:0/2525887840 wait complete. 2023-10-06T11:01:56.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.823+0000 7efe751e6700 1 Processor -- start 2023-10-06T11:01:56.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.823+0000 7efe751e6700 1 -- start start 2023-10-06T11:01:56.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.823+0000 7efe751e6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efe7006c940 0x7efe7015a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:56.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.823+0000 7efe751e6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe700ae430 0x7efe700c1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:56.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.823+0000 7efe751e6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700b0540 0x7efe700c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:56.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.823+0000 7efe751e6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe700c2ec0 con 0x7efe700ae430 2023-10-06T11:01:56.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.823+0000 7efe751e6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe700acb20 con 0x7efe700b0540 2023-10-06T11:01:56.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.823+0000 7efe751e6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe700c22b0 con 0x7efe7006c940 2023-10-06T11:01:56.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe6e59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe700ae430 0x7efe700c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:56.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe6e59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe700ae430 0x7efe700c1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47416/0 (socket says 172.21.15.7:47416) 2023-10-06T11:01:56.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe6e59c700 1 -- 172.21.15.7:0/1418425613 learned_addr learned my addr 172.21.15.7:0/1418425613 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:56.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe6f59e700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700b0540 0x7efe700c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:56.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe6ed9d700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efe7006c940 0x7efe7015a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:56.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe6e59c700 1 -- 172.21.15.7:0/1418425613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efe7006c940 msgr2=0x7efe7015a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:56.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe6e59c700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efe7006c940 0x7efe7015a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe6e59c700 1 -- 172.21.15.7:0/1418425613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700b0540 msgr2=0x7efe700c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:56.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe6e59c700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700b0540 0x7efe700c1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:56.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe6e59c700 1 -- 172.21.15.7:0/1418425613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68009ae0 con 0x7efe700ae430 2023-10-06T11:01:56.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe6f59e700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700b0540 0x7efe700c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:01:56.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe6e59c700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe700ae430 0x7efe700c1760 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efe6400c590 tx=0x7efe6400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:56.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe56ffd700 1 -- 172.21.15.7:0/1418425613 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64011590 con 0x7efe700ae430 2023-10-06T11:01:56.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe56ffd700 1 -- 172.21.15.7:0/1418425613 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe64011710 con 0x7efe700ae430 2023-10-06T11:01:56.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe751e6700 1 -- 172.21.15.7:0/1418425613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe700c2590 con 0x7efe700ae430 2023-10-06T11:01:56.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe56ffd700 1 -- 172.21.15.7:0/1418425613 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64011ad0 con 0x7efe700ae430 2023-10-06T11:01:56.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.824+0000 7efe751e6700 1 -- 172.21.15.7:0/1418425613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe700c2b50 con 0x7efe700ae430 2023-10-06T11:01:56.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.825+0000 7efe751e6700 1 -- 172.21.15.7:0/1418425613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe70070480 con 0x7efe700ae430 2023-10-06T11:01:56.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.826+0000 7efe56ffd700 1 -- 172.21.15.7:0/1418425613 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe6401b3b0 con 0x7efe700ae430 2023-10-06T11:01:56.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.826+0000 7efe56ffd700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efe5c066f30 0x7efe5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:56.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.826+0000 7efe56ffd700 1 -- 172.21.15.7:0/1418425613 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7efe64083a00 con 0x7efe700ae430 2023-10-06T11:01:56.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.826+0000 7efe6ed9d700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efe5c066f30 0x7efe5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:56.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.827+0000 7efe6ed9d700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efe5c066f30 0x7efe5c0693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efe60009db0 tx=0x7efe600091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:56.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:56.831+0000 7efe56ffd700 1 -- 172.21.15.7:0/1418425613 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe64050cd0 con 0x7efe700ae430 2023-10-06T11:01:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.032+0000 7efe751e6700 1 -- 172.21.15.7:0/1418425613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7efe700c85e0 con 0x7efe700ae430 2023-10-06T11:01:57.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.036+0000 7efe56ffd700 1 -- 172.21.15.7:0/1418425613 <== mon.0 v2:172.21.15.7:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efe640011f0 con 0x7efe700ae430 2023-10-06T11:01:57.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.036+0000 7efe56ffd700 1 -- 172.21.15.7:0/1418425613 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7efe64017070 con 0x7efe700ae430 2023-10-06T11:01:57.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.039+0000 7efe751e6700 1 -- 172.21.15.7:0/1418425613 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efe5c066f30 msgr2=0x7efe5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:57.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.039+0000 7efe751e6700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efe5c066f30 0x7efe5c0693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efe60009db0 tx=0x7efe600091a0 comp rx=0 tx=0).stop 2023-10-06T11:01:57.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.039+0000 7efe751e6700 1 -- 172.21.15.7:0/1418425613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe700ae430 msgr2=0x7efe700c1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:57.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.039+0000 7efe751e6700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe700ae430 0x7efe700c1760 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efe6400c590 tx=0x7efe6400c8a0 comp rx=0 tx=0).stop 2023-10-06T11:01:57.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.039+0000 7efe751e6700 1 -- 172.21.15.7:0/1418425613 shutdown_connections 2023-10-06T11:01:57.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.039+0000 7efe751e6700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7efe5c066f30 0x7efe5c0693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:57.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.039+0000 7efe751e6700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700b0540 0x7efe700c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:57.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.039+0000 7efe751e6700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efe7006c940 0x7efe7015a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:57.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.039+0000 7efe751e6700 1 --2- 172.21.15.7:0/1418425613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe700ae430 0x7efe700c1760 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:57.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.039+0000 7efe751e6700 1 -- 172.21.15.7:0/1418425613 >> 172.21.15.7:0/1418425613 conn(0x7efe700cded0 msgr2=0x7efe700c8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:57.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.039+0000 7efe751e6700 1 -- 172.21.15.7:0/1418425613 shutdown_connections 2023-10-06T11:01:57.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.039+0000 7efe751e6700 1 -- 172.21.15.7:0/1418425613 wait complete. 2023-10-06T11:01:57.055 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:01:57.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:01:57.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.186+0000 7fdfcb5a8700 1 Processor -- start 2023-10-06T11:01:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.186+0000 7fdfcb5a8700 1 -- start start 2023-10-06T11:01:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.187+0000 7fdfcb5a8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdfc415d2b0 0x7fdfc41641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.187+0000 7fdfcb5a8700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc40694d0 con 0x7fdfc41590d0 2023-10-06T11:01:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.187+0000 7fdfcb5a8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc415abc0 con 0x7fdfc415ce10 2023-10-06T11:01:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.187+0000 7fdfcb5a8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc4068990 con 0x7fdfc415d2b0 2023-10-06T11:01:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.187+0000 7fdfc9344700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdfc41590d0 0x7fdfc4069bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37166/0 (socket says 172.21.15.7:37166) 2023-10-06T11:01:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.187+0000 7fdfc9344700 1 -- 172.21.15.7:0/3522167490 learned_addr learned my addr 172.21.15.7:0/3522167490 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-06T11:01:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.187+0000 7fdfc9b45700 1 --2- 172.21.15.7:0/3522167490 >> v2:172.21.15.50:3300/0 conn(0x7fdfc415d2b0 0x7fdfc41641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.187+0000 7fdfbbfff700 1 -- 172.21.15.7:0/3522167490 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21139716 0 0) 0x7fdfc40694d0 con 0x7fdfc41590d0 2023-10-06T11:01:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.187+0000 7fdfbbfff700 1 -- 172.21.15.7:0/3522167490 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb0003570 con 0x7fdfc41590d0 2023-10-06T11:01:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.187+0000 7fdfbbfff700 1 -- 172.21.15.7:0/3522167490 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472868441 0 0) 0x7fdfc415abc0 con 0x7fdfc415ce10 2023-10-06T11:01:57.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.187+0000 7fdfbbfff700 1 -- 172.21.15.7:0/3522167490 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc40694d0 con 0x7fdfc415ce10 2023-10-06T11:01:57.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.188+0000 7fdfbbfff700 1 -- 172.21.15.7:0/3522167490 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 462952559 0 0) 0x7fdfb0003570 con 0x7fdfc41590d0 2023-10-06T11:01:57.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.188+0000 7fdfc9b45700 1 -- 172.21.15.7:0/3522167490 >> v1:172.21.15.50:6789/0 conn(0x7fdfc415ce10 legacy=0x7fdfc41594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:57.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.188+0000 7fdfc9b45700 1 -- 172.21.15.7:0/3522167490 >> v1:172.21.15.7:6789/0 conn(0x7fdfc41590d0 legacy=0x7fdfc4069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:57.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.188+0000 7fdfc9b45700 1 -- 172.21.15.7:0/3522167490 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc4068ba0 con 0x7fdfc415d2b0 2023-10-06T11:01:57.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.188+0000 7fdfc9b45700 1 --2- 172.21.15.7:0/3522167490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc415d2b0 0x7fdfc41641b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009e60 tx=0x7fdfbc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=700479d6aba5b6a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:57.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.188+0000 7fdfbbfff700 1 -- 172.21.15.7:0/3522167490 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc00e070 con 0x7fdfc415d2b0 2023-10-06T11:01:57.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.188+0000 7fdfbbfff700 1 -- 172.21.15.7:0/3522167490 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdfbc00b7a0 con 0x7fdfc415d2b0 2023-10-06T11:01:57.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.188+0000 7fdfbbfff700 1 -- 172.21.15.7:0/3522167490 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0001470 con 0x7fdfc415d2b0 2023-10-06T11:01:57.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.189+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/3522167490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc415d2b0 msgr2=0x7fdfc41641b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:57.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.189+0000 7fdfcb5a8700 1 --2- 172.21.15.7:0/3522167490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc415d2b0 0x7fdfc41641b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009e60 tx=0x7fdfbc009780 comp rx=0 tx=0).stop 2023-10-06T11:01:57.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.189+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/3522167490 shutdown_connections 2023-10-06T11:01:57.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.189+0000 7fdfcb5a8700 1 --2- 172.21.15.7:0/3522167490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc415d2b0 0x7fdfc41641b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.189+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/3522167490 >> 172.21.15.7:0/3522167490 conn(0x7fdfc4096160 msgr2=0x7fdfc40afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.189+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/3522167490 shutdown_connections 2023-10-06T11:01:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.189+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/3522167490 wait complete. 2023-10-06T11:01:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.190+0000 7fdfcb5a8700 1 Processor -- start 2023-10-06T11:01:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.190+0000 7fdfcb5a8700 1 -- start start 2023-10-06T11:01:57.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.191+0000 7fdfcb5a8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfc41590d0 0x7fdfc414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:57.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.191+0000 7fdfcb5a8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfc415ce10 0x7fdfc414c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:57.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.191+0000 7fdfcb5a8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc415d2b0 0x7fdfc4158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:57.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.191+0000 7fdfcb5a8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc414e2c0 con 0x7fdfc415ce10 2023-10-06T11:01:57.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.191+0000 7fdfcb5a8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc414f9d0 con 0x7fdfc415d2b0 2023-10-06T11:01:57.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.191+0000 7fdfcb5a8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc414c5d0 con 0x7fdfc41590d0 2023-10-06T11:01:57.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.191+0000 7fdfc8b43700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfc415ce10 0x7fdfc414c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:57.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.191+0000 7fdfc8b43700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfc415ce10 0x7fdfc414c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47426/0 (socket says 172.21.15.7:47426) 2023-10-06T11:01:57.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.191+0000 7fdfc8b43700 1 -- 172.21.15.7:0/1181692075 learned_addr learned my addr 172.21.15.7:0/1181692075 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-06T11:01:57.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.191+0000 7fdfc9b45700 1 --2- 172.21.15.7:0/1181692075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc415d2b0 0x7fdfc4158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:57.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.191+0000 7fdfc9344700 1 --2- 172.21.15.7:0/1181692075 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfc41590d0 0x7fdfc414dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:57.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.192+0000 7fdfc8b43700 1 -- 172.21.15.7:0/1181692075 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfc41590d0 msgr2=0x7fdfc414dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:57.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.192+0000 7fdfc8b43700 1 --2- 172.21.15.7:0/1181692075 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfc41590d0 0x7fdfc414dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:57.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.192+0000 7fdfc8b43700 1 -- 172.21.15.7:0/1181692075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc415d2b0 msgr2=0x7fdfc4158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:57.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.192+0000 7fdfc8b43700 1 --2- 172.21.15.7:0/1181692075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc415d2b0 0x7fdfc4158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:57.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.192+0000 7fdfc8b43700 1 -- 172.21.15.7:0/1181692075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc009a20 con 0x7fdfc415ce10 2023-10-06T11:01:57.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.192+0000 7fdfc8b43700 1 --2- 172.21.15.7:0/1181692075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfc415ce10 0x7fdfc414c090 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400c7c0 tx=0x7fdfb4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.192+0000 7fdfb97fa700 1 -- 172.21.15.7:0/1181692075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4010510 con 0x7fdfc415ce10 2023-10-06T11:01:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.192+0000 7fdfb97fa700 1 -- 172.21.15.7:0/1181692075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdfb4010670 con 0x7fdfc415ce10 2023-10-06T11:01:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.192+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/1181692075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc41587c0 con 0x7fdfc415ce10 2023-10-06T11:01:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.192+0000 7fdfb97fa700 1 -- 172.21.15.7:0/1181692075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4010a30 con 0x7fdfc415ce10 2023-10-06T11:01:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.192+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/1181692075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc414f0a0 con 0x7fdfc415ce10 2023-10-06T11:01:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.193+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/1181692075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc4070480 con 0x7fdfc415ce10 2023-10-06T11:01:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.193+0000 7fdfb97fa700 1 -- 172.21.15.7:0/1181692075 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfb401b3b0 con 0x7fdfc415ce10 2023-10-06T11:01:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.194+0000 7fdfb97fa700 1 --2- 172.21.15.7:0/1181692075 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdfa8066f30 0x7fdfa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:01:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.194+0000 7fdfb97fa700 1 -- 172.21.15.7:0/1181692075 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fdfb4083cb0 con 0x7fdfc415ce10 2023-10-06T11:01:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.194+0000 7fdfc9344700 1 --2- 172.21.15.7:0/1181692075 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdfa8066f30 0x7fdfa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:01:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.195+0000 7fdfc9344700 1 --2- 172.21.15.7:0/1181692075 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdfa8066f30 0x7fdfa80693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdfc415cd60 tx=0x7fdfc0000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:01:57.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.199+0000 7fdfb97fa700 1 -- 172.21.15.7:0/1181692075 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfb4051000 con 0x7fdfc415ce10 2023-10-06T11:01:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.448+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/1181692075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfc414fb10 con 0x7fdfc415ce10 2023-10-06T11:01:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.448+0000 7fdfb97fa700 1 -- 172.21.15.7:0/1181692075 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3520 (secure 0 0 0) 0x7fdfb4017020 con 0x7fdfc415ce10 2023-10-06T11:01:57.451 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-06T11:01:57.451 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3539274987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3539274987},{"type":"v1","addr":"172.21.15.7:6836","nonce":3539274987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1716655212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1716655212},{"type":"v1","addr":"172.21.15.50:6834","nonce":1716655212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/186446686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":186446686},{"type":"v1","addr":"172.21.15.50:6835","nonce":186446686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5829,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3750820082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3750820082},{"type":"v1","addr":"172.21.15.7:6837","nonce":3750820082}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[]} 2023-10-06T11:01:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.451+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/1181692075 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdfa8066f30 msgr2=0x7fdfa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.451+0000 7fdfcb5a8700 1 --2- 172.21.15.7:0/1181692075 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdfa8066f30 0x7fdfa80693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdfc415cd60 tx=0x7fdfc0000bc0 comp rx=0 tx=0).stop 2023-10-06T11:01:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.451+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/1181692075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfc415ce10 msgr2=0x7fdfc414c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:01:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.451+0000 7fdfcb5a8700 1 --2- 172.21.15.7:0/1181692075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfc415ce10 0x7fdfc414c090 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400c7c0 tx=0x7fdfb4007e10 comp rx=0 tx=0).stop 2023-10-06T11:01:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.451+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/1181692075 shutdown_connections 2023-10-06T11:01:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.451+0000 7fdfcb5a8700 1 --2- 172.21.15.7:0/1181692075 >> [v2:172.21.15.7:6832/119417,v1:172.21.15.7:6833/119417] conn(0x7fdfa8066f30 0x7fdfa80693e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.451+0000 7fdfcb5a8700 1 --2- 172.21.15.7:0/1181692075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc415d2b0 0x7fdfc4158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.451+0000 7fdfcb5a8700 1 --2- 172.21.15.7:0/1181692075 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfc41590d0 0x7fdfc414dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.451+0000 7fdfcb5a8700 1 --2- 172.21.15.7:0/1181692075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfc415ce10 0x7fdfc414c090 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:01:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.451+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/1181692075 >> 172.21.15.7:0/1181692075 conn(0x7fdfc4096160 msgr2=0x7fdfc40ab7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:01:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.451+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/1181692075 shutdown_connections 2023-10-06T11:01:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-06T11:01:57.451+0000 7fdfcb5a8700 1 -- 172.21.15.7:0/1181692075 wait complete. 2023-10-06T11:01:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2023-10-06T11:01:57.466 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T11:01:57.466 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T11:01:57.466 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:01:57.467 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:57.476 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:01:57.476 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:01:57.476 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:57.527 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:01:57.527 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:01:57.527 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:57.538 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:01:57.538 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:01:57.539 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:57.590 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:01:57.590 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T11:01:57.590 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T11:01:57.591 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:57.619 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T11:01:57.619 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T11:01:57.619 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:57.687 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T11:01:57.688 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T11:01:57.688 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:57.757 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T11:01:57.757 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T11:01:57.757 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:57.830 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T11:01:57.830 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T11:01:57.830 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:57.866 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T11:01:57.866 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T11:01:57.866 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:57.938 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T11:01:57.938 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T11:01:57.938 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:58.007 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T11:01:58.007 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T11:01:58.008 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:58.080 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T11:01:58.080 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T11:01:58.080 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T11:01:58.080 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:58.108 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T11:01:58.108 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T11:01:58.108 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:58.145 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T11:01:58.145 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T11:01:58.146 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T11:01:58.146 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:58.162 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T11:01:58.162 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T11:01:58.162 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:58.198 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T11:01:58.199 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T11:01:58.199 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:01:58.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-06T11:01:58.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-06T11:01:58.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-06T11:01:58.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-06T11:01:58.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-06T11:01:58.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-06T11:01:58.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-06T11:01:58.252 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T11:01:58.253 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T11:01:58.253 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T11:01:58.294 INFO:teuthology.orchestra.run.smithi007.stdout:1696589936.3145812 mon.a (mon.0) 170 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T11:01:58.294 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T11:01:58.294 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T11:01:58.374 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T11:01:58.455 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T11:01:58.535 INFO:teuthology.orchestra.run.smithi007.stdout:1696589936.3145812 mon.a (mon.0) 170 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T11:01:58.536 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T11:01:58.536 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T11:01:58.793 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T11:01:58.793 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T11:01:58.877 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T11:01:58.878 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T11:01:58.948 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T11:01:58.948 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T11:01:59.041 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T11:01:59.041 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T11:01:59.299 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T11:01:59.299 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T11:01:59.395 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T11:01:59.395 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T11:01:59.505 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T11:01:59.506 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T11:01:59.579 INFO:tasks.ceph:Archiving mon data... 2023-10-06T11:01:59.581 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371/data/mon.a.tgz 2023-10-06T11:01:59.581 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2023-10-06T11:01:59.605 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.9FioUjEX7P 2023-10-06T11:01:59.605 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.9FioUjEX7P 2023-10-06T11:01:59.764 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.9FioUjEX7P 2023-10-06T11:01:59.862 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.9FioUjEX7P is 342KB 2023-10-06T11:01:59.937 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.9FioUjEX7P 2023-10-06T11:01:59.960 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371/data/mon.b.tgz 2023-10-06T11:01:59.960 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-10-06T11:01:59.984 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.ehMZSgyT94 2023-10-06T11:01:59.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ehMZSgyT94 2023-10-06T11:02:00.184 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.ehMZSgyT94 2023-10-06T11:02:00.279 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.ehMZSgyT94 is 448KB 2023-10-06T11:02:00.355 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.ehMZSgyT94 2023-10-06T11:02:00.377 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371/data/mon.c.tgz 2023-10-06T11:02:00.378 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-10-06T11:02:00.441 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.kZI2iTzXyA 2023-10-06T11:02:00.441 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.kZI2iTzXyA 2023-10-06T11:02:00.608 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.kZI2iTzXyA 2023-10-06T11:02:00.703 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.kZI2iTzXyA is 448KB 2023-10-06T11:02:00.800 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.kZI2iTzXyA 2023-10-06T11:02:00.823 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T11:02:00.824 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T11:02:00.826 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T11:02:00.897 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T11:02:00.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T11:02:00.902 DEBUG:teuthology.orchestra.run.smithi050:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T11:02:00.936 INFO:teuthology.orchestra.run.smithi007.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T11:02:00.974 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T11:02:00.982 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T11:02:00.983 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371/remote/smithi007/crash 2023-10-06T11:02:00.984 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T11:02:01.019 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371/remote/smithi050/crash 2023-10-06T11:02:01.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T11:02:01.056 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T11:02:01.057 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:02:01.064 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:02:01.169 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T11:02:01.204 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T11:02:01.242 INFO:tasks.ceph:Compressing logs... 2023-10-06T11:02:01.242 DEBUG:teuthology.orchestra.run.smithi007:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T11:02:01.247 DEBUG:teuthology.orchestra.run.smithi050:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T11:02:03.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-10-06T11:02:03.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-06T11:02:03.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-06T11:02:03.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-06T11:02:03.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-06T11:02:03.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-06T11:02:03.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-10-06T11:02:05.316 INFO:tasks.ceph:Archiving logs... 2023-10-06T11:02:05.317 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371/remote/smithi007/log 2023-10-06T11:02:05.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T11:02:05.996 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371/remote/smithi050/log 2023-10-06T11:02:05.997 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T11:02:06.410 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T11:02:06.419 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T11:02:06.420 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T11:02:06.422 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T11:02:06.506 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T11:02:06.515 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T11:02:06.515 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T11:02:06.518 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T11:02:06.538 INFO:teuthology.orchestra.run.smithi007.stderr:bash: ntpq: command not found 2023-10-06T11:02:06.540 INFO:teuthology.orchestra.run.smithi050.stderr:bash: ntpq: command not found 2023-10-06T11:02:06.543 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T11:02:06.543 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2023-10-06T11:02:06.543 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 33 -460us[ -460us] +/- 71ms 2023-10-06T11:02:06.543 INFO:teuthology.orchestra.run.smithi007.stdout:^* hv02.front.sepia.ceph.com 3 6 377 33 -265us[ -285us] +/- 63ms 2023-10-06T11:02:06.543 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +886us[ +865us] +/- 82ms 2023-10-06T11:02:06.543 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:02:06.546 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T11:02:06.546 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-10-06T11:02:06.546 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 34 -456us[ -450us] +/- 71ms 2023-10-06T11:02:06.546 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv02.front.sepia.ceph.com 3 6 377 34 -283us[ -277us] +/- 63ms 2023-10-06T11:02:06.546 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +886us[ +892us] +/- 82ms 2023-10-06T11:02:06.546 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:02:06.547 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T11:02:06.555 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T11:02:06.555 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T11:02:06.655 DEBUG:teuthology.orchestra.run.smithi007:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T11:02:06.773 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T11:02:06.883 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T11:02:06.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:02:06.922 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T11:02:06.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:02:06.960 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T11:02:06.988 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T11:02:07.058 INFO:teuthology.task.internal:Duration was 925.012127 seconds 2023-10-06T11:02:07.058 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T11:02:07.168 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T11:02:07.169 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T11:02:07.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T11:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T11:02:07.231 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T11:02:07.534 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T11:02:07.534 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2023-10-06T11:02:07.534 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T11:02:07.563 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T11:02:07.563 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T11:02:07.593 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T11:02:07.593 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T11:02:07.607 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T11:02:07.682 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T11:02:07.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T11:02:07.684 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T11:02:07.776 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T11:02:07.787 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T11:02:07.788 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T11:02:07.820 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T11:02:07.852 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T11:02:07.887 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T11:02:07.890 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T11:02:07.922 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2023-10-06T11:02:07.927 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2023-10-06T11:02:07.943 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T11:02:08.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:02:08.002 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T11:02:08.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:02:08.025 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T11:02:08.035 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T11:02:08.036 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371/remote/smithi007 2023-10-06T11:02:08.036 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T11:02:08.090 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371/remote/smithi050 2023-10-06T11:02:08.091 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T11:02:08.136 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T11:02:08.137 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T11:02:08.140 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T11:02:08.193 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T11:02:08.203 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T11:02:08.203 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T11:02:08.344 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T11:02:08.344 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T11:02:08.347 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T11:02:08.368 INFO:teuthology.orchestra.run.smithi007.stdout: 393225 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 11:02 /home/ubuntu/cephtest 2023-10-06T11:02:08.370 INFO:teuthology.orchestra.run.smithi050.stdout: 393225 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 11:02 /home/ubuntu/cephtest 2023-10-06T11:02:08.371 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T11:02:08.425 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T11:02:08.544 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T11:02:08.572 DEBUG:teuthology.nuke:shortname: smithi007 2023-10-06T11:02:08.573 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T11:02:08.592 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 10:38:15.585821', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPmUNiI/du+DjhAlXQqDXZHtSBNrzErqwHdIF4I4HEoabQNYe2dN39WN6tRc+KGGK3RQYjnZAflyfpBIDOwwxvQ='} 2023-10-06T11:02:08.599 DEBUG:teuthology.nuke:shortname: smithi050 2023-10-06T11:02:08.599 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T11:02:08.616 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412371', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 10:38:15.587177', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOausg9QGYOUb+3nlDjpaqaYFRu/skUFfldx5MhhbcPoS5Loddu2QNq0FlmG+37CgvpmltbfDLC8l+xDYcsFi+E='} 2023-10-06T11:02:08.643 INFO:teuthology.orchestra.console.smithi007:Power off 2023-10-06T11:02:08.643 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:02:08.665 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2023-10-06T11:02:08.665 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:02:08.679 INFO:teuthology.orchestra.console.smithi050:Power off 2023-10-06T11:02:08.680 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:02:08.688 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2023-10-06T11:02:08.702 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-10-06T11:02:08.702 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:02:08.725 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-10-06T11:02:12.689 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:02:12.727 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:02:12.799 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2023-10-06T11:02:12.836 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-10-06T11:02:16.802 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:02:16.837 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:02:16.912 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-10-06T11:02:16.946 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-10-06T11:02:17.013 INFO:teuthology.orchestra.console.smithi007:Power off completed 2023-10-06T11:02:17.047 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-10-06T11:02:17.151 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} duration: 925.0121273994446 failure_reason: '"1696589936.3145812 mon.a (mon.0) 170 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T11:02:17.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:02:17.235 INFO:teuthology.run:FAIL